Kafka

Bring in/send out data effectively.

Kafka is an amazing tool for message management and even more powerful when paired with the other tools in your CDH cluster.

Heimdali allows you to not only manage the existence of topics to simplify the interfacing of your data, it also allows you to manage who has access to said topics.

Heimdali also manages information about your applications. Each application is associated with a consumer group with it's own permissions.