kafka

Kafka libraries, tools and example applications built on top of the sarama package.

Libraries

• consumergroup: Distributed Kafka consumer, backed by Zookeeper, supporting load balancing and offset persistence, as defined by the Kafka documentation. API documentation can be found on godoc.org

Tools

The following tools can be useful for discovery, testing, and benchmarking. They also serve as examples of how to use Sarama.

• tools/stressproducer: A tool to stress test the producer to measure throughput and latency.
• tools/consoleconsumer: A tool to consume a kafka topic and write messages to STDOUT.

Examples

• examples/consumergroup: An example consumer application that uses the consumergroup library mentioned above.