Stream Reactor

Streaming reference architecture built around Kafka.

A collection of components to build a real time ingestion pipeline.

Requires gradle 3.0 to build.

To build

gradle compile

To test

gradle test

To create a fat jar

gradle shadowJar

You can also use the gradle wrapper

./gradlew shadowJar

Kafka-Connect-Blockchain

Kafka connect Blockchain source to subscribe to Blockchain streams and write to Kafka.

Kafka-Connect-Bloomberg

Kafka connect Bloomberg source to subscribe to Bloomberg streams via the open API and write to Kafka.

Kafka-Connect-Cassandra-Source

Kafka connect Cassandra source to read Cassandra and write to Kafka.

Kafka-Connect-Cassandra-Sink

Kafka connect Cassandra sink task to write Kafka topic payloads to Cassandra.

Kafka-Connect-Druid

Kafka connect Druid sink to write Kafka topic payloads to Druid.

WORK IN PROGRESS

Kafka-Connect-Elastic

Kafka connect Elastic Search sink to write Kafka topic payloads to Elastic Search.

Kafka-Connect-HBase

Kafka connect HBase sink to write Kafka topic payloads to HBase.

Kafka-Connect-Hazelcast

Kafka connect HBase sink to write Kafka topic payloads to Hazelcast.

Kafka-Connect-Kudu

Kafka connect Kudu sink to write Kafka topic payloads to Kudu.

Kafka-Connect-InfluxDb

Kafka connect InfluxDb sink to write Kafka topic payloads to InfluxDb.

Kafka-Connect-JMS

Kafka connect JMS sink to write Kafka topic payloads to JMS.

Kafka-Connect-Redis

Kafka connect Redis sink to write Kafka topic payloads to Redis.

Kafka-Connect-Rethink

Kafka connect RethinkDb sink to write Kafka topic payloads to RethinkDb.

Kafka-Connect-Yahoo

Kafka connect Yahoo Finance source to write to Kafka

Kafka-Connect-Voltdb

Kafka connect Voltdb sink to write Kafka topic payloads to Voltdb.

Kafka-Socket-Streamer

Akka Http and Reactive Kafka with Websocket and Server Send Event support. Supports limited SQL statements to stream and select from Kafka topics in real time.