Skip to content

Files

Latest commit

ff0f166 · Jan 26, 2021

History

History
This branch is 227 commits behind confluentinc/demo-scene:master.

telegram-bot-carparks

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Jan 26, 2021
Oct 14, 2020
Oct 23, 2020
Oct 23, 2020
Oct 14, 2020
Oct 14, 2020
Jan 26, 2021
Oct 13, 2020
Nov 3, 2020
Nov 3, 2020
Oct 22, 2020

🤖Building a Telegram bot with Apache Kafka and ksqlDB

Imagine you’ve got a stream of data; it’s not “big data,” but it’s certainly a lot. Within the data, you’ve got some bits you’re interested in, and of those bits, you’d like to be able to query information about them at any point. Sounds fun, right? Since I mentioned “querying,” I’d hazard a guess that you’ve got in mind an additional datastore of some sort, whether relational or NoSQL. But what if I told you…​that you didn’t need any datastore other than Kafka itself? What if you could ingest, filter, enrich, aggregate, and query data with just Kafka? With ksqlDB we can do just this, and I want to show you exactly how. In this hands-on talk we’ll walk through an example of building a Telegram bot in which ksqlDB provides the key/value lookups driven by a materialised view on the stream of events in Kafka. We’ll take a look at what ksqlDB is and its capabilities for processing data and driving applications, as well as integrating with other systems.

🎥 Recording

maxresdefault

👾 Code

carpark kibana02

Clone the repository:

git clone https://github.com/confluentinc/demo-scene.git

Make sure you’ve got Docker and Docker Compose, with enough memory allocated to Docker (8GB is good). Spin up the containers:

cd telegram-bot-carparks
docker-compose up -d

Now follow the walkthrough either:

  • short (as shown in the video above)

  • full (adds in historical data and merges two streams)