Demo for querying Confluent Platform with Prometheus

This demo show how to use Prometheus for querying metrics from Confluent Cloud. Please have a look at this article for details: https://www.confluent.io/blog/bring-your-own-monitoring-with-confluent-cloud/

Preconditions

In your Confluent Cloud organization, create an API key, assign it to a service account and grant MetricsViewer" permissions. Customize the Prometheus configuration file template `docker/prometheus/prometheus.yml-template and copy it to docker/prometheus/prometheus.yml.

Running Prometheus

Start the containers by running (if you want to use filebeat for fetching logs):

docker compose up -d

Stopping the containers with removal of all created volumes (be careful!):

docker compose down -v

Cleaning up (CAREFUL: THIS WILL DELETE ALL UNUSED VOLUMES):

docker volumes prune

Usage

Access prometheus with your web browser here:

• URL: http://localhost:9090

Access grafana with your web browser here (username: grafana, password: grafana):

• URL: http://localhost:3000