Geospatial clustering at massive scale

Memray is a memory profiler for Python

A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

An Airflow operator for triggering PagerDuty incidents.

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

Cache File System optimized for columnar formats and object stores

The Python client library for Google's Ads APIs

Apache Druid: a high performance real-time analytics database.

Generate Google Slides from markdown

A proof of concept using Divolte, Kafka, Druid and Superset

Snowflake Data Source for Apache Spark.

The event streaming database purpose-built for stream processing applications

HiBench is a big data benchmark suite.

Druid Docker

docker compose files to create a fully working kafka stack

Confluent's Apache Kafka Python client

Cheat Sheets

Kafka Tutorials microsite

Kafka cluster as Kubernetes StatefulSet, plain manifests and config

A Java HTTP client for consuming Twitter's realtime Streaming API

A collection of design patterns/idioms in Python

Kafka (and Zookeeper) in Docker

Official source for Docker configurations, images, and examples of Dockerfiles for Oracle products and projects

A curated list of resources for learning about Google Cloud Platform certifications and how to prepare for it.

Prevents you from committing secrets and credentials into git repositories

AWS SDK for Python

Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment

The open source version of the AWS Glue docs. You can submit feedback & requests for changes by submitting issues in this repo or by making proposed changes & submitting a pull request.

Modern HTTP benchmarking tool

Redshift data source for Apache Spark