Apache DataFusion Ray

Apache Spark Kubernetes Operator

Apache Iceberg

Apache DataFusion Python Bindings

Apache DataFusion SQL Query Engine

A resource to help you pass system design interview and become good at work 👇

Apache DataFusion Comet Spark Accelerator

Official Dockerfile for Apache Spark

Dataframes powered by a multithreaded, vectorized query engine, written in Rust

Uniffle is a high performance, general purpose Remote Shuffle Service.

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

A cross platform way to express data transformation, relational algebra, standardized record expression and plans.

Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

REST API for Apache Spark on K8S or YARN