Apache Spark - A unified analytics engine for large-scale data processing

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

REST job server for Apache Spark

Distributed Prometheus time series database

Development in Shark has been ended.

[DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark

Simplifying robust end-to-end machine learning on Apache Spark.

Apache Spark training material

Just a bunch of useful links

Former GraphX development repository. GraphX has been merged into Apache Spark; please submit pull requests there.

An open-source toolkit for large-scale genomic analysis

Apache Spark Connector for Azure Cosmos DB

Training materials for Strata, AMP Camp, etc

Spark GPU and SIMD Support

The rooster crows immediately before sunrise, the rooster causes the sun to rise

Hive helper functions for apache spark users

Mirror of Apache Kafka

Mirror of Apache Spark

Spark Connect client library in Rust