Source code for Twitter's Recommendation Algorithm

Apache Spark - A unified analytics engine for large-scale data processing

Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3

A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

ZIO — A type-safe, composable library for async and concurrent programming in Scala

REST job server for Apache Spark

JSON library

Livy is an open source REST interface for interacting with Apache Spark from anywhere

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

TiSpark is built for running Apache Spark on top of TiDB/TiKV

Lightweight real-time big data streaming engine over Akka

Mirror of Apache Toree (Incubating)

Data Lineage Tracking And Visualization Solution

Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apa…

XML data source for Spark SQL and DataFrames

Supporting code for the tutorials on https://www.baeldung.com/scala

Snowflake Data Source for Apache Spark.

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

A simple hello world using Apache Spark

Distributed. Columnar. Versioned. Streaming. SQL.

Mirror of Apache Toree (Incubating)

Mirror of Apache livy (Incubating)

Apache Spark