An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

REST job server for Apache Spark

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

Easy, fast, transparent generic derivation of typeclass instances

A small demo app to show how java threads are mapped to linux threads through JNI

Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-disks.