An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

ZIO — A type-safe, composable library for async and concurrent programming in Scala

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

Slick (Scala Language Integrated Connection Kit) is a modern database query and access library for Scala

Base classes to use when writing tests with Spark

Essential Spark extensions and helper methods ✨😲

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)