dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

🦜🔗 Build context-aware reasoning applications

Avro SerDe for Apache Spark structured APIs.

The most popular ClickHouse plugin for Airflow. 🔝 Top-1% downloads on PyPI: https://pypi.org/project/airflow-clickhouse-plugin! Based on mymarilyn/clickhouse-driver.

Apache Spark - A unified analytics engine for large-scale data processing

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows