Azure Data Factory

tokyo-olympic-azure-data-engineering-project

In this project, I have used Azure Data Factory (ADF) to ingest data from Azure SQL Database into Azure Data Lake Storage Gen2 (ADLS Gen2). Once the data is landed in the lake, transform it via map…

A data engineering project (Twitter monitor app)

This data project can be used as a take-home assignment to learn Pyspark and Data Engineering.

This repo contains commands that data engineers use in day to day work.

Big Data for Data Engineers Coursera Specialization from Yandex

Sample project to demonstrate data engineering best practices