Pinterest Data Pipeline that simulate data ingestion and processing for both batch and streaming data.
kafka aws-s3 aws-apigateway aws-cli aws-ec2 bash-script aws-rds databricks aws-rds-postgres airflow-dags msk-connect msk-cluster
-
Updated
Aug 26, 2024 - Jupyter Notebook