Assignment Requirements

• Use the notebook given at https://bit.ly/3ugP8Qg
• Build an AirFlow DAG for all pipelines and filters in the United Kingdom (UK).
• The output of the pipelines should be:
  • uk_scoring_report.png
  • uk_scoring_report.csv
  • PostgreSQL table uk_scoring_report
• Provide a GitHub repo for your solution with all required instructions.

Source repository: https://github.com/alhaol/psut-data-eng

Notes:

• I have only imported covid-19 data relating to the United Kingdom and the 'England' region only.
• The 'notebooks' folder contain the jupyter notebook used to test the code before inserting it into an Airflow pipeline.
• The outputs of the Airflow DAG pipeline are in the 'data' folder.
• The 'screenshots' folder contain screenshots of the outputs of the successful Airflow DAG pipeline.