Skip to content
/ Covid_19_data-analysis Public

Analysis covid 19 data from https://api.covid19api.com/summary and using Nifi for data retrievel, Kafka and pysparka for streaming data processing and HDFS FOR STAORAGE, hIVE , qUICK SIGHT FOR DATA ANALYSIS

0 stars 1 fork Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

pnandini/Covid_19_data-analysis

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
Architecture for the project.PNG
Architecture for the project.PNG
 
 
Building big data pipeline on AWS-dezyre.docx
Building big data pipeline on AWS-dezyre.docx
 
 
Microsoft Word - AWS-documentation-Project Pro.docx.pdf
Microsoft Word - AWS-documentation-Project Pro.docx.pdf
 
 
NifiAttributeListEncrypt-v1.3.xml
NifiAttributeListEncrypt-v1.3.xml
 
 
ProjectPro-Building+data+pipeline+using+Hive+and+Spark.pdf
ProjectPro-Building+data+pipeline+using+Hive+and+Spark.pdf
 
 
README.md
README.md
 
 
Steps to install required services on AWS Ec2 instance.docx
Steps to install required services on AWS Ec2 instance.docx
 
 
corana_data.hql
corana_data.hql
 
 
hive_script_airflow.py
hive_script_airflow.py
 
 
pyspark_job_to_write_data_to_kafkatopic.py
pyspark_job_to_write_data_to_kafkatopic.py
 
 

Repository files navigation

Covid_19_data-analysis

Analysis covid 19 data from https://api.covid19api.com/summary and using Nifi for data retrievel, Kafka and pysparka for streaming data processing and HDFS FOR STAORAGE (Also used airflow for moving data to Hive), hIVE , AWS Quick Sight for Data Analys.

Tutorial Provided by Dezyre.

About

Analysis covid 19 data from https://api.covid19api.com/summary and using Nifi for data retrievel, Kafka and pysparka for streaming data processing and HDFS FOR STAORAGE, hIVE , qUICK SIGHT FOR DATA ANALYSIS

Resources

Readme
Activity

Stars

0 stars

Watchers

1 watching

Forks

1 fork
Report repository

Releases

No releases published

Packages

No packages published

Languages