Pinned Loading

1. ELT-Data-Pipeline ELT-Data-Pipeline Public

   A complete ETL infrastructure built using broad-scale parallel webscrapers in the cloud, a data lake, a custom ETL pipeline, and a data warehouse.

   Python 1

2. Dash Dash Public

   An interactive dashboard built with Python and Dash that mines scraped data from Linkedin.

   Python 2

3. Airflow-Scrapy Airflow-Scrapy Public

   A fast and asynchronous webscraper with rotating proxies built using Scrapy, scheduled with Apache Airflow, & deployed using AWS MWAA

   Python

4. WikiCSS WikiCSS Public

   Formats wikipedia and standford encylclopedia of philosophy (SEP) for a smoother reading experience

   CSS 1

5. Snippet for Scrapy crawler with more... Snippet for Scrapy crawler with more than 1 level of depth

   1

   import scrapy

   2

   3

   class PublicSpider(scrapy.Spider):

   4

       name = "myFirstSpider"

   5

6. RealTimeTranslator RealTimeTranslator Public

   A realtime japanese to english translator for windows that translates all replaces any japanese text on screen with english so that you can start playing those japanese visual novels and jrpgs that…

   Python 2