Repositories list

• SpringPlayground

  Public
  Java Spring (Boot/Cloud..) backend playground | #SE

  JavaScript

  •4•0•0•0•Updated Jun 20, 2024Jun 20, 2024

• airflow-site

  Public
  Apache Airflow Website

  312•0•0•0•Updated Mar 20, 2024Mar 20, 2024

• prefect

  Public
  Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

  Python

  •

  Apache License 2.0

  •1.7k•0•0•0•Updated Mar 14, 2024Mar 14, 2024

• flink-training

  Public
  Apache Flink Training Excercises

  Java

  •

  Apache License 2.0

  •671•0•0•0•Updated Jan 18, 2024Jan 18, 2024

• demo-change-data-capture

  Public
  This demo shows how to capture data changes from relational databases and stream them to Confluent Cloud.

  HCL

  •4•0•0•0•Updated Dec 9, 2023Dec 9, 2023

• drone-fly

  Public
  A service which allows Hive Metastore Listeners to be deployed outside of the Hive Metastore Service

  Java

  •

  Apache License 2.0

  •3•0•0•0•Updated Jul 3, 2023Jul 3, 2023

• CS_basics5

  Public
  My CS learning : algorithm, data structure, and system design | #SE

  Python

  •44•0•0•0•Updated Jun 11, 2023Jun 11, 2023

• metabase

  Public
  The simplest, fastest way to get business intelligence and analytics to everyone in your company 😋

  Clojure

  •

  Other

  •5.2k•0•0•0•Updated Mar 5, 2023Mar 5, 2023

• amazon-redshift-utils2

  Public
  Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment

  Python

  •

  Apache License 2.0

  •1.3k•0•0•0•Updated Feb 10, 2023Feb 10, 2023

• Spark-Structured-Streaming-Examples

  Public
  Spark Structured Streaming / Kafka / Cassandra / Elastic

  Scala

  •

  Apache License 2.0

  •79•0•0•0•Updated Feb 7, 2023Feb 7, 2023

• datahub

  Public
  The Metadata Platform for the Modern Data Stack

  Java

  •

  Apache License 2.0

  •3k•0•0•0•Updated Feb 6, 2023Feb 6, 2023

• data-engineering-zoomcamp

  Public template
  Free Data Engineering course!

  Jupyter Notebook

  •5.6k•0•0•0•Updated Feb 5, 2023Feb 5, 2023

• elementary

  Public
  Open-source data observability for analytics engineers.

  HTML

  •

  Apache License 2.0

  •169•0•0•0•Updated Jan 12, 2023Jan 12, 2023

• kinesis-aggregation

  Public
  AWS libraries/modules for working with Kinesis aggregated record data

  Java

  •

  Apache License 2.0

  •153•0•0•0•Updated Jan 3, 2023Jan 3, 2023

• daft-scraper

  Public
  A library for scraping listings data from daft.ie

  Python

  •

  MIT License

  •6•0•0•0•Updated Dec 24, 2022Dec 24, 2022

• zsh-autosuggestions

  Public
  Fish-like autosuggestions for zsh

  Shell

  •

  MIT License

  •1.9k•0•0•0•Updated Dec 23, 2022Dec 23, 2022

• extraction-framework

  Public
  The software used to extract structured data from Wikipedia

  Scala

  •271•0•0•0•Updated Nov 23, 2022Nov 23, 2022

• learn_python3_spider

  Public
  python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifulSoup、selenium、appium、scrapy等，以及IP代理，验证码识别，Mysql，MongoDB数据库的python使用，多线程多进程爬虫的使用，css 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等

  Python

  •

  MIT License

  •3.8k•0•0•0•Updated Nov 23, 2022Nov 23, 2022

• video-to-sqlite

  Public
  Extract metadata from a video to an sqlite database

  Python

  •

  Other

  •3•0•0•0•Updated Oct 5, 2022Oct 5, 2022

• cc-pyspark

  Public
  Process Common Crawl data with Python and Spark

  Python

  •

  MIT License

  •87•0•0•0•Updated Sep 21, 2022Sep 21, 2022

• scala-tutorials

  Public
  Scala

  •

  MIT License

  •213•0•0•0•Updated Sep 4, 2022Sep 4, 2022

• facebook_crawler

  Public
  Python

  •

  MIT License

  •68•0•0•0•Updated Aug 14, 2022Aug 14, 2022

• zio-course

  Public
  The official repository for the Rock the JVM ZIO course

  Scala

  •49•0•0•0•Updated Jul 9, 2022Jul 9, 2022

• maxwell

  Public
  Maxwell's daemon, a mysql-to-json kafka producer

  Java

  •

  Other

  •1k•0•0•0•Updated Jul 7, 2022Jul 7, 2022

• amazon-kinesis-data-analytics-flink-starter-kit

  Public
  Amazon Kinesis Data Analytics Flink Starter Kit helps you with the development of Flink Application with Kinesis Stream as a source and Amazon S3 as a sink. This demonstrates the use of Session Window with AggregateFunction.

  Java

  •

  MIT No Attribution

  •15•0•0•0•Updated Jun 30, 2022Jun 30, 2022

• spark-jobserver

  Public
  REST job server for Apache Spark

  Scala

  •

  Other

  •995•0•0•0•Updated Jun 24, 2022Jun 24, 2022

• beginner_de_project

  Public
  Beginner data engineering project - batch edition

  Shell

  •

  MIT License

  •144•0•0•0•Updated Jun 13, 2022Jun 13, 2022

• aws-doc-sdk-examples

  Public
  Welcome to the AWS Code Examples Repository. This repo contains code examples used in the AWS documentation, AWS SDK Developer Guides, and more. For more information, see the Readme.rst file below.

  Java

  •

  Apache License 2.0

  •5.7k•0•0•0•Updated Jun 7, 2022Jun 7, 2022

• spotify

  Public
  A Scala wrapper for the Spotify Web API

  Scala

  •

  Apache License 2.0

  •4•0•0•0•Updated Apr 24, 2022Apr 24, 2022

• microbatch-hourly-deduped-tutorial

  Public
  Python

  •27•0•0•0•Updated Apr 19, 2022Apr 19, 2022