Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Oct 3, 2024

• feature: some functions to monitor in currently processing files

  ahmadMuhammadGd

  committed
  dff6d3d

• feature: update outlet dataset and get extra from triggering dataset

  ahmadMuhammadGd

  committed
  2fc511c

• INFO_FOUND_CSV

  ahmadMuhammadGd

  committed
  79d6c23

• fix: multi-line python args fix

  ahmadMuhammadGd

  committed
  24191d5

• cross-dag communication implementation using airflow context and datasets

  ahmadMuhammadGd

  committed
  47aba50

• xcom pickling

  ahmadMuhammadGd

  committed
  713f701

Commits on Sep 28, 2024

• data aware dags are closely completed

  ahmadMuhammadGd

  committed
  59b0191

• switched branch name from env_var to var, renamed timestamp column

  ahmadMuhammadGd

  committed
  009411c

• read write airflow dataset metadata

  ahmadMuhammadGd

  committed
  bbb39ac

Commits on Sep 27, 2024

• postgres as a backend

  ahmadMuhammadGd

  committed
  251a8a8

• dataset utils, read extra dataset from the previous dag (cross-share data)

  ahmadMuhammadGd

  committed
  c3a6d16

Commits on Sep 16, 2024

• Merge pull request #2 from ahmadMuhammadGd/fix/dbt

  Show description for 7c78895
  ahmadMuhammadGd

  authored
  7c78895

• fix incremental load issue

  ahmadMuhammadGd

  committed
  2b467d2

Commits on Sep 14, 2024

• fix triggerd dag id

  ahmadMuhammadGd

  committed
  fad3c9c

• fix: network issue

  ahmadMuhammadGd

  committed
  9d26dcc

• correcting pool name

  ahmadMuhammadGd

  committed
  e34df78

• core: all services shares the same network

  ahmadMuhammadGd

  committed
  c61fc97

• core: added new pool with 1 slot for ingest and transformation dags

  ahmadMuhammadGd

  committed
  4f2760e

• fix: more joining conditions for location_id, zip_code may be empty for several locations

  ahmadMuhammadGd

  committed
  933f623

Commits on Sep 13, 2024

• fix: more joining conditions for location_id, zip_code may be empty for several locations

  ahmadMuhammadGd

  committed
  10c4f92

• md example for extra field in custom SSHSparkOperator

  ahmadMuhammadGd

  committed
  ddfb51f

• md example for extra field in custom SSHSparkOperator

  ahmadMuhammadGd

  committed
  d8f9746

• no need for this now

  ahmadMuhammadGd

  committed
  4b524d4

Commits on Sep 12, 2024

• docstring SSHSparkOperator

  ahmadMuhammadGd

  committed
  109781f

• dag documentation

  ahmadMuhammadGd

  committed
  b6fe8fb

• fix: move object algorithm

  ahmadMuhammadGd

  committed
  7a502e2

• fixed: exporting env variables before dbt run and dbt test

  ahmadMuhammadGd

  committed
  20fcc6d

• added documentation

  ahmadMuhammadGd

  committed
  0b4a273

• fix: timestamp load. core: changed objects archetecture, s3://queued/landing/* for all raw csvs, while s3://queued/processed/* for successfully loaded files, s3://queued/rejected_csv/* for files wh…

  Show description for e2ef8e2
  ahmadMuhammadGd

  committed
  e2ef8e2

• fix: cant overwrite branch name in environment variable

  ahmadMuhammadGd

  committed
  569f104

• add info to variables for cross dag communication

  ahmadMuhammadGd

  committed
  265c0d6

• fix: timestamp issue

  ahmadMuhammadGd

  committed
  1542410

Commits on Sep 11, 2024

• fix: ingestion time laod formate

  ahmadMuhammadGd

  committed
  a754bc2

• fix: ingestion timestamp SQL casting

  ahmadMuhammadGd

  committed
  fcef575

• changed airflow node name

  ahmadMuhammadGd

  committed
  37dca4f

Pagination

PreviousNext