Skip to content

Commit

Permalink
fixed: exporting env variables before dbt run and dbt test
Browse files Browse the repository at this point in the history
  • Loading branch information
ahmadMuhammadGd committed Sep 12, 2024
1 parent 0b4a273 commit 20fcc6d
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions airflow/dags/02-transformation_layer/amazon_csv_orders.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,12 @@
tags=["Spark", "SSH", "Iceberg", "Soda", "Nessie", "transforming", "CSV", "Amazon"],
default_args=default_args,
schedule=[SUCCESS_CLEANING_DATASET],
doc_md="""
# **Dag_id**: transform_to_gold
- This DAG is responsible for transforming Amazon order data from the silver layer to the gold layer using dbt (Data Build Tool).
- It processes source, dimension, and fact models in parallel, with tests after each transformation.
- The workflow updates success or failure datasets depending on the outcome of the dbt transformations.
"""
)

def transform_audit():
Expand Down

0 comments on commit 20fcc6d

Please sign in to comment.