Skip to content

Commit

Permalink
chore: Airflow broken links updated (aws-ia#1206)
Browse files Browse the repository at this point in the history
  • Loading branch information
vara-bonthu authored Nov 23, 2022
1 parent bb52577 commit 349bbfa
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions docs/add-ons/apache-airflow.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Apache Airflow add-on

This document describes the details of the best practices for building and deploying Self-managed **Highly Scalable Apache Airflow cluster on Kubernetes(Amazon EKS) Cluster**.
Alternatively, Amazon also provides a fully managed Apache Airflow service(MWAA). Please see this [example]( https://github.com/aws-ia/terraform-aws-eks-blueprints/tree/main/examples/managed-workflow-apache-airflow) if you are looking to build Amazon MWAA.
Alternatively, Amazon also provides a fully managed Apache Airflow service(MWAA). Please see this [example](https://awslabs.github.io/data-on-eks/docs/job-schedulers-eks/aws-managed-airflow) if you are looking to build Amazon MWAA.

Apache Airflow is used for the scheduling and orchestration of data pipelines or workflows.
Orchestration of data pipelines refers to the sequencing, coordination, scheduling, and managing complex data pipelines from diverse sources.
Expand Down Expand Up @@ -61,17 +61,17 @@ You can modify the `values.yaml` to set the Load Balancer to `internal` and uplo
Ensure access to the WebUI using internal domain and network.


Checkout the [examples](https://github.com/aws-ia/terraform-aws-eks-blueprints/tree/main/examples/analytics/airflow-on-eks) of deploying and using Apache Airflow on Amazon EKS.
Checkout the [examples](https://awslabs.github.io/data-on-eks/docs/job-schedulers-eks/self-managed-airflow) of deploying and using Apache Airflow on Amazon EKS.

## Usage

The [Apache Airflow](https://github.com/aws-ia/terraform-aws-eks-blueprints/tree/main/examples/analytics/airflow-on-eks) can be deployed by enabling the add-on via the following.
The [Apache Airflow](https://awslabs.github.io/data-on-eks/docs/job-schedulers-eks/self-managed-airflow) can be deployed by enabling the add-on via the following.

```hcl
enable_airflow = true
```

For production workloads, you can use this [example](https://github.com/aws-ia/terraform-aws-eks-blueprints/tree/main/examples/analytics/airflow-on-eks) with custom Helm Config.
For production workloads, you can use this [example](https://awslabs.github.io/data-on-eks/docs/job-schedulers-eks/self-managed-airflow) with custom Helm Config.

```hcl
enable_airflow = true
Expand Down

0 comments on commit 349bbfa

Please sign in to comment.