Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Creating run backfill #46348

Merged
merged 6 commits into from
Feb 13, 2025
Merged

Creating run backfill #46348

merged 6 commits into from
Feb 13, 2025

Conversation

aritra24
Copy link
Collaborator

@aritra24 aritra24 commented Feb 1, 2025

Resolves: #43969


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@boring-cyborg boring-cyborg bot added the area:UI Related to UI/UX. For Frontend Developers. label Feb 1, 2025
Copy link
Contributor

@bbovenzi bbovenzi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking this on!

We need to change the fields from DagRun Trigger to Backfill. Here are the fields we need to have:

export type BackfillPostBody = {
  dag_id: string;
  from_date: string;
  to_date: string;
  run_backwards?: boolean;
  dag_run_conf?: {
    [key: string]: unknown;
  };
  reprocess_behavior?: "failed" | "completed" | "none";
  max_active_runs?: number;
};

airflow/ui/src/components/Menu/RunBackfillForm.tsx Outdated Show resolved Hide resolved
airflow/ui/src/components/Menu/RunBackfillForm.tsx Outdated Show resolved Hide resolved
airflow/ui/src/components/Menu/RunBackfillForm.tsx Outdated Show resolved Hide resolved
airflow/ui/src/components/Menu/RunBackfillForm.tsx Outdated Show resolved Hide resolved
airflow/ui/src/components/Menu/RunBackfillForm.tsx Outdated Show resolved Hide resolved
@aritra24
Copy link
Collaborator Author

aritra24 commented Feb 8, 2025

Still needs some fixing up, throws a bunch of errors on sending the requests. Pushing now to get some feedback on the UI changes.

@aritra24
Copy link
Collaborator Author

aritra24 commented Feb 8, 2025

Screenshot 2025-02-08 at 2 53 56 PM This is what the UI looks like right now.

@bbovenzi
Copy link
Contributor

Screenshot 2025-02-08 at 2 53 56 PM This is what the UI looks like right now.

Looking better. A few notes:

  • "Data Interval Start/End" should simply be "Date Range"
  • "Run Type" should be "Reprocess Behavior"
  • Let's try to get the radio cards to render in a row instead of a column

Added an alert for number of backfills, fixed the dryrun request,
fixed up a bit of the UI.
@aritra24
Copy link
Collaborator Author

Screenshot 2025-02-12 at 10 18 56 PM Latest UI

@aritra24 aritra24 marked this pull request as ready for review February 12, 2025 16:55
@aritra24 aritra24 changed the title WIP: Creating run backfill Creating run backfill Feb 12, 2025
Copy link
Contributor

@bbovenzi bbovenzi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice work. Thanks for putting up with all my comments

@aritra24
Copy link
Collaborator Author

Thanks for all the feedback!

@bbovenzi bbovenzi merged commit 8f05f99 into apache:main Feb 13, 2025
35 checks passed
ambika-garg pushed a commit to ambika-garg/airflow that referenced this pull request Feb 17, 2025
* WIP: Creating run backfill

* ui changes, some temp code to be filled in

* Fixing up a bunch of UI

Starting to call the APIs still has some issues

* remove null note in ActionAccordion

* Updated UI

Added an alert for number of backfills, fixed the dryrun request,
fixed up a bit of the UI.

* Resolved review comments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:UI Related to UI/UX. For Frontend Developers.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

AIP-38 | Create backfill
2 participants