Skip to content

Commit

Permalink
Much more docs improvments
Browse files Browse the repository at this point in the history
  • Loading branch information
mistercrunch committed Feb 2, 2015
1 parent 02cc2f0 commit 5da5b72
Show file tree
Hide file tree
Showing 10 changed files with 80 additions and 4 deletions.
Binary file added docs/img/adhoc.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/img/dags.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/img/gantt.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/img/graph.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/img/tree.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
6 changes: 3 additions & 3 deletions docs/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ Content

installation
ui
code
cli
profiling
tutorial
profiling
cli
code
1 change: 1 addition & 0 deletions docs/profiling.rst
Original file line number Diff line number Diff line change
Expand Up @@ -13,3 +13,4 @@ The adhoc query UI allows for simple SQL interaction with the database
connections registered in Airflow.

.. image:: img/adhoc.png

1 change: 1 addition & 0 deletions docs/start_doc_server.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
python -m SimpleHTTPServer 8000
2 changes: 1 addition & 1 deletion docs/tutorial.rst
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@

Airflow tutorial
=============
================

This tutorial walks through some of the fundamental concepts, objects
and their usage.
Expand Down
74 changes: 74 additions & 0 deletions docs/ui.rst
Original file line number Diff line number Diff line change
@@ -1,17 +1,91 @@
UI / Screenshots
=================
The Airflow UI make it easy to monitor and troubleshoot your data pipelines.
Here's a quick overview of some of the features and visualizations you
can find in the Airflow UI.


DAGs View
.........
List of the DAGs in your environment, and a set of shortcuts to useful pages.
You can see exactly how many tasks succeeded, failed and are currently
running at a glance.

------------

.. image:: img/dags.png

------------


Tree View
.........
A tree representation of the DAG that spans across time. If a pipeline is
late, you can quickly see where the different steps are at and identify
the blocking ones.

------------

.. image:: img/tree.png

------------

Graph View
..........
The graph is perhaps the most comprehensive. Visualize your DAG's dependencies
and their current status for a specific run.

------------

.. image:: img/graph.png

------------

Gantt Chart
...........
The Gantt chart lets you analyse task duration and overlap, you can quickly
identify bottlenecks and where the bulk of the time is spent for specific
DAG runs.

------------

.. image:: img/gantt.png

------------

Task Duration
.............
The duration of your different tasks over the past N runs. This view lets
you find outliers and quickly understand where the time is spent in your
DAG, over many runs.


------------

.. image:: img/duration.png

------------

Code View
.........
Transparency is everything. While the code for your pipeline is in source
control, this is a quick way to get to the code that generates the DAG and
provide yet more context.

------------

.. image:: img/code.png

------------

Task Instance Context Menu
.........
From the pages seen above (tree view, graph view, gantt, ...), it is always
possible to click on a task instance, and get to this rich context menu
that can take you to more detailed metadata, and perform some actions.

------------

.. image:: img/context.png

------------

0 comments on commit 5da5b72

Please sign in to comment.