Skip to content

Commit

Permalink
docs(celery): reworded, add actual multiple queues example (apache#17541
Browse files Browse the repository at this point in the history
)

I was reading the documentation to learn how to define multiple queues, but the example is incomplete, so I had to experiment on the CLI to see what works:

This failed: 
`airflow celery worker -q spark, park`  

This works:
 `airflow celery worker -q spark,quark`

This PR updates the documentation to clarify the command line syntax.
  • Loading branch information
noelmcloughlin authored Aug 10, 2021
1 parent 77c4325 commit 2ed5784
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions docs/apache-airflow/executor/celery.rst
Original file line number Diff line number Diff line change
Expand Up @@ -208,9 +208,9 @@ the queue that tasks get assigned to when not specified, as well as which
queue Airflow workers listen to when started.

Workers can listen to one or multiple queues of tasks. When a worker is
started (using the command ``airflow celery worker``), a set of comma-delimited
queue names can be specified (e.g. ``airflow celery worker -q spark``). This worker
will then only pick up tasks wired to the specified queue(s).
started (using command ``airflow celery worker``), a set of comma-delimited queue
names (no whitespaces) can be given (e.g. ``airflow celery worker -q spark,quark``).
This worker will then only pick up tasks wired to the specified queue(s).

This can be useful if you need specialized workers, either from a
resource perspective (for say very lightweight tasks where one worker
Expand Down

0 comments on commit 2ed5784

Please sign in to comment.