Skip to content

Commit

Permalink
Adding documentation explaining "strange" URI required when using AWS… (
Browse files Browse the repository at this point in the history
  • Loading branch information
kubatyszko authored Dec 31, 2020
1 parent 6700563 commit d202fd4
Show file tree
Hide file tree
Showing 2 changed files with 11 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -58,6 +58,16 @@ Optionally you can supply a profile name to reference aws profile, e.g. defined
The value of the SSM parameter must be the :ref:`connection URI representation <generating_connection_uri>`
of the connection object.

In some cases, URI's you will need stored in Secrets Manager may not be intuitive, for example when using HTTP / HTTPS or SPARK, you may need URI's that will look like this:

http://https%3A%2F%2Fexample.com

spark://spark%3A%2F%2Fspark-master-0.spark-master.spark:7077

This is a known situation, where schema and protocol parts of the URI are independent and in some cases, need to be specified explicitly.

See https://github.com/apache/airflow/pull/10256 and https://github.com/apache/airflow/issues/10913 for more detailed discussion that led to this documentation update. This may get resolved in the future.

Storing and Retrieving Variables
""""""""""""""""""""""""""""""""

Expand Down
1 change: 1 addition & 0 deletions docs/spelling_wordlist.txt
Original file line number Diff line number Diff line change
Expand Up @@ -1204,6 +1204,7 @@ sourceUploadUrl
sparkApplication
sparkcmd
sparksql
Fspark
spegno
spotahome
sql
Expand Down

0 comments on commit d202fd4

Please sign in to comment.