Skip to content

Commit

Permalink
Prepare ad-hoc release of the four previously excluded providers (apa…
Browse files Browse the repository at this point in the history
…che#14655)

Documentation update for the four previously excluded providers that
got extra fixes/bumping to the latest version of the libraries.

* apache.beam
* apache.druid
* microsoft.azure
* snowflake
  • Loading branch information
potiuk authored Mar 8, 2021
1 parent 97b5e4c commit b753c7f
Show file tree
Hide file tree
Showing 25 changed files with 97 additions and 46 deletions.
3 changes: 1 addition & 2 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -271,9 +271,8 @@ ENV INSTALL_FROM_PYPI=${INSTALL_FROM_PYPI}
# Force them on the main Airflow package.
# * chardet<4 - required to keep snowflake happy
# * urllib3 - required to keep boto3 happy
# * pytz<2021.0: required by snowflake provider
# * pyjwt<2.0.0: flask-jwt-extended requires it
ARG EAGER_UPGRADE_ADDITIONAL_REQUIREMENTS="chardet<4 urllib3<1.26 pytz<2021.0 pyjwt<2.0.0"
ARG EAGER_UPGRADE_ADDITIONAL_REQUIREMENTS="chardet<4 urllib3<1.26 pyjwt<2.0.0"

WORKDIR /opt/airflow

Expand Down
5 changes: 2 additions & 3 deletions Dockerfile.ci
Original file line number Diff line number Diff line change
Expand Up @@ -338,13 +338,12 @@ COPY airflow/__init__.py ${AIRFLOW_SOURCES}/airflow/__init__.py

# Those are additional constraints that are needed for some extras but we do not want to
# force them on the main Airflow package. Those limitations are:
# * chardet,<4: required by snowflake provider
# * chardet<4: required by snowflake provider
# * lazy-object-proxy<1.5.0: required by astroid
# * pytz<2021.0: required by snowflake provider
# * pyOpenSSL: required by snowflake provider https://github.com/snowflakedb/snowflake-connector-python/blob/v2.3.6/setup.py#L201
# * urllib3<1.26: Required to keep boto3 happy
# * pyjwt<2.0.0: flask-jwt-extended requires it
ARG EAGER_UPGRADE_ADDITIONAL_REQUIREMENTS="chardet<4 lazy-object-proxy<1.5.0 pyOpenSSL<20.0.0 pytz<2021.0 urllib3<1.26 pyjwt<2.0.0"
ARG EAGER_UPGRADE_ADDITIONAL_REQUIREMENTS="chardet<4 lazy-object-proxy<1.5.0 pyOpenSSL<20.0.0 purllib3<1.26 pyjwt<2.0.0"
ENV EAGER_UPGRADE_ADDITIONAL_REQUIREMENTS=${EAGER_UPGRADE_ADDITIONAL_REQUIREMENTS}

ARG CONTINUE_ON_PIP_CHECK_FAILURE="false"
Expand Down
3 changes: 2 additions & 1 deletion airflow/providers/apache/beam/ADDITIONAL_INFO.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,9 +17,10 @@
under the License.
-->

## Release 2021.3.3
## Release 2021.3.13

### Bug fixes

* `Improve Apache Beam operators - refactor operator - common Dataflow logic (#14094)`
* `Corrections in docs and tools after releasing provider RCs (#14082)`
* `Remove WARNINGs from BeamHook (#14554)`
Original file line number Diff line number Diff line change
@@ -1,8 +1,10 @@


### Release 2021.3.3
### Release 2021.3.13

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------|
| [4e5763060](https://github.com/apache/airflow/commit/4e5763060683456405ab6173cdee1f2facc231e5) | 2021-03-03 | `Remove WARNINGs from BeamHook (#14554)` |
| [589d6dec9](https://github.com/apache/airflow/commit/589d6dec922565897785bcbc5ac6bb3b973d7f5d) | 2021-02-27 | `Prepare to release the next wave of providers: (#14487)` |
| [8a731f536](https://github.com/apache/airflow/commit/8a731f536cc946cc62c20921187354b828df931e) | 2021-02-05 | `Improve Apache Beam operators - refactor operator - common Dataflow logic (#14094)` |
| [10343ec29](https://github.com/apache/airflow/commit/10343ec29f8f0abc5b932ba26faf49bc63c6bcda) | 2021-02-05 | `Corrections in docs and tools after releasing provider RCs (#14082)` |
11 changes: 7 additions & 4 deletions airflow/providers/apache/beam/BACKPORT_PROVIDER_README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@

# Package apache-airflow-backport-providers-apache-beam

Release: 2021.3.3
Release: 2021.3.13

**Table of contents**

Expand All @@ -34,7 +34,7 @@ Release: 2021.3.3
- [Hooks](#hooks)
- [New hooks](#new-hooks)
- [Releases](#releases)
- [Release 2021.3.3](#release-202133)
- [Release 2021.3.13](#release-2021313)
- [Release 2021.2.5](#release-202125)

## Backport package
Expand All @@ -48,12 +48,13 @@ While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade pyth
want to use this backport package.


## Release 2021.3.3
## Release 2021.3.13

### Bug fixes

* `Improve Apache Beam operators - refactor operator - common Dataflow logic (#14094)`
* `Corrections in docs and tools after releasing provider RCs (#14082)`
* `Remove WARNINGs from BeamHook (#14554)`


## Installation
Expand Down Expand Up @@ -115,10 +116,12 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

## Releases

### Release 2021.3.3
### Release 2021.3.13

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------|
| [4e5763060](https://github.com/apache/airflow/commit/4e5763060683456405ab6173cdee1f2facc231e5) | 2021-03-03 | `Remove WARNINGs from BeamHook (#14554)` |
| [589d6dec9](https://github.com/apache/airflow/commit/589d6dec922565897785bcbc5ac6bb3b973d7f5d) | 2021-02-27 | `Prepare to release the next wave of providers: (#14487)` |
| [8a731f536](https://github.com/apache/airflow/commit/8a731f536cc946cc62c20921187354b828df931e) | 2021-02-05 | `Improve Apache Beam operators - refactor operator - common Dataflow logic (#14094)` |
| [10343ec29](https://github.com/apache/airflow/commit/10343ec29f8f0abc5b932ba26faf49bc63c6bcda) | 2021-02-05 | `Corrections in docs and tools after releasing provider RCs (#14082)` |

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/beam/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,7 @@ Bug fixes

* ``Improve Apache Beam operators - refactor operator - common Dataflow logic (#14094)``
* ``Corrections in docs and tools after releasing provider RCs (#14082)``
* ``Remove WARNINGs from BeamHook (#14554)``

1.0.0
.....
Expand Down
6 changes: 5 additions & 1 deletion airflow/providers/apache/druid/ADDITIONAL_INFO.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,8 +17,12 @@
under the License.
-->

## Release 2021.3.3
## Release 2021.3.13

### Features

* `Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)`

### Bug fixes

* `Bugfix: DruidOperator fails to submit ingestion tasks (#14418)`
Original file line number Diff line number Diff line change
@@ -1,9 +1,11 @@


### Release 2021.3.3
### Release 2021.3.13

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------|
| [59065400f](https://github.com/apache/airflow/commit/59065400ff6333e3ff085f3d9fe9005a0a849aef) | 2021-03-05 | `Bugfix: DruidOperator fails to submit ingestion tasks (#14418)` |
| [589d6dec9](https://github.com/apache/airflow/commit/589d6dec922565897785bcbc5ac6bb3b973d7f5d) | 2021-02-27 | `Prepare to release the next wave of providers: (#14487)` |
| [33214d932](https://github.com/apache/airflow/commit/33214d9326bb0bb52f06e230895f4f68fc952664) | 2021-02-26 | `Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)` |
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
Expand Down
14 changes: 10 additions & 4 deletions airflow/providers/apache/druid/BACKPORT_PROVIDER_README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@

# Package apache-airflow-backport-providers-apache-druid

Release: 2021.3.3
Release: 2021.3.13

**Table of contents**

Expand All @@ -37,7 +37,7 @@ Release: 2021.3.3
- [Hooks](#hooks)
- [Moved hooks](#moved-hooks)
- [Releases](#releases)
- [Release 2021.3.3](#release-202133)
- [Release 2021.3.13](#release-2021313)
- [Release 2020.10.29](#release-20201029)
- [Release 2020.10.5](#release-2020105)
- [Release 2020.6.24](#release-2020624)
Expand All @@ -53,12 +53,16 @@ While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade pyth
want to use this backport package.


## Release 2021.3.3
## Release 2021.3.13

### Features

* `Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)`

### Bug fixes

* `Bugfix: DruidOperator fails to submit ingestion tasks (#14418)`


## Installation

Expand Down Expand Up @@ -136,10 +140,12 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

## Releases

### Release 2021.3.3
### Release 2021.3.13

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------|
| [59065400f](https://github.com/apache/airflow/commit/59065400ff6333e3ff085f3d9fe9005a0a849aef) | 2021-03-05 | `Bugfix: DruidOperator fails to submit ingestion tasks (#14418)` |
| [589d6dec9](https://github.com/apache/airflow/commit/589d6dec922565897785bcbc5ac6bb3b973d7f5d) | 2021-02-27 | `Prepare to release the next wave of providers: (#14487)` |
| [33214d932](https://github.com/apache/airflow/commit/33214d9326bb0bb52f06e230895f4f68fc952664) | 2021-02-26 | `Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)` |
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
Expand Down
5 changes: 5 additions & 0 deletions airflow/providers/apache/druid/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,11 @@ Features

* ``Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)``

Bugfixes
~~~~~~~~

* ``Bugfix: DruidOperator fails to submit ingestion tasks (#14418)``

1.0.1
.....

Expand Down
3 changes: 2 additions & 1 deletion airflow/providers/microsoft/azure/ADDITIONAL_INFO.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,11 +19,12 @@

# Changelog

## Release 2021.3.3
## Release 2021.3.13

### Features

* `Add Azure Data Factory hook (#11015)`
* ``Fix AzureDataFactoryHook failing to instantiate its connection (#14565)``

### Bug fixes

Expand Down
Original file line number Diff line number Diff line change
@@ -1,9 +1,12 @@


### Release 2021.3.3
### Release 2021.3.13

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------------|
| [e7bb17aeb](https://github.com/apache/airflow/commit/e7bb17aeb83b2218620c5320241b0c9f902d74ff) | 2021-03-06 | `Use built-in &#39;cached_property&#39; on Python 3.8 where possible (#14606)` |
| [630aeff72](https://github.com/apache/airflow/commit/630aeff72c7903ae8d4608f3530057bb6255e10b) | 2021-03-02 | `Fix AzureDataFactoryHook failing to instantiate its connection (#14565)` |
| [589d6dec9](https://github.com/apache/airflow/commit/589d6dec922565897785bcbc5ac6bb3b973d7f5d) | 2021-02-27 | `Prepare to release the next wave of providers: (#14487)` |
| [11d03d2f6](https://github.com/apache/airflow/commit/11d03d2f63d88a284d6aaded5f9ab6642a60561b) | 2021-02-26 | `Add Azure Data Factory hook (#11015)` |
| [5bfa0f123](https://github.com/apache/airflow/commit/5bfa0f123b39babe1ef66c139e59e452240a6bd7) | 2021-02-25 | `BugFix: Fix remote log in azure storage blob displays in one line (#14313)` |
| [ca35bd7f7](https://github.com/apache/airflow/commit/ca35bd7f7f6bc2fb4f2afd7762114ce262c61941) | 2021-02-21 | `By default PIP will install all packages in .local folder (#14125)` |
Expand Down
14 changes: 9 additions & 5 deletions airflow/providers/microsoft/azure/BACKPORT_PROVIDER_README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@

# Package apache-airflow-backport-providers-microsoft-azure

Release: 2021.3.3
Release: 2021.3.13

**Table of contents**

Expand All @@ -44,7 +44,7 @@ Release: 2021.3.3
- [Secrets](#secrets)
- [New secrets](#new-secrets)
- [Releases](#releases)
- [Release 2021.3.3](#release-202133)
- [Release 2021.3.13](#release-2021313)
- [Release 2021.2.5](#release-202125)
- [Release 2020.11.23](#release-20201123)
- [Release 2020.10.29](#release-20201029)
Expand All @@ -64,11 +64,12 @@ want to use this backport package.

# Changelog

## Release 2021.3.3
## Release 2021.3.13

### Features

* `Add Azure Data Factory hook (#11015)`
* ``Fix AzureDataFactoryHook failing to instantiate its connection (#14565)``

### Bug fixes

Expand All @@ -91,7 +92,7 @@ You can install this package on top of an existing airflow 1.10.* installation v
| `azure-keyvault` | `>=4.1.0` |
| `azure-kusto-data` | `>=0.0.43,<0.1` |
| `azure-mgmt-containerinstance` | `>=1.5.0,<2.0` |
| `azure-mgmt-datafactory` | `>=0.13.0` |
| `azure-mgmt-datafactory` | `>=1.0.0,<2.0` |
| `azure-mgmt-datalake-store` | `>=0.5.0` |
| `azure-mgmt-resource` | `>=2.2.0` |
| `azure-storage-blob` | `>=12.7.0` |
Expand Down Expand Up @@ -220,10 +221,13 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

## Releases

### Release 2021.3.3
### Release 2021.3.13

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------------|
| [e7bb17aeb](https://github.com/apache/airflow/commit/e7bb17aeb83b2218620c5320241b0c9f902d74ff) | 2021-03-06 | `Use built-in &#39;cached_property&#39; on Python 3.8 where possible (#14606)` |
| [630aeff72](https://github.com/apache/airflow/commit/630aeff72c7903ae8d4608f3530057bb6255e10b) | 2021-03-02 | `Fix AzureDataFactoryHook failing to instantiate its connection (#14565)` |
| [589d6dec9](https://github.com/apache/airflow/commit/589d6dec922565897785bcbc5ac6bb3b973d7f5d) | 2021-02-27 | `Prepare to release the next wave of providers: (#14487)` |
| [11d03d2f6](https://github.com/apache/airflow/commit/11d03d2f63d88a284d6aaded5f9ab6642a60561b) | 2021-02-26 | `Add Azure Data Factory hook (#11015)` |
| [5bfa0f123](https://github.com/apache/airflow/commit/5bfa0f123b39babe1ef66c139e59e452240a6bd7) | 2021-02-25 | `BugFix: Fix remote log in azure storage blob displays in one line (#14313)` |
| [ca35bd7f7](https://github.com/apache/airflow/commit/ca35bd7f7f6bc2fb4f2afd7762114ce262c61941) | 2021-02-21 | `By default PIP will install all packages in .local folder (#14125)` |
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/microsoft/azure/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,7 @@ Bug fixes
~~~~~~~~~

* ``BugFix: Fix remote log in azure storage blob displays in one line (#14313)``
* ``Fix AzureDataFactoryHook failing to instantiate its connection (#14565)``

1.1.0
.....
Expand Down
6 changes: 5 additions & 1 deletion airflow/providers/snowflake/ADDITIONAL_INFO.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,11 @@
under the License.
-->

## Release 2021.3.3
## Release 2021.3.13

### Features

* ``Bumped snowflake-connector-python library to >=2.4.1 version and get rid of pytz library pinning``

### Bug fixes

Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,8 @@


### Release 2021.3.3
### Release 2021.3.13

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------|
| [589d6dec9](https://github.com/apache/airflow/commit/589d6dec922565897785bcbc5ac6bb3b973d7f5d) | 2021-02-27 | `Prepare to release the next wave of providers: (#14487)` |
| [10343ec29](https://github.com/apache/airflow/commit/10343ec29f8f0abc5b932ba26faf49bc63c6bcda) | 2021-02-05 | `Corrections in docs and tools after releasing provider RCs (#14082)` |
15 changes: 10 additions & 5 deletions airflow/providers/snowflake/BACKPORT_PROVIDER_README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@

# Package apache-airflow-backport-providers-snowflake

Release: 2021.3.3
Release: 2021.3.13

**Table of contents**

Expand All @@ -36,7 +36,7 @@ Release: 2021.3.3
- [Hooks](#hooks)
- [New hooks](#new-hooks)
- [Releases](#releases)
- [Release 2021.3.3](#release-202133)
- [Release 2021.3.13](#release-2021313)
- [Release 2021.2.5](#release-202125)
- [Release 2020.11.23](#release-20201123)
- [Release 2020.10.29](#release-20201029)
Expand All @@ -54,7 +54,11 @@ While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade pyth
want to use this backport package.


## Release 2021.3.3
## Release 2021.3.13

### Features

* ``Bumped snowflake-connector-python library to &gt;=2.4.1 version and get rid of pytz library pinning``

### Bug fixes

Expand All @@ -77,7 +81,7 @@ You can install this package on top of an existing airflow 1.10.* installation v

| PIP package | Version required |
|:-----------------------------|:-------------------|
| `snowflake-connector-python` | `>=2.3.8` |
| `snowflake-connector-python` | `>=2.4.1` |
| `snowflake-sqlalchemy` | `>=1.1.0` |

## Cross provider package dependencies
Expand Down Expand Up @@ -139,10 +143,11 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

## Releases

### Release 2021.3.3
### Release 2021.3.13

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------|
| [589d6dec9](https://github.com/apache/airflow/commit/589d6dec922565897785bcbc5ac6bb3b973d7f5d) | 2021-02-27 | `Prepare to release the next wave of providers: (#14487)` |
| [10343ec29](https://github.com/apache/airflow/commit/10343ec29f8f0abc5b932ba26faf49bc63c6bcda) | 2021-02-05 | `Corrections in docs and tools after releasing provider RCs (#14082)` |


Expand Down
9 changes: 7 additions & 2 deletions airflow/providers/snowflake/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -19,14 +19,19 @@
Changelog
---------

1.1.1
1.2.0
.....

Features
~~~~~~~~

* ``Bumped snowflake-connector-python library to >=2.4.1 version and get rid of pytz library pinning``

Bug fixes
~~~~~~~~~

* ``Corrections in docs and tools after releasing provider RCs (#14082)``

* ``Prepare to release the next wave of providers: (#14487)``

1.1.0
.....
Expand Down
4 changes: 3 additions & 1 deletion docs/apache-airflow-providers-apache-beam/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -31,11 +31,13 @@ For high-level changelog, see :doc:`package information including changelog <ind
1.0.1
.....

Latest change: 2021-02-05
Latest change: 2021-03-03

================================================================================================ =========== ======================================================================================
Commit Committed Subject
================================================================================================ =========== ======================================================================================
`4e5763060 <https://github.com/apache/airflow/commit/4e5763060683456405ab6173cdee1f2facc231e5>`_ 2021-03-03 ``Remove WARNINGs from BeamHook (#14554)``
`589d6dec9 <https://github.com/apache/airflow/commit/589d6dec922565897785bcbc5ac6bb3b973d7f5d>`_ 2021-02-27 ``Prepare to release the next wave of providers: (#14487)``
`8a731f536 <https://github.com/apache/airflow/commit/8a731f536cc946cc62c20921187354b828df931e>`_ 2021-02-05 ``Improve Apache Beam operators - refactor operator - common Dataflow logic (#14094)``
`10343ec29 <https://github.com/apache/airflow/commit/10343ec29f8f0abc5b932ba26faf49bc63c6bcda>`_ 2021-02-05 ``Corrections in docs and tools after releasing provider RCs (#14082)``
================================================================================================ =========== ======================================================================================
Expand Down
Loading

0 comments on commit b753c7f

Please sign in to comment.