Skip to content

Commit

Permalink
Bump minimum Airflow version in providers to Airflow 2.7.0 (apache#39240
Browse files Browse the repository at this point in the history
)

* Bump minimum Airflow version in providers to Airflow 2.7.0

* fix breeze tests

* drop 2.7.0 in favor of 2.7.1
  • Loading branch information
eladkal authored Apr 25, 2024
1 parent 5638bc3 commit ead9b00
Show file tree
Hide file tree
Showing 174 changed files with 359 additions and 366 deletions.
4 changes: 2 additions & 2 deletions PROVIDERS.rst
Original file line number Diff line number Diff line change
Expand Up @@ -144,8 +144,8 @@ Airflow version to the next MINOR release, when 12 months passed since the first
MINOR version of Airflow.

For example this means that by default we upgrade the minimum version of Airflow supported by providers
to 2.7.0 in the first Provider's release after 27th of April 2024. 27th of April 2023 is the date when the
first ``PATCHLEVEL`` of 2.6 (2.6.0) has been released.
to 2.8.0 in the first Provider's release after 18th of August 2024. 18th of August 2023 is the date when the
first ``PATCHLEVEL`` of 2.7 (2.7.0) has been released.

When we increase the minimum Airflow version, this is not a reason to bump ``MAJOR`` version of the providers
(unless there are other breaking changes in the provider). The reason for that is that people who use
Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/airbyte/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-airbyte:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-airbyte:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/airbyte/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- apache-airflow-providers-http

integrations:
Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/alibaba/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-alibaba:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-alibaba:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/alibaba/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- oss2>=2.14.0
- alibabacloud_adb20211201>=1.0.0
- alibabacloud_tea_openapi>=0.3.7
Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/amazon/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-amazon:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-amazon:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/amazon/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -82,7 +82,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- apache-airflow-providers-common-sql>=1.3.1
- apache-airflow-providers-http
# We should update minimum version of boto3 and here regularly to avoid `pip` backtracking with the number
Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apache/beam/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-beam:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-beam:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/beam/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
# Apache Beam > 2.53.0 and pyarrow > 14.0.1 fix https://nvd.nist.gov/vuln/detail/CVE-2023-47248.
- apache-beam>=2.53.0
- pyarrow>=14.0.1
Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apache/cassandra/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-cassandra:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-cassandra:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/cassandra/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- cassandra-driver>=3.29.1

integrations:
Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apache/drill/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-drill:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-drill:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/drill/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- apache-airflow-providers-common-sql>=1.3.1
- sqlalchemy-drill>=1.1.0

Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apache/druid/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-druid:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-druid:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/druid/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- apache-airflow-providers-common-sql>=1.3.1
- pydruid>=0.4.1

Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apache/flink/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-flink:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-flink:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/flink/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- cryptography>=2.0.0
- apache-airflow-providers-cncf-kubernetes>=5.1.0

Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apache/hdfs/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-hdfs:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-hdfs:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/hdfs/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- hdfs[avro,dataframe,kerberos]>=2.0.4

integrations:
Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apache/hive/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-hive:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-hive:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/hive/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- apache-airflow-providers-common-sql>=1.3.1
- hmsclient>=0.1.0
# In pandas 2.2 minimal version of the sqlalchemy is 2.0
Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apache/impala/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-impala:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-impala:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/impala/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ versions:

dependencies:
- impyla>=0.18.0,<1.0
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0

additional-extras:
- name: kerberos
Expand Down
6 changes: 3 additions & 3 deletions airflow/providers/apache/kafka/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,16 +27,16 @@

__all__ = ["__version__"]

__version__ = "1.4.0"
__version__ = "1.3.1"

try:
from airflow import __version__ as airflow_version
except ImportError:
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-kafka:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-kafka:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/kafka/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- asgiref
- confluent-kafka>=1.8.2

Expand Down
6 changes: 3 additions & 3 deletions airflow/providers/apache/kylin/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,16 +27,16 @@

__all__ = ["__version__"]

__version__ = "3.6.0"
__version__ = "3.5.0"

try:
from airflow import __version__ as airflow_version
except ImportError:
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-kylin:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-kylin:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/kylin/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- kylinpy>=2.6

integrations:
Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apache/livy/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-livy:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-livy:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/livy/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- apache-airflow-providers-http
- aiohttp>=3.9.2
- asgiref
Expand Down
6 changes: 3 additions & 3 deletions airflow/providers/apache/pig/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,16 +27,16 @@

__all__ = ["__version__"]

__version__ = "4.4.0"
__version__ = "4.3.0"

try:
from airflow import __version__ as airflow_version
except ImportError:
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-pig:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-pig:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/pig/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0

integrations:
- integration-name: Apache Pig
Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apache/pinot/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-pinot:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-pinot:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/pinot/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- apache-airflow-providers-common-sql>=1.3.1
- pinotdb>=5.1.0

Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apache/spark/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-spark:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apache-spark:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apache/spark/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ versions:
- 1.0.0

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- pyspark
- grpcio-status>=1.59.0

Expand Down
4 changes: 2 additions & 2 deletions airflow/providers/apprise/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@
from airflow.version import version as airflow_version

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.6.0"
"2.7.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apprise:{__version__}` needs Apache Airflow 2.6.0+"
f"The package `apache-airflow-providers-apprise:{__version__}` needs Apache Airflow 2.7.0+"
)
2 changes: 1 addition & 1 deletion airflow/providers/apprise/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ integrations:
tags: [software]

dependencies:
- apache-airflow>=2.6.0
- apache-airflow>=2.7.0
- apprise

hooks:
Expand Down
Loading

0 comments on commit ead9b00

Please sign in to comment.