operators-and-hooks-ref.rst

Operators and Hooks Reference

Content

• Fundamentals
• ASF: Apache Software Foundation
• Azure: Microsoft Azure
• AWS: Amazon Web Services
• GCP: Google Cloud Platform
• Service integrations
• Software integrations
• Protocol integrations

Fundamentals

Base:

• :mod:`airflow.hooks.base_hook`
• :mod:`airflow.hooks.dbapi_hook`
• :mod:`airflow.models.baseoperator`
• :mod:`airflow.sensors.base_sensor_operator`

Operators:

• :mod:`airflow.operators.branch_operator`
• :mod:`airflow.operators.check_operator`
• :mod:`airflow.operators.dagrun_operator`
• :mod:`airflow.operators.dummy_operator`
• :mod:`airflow.operators.generic_transfer`
• :mod:`airflow.operators.latest_only_operator`
• :mod:`airflow.operators.subdag_operator`

Sensors:

• :mod:`airflow.contrib.sensors.weekday_sensor`
• :mod:`airflow.sensors.external_task_sensor`
• :mod:`airflow.sensors.sql_sensor`
• :mod:`airflow.sensors.time_delta_sensor`
• :mod:`airflow.sensors.time_sensor`

ASF: Apache Software Foundation

Airflow supports various software created by Apache Software Foundation.

Software operators and hooks

These integrations allow you to perform various operations within software developed by Apache Software Foundation.

Service name	Guides	Hook	Operators	Sensors
Apache Cassandra		:mod:`airflow.contrib.hooks.cassandra_hook`		:mod:`airflow.contrib.sensors.cassandra_record_sensor`, :mod:`airflow.contrib.sensors.cassandra_table_sensor`
Apache Druid		:mod:`airflow.hooks.druid_hook`	:mod:`airflow.contrib.operators.druid_operator`, :mod:`airflow.operators.druid_check_operator`
Apache Hive		:mod:`airflow.hooks.hive_hooks`	:mod:`airflow.operators.hive_operator`, :mod:`airflow.operators.hive_stats_operator`	:mod:`airflow.sensors.named_hive_partition_sensor`, :mod:`airflow.sensors.hive_partition_sensor`, :mod:`airflow.sensors.metastore_partition_sensor`
Apache Pig		:mod:`airflow.hooks.pig_hook`	:mod:`airflow.operators.pig_operator`
Apache Pinot		:mod:`airflow.contrib.hooks.pinot_hook`
Apache Spark		:mod:`airflow.contrib.hooks.spark_jdbc_hook`, :mod:`airflow.contrib.hooks.spark_jdbc_script`, :mod:`airflow.contrib.hooks.spark_sql_hook`, :mod:`airflow.contrib.hooks.spark_submit_hook`	:mod:`airflow.contrib.operators.spark_jdbc_operator`, :mod:`airflow.contrib.operators.spark_sql_operator`, :mod:`airflow.contrib.operators.spark_submit_operator`
Apache Sqoop		:mod:`airflow.contrib.hooks.sqoop_hook`	:mod:`airflow.contrib.operators.sqoop_operator`
Hadoop Distributed File System (HDFS)		:mod:`airflow.hooks.hdfs_hook`		:mod:`airflow.sensors.hdfs_sensor`, :mod:`airflow.contrib.sensors.hdfs_sensor`
WebHDFS		:mod:`airflow.hooks.webhdfs_hook`		:mod:`airflow.sensors.web_hdfs_sensor`

Transfer operators and hooks

These integrations allow you to copy data from/to software developed by Apache Software Foundation.

Source	Destination	Guide	Operators
Amazon Simple Storage Service (S3)	Apache Hive		:mod:`airflow.operators.s3_to_hive_operator`
Apache Cassandra	Google Cloud Storage (GCS)		:mod:`airflow.operators.cassandra_to_gcs`
Apache Hive	Amazon DynamoDB		:mod:`airflow.contrib.operators.hive_to_dynamodb`
Apache Hive	Apache Druid		:mod:`airflow.operators.hive_to_druid`
Apache Hive	MySQL		:mod:`airflow.operators.hive_to_mysql`
Apache Hive	Samba		:mod:`airflow.operators.hive_to_samba_operator`
Microsoft SQL Server (MSSQL)	Apache Hive		:mod:`airflow.operators.mssql_to_hive`
MySQL	Apache Hive		:mod:`airflow.operators.mysql_to_hive`
Vertica	Apache Hive		:mod:`airflow.contrib.operators.vertica_to_hive`

Azure: Microsoft Azure

Airflow has limited support for Microsoft Azure.

Service operators and hooks

These integrations allow you to perform various operations within the Microsoft Azure.

Service name	Hook	Operators	Sensors
Azure Blob Storage	:mod:`airflow.contrib.hooks.wasb_hook`	:mod:`airflow.contrib.operators.wasb_delete_blob_operator`	:mod:`airflow.contrib.sensors.wasb_sensor`
Azure Container Instances	:mod:`airflow.contrib.hooks.azure_container_instance_hook`, :mod:`airflow.contrib.hooks.azure_container_registry_hook`, :mod:`airflow.contrib.hooks.azure_container_volume_hook`	:mod:`airflow.contrib.operators.azure_container_instances_operator`
Azure Cosmos DB	:mod:`airflow.contrib.hooks.azure_cosmos_hook`	:mod:`airflow.contrib.operators.azure_cosmos_operator`	:mod:`airflow.contrib.sensors.azure_cosmos_sensor`
Azure Data Lake Storage	:mod:`airflow.contrib.hooks.azure_data_lake_hook`	:mod:`airflow.contrib.operators.adls_list_operator`
Azure Files	:mod:`airflow.contrib.hooks.azure_fileshare_hook`

Transfer operators and hooks

These integrations allow you to copy data from/to Microsoft Azure.

Source	Destination	Guide	Operators
Azure Data Lake Storage	Google Cloud Storage (GCS)		:mod:`airflow.operators.adls_to_gcs`
Local	Azure Blob Storage		:mod:`airflow.contrib.operators.file_to_wasb`
Oracle	Azure Data Lake Storage		:mod:`airflow.contrib.operators.oracle_to_azure_data_lake_transfer`

AWS: Amazon Web Services

Airflow has support for Amazon Web Services.

All hooks are based on :mod:`airflow.contrib.hooks.aws_hook`.

Service operators and hooks

These integrations allow you to perform various operations within the Amazon Web Services.

Service name	Hook	Operators	Sensors
AWS Batch		:mod:`airflow.contrib.operators.awsbatch_operator`
AWS DataSync	:mod:`airflow.providers.amazon.aws.hooks.datasync`	:mod:`airflow.providers.amazon.aws.operators.datasync`
AWS Glue Catalog	:mod:`airflow.contrib.hooks.aws_glue_catalog_hook`		:mod:`airflow.contrib.sensors.aws_glue_catalog_partition_sensor`
AWS Lambda	:mod:`airflow.providers.amazon.aws.hooks.lambda_function`
Amazon Athena	:mod:`airflow.providers.amazon.aws.hooks.athena`	:mod:`airflow.providers.amazon.aws.operators.athena`	:mod:`airflow.providers.amazon.aws.sensors.athena`
Amazon CloudWatch Logs	:mod:`airflow.contrib.hooks.aws_logs_hook`
Amazon DynamoDB	:mod:`airflow.contrib.hooks.aws_dynamodb_hook`
Amazon EC2		:mod:`airflow.contrib.operators.ecs_operator`
Amazon EMR	:mod:`airflow.contrib.hooks.emr_hook`	:mod:`airflow.contrib.operators.emr_add_steps_operator`, :mod:`airflow.contrib.operators.emr_create_job_flow_operator`, :mod:`airflow.contrib.operators.emr_terminate_job_flow_operator`	:mod:`airflow.contrib.sensors.emr_base_sensor`, :mod:`airflow.contrib.sensors.emr_job_flow_sensor`, :mod:`airflow.contrib.sensors.emr_step_sensor`
Amazon Kinesis Data Firehose	:mod:`airflow.providers.amazon.aws.hooks.kinesis`
Amazon Redshift	:mod:`airflow.providers.amazon.aws.hooks.redshift`		:mod:`airflow.providers.amazon.aws.sensors.redshift`
Amazon SageMaker	:mod:`airflow.contrib.hooks.sagemaker_hook`	:mod:`airflow.contrib.operators.sagemaker_base_operator`, :mod:`airflow.contrib.operators.sagemaker_endpoint_config_operator`, :mod:`airflow.contrib.operators.sagemaker_endpoint_operator`, :mod:`airflow.contrib.operators.sagemaker_model_operator`, :mod:`airflow.contrib.operators.sagemaker_training_operator`, :mod:`airflow.contrib.operators.sagemaker_transform_operator`, :mod:`airflow.contrib.operators.sagemaker_tuning_operator`	:mod:`airflow.contrib.sensors.sagemaker_base_sensor`, :mod:`airflow.contrib.sensors.sagemaker_endpoint_sensor`, :mod:`airflow.contrib.sensors.sagemaker_training_sensor`, :mod:`airflow.contrib.sensors.sagemaker_transform_sensor`, :mod:`airflow.contrib.sensors.sagemaker_tuning_sensor`
Amazon Simple Notification Service (SNS)	:mod:`airflow.providers.amazon.aws.hooks.sns`	:mod:`airflow.providers.amazon.aws.operators.sns`
Amazon Simple Queue Service (SQS)	:mod:`airflow.providers.amazon.aws.hooks.sqs`	:mod:`airflow.providers.amazon.aws.operators.sqs`	:mod:`airflow.providers.amazon.aws.sensors.sqs`
Amazon Simple Storage Service (S3)	:mod:`airflow.providers.amazon.aws.hooks.s3`	:mod:`airflow.operators.s3_file_transform_operator`, :mod:`airflow.contrib.operators.s3_copy_object_operator`, :mod:`airflow.contrib.operators.s3_delete_objects_operator`, :mod:`airflow.contrib.operators.s3_list_operator`	:mod:`airflow.sensors.s3_key_sensor`, :mod:`airflow.sensors.s3_prefix_sensor`

Transfer operators and hooks

These integrations allow you to copy data from/to Amazon Web Services.

Source	Destination	Guide	Operators
All GCP services :ref:`[1] <integration:GCP-Discovery>`	Amazon Simple Storage Service (S3)		:mod:`airflow.operators.google_api_to_s3_transfer`
Amazon DataSync	Amazon Simple Storage Service (S3)		:mod:`airflow.providers.amazon.aws.operators.datasync`
Amazon DynamoDB	Amazon Simple Storage Service (S3)		:mod:`airflow.contrib.operators.dynamodb_to_s3`
Amazon Redshift	Amazon Simple Storage Service (S3)		:mod:`airflow.operators.redshift_to_s3_operator`
Amazon Simple Storage Service (S3)	Amazon Redshift		:mod:`airflow.operators.s3_to_redshift_operator`
Amazon Simple Storage Service (S3)	Apache Hive		:mod:`airflow.operators.s3_to_hive_operator`
Amazon Simple Storage Service (S3)	Google Cloud Storage (GCS)	:doc:`How to use <howto/operator/gcp/cloud_storage_transfer_service>`	:mod:`airflow.contrib.operators.s3_to_gcs_operator`, :mod:`airflow.gcp.operators.cloud_storage_transfer_service`
Amazon Simple Storage Service (S3)	SSH File Transfer Protocol (SFTP)		:mod:`airflow.contrib.operators.s3_to_sftp_operator`
Apache Hive	Amazon DynamoDB		:mod:`airflow.contrib.operators.hive_to_dynamodb`
Google Cloud Storage (GCS)	Amazon Simple Storage Service (S3)		:mod:`airflow.operators.gcs_to_s3`
Internet Message Access Protocol (IMAP)	Amazon Simple Storage Service (S3)		:mod:`airflow.contrib.operators.imap_attachment_to_s3_operator`
MongoDB	Amazon Simple Storage Service (S3)		:mod:`airflow.contrib.operators.mongo_to_s3`
SSH File Transfer Protocol (SFTP)	Amazon Simple Storage Service (S3)		:mod:`airflow.contrib.operators.sftp_to_s3_operator`

:ref:`[1] <integration:AWS-Discovery-ref>` Those discovery-based operators use :class:`airflow.gcp.hooks.discovery_api.GoogleDiscoveryApiHook` to communicate with Google Services via the Google API Python Client. Please note that this library is in maintenance mode hence it won't fully support GCP in the future. Therefore it is recommended that you use the custom GCP Service Operators for working with the Google Cloud Platform.

GCP: Google Cloud Platform

Airflow has extensive support for the Google Cloud Platform.

See the :doc:`GCP connection type <howto/connection/gcp>` documentation to configure connections to GCP.

All hooks are based on :class:`airflow.gcp.hooks.base.GoogleCloudBaseHook`.

Note

You can learn how to use GCP integrations by analyzing the source code of the particular example DAGs.

Service operators and hooks

These integrations allow you to perform various operations within the Google Cloud Platform.

Service name	Guide	Hook	Operators	Sensors
AutoML	:doc:`How to use <howto/operator/gcp/automl>`	:mod:`airflow.gcp.hooks.automl`	:mod:`airflow.gcp.operators.automl`
BigQuery		:mod:`airflow.gcp.hooks.bigquery`	:mod:`airflow.gcp.operators.bigquery`	:mod:`airflow.gcp.sensors.bigquery`
BigQuery Data Transfer Service	:doc:`How to use <howto/operator/gcp/bigquery_dts>`	:mod:`airflow.gcp.hooks.bigquery_dts`	:mod:`airflow.gcp.operators.bigquery_dts`	:mod:`airflow.gcp.sensors.bigquery_dts`
Bigtable	:doc:`How to use <howto/operator/gcp/bigtable>`	:mod:`airflow.gcp.hooks.bigtable`	:mod:`airflow.gcp.operators.bigtable`	:mod:`airflow.gcp.sensors.bigtable`
Cloud Build	:doc:`How to use <howto/operator/gcp/cloud_build>`	:mod:`airflow.gcp.hooks.cloud_build`	:mod:`airflow.gcp.operators.cloud_build`
Compute Engine	:doc:`How to use <howto/operator/gcp/compute>`	:mod:`airflow.gcp.hooks.compute`	:mod:`airflow.gcp.operators.compute`
Cloud Data Loss Prevention (DLP)		:mod:`airflow.gcp.hooks.dlp`	:mod:`airflow.gcp.operators.dlp`
Dataflow		:mod:`airflow.gcp.hooks.dataflow`	:mod:`airflow.gcp.operators.dataflow`
Dataproc		:mod:`airflow.gcp.hooks.dataproc`	:mod:`airflow.gcp.operators.dataproc`
Datastore		:mod:`airflow.gcp.hooks.datastore`	:mod:`airflow.gcp.operators.datastore`
Cloud Functions	:doc:`How to use <howto/operator/gcp/functions>`	:mod:`airflow.gcp.hooks.functions`	:mod:`airflow.gcp.operators.functions`
Cloud Key Management Service (KMS)		:mod:`airflow.gcp.hooks.kms`
Kubernetes Engine		:mod:`airflow.gcp.hooks.kubernetes_engine`	:mod:`airflow.gcp.operators.kubernetes_engine`
Machine Learning Engine		:mod:`airflow.gcp.hooks.mlengine`	:mod:`airflow.gcp.operators.mlengine`
Cloud Memorystore	:doc:`How to use <howto/operator/gcp/cloud_memorystore>`	:mod:`airflow.gcp.hooks.cloud_memorystore`	:mod:`airflow.gcp.operators.cloud_memorystore`
Natural Language	:doc:`How to use <howto/operator/gcp/natural_language>`	:mod:`airflow.providers.google.cloud.hooks.natural_language`	:mod:`airflow.providers.google.cloud.operators.natural_language`
Cloud Pub/Sub	:doc:`How to use <howto/operator/gcp/pubsub>`	:mod:`airflow.providers.google.cloud..hooks.pubsub`	:mod:`airflow.providers.google.cloud..operators.pubsub`	:mod:`airflow.providers.google.cloud..sensors.pubsub`
Cloud Spanner	:doc:`How to use <howto/operator/gcp/spanner>`	:mod:`airflow.gcp.hooks.spanner`	:mod:`airflow.gcp.operators.spanner`
Cloud Speech-to-Text	:doc:`How to use <howto/operator/gcp/speech>`	:mod:`airflow.gcp.hooks.speech_to_text`	:mod:`airflow.gcp.operators.speech_to_text`
Cloud SQL	:doc:`How to use <howto/operator/gcp/sql>`	:mod:`airflow.gcp.hooks.cloud_sql`	:mod:`airflow.gcp.operators.cloud_sql`
Cloud Storage (GCS)	:doc:`How to use <howto/operator/gcp/gcs>`	:mod:`airflow.gcp.hooks.gcs`	:mod:`airflow.gcp.operators.gcs`	:mod:`airflow.gcp.sensors.gcs`
Storage Transfer Service	:doc:`How to use <howto/operator/gcp/cloud_storage_transfer_service>`	:mod:`airflow.gcp.hooks.cloud_storage_transfer_service`	:mod:`airflow.gcp.operators.cloud_storage_transfer_service`	:mod:`airflow.gcp.sensors.cloud_storage_transfer_service`
Cloud Tasks		:mod:`airflow.gcp.hooks.tasks`	:mod:`airflow.gcp.operators.tasks`
Cloud Text-to-Speech	:doc:`How to use <howto/operator/gcp/speech>`	:mod:`airflow.gcp.hooks.text_to_speech`	:mod:`airflow.gcp.operators.text_to_speech`
Cloud Translation	:doc:`How to use <howto/operator/gcp/translate>`	:mod:`airflow.gcp.hooks.translate`	:mod:`airflow.gcp.operators.translate`
Cloud Video Intelligence	:doc:`How to use <howto/operator/gcp/video_intelligence>`	:mod:`airflow.gcp.hooks.video_intelligence`	:mod:`airflow.gcp.operators.video_intelligence`
Cloud Vision	:doc:`How to use <howto/operator/gcp/vision>`	:mod:`airflow.providers.google.cloud.hooks.vision`	:mod:`airflow.providers.google.cloud.operators.vision`

Transfer operators and hooks

These integrations allow you to copy data from/to Google Cloud Platform.

Source	Destination	Guide	Operators
All services :ref:`[1] <integration:GCP-Discovery>`	Amazon Simple Storage Service (S3)		:mod:`airflow.operators.google_api_to_s3_transfer`
Amazon Simple Storage Service (S3)	Google Cloud Storage (GCS)	:doc:`How to use <howto/operator/gcp/cloud_storage_transfer_service>`	:mod:`airflow.contrib.operators.s3_to_gcs_operator`, :mod:`airflow.gcp.operators.cloud_storage_transfer_service`
Apache Cassandra	Google Cloud Storage (GCS)		:mod:`airflow.operators.cassandra_to_gcs`
Azure Data Lake Storage	Google Cloud Storage (GCS)		:mod:`airflow.operators.adls_to_gcs`
Google BigQuery	MySQL		:mod:`airflow.operators.bigquery_to_mysql`
Google BigQuery	Cloud Storage (GCS)		:mod:`airflow.operators.bigquery_to_gcs`
Google BigQuery	Google BigQuery		:mod:`airflow.operators.bigquery_to_bigquery`
Google Cloud Storage (GCS)	Amazon Simple Storage Service (S3)		:mod:`airflow.operators.gcs_to_s3`
Google Cloud Storage (GCS)	Google BigQuery		:mod:`airflow.operators.gcs_to_bq`
Google Cloud Storage (GCS)	Google Cloud Storage (GCS)	:doc:`How to use <howto/operator/gcp/gcs_to_gcs>`, :doc:`How to use <howto/operator/gcp/cloud_storage_transfer_service>`	:mod:`airflow.operators.gcs_to_gcs`, :mod:`airflow.gcp.operators.cloud_storage_transfer_service`
Google Cloud Storage (GCS)	Google Drive		:mod:`airflow.contrib.operators.gcs_to_gdrive_operator`
Google Cloud Storage (GCS)	SFTP	:doc:`How to use <howto/operator/gcp/gcs_to_sftp>`	:mod:`airflow.operators.gcs_to_sftp`
Local	Google Cloud Storage (GCS)		:mod:`airflow.operators.local_to_gcs`
Microsoft SQL Server (MSSQL)	Google Cloud Storage (GCS)		:mod:`airflow.operators.mssql_to_gcs`
MySQL	Google Cloud Storage (GCS)		:mod:`airflow.operators.mysql_to_gcs`
PostgresSQL	Google Cloud Storage (GCS)		:mod:`airflow.operators.postgres_to_gcs`
SFTP	Google Cloud Storage (GCS)	:doc:`How to use <howto/operator/gcp/sftp_to_gcs>`	:mod:`airflow.providers.google.cloud.operators.sftp_to_gcs`
SQL	Cloud Storage (GCS)		:mod:`airflow.operators.sql_to_gcs`

:ref:`[1] <integration:GCP-Discovery-ref>` Those discovery-based operators use :class:`airflow.gcp.hooks.discovery_api.GoogleDiscoveryApiHook` to communicate with Google Services via the Google API Python Client. Please note that this library is in maintenance mode hence it won't fully support GCP in the future. Therefore it is recommended that you use the custom GCP Service Operators for working with the Google Cloud Platform.

Other operators and hooks

Guide	Operators	Hooks
:doc:`How to use <howto/operator/gcp/translate-speech>`	:mod:`airflow.gcp.operators.translate_speech`
		:mod:`airflow.gcp.hooks.discovery_api`

Service integrations

Service operators and hooks

These integrations allow you to perform various operations within various services.

Service name	Guide	Hook	Operators	Sensors
Atlassian Jira		:mod:`airflow.contrib.hooks.jira_hook`	:mod:`airflow.contrib.operators.jira_operator`	:mod:`airflow.contrib.sensors.jira_sensor`
Databricks		:mod:`airflow.contrib.hooks.databricks_hook`	:mod:`airflow.contrib.operators.databricks_operator`
Datadog		:mod:`airflow.contrib.hooks.datadog_hook`		:mod:`airflow.contrib.sensors.datadog_sensor`
Pagerduty		:mod:`airflow.contrib.hooks.pagerduty_hook`
Dingding	:doc:`How to use <howto/operator/dingding>`	:mod:`airflow.contrib.hooks.dingding_hook`	:mod:`airflow.contrib.operators.dingding_operator`
Discord		:mod:`airflow.contrib.hooks.discord_webhook_hook`	:mod:`airflow.contrib.operators.discord_webhook_operator`
Google Campaign Manager	:doc:`How to use <howto/operator/gcp/campaign_manager>`	:mod:`airflow.providers.google.marketing_platform.hooks.campaign_manager`	:mod:`airflow.providers.google.marketing_platform.operators.campaign_manager`	:mod:`airflow.providers.google.marketing_platform.sensors.campaign_manager`
Google Display&Video 360	:doc:`How to use <howto/operator/gcp/display_video>`	:mod:`airflow.providers.google.marketing_platform.hooks.display_video`	:mod:`airflow.providers.google.marketing_platform.operators.display_video`	:mod:`airflow.providers.google.marketing_platform.sensors.display_video`
Google Drive		:mod:`airflow.contrib.hooks.gdrive_hook`
Google Search Ads 360	:doc:`How to use <howto/operator/gcp/search_ads>`	:mod:`airflow.providers.google.marketing_platform.hooks.search_ads`	:mod:`airflow.providers.google.marketing_platform.operators.search_ads`	:mod:`airflow.providers.google.marketing_platform.sensors.search_ads`
Google Spreadsheet		:mod:`airflow.gcp.hooks.gsheets`
IBM Cloudant		:mod:`airflow.contrib.hooks.cloudant_hook`
Jenkins		:mod:`airflow.contrib.hooks.jenkins_hook`	:mod:`airflow.contrib.operators.jenkins_job_trigger_operator`
Opsgenie		:mod:`airflow.contrib.hooks.opsgenie_alert_hook`	:mod:`airflow.contrib.operators.opsgenie_alert_operator`
Qubole		:mod:`airflow.contrib.hooks.qubole_hook`, :mod:`airflow.contrib.hooks.qubole_check_hook`	:mod:`airflow.contrib.operators.qubole_operator`, :mod:`airflow.contrib.operators.qubole_check_operator`	:mod:`airflow.contrib.sensors.qubole_sensor`
Salesforce		:mod:`airflow.contrib.hooks.salesforce_hook`
Segment		:mod:`airflow.contrib.hooks.segment_hook`	:mod:`airflow.contrib.operators.segment_track_event_operator`
Slack		:mod:`airflow.hooks.slack_hook`, :mod:`airflow.contrib.hooks.slack_webhook_hook`	:mod:`airflow.operators.slack_operator`, :mod:`airflow.contrib.operators.slack_webhook_operator`
Snowflake		:mod:`airflow.contrib.hooks.snowflake_hook`	:mod:`airflow.contrib.operators.snowflake_operator`
Vertica		:mod:`airflow.contrib.hooks.vertica_hook`	:mod:`airflow.contrib.operators.vertica_operator`
Zendesk		:mod:`airflow.hooks.zendesk_hook`

Transfer operators and hooks

These integrations allow you to perform various operations within various services.

Source	Destination	Guide	Operators
Google Cloud Storage (GCS)	Google Drive		:mod:`airflow.contrib.operators.gcs_to_gdrive_operator`
Vertica	Apache Hive		:mod:`airflow.contrib.operators.vertica_to_hive`
Vertica	MySQL		:mod:`airflow.contrib.operators.vertica_to_mysql`

Software integrations

Software operators and hooks

These integrations allow you to perform various operations using various software.

Service name	Guide	Hook	Operators	Sensors
Celery				:mod:`airflow.contrib.sensors.celery_queue_sensor`
Docker		:mod:`airflow.hooks.docker_hook`	:mod:`airflow.operators.docker_operator`, :mod:`airflow.contrib.operators.docker_swarm_operator`
GNU Bash	:doc:`How to use <howto/operator/bash>`		:mod:`airflow.operators.bash_operator`	:mod:`airflow.contrib.sensors.bash_sensor`
Kubernetes	:doc:`How to use <howto/operator/kubernetes>`		:mod:`airflow.contrib.operators.kubernetes_pod_operator`
Microsoft SQL Server (MSSQL)		:mod:`airflow.hooks.mssql_hook`	:mod:`airflow.operators.mssql_operator`
MongoDB		:mod:`airflow.contrib.hooks.mongo_hook`		:mod:`airflow.contrib.sensors.mongo_sensor`
MySQL		:mod:`airflow.hooks.mysql_hook`	:mod:`airflow.operators.mysql_operator`
OpenFaaS		:mod:`airflow.contrib.hooks.openfaas_hook`
Oracle		:mod:`airflow.hooks.oracle_hook`	:mod:`airflow.operators.oracle_operator`
Papermill	:doc:`How to use <howto/operator/papermill>`		:mod:`airflow.operators.papermill_operator`
PostgresSQL		:mod:`airflow.hooks.postgres_hook`	:mod:`airflow.operators.postgres_operator`
Presto		:mod:`airflow.hooks.presto_hook`	:mod:`airflow.operators.presto_check_operator`
Python			:mod:`airflow.operators.python_operator`	:mod:`airflow.contrib.sensors.python_sensor`
Redis		:mod:`airflow.contrib.hooks.redis_hook`	:mod:`airflow.contrib.operators.redis_publish_operator`	:mod:`airflow.contrib.sensors.redis_pub_sub_sensor`, :mod:`airflow.contrib.sensors.redis_key_sensor`
Samba		:mod:`airflow.hooks.samba_hook`
SQLite		:mod:`airflow.hooks.sqlite_hook`	:mod:`airflow.operators.sqlite_operator`

Transfer operators and hooks

These integrations allow you to copy data.

Source	Destination	Guide	Operators
Apache Hive	Samba		:mod:`airflow.operators.hive_to_samba_operator`
BigQuery	MySQL		:mod:`airflow.operators.bigquery_to_mysql`
Microsoft SQL Server (MSSQL)	Apache Hive		:mod:`airflow.operators.mssql_to_hive`
Microsoft SQL Server (MSSQL)	Google Cloud Storage (GCS)		:mod:`airflow.operators.mssql_to_gcs`
MongoDB	Amazon Simple Storage Service (S3)		:mod:`airflow.contrib.operators.mongo_to_s3`
MySQL	Apache Hive		:mod:`airflow.operators.mysql_to_hive`
MySQL	Google Cloud Storage (GCS)		:mod:`airflow.operators.mysql_to_gcs`
Oracle	Azure Data Lake Storage		:mod:`airflow.contrib.operators.oracle_to_azure_data_lake_transfer`
Oracle	Oracle		:mod:`airflow.contrib.operators.oracle_to_oracle_transfer`
PostgresSQL	Google Cloud Storage (GCS)		:mod:`airflow.operators.postgres_to_gcs`
Presto	MySQL		:mod:`airflow.operators.presto_to_mysql`
SQL	Cloud Storage (GCS)		:mod:`airflow.operators.sql_to_gcs`
Vertica	Apache Hive		:mod:`airflow.contrib.operators.vertica_to_hive`
Vertica	MySQL		:mod:`airflow.contrib.operators.vertica_to_mysql`

Protocol integrations

Protocol operators and hooks

These integrations allow you to perform various operations within various services using standardized communication protocols or interface.

Service name	Guide	Hook	Operators	Sensors
File Transfer Protocol (FTP)		:mod:`airflow.contrib.hooks.ftp_hook`		:mod:`airflow.contrib.sensors.ftp_sensor`
Filesystem		:mod:`airflow.contrib.hooks.fs_hook`		:mod:`airflow.contrib.sensors.file_sensor`
Hypertext Transfer Protocol (HTTP)		:mod:`airflow.hooks.http_hook`	:mod:`airflow.operators.http_operator`	:mod:`airflow.sensors.http_sensor`
Internet Message Access Protocol (IMAP)		:mod:`airflow.contrib.hooks.imap_hook`		:mod:`airflow.contrib.sensors.imap_attachment_sensor`
Java Database Connectivity (JDBC)		:mod:`airflow.hooks.jdbc_hook`	:mod:`airflow.operators.jdbc_operator`
SSH File Transfer Protocol (SFTP)		:mod:`airflow.contrib.hooks.sftp_hook`	:mod:`airflow.contrib.operators.sftp_operator`	:mod:`airflow.contrib.sensors.sftp_sensor`
Secure Shell (SSH)		:mod:`airflow.contrib.hooks.ssh_hook`	:mod:`airflow.contrib.operators.ssh_operator`
Simple Mail Transfer Protocol (SMTP)			:mod:`airflow.operators.email_operator`
Windows Remote Management (WinRM)		:mod:`airflow.contrib.hooks.winrm_hook`	:mod:`airflow.contrib.operators.winrm_operator`
gRPC		:mod:`airflow.contrib.hooks.grpc_hook`	:mod:`airflow.contrib.operators.grpc_operator`

Transfer operators and hooks

These integrations allow you to copy data.

Source	Destination	Guide	Operators
Amazon Simple Storage Service (S3)	SSH File Transfer Protocol (SFTP)		:mod:`airflow.contrib.operators.s3_to_sftp_operator`
Filesystem	Azure Blob Storage		:mod:`airflow.contrib.operators.file_to_wasb`
Filesystem	Google Cloud Storage (GCS)		:mod:`airflow.operators.local_to_gcs`
Internet Message Access Protocol (IMAP)	Amazon Simple Storage Service (S3)		:mod:`airflow.contrib.operators.imap_attachment_to_s3_operator`
SSH File Transfer Protocol (SFTP)	Amazon Simple Storage Service (S3)		:mod:`airflow.contrib.operators.sftp_to_s3_operator`