data-factory-api-change-log.md

title	description	services	documentationcenter	author	manager	editor	ms.assetid	ms.service	ms.workload	ms.tgt_pltfrm	ms.devlang	ms.topic	ms.date	ms.author	robots
Data Factory - .NET API Change Log | Microsoft Docs	Describes breaking changes, feature additions, bug fixes etc... in a specific version of .NET API for the Azure Data Factory.	data-factory		sharonlo101	craigg		8208271b-7f4c-4214-b665-d2ff503c4470	data-factory	data-services	na	na	conceptual	01/22/2018	shlo	noindex

Azure Data Factory - .NET API change log

Note

This article applies to version 1 of Data Factory.

This article provides information about changes to Azure Data Factory SDK in a specific version. You can find the latest NuGet package for Azure Data Factory here

Version 4.11.0

Feature Additions:

• The following linked service types have been added:
  • OnPremisesMongoDbLinkedService
  • AmazonRedshiftLinkedService
  • AwsAccessKeyLinkedService
• The following dataset types have been added:
  • MongoDbCollectionDataset
  • AmazonS3Dataset
• The following copy source types have been added:
  • MongoDbSource

Version 4.10.0

• The following optional properties have been added to TextFormat:
  • SkipLineCount
  • FirstRowAsHeader
  • TreatEmptyAsNull
• The following linked service types have been added:
  • OnPremisesCassandraLinkedService
  • SalesforceLinkedService
• The following dataset types have been added:
  • OnPremisesCassandraTableDataset
• The following copy source types have been added:
  • CassandraSource
• Add WebServiceInputs property to AzureMLBatchExecutionActivity
  • Enable passing multiple web service inputs to an Azure Machine Learning experiment

Version 4.9.1

Bug fix

• Deprecate WebApi-based authentication for WebLinkedService.

Version 4.9.0

Feature Additions

• Add EnableStaging and StagingSettings properties to CopyActivity. See Staged copy for details on the feature.

Bug fix

• Introduce an overload of ActivityWindowOperationExtensions.List method, which takes an ActivityWindowsByActivityListParameters instance.
• Mark WriteBatchSize and WriteBatchTimeout as optional in CopySink.

Version 4.8.0

Feature Additions

• The following optional properties have been added to Copy activity type to enable tuning of copy performance:
  • ParallelCopies
  • CloudDataMovementUnits

Version 4.7.0

Feature Additions

• Added new StorageFormat type OrcFormat type to copy files in optimized row columnar (ORC) format.
• Add AllowPolyBase and PolyBaseSettings properties to SqlDWSink.
  • Enables the use of PolyBase to copy data into SQL Data Warehouse.

Version 4.6.1

Bug Fixes

• Fixes HTTP request for listing activity windows.
  • Removes the resource group name and the data factory name from the request payload.

Version 4.6.0

Feature Additions

• The following properties have been added to PipelineProperties:
  • PipelineMode
  • ExpirationTime
  • Datasets
• The following properties have been added to PipelineRuntimeInfo:
  • PipelineState
• Added new StorageFormat type JsonFormat type to define datasets whose data is in JSON format.

Version 4.5.0

Feature Additions

• Added list operations for activity window.
  • Added methods to retrieve activity windows with filters based on the entity types (that is, data factories, datasets, pipelines, and activities).
• The following linked service types have been added:
  • ODataLinkedService, WebLinkedService
• The following dataset types have been added:
  • ODataResourceDataset, WebTableDataset
• The following copy source types have been added:
  • WebSource

Version 4.4.0

Feature additions

• The following linked service type has been added as data sources and sinks for copy activities:
  • AzureStorageSasLinkedService. See Azure Storage SAS Linked Service for conceptual information and examples.

Version 4.3.0

Feature additions

• The following linked service types haven been added as data sources for copy activities:
  • HdfsLinkedService. See Move data from HDFS using Data Factory for conceptual information and examples.
  • OnPremisesOdbcLinkedService. See Move data From ODBC data stores using Azure Data Factory for conceptual information and examples.

Version 4.2.0

Feature additions

• The following new activity type has been added: AzureMLUpdateResourceActivity. For details about the activity, see Updating Azure ML models using the Update Resource Activity.
• A new optional property updateResourceEndpoint has been added to the AzureMLLinkedService class.
• LongRunningOperationInitialTimeout and LongRunningOperationRetryTimeout properties have been added to the DataFactoryManagementClient class.
• Allow configuration of the timeouts for client calls to the Data Factory service.

Version 4.1.0

Feature additions

• The following linked service types have been added:
  • AzureDataLakeStoreLinkedService
  • AzureDataLakeAnalyticsLinkedService
• The following activity types have been added:
  • DataLakeAnalyticsUSQLActivity
• The following dataset types have been added:
  • AzureDataLakeStoreDataset
• The following source and sink types for Copy Activity have been added:
  • AzureDataLakeStoreSource
  • AzureDataLakeStoreSink

Version 4.0.1

Breaking changes

The following classes have been renamed. The new names were the original names of classes before 4.0.0 release.

Name in 4.0.0	Name in 4.0.1
AzureSqlDataWarehouseDataset	AzureSqlDataWarehouseTableDataset
AzureSqlDataset	AzureSqlTableDataset
AzureDataset	AzureTableDataset
OracleDataset	OracleTableDataset
RelationalDataset	RelationalTableDataset
SqlServerDataset	SqlServerTableDataset

Version 4.0.0

Breaking changes

• The Following classes/interfaces have been renamed.

Old name	New name
ITableOperations	IDatasetOperations
Table	Dataset
TableProperties	DatasetProperties
TableTypeProprerties	DatasetTypeProperties
TableCreateOrUpdateParameters	DatasetCreateOrUpdateParameters
TableCreateOrUpdateResponse	DatasetCreateOrUpdateResponse
TableGetResponse	DatasetGetResponse
TableListResponse	DatasetListResponse
CreateOrUpdateWithRawJsonContentParameters	DatasetCreateOrUpdateWithRawJsonContentParameters

• The List methods return paged results now. If the response contains a non-empty NextLink property, the client application needs to continue fetching the next page until all pages are returned. Here is an example:

   PipelineListResponse response = client.Pipelines.List("ResourceGroupName", "DataFactoryName");
   var pipelines = new List<Pipeline>(response.Pipelines);
  
   string nextLink = response.NextLink;
   while (!string.IsNullOrEmpty(nextLink))
   {
       PipelineListResponse nextResponse = client.Pipelines.ListNext(nextLink);
       pipelines.AddRange(nextResponse.Pipelines);
  
       nextLink = nextResponse.NextLink;
   }

• List pipeline API returns only the summary of a pipeline instead of full details. For instance, activities in a pipeline summary only contain name and type.

Feature additions

• The SqlDWSink class supports two new properties, SliceIdentifierColumnName and SqlWriterCleanupScript, to support idempotent copy to Azure SQL Data Warehouse. See the Azure SQL Data Warehouse article for details about these properties.
• We now support running stored procedure against Azure SQL Database and Azure SQL Data Warehouse sources as part of the Copy Activity. The SqlSource and SqlDWSource classes have the following properties: SqlReaderStoredProcedureName and StoredProcedureParameters. See the Azure SQL Database and Azure SQL Data Warehouse articles on Azure.com for details about these properties.