| title | description | services | documentationcenter | author | manager | editor | ms.assetid | ms.service | ms.workload | ms.tgt_pltfrm | ms.devlang | ms.topic | ms.date | ms.author |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Data Factory - .NET API Change Log | Microsoft Docs |
Describes breaking changes, feature additions, bug fixes etc... in a specific version of .NET API for the Azure Data Factory. |
data-factory |
spelluru |
jhubbard |
monicar |
8208271b-7f4c-4214-b665-d2ff503c4470 |
data-factory |
data-services |
na |
na |
article |
09/21/2016 |
spelluru |
This article provides information about changes to Azure Data Factory SDK in a specific version. You can find the latest NuGet package for Azure Data Factory here
Feature Additions:
- The following linked service types have been added:
- The following dataset types have been added:
- The following copy source types have been added:
- The following optional properties have been added to TextFormat:
- The following linked service types have been added:
- The following dataset types have been added:
- The following copy source types have been added:
- Add WebServiceInputs property to AzureMLBatchExecutionActivity
- Enable passing multiple web service inputs to an Azure Machine Learning experiment
- Deprecate WebApi-based authentication for WebLinkedService.
- Add EnableStaging and StagingSettings properties to CopyActivity. See Staged copy for details on the feature.
- Introduce an overload of ActivityWindowOperationExtensions.List method, which takes an ActivityWindowsByActivityListParameters instance.
- Mark WriteBatchSize and WriteBatchTimeout as optional in CopySink.
- The following optional properties have been added to Copy activity type to enable tuning of copy performance:
- Added new StorageFormat type OrcFormat type to copy files in optimized row columnar (ORC) format.
- Add AllowPolyBase and PolyBaseSettings properties to SqlDWSink.
- Enables the use of PolyBase to copy data into SQL Data Warehouse.
- Fixes HTTP request for listing activity windows.
- Removes the resource group name and the data factory name from the request payload.
- The following properties have been added to PipelineProperties:
- The following properties have been added to PipelineRuntimeInfo:
- Added new StorageFormat type JsonFormat type to define datasets whose data is in JSON format.
- Added list operations for activity window.
- Added methods to retrieve activity windows with filters based on the entity types (that is, data factories, datasets, pipelines, and activities).
- The following linked service types have been added:
- The following dataset types have been added:
- The following copy source types have been added:
- The following linked service type has been added as data sources and sinks for copy activities:
- AzureStorageSasLinkedService. See Azure Storage SAS Linked Service for conceptual information and examples.
- The following linked service types haven been added as data sources for copy activities:
- HdfsLinkedService. See Move data from HDFS using Data Factory for conceptual information and examples.
- OnPremisesOdbcLinkedService. See Move data From ODBC data stores using Azure Data Factory for conceptual information and examples.
- The following new activity type has been added: AzureMLUpdateResourceActivity. For details about the activity, see Updating Azure ML models using the Update Resource Activity.
- A new optional property updateResourceEndpoint has been added to the AzureMLLinkedService class.
- LongRunningOperationInitialTimeout and LongRunningOperationRetryTimeout properties have been added to the DataFactoryManagementClient class.
- Allow configuration of the timeouts for client calls to the Data Factory service.
- The following linked service types have been added:
- The following activity types have been added:
- The following dataset types have been added:
- The following source and sink types for Copy Activity have been added:
The following classes have been renamed. The new names were the original names of classes before 4.0.0 release.
| Name in 4.0.0 | Name in 4.0.1 |
|---|---|
| AzureSqlDataWarehouseDataset | AzureSqlDataWarehouseTableDataset |
| AzureSqlDataset | AzureSqlTableDataset |
| AzureDataset | AzureTableDataset |
| OracleDataset | OracleTableDataset |
| RelationalDataset | RelationalTableDataset |
| SqlServerDataset | SqlServerTableDataset |
- The Following classes/interfaces have been renamed.
| Old name | New name |
|---|---|
| ITableOperations | IDatasetOperations |
| Table | Dataset |
| TableProperties | DatasetProperties |
| TableTypeProprerties | DatasetTypeProperties |
| TableCreateOrUpdateParameters | DatasetCreateOrUpdateParameters |
| TableCreateOrUpdateResponse | DatasetCreateOrUpdateResponse |
| TableGetResponse | DatasetGetResponse |
| TableListResponse | DatasetListResponse |
| CreateOrUpdateWithRawJsonContentParameters | DatasetCreateOrUpdateWithRawJsonContentParameters |
-
The List methods return paged results now. If the response contains a non-empty NextLink property, the client application needs to continue fetching the next page until all pages are returned. Here is an example:
PipelineListResponse response = client.Pipelines.List("ResourceGroupName", "DataFactoryName"); var pipelines = new List<Pipeline>(response.Pipelines); string nextLink = response.NextLink; while (string.IsNullOrEmpty(response.NextLink)) { PipelineListResponse nextResponse = client.Pipelines.ListNext(nextLink); pipelines.AddRange(nextResponse.Pipelines); nextLink = nextResponse.NextLink; } -
List pipeline API returns only the summary of a pipeline instead of full details. For instance, activities in a pipeline summary only contain name and type.
- The SqlDWSink class supports two new properties, SliceIdentifierColumnName and SqlWriterCleanupScript, to support idempotent copy to Azure SQL Data Warehouse. See the Azure SQL Data Warehouse article, specifically, the Mechanism 1 and Mechanism 2 sections, for details about these properties.
- We now support running stored procedure against Azure SQL Database and Azure SQL Data Warehouse sources as part of the Copy Activity. The SqlSource and SqlDWSource classes have the following properties: SqlReaderStoredProcedureName and StoredProcedureParameters. See the Azure SQL Database and Azure SQL Data Warehouse articles on Azure.com for details about these properties.