| title | description | services | documentationcenter | author | manager | editor | ms.assetid | ms.service | ms.workload | ms.tgt_pltfrm | ms.devlang | ms.topic | ms.date | ms.author |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Moving large amounts of data to/from cloud storage in Azure | Microsoft Docs |
An overview of the different methods for moving data to and from Azure Storage. |
storage |
JarrettRenshaw |
msmets |
tysonn |
5e3947a9-d99b-4108-9d57-3eb67c03e7ba |
storage |
storage |
na |
na |
article |
01/30/2017 |
jarrettr |
If you want to move on-premises data to Azure Storage (or vice versa), there are a variety of ways to do this. The approach that works best for you will depend on your scenario. This article will provide a quick overview of different scenarios and appropriate offerings for each one.
If you're building an application, developing against the REST API or one of our many client libraries is a great way to move data to and from Azure Storage.
Azure Storage provides rich client libraries for .NET, iOS, Java, Android, Universal Windows Platform (UWP), Xamarin, C++, Node.JS, PHP, Ruby, and Python. The client libraries offer advanced capabilities such as retry logic, logging, and parallel uploads. You can also develop directly against the REST API, which can be called by any language that makes HTTP/HTTPS requests.
See Get Started with Azure Blob Storage to learn more.
In addition, we also offer the Azure Storage Data Movement Library which is a library designed for high-performance copying of data to and from Azure. Please refer to our Data Movement Library documentation to learn more.
If you want an easy way to view your Azure Storage data while also having the ability to upload and download your data, then consider using an Azure Storage Explorer.
Check out our list of Azure Storage Explorers to learn more.
If you require or are more comfortable with a command-line utility (e.g. System Administrators), here are a few options for you to consider:
AzCopy is a Windows command-line utility designed for high-performance copying of data to and from Azure Storage. You can also copy data within a storage account, or between different storage accounts.
See Transfer data with the AzCopy Command-Line Utility to learn more.
Azure PowerShell is a module that provides cmdlets for managing services on Azure. It's a task-based command-line shell and scripting language designed especially for system administration.
See Using Azure PowerShell with Azure Storage to learn more.
Azure CLI provides a set of open source, cross-platform commands for working with Azure services. Azure CLI is available on Windows, OSX, and Linux.
See Using the Azure CLI with Azure Storage to learn more.
One of the biggest challenges associated with moving large amounts of data is the transfer time. If you want to get data to/from Azure Storage without worrying about networks costs or writing code, then Azure Import/Export is an appropriate solution.
See Azure Import/Export to learn more.
If you simply need to backup your data to Azure Storage, Azure Backup is the way to go. This is a powerful solution for backing up on-premises data and Azure VMs.
See Azure Backup to learn more.
If you need a solution for accessing your data on-premises and from the cloud, then you should consider using Azure's hybrid cloud storage solution, StorSimple. This solution consists of a physical StorSimple device that intelligently stores frequently used data on SSDs, occasionally used data on HDDs, and inactive/backup/archival data on Azure Storage.
See StorSimple to learn more.
When you have on-premises workloads and applications, you'll need a solution that allows your business to continue running in the event of a disaster. Azure Site Recovery handles replication, failover, and recovery of virtual machines and physical servers. Replicated data is stored in Azure Storage, allowing you to eliminate the need for a secondary on-site datacenter.
See Azure Site Recovery to learn more.
The only way to copy VHDs between region is to copy the data between storage accounts on each region. You can use AZCopy for this. See Transfer data with the AzCopy Command-Line Utility to learn more. For very large amounts of data, you can also Azure Import/Export. See Azure Import/Export to learn more.