Skip to content

Latest commit

 

History

History
46 lines (28 loc) · 2.28 KB

data-lake-storage-introduction-abfs-uri.md

File metadata and controls

46 lines (28 loc) · 2.28 KB
title description services author ms.topic ms.author ms.date ms.service ms.component
Use the Azure Data Lake Storage Gen2 Preview URI
Use the Azure Data Lake Storage Gen2 Preview URI
storage
jamesbak
conceptual
jamesbak
12/06/2018
storage
data-lake-storage-gen2

Use the Azure Data Lake Storage Gen2 URI

The Hadoop Filesystem driver that is compatible with Azure Data Lake Storage Gen2 Preview is known by its scheme identifier abfs (Azure Blob File System). Consistent with other Hadoop Filesystem drivers, the ABFS driver employs a URI format to address files and directories within a Data Lake Storage Gen2 capable account.

URI syntax

The URI syntax for Data Lake Storage Gen2 is dependent on whether or not your storage account is set up to have Data Lake Storage Gen2 as the default file system.

If the Data Lake Storage Gen2 capable account you wish to address is not set as the default file system during account creation, then the shorthand URI syntax is:

abfs[s]1://<file_system>2@<account_name>3.dfs.core.windows.net/<path>4/<file_name>5

  1. Scheme identifier: The abfs protocol is used as the scheme identifier. You have the option to connect with or without a secure socket layer (SSL) connection. Use abfss to connect with a secure socket layer connection.

  2. File system: The parent location that holds the files and folders. This is the same as Containers in the Azure Storage Blobs service.

  3. Account name: The name given to your storage account during creation.

  4. Paths: A forward slash delimited (/) representation of the directory structure.

  5. File name: The name of the individual file. This parameter is optional if you are addressing a directory.

However, if the account you wish to address is set as the default file system during account creation, then the shorthand URI syntax is:

/<path>1/<file_name>2

  1. Path: A forward slash delimited (/) representation of the directory structure.

  2. File Name: The name of the individual file.

Next steps