move hbase files

Author: mumian

articles/hdinsight/hadoop/apache-hadoop-introduction.md

@@ -0,0 +1,82 @@
+---
+title: What is HBase in Azure HDInsight? | Microsoft Docs
+description: An introduction to Apache HBase in HDInsight, a NoSQL database build on Hadoop. Learn about use cases and compare HBase to other Hadoop clusters.
+keywords: bigtable,nosql,what is hbase,apache hbase,hbase,habase overview,
+services: hdinsight
+documentationcenter: ''
+tags: azure-portal
+author: mumian
+manager: jhubbard
+editor: cgronlun
+
+ms.assetid: d2a76d53-133a-4849-a30c-88d9c794391c
+ms.service: hdinsight
+ms.custom: hdinsightactive,hdiseo17may2017
+ms.workload: big-data
+ms.tgt_pltfrm: na
+ms.devlang: na
+ms.topic: get-started-article
+ms.date: 07/17/2017
+ms.author: jgao
+
+---
+# What is HBase in HDInsight: A NoSQL database that provides BigTable-like capabilities for Hadoop
+Apache HBase is an open-source, NoSQL database that is built on Hadoop and modeled after Google BigTable. HBase provides random access and strong consistency for large amounts of unstructured and semistructured data in a schemaless database organized by column families.
+
+Data is stored in the rows of a table, and data within a row is grouped by column family. HBase is a schemaless database in the sense that neither the columns nor the type of data stored in them need to be defined before using them. The open-source code scales linearly to handle petabytes of data on thousands of nodes. It can rely on data redundancy, batch processing, and other features that are provided by distributed applications in the Hadoop ecosystem.
+
+## How is HBase implemented in Azure HDInsight?
+HDInsight HBase is offered as a managed cluster that is integrated into the Azure environment. The clusters are configured to store data directly in [Azure Storage](./../hdinsight-hadoop-use-blob-storage.md) or [Azure Data Lake Store](./../hdinsight-hadoop-use-data-lake-store.md), which provides low latency and increased elasticity in performance and cost choices. This enables customers to build interactive websites that work with large datasets, to build services that store sensor and telemetry data from millions of end points, and to analyze this data with Hadoop jobs. HBase and Hadoop are good starting points for big data project in Azure; in particular, they can enable real-time applications to work with large datasets.
+
+The HDInsight implementation leverages the scale-out architecture of HBase to provide automatic sharding of tables, strong consistency for reads and writes, and automatic failover. Performance is enhanced by in-memory caching for reads and high-throughput streaming for writes. HBase cluster can be created inside virtual network. For details, see  [Create HDInsight clusters on Azure Virtual Network][hbase-provision-vnet].
+
+## How is data managed in HDInsight HBase?
+Data can be managed in HBase by using the `create`, `get`, `put`, and `scan` commands from the HBase shell. Data is written to the database by using `put` and read by using `get`. The `scan` command is used to obtain data from multiple rows in a table. Data can also be managed using the HBase C# API, which provides a client library on top of the HBase REST API. An HBase database can also be queried by using Hive. For an introduction to these programming models, see [Get started using HBase with Hadoop in HDInsight][hbase-get-started]. Co-processors are also available, which allow data processing in the nodes that host the database.
+
+> [!NOTE]
+> Thrift is not supported by HBase in HDInsight.
+>
+
+## Scenarios: Use cases for HBase
+The canonical use case for which BigTable (and by extension, HBase) was created was web search. Search engines build indexes that map terms to the web pages that contain them. But there are many other use cases that HBase is suitable for—several of which are itemized in this section.
+
+* Key-value store
+  
+    HBase can be used as a key-value store, and it is suitable for managing message systems. Facebook uses HBase for their messaging system, and it is ideal for storing and managing Internet communications. WebTable uses HBase to search for and manage tables that are extracted from webpages.
+* Sensor data
+  
+    HBase is useful for capturing data that is collected incrementally from various sources. This includes social analytics, time series, keeping interactive dashboards up-to-date with trends and counters, and managing audit log systems. Examples include Bloomberg trader terminal and the Open Time Series Database (OpenTSDB), which stores and provides access to metrics collected about the health of server systems.
+* Real-time query
+  
+    [Phoenix](http://phoenix.apache.org/) is a SQL query engine for Apache HBase. It is accessed as a JDBC driver, and it enables querying and managing HBase tables by using SQL.
+* HBase as a platform
+  
+    Applications can run on top of HBase by using it as a datastore. Examples include Phoenix, OpenTSDB, Kiji, and Titan. Applications can also integrate with HBase. Examples include Hive, Pig, Solr, Storm, Flume, Impala, Spark, Ganglia, and Drill.
+
+## <a name="next-steps"></a>Next steps
+* [Get started using HBase with Hadoop in HDInsight][hbase-get-started]
+* [Create HDInsight clusters on Azure Virtual Network][hbase-provision-vnet]
+* [Configure HBase replication in HDInsight](apache-hbase-replication.md)
+* [Use Maven to build Java applications that use HBase with HDInsight (Hadoop)][hbase-build-java-maven]
+
+## <a name="see-also"></a>See also
+* [Apache HBase](https://hbase.apache.org/)
+* [Bigtable: A Distributed Storage System for Structured Data](http://research.google.com/archive/bigtable.html)
+
+[hbase-provision-vnet]:apache-hbase-provision-vnet.md
+
+[hbase-build-java-maven]: hdinsight-hbase-build-java-maven.md
+
+[hdinsight-use-hive]:../hdinsight-use-hive.md
+
+[hdinsight-storage]: ../../hdinsight-hadoop-use-blob-storage.md
+
+[hbase-get-started]: http://azure.microsoft.com/documentation/articles/hdinsight-hbase-get-started/
+
+[azure-purchase-options]: http://azure.microsoft.com/pricing/purchase-options/
+[azure-member-offers]: http://azure.microsoft.com/pricing/member-offers/
+[azure-free-trial]: http://azure.microsoft.com/pricing/free-trial/
+[azure-management-portal]: https://portal.azure.com/
+[azure-create-storageaccount]:../../storage/common/storage-create-storage-account.md
+
+[apache-hadoop]: http://hadoop.apache.org/

articles/hdinsight/hadoop/hdinsight-use-hive.md

@@ -0,0 +1,91 @@
+---
+title: Use Apache Phoenix and SQLLine with HBase in Azure HDInsight | Microsoft Docs
+description: Learn how to use Apache Phoenix in HDInsight. Also, learn how to install and set up SQLLine on your computer to connect to an HBase cluster in HDInsight.
+services: hdinsight
+documentationcenter: ''
+author: mumian
+manager: jhubbard
+editor: cgronlun
+
+ms.assetid: cda0f33b-a2e8-494c-972f-ae0bb482b818
+ms.service: hdinsight
+ms.custom: hdinsightactive
+ms.devlang: na
+ms.topic: article
+ms.tgt_pltfrm: na
+ms.workload: big-data
+ms.date: 09/22/2017
+ms.author: jgao
+
+---
+# Use Apache Phoenix with Linux-based HBase clusters in HDInsight
+Learn how to use [Apache Phoenix](http://phoenix.apache.org/) in Azure HDInsight, and how to use SQLLine. For more information about Phoenix, see [Phoenix in 15 minutes or less](http://phoenix.apache.org/Phoenix-in-15-minutes-or-less.html). For the Phoenix grammar, see [Phoenix grammar](http://phoenix.apache.org/language/index.html).
+
+> [!NOTE]
+> For Phoenix version information about HDInsight, see [What's new in the Hadoop cluster versions provided by HDInsight](../hdinsight-component-versioning.md).
+>
+>
+
+## Use SQLLine
+[SQLLine](http://sqlline.sourceforge.net/) is a command-line utility to execute SQL.
+
+### Prerequisites
+Before you can use SQLLine, you must have the following items:
+
+* **An HBase cluster in HDInsight**. To create one, see [Get started with Apache HBase in HDInsight](./apache-hbase-tutorial-get-started.md).
+
+When you connect to an HBase cluster, you need to connect to one of the ZooKeeper VMs. Each HDInsight cluster has three ZooKeeper VMs.
+
+**To get the ZooKeeper host name**
+
+1. Open Ambari by browsing to **https://\<cluster name\>.azurehdinsight.net**.
+2. To sign in, enter the HTTP (cluster) user name and password.
+3. In the left menu, select **ZooKeeper**. Three **ZooKeeper Server** instances are listed.
+4. Select one of the **ZooKeeper Server** instances. On the **Summary** pane, find the **Hostname**. It looks similar to *zk1-jdolehb.3lnng4rcvp5uzokyktxs4a5dhd.bx.internal.cloudapp.net*.
+
+**To use SQLLine**
+
+1. Connect to the cluster by using SSH. For more information, see [Use SSH with HDInsight](../hdinsight-hadoop-linux-use-ssh-unix.md).
+
+2. In SSH, use the following commands to run SQLLine:
+
+        cd /usr/hdp/2.2.9.1-7/phoenix/bin
+        ./sqlline.py <ZOOKEEPER SERVER FQDN>:2181:/hbase-unsecure
+3. To create an HBase table, and insert some data, run the following commands:
+
+        CREATE TABLE Company (COMPANY_ID INTEGER PRIMARY KEY, NAME VARCHAR(225));
+
+        !tables
+
+        UPSERT INTO Company VALUES(1, 'Microsoft');
+
+        SELECT * FROM Company;
+
+        !quit
+
+For more information, see the [SQLLine manual](http://sqlline.sourceforge.net/#manual) and [Phoenix grammar](http://phoenix.apache.org/language/index.html).
+
+## Next steps
+In this article, you learned how to use Apache Phoenix in HDInsight. To learn more, see these articles:
+
+* [HDInsight HBase overview][hdinsight-hbase-overview].
+  HBase is an Apache, open-source, NoSQL database built on Hadoop that provides random access and strong consistency for large amounts of unstructured and semistructured data.
+* [Provision HBase clusters on Azure Virtual Network][hdinsight-hbase-provision-vnet].
+  With virtual network integration, HBase clusters can be deployed to the same virtual network as your applications, so applications can communicate directly with HBase.
+* [Configure HBase replication in HDInsight](apache-hbase-replication.md). Learn how to set up HBase replication across two Azure datacenters.
+
+
+[azure-portal]: https://portal.azure.com
+[vnet-point-to-site-connectivity]: https://msdn.microsoft.com/library/azure/09926218-92ab-4f43-aa99-83ab4d355555#BKMK_VNETPT
+
+[hdinsight-manage-portal]: hdinsight-administer-use-management-portal.md#connect-to-clusters-using-rdp
+[hdinsight-hbase-provision-vnet]:apache-hbase-provision-vnet.md
+[hdinsight-hbase-overview]:apache-hbase-overview.md
+
+[hdinsight-hbase-phoenix-sqlline]: ./media/hdinsight-hbase-phoenix-squirrel/hdinsight-hbase-phoenix-sqlline.png
+[img-certificate]: ./media/hdinsight-hbase-phoenix-squirrel/hdinsight-hbase-vpn-certificate.png
+[img-vnet-diagram]: ./media/hdinsight-hbase-phoenix-squirrel/hdinsight-hbase-vnet-point-to-site.png
+[img-squirrel-driver]: ./media/hdinsight-hbase-phoenix-squirrel/hdinsight-hbase-squirrel-driver.png
+[img-squirrel-alias]: ./media/hdinsight-hbase-phoenix-squirrel/hdinsight-hbase-squirrel-alias.png
+[img-squirrel]: ./media/hdinsight-hbase-phoenix-squirrel/hdinsight-hbase-squirrel.png
+[img-squirrel-sql]: ./media/hdinsight-hbase-phoenix-squirrel/hdinsight-hbase-squirrel-sql.png