Skip to content

Latest commit

 

History

History
107 lines (80 loc) · 9.11 KB

hdinsight-apps-install-applications.md

File metadata and controls

107 lines (80 loc) · 9.11 KB
title description services documentationcenter author manager editor tags ms.assetid ms.service ms.custom ms.devlang ms.topic ms.tgt_pltfrm ms.workload ms.date ms.author
Install third-party Hadoop applications on Azure HDInsight | Microsoft Docs
Learn how to install third-party Hadoop applications on Azure HDInsight.
hdinsight
mumian
jhubbard
cgronlun
azure-portal
eaf5904d-41e2-4a5f-8bec-9dde069039c2
hdinsight
hdinsightactive
na
article
na
big-data
11/06/2017
jgao

Install third-party Hadoop applications on Azure HDInsight

Learn how to install a third-party Hadoop application on Azure HDInsight. For instructions on installing your own application, see Install custom HDInsight applications.

An HDInsight application is an application that users can install on an HDInsight cluster. These applications can be developed by Microsoft, independent software vendors (ISV) or by yourself.

The follosing list shows the published applications:

  • AtScale Intelligence Platform turns your HDInsight cluster into a scale-out OLAP server. The application allows you to query billions of rows of data interactively using the BI tools from Microsoft Excel, PowerBI, Tableau Software to QlikView.
  • Cask CDAP for HDInsight provides the first unified integration platform for big data that cuts down the time to production for data applications and data lakes by 80%. This application only supports Standard HBase 3.4 clusters.
  • DATAIKU DDS on HDInsight allows data professionals to prototype, build, and deploy highly specific services that transform raw data into impactful business predictions.
  • Datameer: Datameer offers analysts an interactive way to discover, analyze, and visualize the results on Big Data. Pull in additional data sources easily to discover new relationships and get the answers you need quickly.
  • H2O Artificial Intelligence for HDInsight (Beta) H2O Sparkling Water supports the following distributed algorithms: GLM, Naïve Bayes, Distributed Random Forest, Gradient Boosting Machine, Deep Neural Networks, Deep learning, K-means, PCA, Generalized Low Rank Models, Anomaly Detection, and Autoencoders.
  • Kyligence Analytics Platform Kyligence Analytics Platform (KAP) is an enterprise-ready data warehouse powered by Apache Kylin and Apache Hadoop; it empowers sub-second query latency on massive scale dataset, and simplifies data analytics for business users and analysts.
  • Paxata Self-service Data Preparation
  • SnapLogic Hadooplex The SnapLogic Hadooplex running on HDInsight enables customers to get to business insights faster by providing self-service data ingestion and preparation from virtually any source to the Microsoft Azure cloud platform.
  • Spark Job Server for KNIME Spark Executor Spark Job Server for KNIME Spark Executor is used to connect the KNIME Analytics Platform to HDInsight clusters.
  • Streamsets Data Collector for HDnsight provides a full-featured integrated development environment (IDE) that lets you design, test, deploy, and manage any-to-any ingest pipelines that mesh stream and batch data, and include a variety of in-stream transformations—all without having to write custom code.
  • WANdisco Fusion HDI App enables continuous consistent connectivity to data as it changes wherever it is located. It provides you with access to your data anytime and anywhere with no downtime and no disruption.

The instructions provided in this article use Azure portal. You can also export the Azure Resource Manager template from the portal or obtain a copy of the Resource Manager template from vendors, and use Azure PowerShell and Azure CLI to deploy the template. See Create Hadoop clusters on HDInsight using Resource Manager templates.

Prerequisites

If you want to install HDInsight applications on an existing HDInsight cluster, you must have an HDInsight cluster. To create one, see Create clusters. You can also install HDInsight applications when you create an HDInsight cluster.

Install applications to existing clusters

The following procedure shows you how to install HDInsight applications to an existing HDInsight cluster.

To install an HDInsight application

  1. Sign in to the Azure portal.

  2. Click HDInsight Clusters in the left menu.

  3. Click an HDInsight cluster. If you don't have one, you must create one first. see Create clusters.

  4. Click Applications under the Configurations category. You can see a list of installed applications. If you cannot find Applications, that means there is no applications for this version of the HDInsight cluster.

    HDInsight applications portal menu

  5. Click Add from the menu.

    HDInsight applications installed apps

    You can see a list of existing HDInsight applications.

    HDInsight applications available applications

  6. Click one of the applications, accept the legal terms, and then click Select.

You can see the installation status from the portal notifications (click the bell icon on the top of the portal). After the application is installed, the application appears on the Installed Apps list.

Install applications during cluster creation

You have the option to install HDInsight applications when you create a cluster. During the process, HDInsight applications are installed after the cluster is created and is in the running state. To install applications during cluster creation using the Azure portal, you use the --Custom-- option instead of the default --Quick create-- option.

List installed HDInsight apps and properties

The portal shows a list of the installed HDInsight applications for a cluster, and the properties of each installed application.

To list HDInsight application and display properties

  1. Sign in to the Azure portal.

  2. Click HDInsight Clusters in the left menu.

  3. Click an HDInsight cluster.

  4. From Settings, click Applications under the General category. The Installed Apps are listed on the right.

    HDInsight applications installed apps

  5. Click one of the installed applications to show the property. The property lists:

    • App name: application name.
    • Status: application status.
    • Webpage: The URL of the web application that you have deployed to the edge node. The credential is the same as the HTTP user credentials that you have configured for the cluster.
    • HTTP endpoint: The credential is the same as the HTTP user credentials that you have configured for the cluster.
    • SSH endpoint: You can use SSH to connect to the edge node. The SSH credentials are the same as the SSH user credentials that you have configured for the cluster. For information, see Use SSH with HDInsight.

  6. To delete an application, right-click the application, and then click Delete from the context menu.

Connect to the edge node

You can connect to the edge node using HTTP and SSH. The endpoint information can be found from the portal. For information, see Use SSH with HDInsight.

The HTTP endpoint credentials are the HTTP user credentials that you have configured for the HDInsight cluster; the SSH endpoint credentials are the SSH credentials that you have configured for the HDInsight cluster.

Troubleshoot

See Troubleshoot the installation.

Next steps