Skip to content

Files

Latest commit

mumianmumian
fix acronym
Nov 17, 2017
008b1a9 · Nov 17, 2017

History

History
64 lines (45 loc) · 3.22 KB

hdinsight-hadoop-oms-log-analytics-tutorial.md

File metadata and controls

64 lines (45 loc) · 3.22 KB
title description services documentationcenter author manager editor tags ms.service ms.custom ms.workload ms.tgt_pltfrm ms.devlang ms.topic ms.date ms.author
Use Log Analytics to monitor Azure HDInsight clusters | Microsoft Docs
Learn how to use Azure Log Analytics to monitor jobs running in an HDInsight cluster.
hdinsight
nitinme
jhubbard
cgronlun
azure-portal
hdinsight
hdinsightactive
big-data
na
na
article
11/17/2017
nitinme

Use Azure Log Analytics to monitor HDInsight clusters

Learn how to use Azure Log Analytics to monitor Hadoop cluster operations in HDInsight.

Log Analytics is a service in Operations Management Suite (OMS) that monitors your cloud and on-premises environments to maintain their availability and performance. It collects data generated by resources in your cloud and on-premises environments and from other monitoring tools to provide analysis across multiple sources.

Prerequisites

  • An Azure subscription. Before you begin this tutorial, you must have an Azure subscription. See Create your free Azure account today.

  • An Azure HDInsight cluster. Currently, you can use Azure Operations Management Suite with the following HDInsight cluster types:

    • Hadoop
    • HBase
    • Interactive Query
    • Kafka
    • Spark
    • Storm

    For the instructions on how to create an HDInsight cluster, see Get started with Azure HDInsight.

  • A Log Analytics workspace. You can think of this workspace as a unique Log Analytics environment with its own data repository, data sources, and solutions. You must have one such workspace already created that you can associate with Azure HDInsight clusters. For instructions, see Create a Log Analytics workspace.

Configure HDInsight cluster to use Log Analytics

In this section, you configure an existing HDInsight Hadoop cluster to use an Azure Log Analytics workspace to monitor jobs, debug logs, etc.

  1. Open an HDInsight cluster in the Azure portal.

  2. In the left pane, click Monitoring.

  3. In the right pane, click Enable, select an existing Log Analytics workspace, and then click Save.

    Enable monitoring for HDInsight clusters

    It takes a few moments to save the setting. Once it is done, you can see an Open OMS Dashboard button on the top.

    Open Operations Management Suite dashboard

  4. Click Open OMS dashboard.

  5. Enter your Azure credentials if prompted.

    Operations Management Suite portal

Next steps