Skip to content

Latest commit

 

History

History
209 lines (122 loc) · 9.06 KB

grafana.md

File metadata and controls

209 lines (122 loc) · 9.06 KB
title description services author ms.author ms.reviewer ms.service ms.topic ms.date
Visualize data from Azure Data Explorer in Grafana
In this how-to, you learn how to set up Azure Data Explorer as a data source for Grafana, and then visualize data from a sample cluster.
data-explorer
orspod
v-orspod
mblythe
data-explorer
conceptual
12/05/2018

Visualize data from Azure Data Explorer in Grafana

Grafana is an analytics platform that enables you to query and visualize data, then create and share dashboards based on your visualizations. Grafana provides an Azure Data Explorer plugin, which enables you to connect to and visualize data from Azure Data Explorer. In this article, you learn how to set up Azure Data Explorer as a data source for Grafana, and then visualize data from a sample cluster.

Prerequisites

You need the following to complete this how to:

Configure the data source

You perform the following steps to configure Azure Data Explorer as a data source for Grafana. We'll cover these steps in more detail in this section:

  1. Create an Azure Active Directory (Azure AD) service principal. The service principal is used by Grafana to access the Azure Data Explorer service.

  2. Add the Azure AD service principal to the viewers role in the Azure Data Explorer database.

  3. Specify Grafana connection properties based on information from the Azure AD service principal, then test the connection.

Create a service principal

You can create the service principal in the Azure portal or using the Azure CLI command-line experience. Regardless of which method you use, after creation you get values for four connection properties that you'll use in later steps.

Azure portal

  1. To create the service principal, follow the instructions in the Azure portal documentation.

    1. In the Assign the application to a role section, assign a role type of Reader to your Azure Data Explorer cluster.

    2. In the Get values for signing in section, copy the three property values covered in the steps: Directory ID (tenant ID), Application ID, and Password.

  2. In the Azure portal, select Subscriptions then copy the ID for the subscription in which you created the service principal.

    Subscription ID - portal

Azure CLI

  1. Create a service principal. Set an appropriate scope and a role type of reader.

    az ad sp create-for-rbac --name "https://{UrlToYourGrafana}:{PortNumber}" --role "reader" \
                         --scopes /subscriptions/{SubID}/resourceGroups/{ResourceGroupName}

    For more information, see Create an Azure service principal with Azure CLI.

  2. The command returns a result set like the following. Copy the three property values: appID, password, and tenant.

    {
  "appId": "XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX",
  "displayName": "{UrlToYourGrafana}:{PortNumber}",
  "name": "https://{UrlToYourGrafana}:{PortNumber}",
  "password": "XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX",
  "tenant": "XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX"
}

  3. Get a list of your subscriptions.

    az account list --output table

    Copy the appropriate subscription ID.

    Subscription ID - CLI

Add the service principal to the viewers role

Now that you have a service principal, you add it to the viewers role in the Azure Data Explorer database. You can perform this task under Permissions in the Azure portal, or under Query by using a management command.

Azure portal - Permissions

  1. In the Azure portal, go to your Azure Data Explorer cluster.

  2. In the Overview section, select the database with the StormEvents sample data.

    Select database

  3. Select Permissions then Add.

    Database permissions

  4. Under Add database permissions, select the Viewer role then Select principals.

    Add database permissions

  5. Search for the service principal you created (the example shows the principal mb-grafana). Select the principal, then Select.

    Manage permissions in the Azure portal

  6. Select Save.

    Manage permissions in the Azure portal

Management command - Query

  1. In the Azure portal, go to your Azure Data Explorer cluster, and select Query.

    Query

  2. Run the following command in the query window. Use the application ID and tenant ID from the Azure portal or CLI.

    .add database {TestDatabase} viewers ('aadapp={ApplicationID};{TenantID}')

    The command returns a result set like the following. In this example, the first row is for an existing user in the database, and the second row is for the service principal that was just added.

    Result set

Specify properties and test the connection

With the service principal assigned to the viewers role, you now specify properties in your instance of Grafana, and test the connection to Azure Data Explorer.

  1. In Grafana, on the left menu, select the gear icon then Data Sources.

    Data sources

  2. Select Add data source.

  3. On the Data Sources / New page, enter a name for the data source, then select the type Azure Data Explorer Datasource.

    Connection name and type

  4. Enter the name of your cluster in the form https://{ClusterName}.{Region}.kusto.windows.net. Enter the other values from the Azure portal or CLI. See the table below the following image for a mapping.

    Connection properties

    Grafana UI Azure portal Azure CLI
    Subscription Id SUBSCRIPTION ID SubscriptionId
    Tenant Id Directory ID tenant
    Client Id Application ID appId
    Client secret Password password

  5. Select Save & Test.

    If the test is successful, go to the next section. If you encounter any issues, check the values you specified in Grafana, and review previous steps.

Visualize data

Now you've finished configuring Azure Data Explorer as a data source for Grafana, it's time to visualize data. We'll show a basic example here, but there's a lot more you can do. We recommend looking at Write queries for Azure Data Explorer for examples of other queries to run against the sample data set.

  1. In Grafana, on the left menu, select the plus icon then Dashboard.

    Create dashboard

  2. Under the Add tab, select Graph.

    Add graph

  3. On the graph panel, select Panel Title then Edit.

    Edit panel

  4. At the bottom of the panel, select Data Source then select the data source that you configured.

    Select data source

  5. In the query pane, copy in the following query then select Run. The query buckets the count of events by day for the sample data set.

    StormEvents
| summarize event_count=count() by bin(StartTime, 1d)

    Run query

  6. The graph doesn't show any results because it's scoped by default to data from the last six hours. On the top menu, select Last 6 hours.

    Last six hours

  7. Specify a custom range that covers 2007, the year included in our StormEvents sample data set. Select Apply.

    Custom date range

    Now the graph shows the data from 2007, bucketed by day.

    Finished graph

  8. On the top menu, select the save icon: Save icon.

Next steps

Write queries for Azure Data Explorer

Tutorial: Visualize data from Azure Data Explorer in Power BI