71066-fix-validation-warnings-batch15

Author: jomolnar

articles/hdinsight/hdinsight-debug-tez-ui.md

@@ -22,15 +22,15 @@ ROBOTS: NOINDEX
 The Tez UI is a web page that can be used to understand and debug jobs that use Tez as the execution engine on Windows-based HDInsight clusters. The Tez UI allows you to visualize the job as a graph of connected items, drill into each item, and retrieve statistics and logging information.
 
 > [!IMPORTANT]
-> The steps in this document require an HDInsight cluster that uses Windows. Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-32-and-33-nearing-deprecation-date).
+> The steps in this document require an HDInsight cluster that uses Windows. Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-33-nearing-deprecation-date).
 
 ## Prerequisites
 * A Windows-based HDInsight cluster. For steps on creating a new cluster, see [Get started using Windows-based HDInsight](hdinsight-hadoop-tutorial-get-started-windows.md).
-  
+
   > [!IMPORTANT]
   > The Tez UI is only available on Windows-based HDInsight clusters created after February 8th, 2016.
-  > 
-  > 
+  >
+  >
 * A Windows-based Remote Desktop client.
 
 ## Understanding Tez
@@ -53,90 +53,89 @@ Use the following steps to run a Hive query that will execute using Tez.
 
 1. In a web browser, navigate to https://CLUSTERNAME.azurehdinsight.net, where **CLUSTERNAME** is the name of your HDInsight cluster.
 2. From the menu at the top of the page, select the **Hive Editor**. This will display a page with the following example query.
-   
+
         Select * from hivesampletable
-   
+
     Erase the example query and replace it with the following.
-   
+
         set hive.execution.engine=tez;
         select market, state, country from hivesampletable where deviceplatform='Android' group by market, country, state;
 3. Select the **Submit** button. The **Job Session** section at the bottom of the page will display the status of the query. Once the status changes to **Completed**, select the **View Details** link to view the results. The **Job Output** should be similar to the following:
-   
+
         en-GB   Hessen      Germany
         en-GB   Kingston    Jamaica
         en-GB   Nairobi Area    Kenya
 
 ## Use the Tez UI
 > [!NOTE]
 > The Tez UI is only available from the desktop of the cluster head nodes, so you must use Remote Desktop to connect to the head nodes.
-> 
-> 
+>
+>
 
 1. From the [Azure portal](https://portal.azure.com), select your HDInsight cluster. From the top of the HDInsight blade, select the **Remote Desktop** icon. This will display the remote desktop blade
-   
+
     ![Remote desktop icon](./media/hdinsight-debug-tez-ui/remotedesktopicon.png)
 2. From the Remote Desktop blade, select **Connect** to connect to the cluster head node. When prompted, use the cluster Remote Desktop user name and password to authenticate the connection.
-   
+
     ![Remote desktop connect icon](./media/hdinsight-debug-tez-ui/remotedesktopconnect.png)
-   
+
    > [!NOTE]
    > If you have not enabled Remote Desktop connectivity, provide a user name, password, and expiration date, then select **Enable** to enable Remote Desktop. Once it has been enabled, use the previous steps to connect.
-   > 
-   > 
+   >
+   >
 3. Once connected, open Internet Explorer on the remote desktop, select the gear icon in the upper right of the browser, and then select **Compatibility View Settings**.
 4. From the bottom of **Compatibility View Settings**, clear the check box for **Display intranet sites in Compatibility View** and **Use Microsoft compatibility lists**, and then select **Close**.
 5. In Internet Explorer, browse to http://headnodehost:8188/tezui/#/. This will display the Tez UI
-   
+
     ![Tez UI](./media/hdinsight-debug-tez-ui/tezui.png)
-   
+
     When the Tez UI loads, you will see a list of DAGs that are currently running, or have been ran on the cluster. The default view includes the Dag Name, Id, Submitter, Status, Start Time, End Time, Duration, Application ID, and Queue. More columns can be added using the gear icon at the right of the page.
-   
+
     If you have only one entry, it will be for the query that you ran in the previous section. If you have multiple entries, you can search by entering search criteria in the fields above the DAGs, then hit **Enter**.
 6. Select the **Dag Name** for the most recent DAG entry. This will display information about the DAG, as well as the option to download a zip of JSON files that contain information about the DAG.
-   
+
     ![DAG Details](./media/hdinsight-debug-tez-ui/dagdetails.png)
 7. Above the **DAG Details** are several links that can be used to display information about the DAG.
-   
+
    * **DAG Counters** displays counters information for this DAG.
    * **Graphical View** displays a graphical representation of this DAG.
    * **All Vertices** displays a list of the vertices in this DAG.
    * **All Tasks** displays a list of the tasks for all vertices in this DAG.
    * **All TaskAttempts** displays information about the attempts to run tasks for this DAG.
-     
+
      > [!NOTE]
      > If you scroll the column display for Vertices, Tasks and TaskAttempts, notice that there are links to view **counters** and **view or download logs** for each row.
-     > 
-     > 
-     
+     >
+     >
+
      If there was a failure with the job, the DAG Details will display a status of FAILED, along with links to information about the failed task. Diagnostics information will be displayed beneath the DAG details.
 8. Select **Graphical View**. This displays a graphical representation of the DAG. You can place the mouse over each vertex in the view to display information about it.
-   
+
     ![Graphical view](./media/hdinsight-debug-tez-ui/dagdiagram.png)
 9. Clicking on a vertex will load the **Vertex Details** for that item. Click on the **Map 1** vertex to display details for this item. Select **Confirm** to confirm the navigation.
-   
+
     ![Vertex details](./media/hdinsight-debug-tez-ui/vertexdetails.png)
 10. Note that you now have links at the top of the page that are related to vertices and tasks.
-    
+
     > [!NOTE]
     > You can also arrive at this page by going back to **DAG Details**, selecting **Vertex Details**, and then selecting the **Map 1** vertex.
-    > 
-    > 
-    
+    >
+    >
+
     * **Vertex Counters** displays counter information for this vertex.
     * **Tasks** displays tasks for this vertex.
     * **Task Attempts** displays information about attempts to run tasks for this vertex.
     * **Sources & Sinks** displays data sources and sinks for this vertex.
-      
+
       > [!NOTE]
       > As with the previous menu, you can scroll the column display for Tasks, Task Attempts, and Sources & Sinks__ to display links to more information for each item.
-      > 
-      > 
+      >
+      >
 11. Select **Tasks**, and then select the item named **00_000000**. This will display **Task Details** for this task. From this screen, you can view **Task Counters** and **Task Attempts**.
-    
+
     ![Task details](./media/hdinsight-debug-tez-ui/taskdetails.png)
 
 ## Next Steps
 Now that you have learned how to use the Tez view, learn more about [Using Hive on HDInsight](hdinsight-use-hive.md).
 
 For more detailed technical information on Tez, see the [Tez page at Hortonworks](http://hortonworks.com/hadoop/tez/).
-

articles/hdinsight/hdinsight-hadoop-access-yarn-app-logs-linux.md

@@ -23,7 +23,7 @@ ms.author: larryfr
 This document explains how to access the logs for YARN (Yet Another Resource Negotiator) applications that have finished on a Hadoop cluster in Azure HDInsight.
 
 > [!IMPORTANT]
-> The steps in this document require an HDInsight cluster that uses Linux. Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-32-and-33-nearing-deprecation-date).
+> The steps in this document require an HDInsight cluster that uses Linux. Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-33-nearing-deprecation-date).
 
 ## Prerequisites
 * A Linux-based HDInsight cluster.
@@ -54,7 +54,7 @@ Application logs (and the associated container logs) are critical in debugging p
 
 In that location, *user* is the name of the user who started the application, and *applicationId* is the unique identifier of an application as assigned by the YARN RM.
 
-The aggregated logs are not directly readable, as they are written in a [TFile][T-file], [binary format][binary-format] indexed by container. You must use the YARN ResourceManager logs or CLI tools to view these logs as plain text for applications or containers of interest. 
+The aggregated logs are not directly readable, as they are written in a [TFile][T-file], [binary format][binary-format] indexed by container. You must use the YARN ResourceManager logs or CLI tools to view these logs as plain text for applications or containers of interest.
 
 ## YARN CLI tools
 
@@ -74,12 +74,12 @@ Once you have created an SSH tunnel, use the following steps to view the YARN lo
 
 1. In your web browser, navigate to https://CLUSTERNAME.azurehdinsight.net. Replace CLUSTERNAME with the name of your HDInsight cluster.
 2. From the list of services on the left, select **YARN**.
-   
+
     ![Yarn service selected](./media/hdinsight-hadoop-access-yarn-app-logs-linux/yarnservice.png)
 3. From the **Quick Links** dropdown, select one of the cluster head nodes and then select **ResourceManager Log**.
-   
+
     ![Yarn quick links](./media/hdinsight-hadoop-access-yarn-app-logs-linux/yarnquicklinks.png)
-   
+
     You are presented with a list of links to YARN logs.
 
 [YARN-timeline-server]:http://hadoop.apache.org/docs/r2.4.0/hadoop-yarn/hadoop-yarn-site/TimelineServer.html

articles/hdinsight/hdinsight-hadoop-access-yarn-app-logs.md

@@ -23,8 +23,8 @@ ROBOTS: NOINDEX
 This topic explains how to access the logs for YARN (Yet Another Resource Negotiator) applications that have finished on a Windows-based Hadoop cluster in Azure HDInsight
 
 > [!IMPORTANT]
-> The information in this document applies only to Windows-based HDInsight clusters. Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-32-and-33-nearing-deprecation-date). For information on accessing YARN logs on Linux-based HDInsight clusters, see [Access YARN application logs on Linux-based Hadoop on HDInsight](hdinsight-hadoop-access-yarn-app-logs-linux.md)
-> 
+> The information in this document applies only to Windows-based HDInsight clusters. Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-33-nearing-deprecation-date). For information on accessing YARN logs on Linux-based HDInsight clusters, see [Access YARN application logs on Linux-based Hadoop on HDInsight](hdinsight-hadoop-access-yarn-app-logs-linux.md)
+>
 
 
 ### Prerequisites
@@ -66,9 +66,9 @@ The aggregated logs are not directly readable, as they are written in a [TFile][
 
 
 ## YARN ResourceManager UI
-The YARN ResourceManager UI runs on the cluster headnode, and can be accessed through the Azure portal dashboard: 
+The YARN ResourceManager UI runs on the cluster headnode, and can be accessed through the Azure portal dashboard:
 
-1. Sign in to [Azure portal](https://portal.azure.com/). 
+1. Sign in to [Azure portal](https://portal.azure.com/).
 2. On the left menu, click **Browse**, click **HDInsight Clusters**, click a Windows-based cluster that you want to access the YARN application logs.
 3. On the top menu, click **Dashboard**. You will see a page opened on a new browser tab called **HDInsight Query Console**.
 4. From **HDInsight Query Console**, click **Yarn UI**.

articles/hdinsight/hdinsight-hadoop-add-hive-libraries.md

@@ -43,7 +43,7 @@ For **Linux-based clusters**: [https://hdiconfigactions.blob.core.windows.net/li
 For **Windows-based clusters**: [https://hdiconfigactions.blob.core.windows.net/setupcustomhivelibsv01/setup-customhivelibs-v01.ps1](https://hdiconfigactions.blob.core.windows.net/setupcustomhivelibsv01/setup-customhivelibs-v01.ps1)
 
 > [!IMPORTANT]
-> Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-32-and-33-nearing-deprecation-date).
+> Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-33-nearing-deprecation-date).
 
 **Requirements**
 

articles/hdinsight/hdinsight-hadoop-collect-debug-heap-dump-linux.md

@@ -27,7 +27,7 @@ Heap dumps contain a snapshot of the application's memory, including the values
 
 
 > [!IMPORTANT]
-> The steps in this document only work with HDInsight clusters that use Linux. Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-32-and-33-nearing-deprecation-date).
+> The steps in this document only work with HDInsight clusters that use Linux. Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-33-nearing-deprecation-date).
 
 ## <a name="whichServices"></a>Services
 You can enable heap dumps for the following services:

articles/hdinsight/hdinsight-hadoop-collect-debug-heap-dumps.md

@@ -22,19 +22,19 @@ ROBOTS: NOINDEX
 # Collect heap dumps in Blob storage to debug and analyze Hadoop services
 [!INCLUDE [heapdump-selector](../../includes/hdinsight-selector-heap-dump.md)]
 
-Heap dumps contain a snapshot of the application's memory, including the values of variables 
-at the time the dump was created. So they are very useful for diagnosing problems that occur 
-at run-time. Heap dumps can be automatically collected for Hadoop services and placed inside 
-the Azure Blob storage account of a user under HDInsightHeapDumps/. 
-
-The collection of heap dumps for various services must be enabled for services on individual 
-clusters. The default for this feature is to be off for a cluster. These heap dumps can be 
-large, so it is advisable to monitor the Blob storage account where they are being saved 
+Heap dumps contain a snapshot of the application's memory, including the values of variables
+at the time the dump was created. So they are very useful for diagnosing problems that occur
+at run-time. Heap dumps can be automatically collected for Hadoop services and placed inside
+the Azure Blob storage account of a user under HDInsightHeapDumps/.
+
+The collection of heap dumps for various services must be enabled for services on individual
+clusters. The default for this feature is to be off for a cluster. These heap dumps can be
+large, so it is advisable to monitor the Blob storage account where they are being saved
 once the collection has been enabled.
 
 > [!IMPORTANT]
-> Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-32-and-33-nearing-deprecation-date). The information in this article only applies to Windows-based HDInsight. 
-> For information on Linux-based HDInsight, see [Enable heap dumps for Hadoop services on 
+> Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-33-nearing-deprecation-date). The information in this article only applies to Windows-based HDInsight. 
+> For information on Linux-based HDInsight, see [Enable heap dumps for Hadoop services on
 > Linux-based HDInsight](hdinsight-hadoop-collect-debug-heap-dump-linux.md)
 
 
@@ -48,13 +48,13 @@ You can enable heap dumps for the following services:
 * **hdfs** - datanode, secondarynamenode, namenode
 
 ## Configuration elements that enable heap dumps
-To turn on heap dumps for a service, you need to set the appropriate configuration elements 
+To turn on heap dumps for a service, you need to set the appropriate configuration elements
 in the section for that service, which is specified by **service_name**.
 
     "javaargs.<service_name>.XX:+HeapDumpOnOutOfMemoryError" = "-XX:+HeapDumpOnOutOfMemoryError",
     "javaargs.<service_name>.XX:HeapDumpPath" = "-XX:HeapDumpPath=c:\Dumps\<service_name>_%date:~4,2%%date:~7,2%%date:~10,2%%time:~0,2%%time:~3,2%%time:~6,2%.hprof"
 
-The value of **service_name** can be any of the services listed above: 
+The value of **service_name** can be any of the services listed above:
 tempelton, hiveserver2, metastore, derbyserver, jobhistoryserver, resourcemanager, nodemanager, timelineserver, datanode, secondarynamenode, or namenode.
 
 ## Enable using Azure PowerShell

articles/hdinsight/hdinsight-hadoop-create-linux-clusters-azure-cli.md

@@ -26,7 +26,7 @@ ms.author: larryfr
 The steps in this document walk-through creating a HDInsight 3.5 cluster using the Azure CLI 1.0.
 
 > [!IMPORTANT]
-> Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight 3.2 and 3.3 deprecation](hdinsight-component-versioning.md#hdi-version-32-and-33-nearing-deprecation-date).
+> Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight 3.2 and 3.3 deprecation](hdinsight-component-versioning.md#hdi-version-33-nearing-deprecation-date).
 
 
 ## Prerequisites
@@ -144,4 +144,3 @@ Now that you have successfully created an HDInsight cluster using the Azure CLI,
 * [Develop Java topologies for Storm on HDInsight](hdinsight-storm-develop-java-topology.md)
 * [Use Python components in Storm on HDInsight](hdinsight-storm-develop-python-topology.md)
 * [Deploy and monitor topologies with Storm on HDInsight](hdinsight-storm-deploy-monitor-topology-linux.md)
-

articles/hdinsight/hdinsight-hadoop-create-linux-clusters-curl-rest.md

@@ -28,7 +28,7 @@ Learn how to create an HDInsight cluster using an Azure Resource Manager templat
 The Azure REST API allows you to perform management operations on services hosted in the Azure platform, including the creation of new resources such as HDInsight clusters.
 
 > [!IMPORTANT]
-> Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-32-and-33-nearing-deprecation-date).
+> Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-33-nearing-deprecation-date).
 
 ## Prerequisites
 

articles/hdinsight/hdinsight-hadoop-customize-cluster-linux.md

@@ -26,7 +26,7 @@ HDInsight provides a configuration option called **Script Action** that invokes
 > [!IMPORTANT]
 > The ability to use script actions on an already running cluster is only available for Linux-based HDInsight clusters.
 >
-> Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-32-and-33-nearing-deprecation-date).
+> Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight Deprecation on Windows](hdinsight-component-versioning.md#hdi-version-33-nearing-deprecation-date).
 
 
 Script actions can also be published to the Azure Marketplace as an HDInsight application. Some of the examples in this document show how you can install an HDInsight application using script action commands from PowerShell and the .NET SDK. For more information on HDInsight applications, see [Publish HDInsight applications into the Azure Marketplace](hdinsight-apps-publish-applications.md).