Skip to content

Latest commit

 

History

History
65 lines (50 loc) · 5.34 KB

log-analytics-data-sources.md

File metadata and controls

65 lines (50 loc) · 5.34 KB
title description services documentationcenter author manager editor ms.assetid ms.service ms.devlang ms.topic ms.tgt_pltfrm ms.workload ms.date ms.author
Configure data sources in OMS Log Analytics | Microsoft Docs
Data sources define the data that Log Analytics collects from agents and other connected sources. This article describes the concept of how Log Analytics uses data sources, explains the details of how to configure them, and provides a summary of the different data sources available.
log-analytics
bwren
carmonm
tysonn
67710115-c861-40f8-a377-57c7fa6909b4
log-analytics
na
article
na
infrastructure-services
05/23/2017
bwren

Data sources in Log Analytics

Log Analytics collects data from the Connected Sources in your OMS workspace and stores it in OMS repository. The data that is collected from each is defined by the Data Sources that you configure. Data in the OMS repository is stored as a set of records. Each data source creates records of a particular type with each type having its own set of properties.

Log Analytics data collection

Data Sources are different than OMS Solutions which also collect data from Connected Sources and create records in the OMS repository. Solutions can be added to your workspace from the Solutions Gallery and will typically provide additional analysis tools in the OMS portal.

Summary of data sources

The data sources that are currently available in Log Analytics are listed in the following table. Each has a link to a separate article providing detail for that data source.

Data Source Event Type Description
Custom logs <LogName>_CL Text files on Windows or Linux agents containing log information.
Windows Event logs Event Events collected from the event log on Windows computers.
Windows Performance counters Perf Performance counters collected from Windows computers.
Linux Performance counters Perf Performance counters collected from Linux computers.
IIS logs W3CIISLog Internet Information Services logs in W3C format.
Syslog Syslog Syslog events on Windows or Linux computers.

Configuring data sources

You configure data sources from the Data menu in Log Analytics Settings. Any configuration is delivered to all connected sources in your OMS workspace. You cannot currently exclude any agents from this configuration.

Configure Windows events

  1. In the OMS console click the Settings tile or the Settings button at the top of the screen.
  2. Select Data.
  3. Click on the data source to configure.
  4. Follow the link to the documentation for each data source in the above table for details on their configuration.

Note

You cannot currently configure Log Analytics data sources in the Azure portal.

Data collection

Data source configurations are delivered to agents that are directly connected to Log Analytics within a few minutes. The specified data is collected from the agent and delivered directly to Log Analytics at intervals specific to each data source. See the documentation for each data source for these specifics.

For System Center Operations Manager (SCOM) agents in a connected management group, data source configurations are translated into management packs and delivered to the management group every 5 minutes by default. The agent downloads the management pack like any other and collects the specified data. Depending on the data source the data will be either sent to a management server which forwards the data to the Log Analytics, or the agent will send the data to Log Analytics without going through the management server. Refer to data collection details for OMS features and solutions for details. You can read about details of connecting SCOM and OMS and modifying the frequency that configuration is delivered at Configure Integration with System Center Operations Manager.

If the agent is unable to connect to Log Analytics or Operations Manager, it will continue to collect data that it will deliver when it establishes a connection. Data can be lost if the amount of data reaches the maximum cache size for the client, or if the agent is not able to establish a connection within 24 hours.

Log Analytics records

All data collected by Log Analytics is stored in the OMS repository as records. Records collected by different data sources will have their own set of properties and be identified by their Type property. See the documentation for each data source and solution for details on each record type.

Next Steps

  • Learn about solutions that add functionality to Log Analytics and also collect data into the OMS repository.
  • Learn about log searches to analyze the data collected from data sources and solutions.
  • Configure alerts to proactively notify you of critical data collected from data sources and solutions.