By default, XpoLog applies an automated pattern to parse the logs, when you click the Save button on the first page of the Add Log wizard.
However, for certain log types (local, Windows Network, Over SSH, and Hadoop HDFS), XpoLog enables you to tune the log and parse it more deeply to normalize the log records into tabular format, by applying patterns on the incoming log data.
This can be performed from the Patterns Administration page, accessed by clicking the Next button on the first page of the Add Log wizard or Edit Log wizard.
The Patterns Administration page is divided into three sections, as follows:
- Upper pane – Text sample from the selected log. This pane presents the first 20 records from the incoming log (original data). You can copy paste other records from the incoming log data into this section, and then view the results of applying a pattern on those records (see ). click the Verify link to see the results of applying a pattern on these records. You can also refresh the display to again show the first 20 records, by clicking the Reset link.
- Central pane – Provides you with three different ways for configuring patterns to apply on the log data.
- Wizard – Use the wizard to create or modify a pattern. As part of the wizard, you can set different indications on each column such as type, length, optional, column name and more (more information on each type is presented in the wizard itself).
- Manual – for advanced users who are familiar with the Pattern language; enter a pattern manually by using XpoLog Patterns language (see XpoLog Patterns Language).
- Automatic – XpoLog matches patterns automatically and suggests possible patterns. This is only available when adding a log; not when editing a log.
- Bottom pane – Log records analysis results. Shows the results of each parsing, i.e. applying the pattern to the log data.
Configuring Additional Patterns
You can configure additional patterns for logs that have different types of records that cannot be represented by a single pattern.
To configure an additional pattern:
- In the central pane, click the New tab.
A new Pattern tab opens, where you can add a new pattern.
Configuring a Manual Pattern
You can configure a pattern to apply on the log records using the Pattern language.
To configure a manual pattern:
- In the toolbar of the central pane, for Pattern Editor, click Manual.
- Type a pattern using Pattern language (see XpoLog Patterns Language). This pattern is to be applied on the log data to normalize the log records into tabular format.
Click Save.
The configured pattern is automatically applied on the log, and the Log Viewer opens displaying the parsed records of the new log. The log name is located in the left pane in its selected location under Folders and Logs. If you put in the log path a {string} pattern, the various files of the log appear in the left pane. Otherwise, only one file appears. You can perform regular actions on this log