Searching and visualizing logs

We are preparing a localization service for the content. We will do our best to provide the localization service as soon as possible.

Available in Classic and VPC

Search log

Effective Log Search & Analytics provides a separate web app screen where you can search for logs.

Log in to web app

1. Log in to console and go to Services > Management & Governance > Effective Log Search & Analytics menu.

2. Select Projects menu and click the [Go to Web-APP] button of the project whose log you want to check from the project list.

3. Effective Log Search & Analytics web app appears in a new window.

How to search log

In the Search for menu of Effective Log Search & Analytics Web App, the logs for 24 days as of the current time are provided as an hourly log collection graph and detailed logs by default.

① You can fill in query field search with Lucene Syntax to define the search criteria.

② You can set the search period settings, and you can view logs collected during the period.

③ Output the log search result as a bar graph. The number of logs collected between the dates and times in the horizontal axis is displayed. Click the bar to view the log for the period. Double-click the bar to view hourly logs in more detail.

④ Effective Log Search & Analytics allows you to use Quick filter to easily filter the logs.

• Quick filter only appears as a filter category when there are one or more logs with data corresponding to each category in the search results.
  • Example: If the logs with logLevel, logSource, and projectVersion values exist and logs with logType values do not exist in the search results, then logType is not displayed as a quick filter category.

⑤ Details of the logs searched are displayed here. Click each category of the logs displayed to enter as a query in ①.

Log Visualization

Effective Log Search & Analytics provides features to visualize logs to configure dashboards.
Effective Log Search & Analytics integrates Kibana, which enables configuration of the dashboard by querying desired log data.

Discover

In the Kibana > Discover menu, you can create a query to search for the log data to visualize. Once a dashboard is created after saving the query created through the Discover menu, you can load the data to be included in the individual widgets that make up the dashboard.

• By creating a Lucene query, you can search for collected log data. When you input a Lucene query, choose the applicable period, and then click the [Refresh] button. The histogram and detailed log data for the log searched by this query will be displayed.

• In the Discover menu, you can also view the resulting log data in a tabular form. When selecting fields to add in a table from the left side menu, the log data are displayed in a tabular form with the selected fields displayed as columns of the table.

• After viewing the log data, you can click the [Save] button located at the top to save the current settings. A saved query can be viewed in the Kibana > Saved Search menu. You can use it as a data source when adding a new widget in the Dashboard > Create Visualize menu.

• Clicking the [Inspect] button shows you a summary of the current search results as well as requested and received information.

Saved Search

Kibana > Saved Search menu shows you the list of queries that you saved in the Discover menu.

• With the Saved Search menu, you can not only view but also delete or edit the list of queries that you saved in the Discover menu.
• Clicking the [ADD SEARCH] button allows you to create a new query. The created query can be used as a data source when adding a new widget in the Dashboard > Create Visualize menu.

Create Visualize

Dashboard > Create Visualize menu visualizes selected log data.

• It supports visualization in multiple ways, including the Area and Line charts, and Heat Map.

• You can choose the desired visualization method and then specify a data source. A data source can be chosen from Saved Search Queries you saved through the Index Pattern or Discover menu.

• By specifying an aggregation method and sorting order with Metric Aggregation and Bucket Aggregation, you can visualize log data in various ways.

• Metric & axes menu provides the features to specify the display type of each axis, label display type, label location, and more.

• With the Panel settings menu, the legend of the applicable visualization and the grid display type can be configured in detail.

• Once the visualization is configured as desired, the result can be saved by clicking [Save] button. You can view the saved visualization in a list in the Manage Visualizations menu. You can also edit it at any time you want.

Dashboard configuration

You can configure a new dashboard in the Dashboard > New menu.

• Clicking the [Create New] button creates a new visualization. Alternatively, a previously created visualization can be added to the dashboard using the [Add] button.

• In the dashboard, the size and location of each visualization can be edited as desired.

• Once configuration of the dashboard is completed, you can save the dashboard by clicking the [Save] button. The saved dashboard is added under Dashboard menu as a new menu that can be directly viewed by clicking it.