Hadoop monitoring with Cloud Insight

Available in VPC

You can use NAVER Cloud Platform's Cloud Insight to monitor Hadoop's performance and operation indicators, and quickly check and respond in case of failures.

Preparations

1. Create a Cloud Hadoop cluster.
   • Please refer to Getting started with Cloud Hadoop for more information about creating Cloud Hadoop.
2. Request subscription to Cloud Insight.
   • Please refer to the Cloud Insight Guide for more information about requesting subscription to Cloud Insight.

Dashboard configuration

If you've completed preparations, then you can create a dashboard in the Cloud Insight console screen and add widgets for monitoring Cloud Hadoop.

The following describes how to create Cloud Insight dashboard and add widgets for monitoring Cloud Hadoop.

1. From the VPC environment of the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) menus, in that order.
2. Click the [Create dashboard] button.
3. Enter the dashboard name and description, and then click the [Create] button.
   
4. Click the [Add widget] button.
5. Enter the widget's name, select the widget type, and then click the [Next] button.
   • This example uses the Time Series widget for the explanation.
     
6. Enter the widget settings as below, and then click the [Next] button.
   
   • Product Type: Cloud Hadoop(VPC)
   • Target: Select All available resources, and then select the cluster to monitor
     (Refer to Set target group when selecting group)
   • Metric: Select All metrics, select items to monitor, and then click the [Add selected item] button
     (Refer to Set rule template when selecting template)
   • Set data list: Select Dimension (properties), Interval (aggregation interval), and Aggregation (aggregation function) of the selected monitoring item
7. After checking the set widget details, click the [Create] button.
   
   • The widget will be added to the dashboard. You can monitor the Cloud Hadoop cluster through the added widget.
     

Group and template settings

You can group specific monitoring targets or save specific monitoring items (metrics) as a template so you can manage monitoring settings and widgets easily.

Set target group

The following describes how to create a target group and group specific monitoring targets.

1. From the VPC environment of the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) menus, in that order.
2. Click the Configuration > Template menus, in that order.
3. Click the [Target Group] tab, and then click the [Create target group] button.
4. Enter the group settings as below, and then click the [Create] button.
   
   • Product Type: Cloud Hadoop(VPC)
   • Group name, Group description: Enter the group name and description
   • Available monitor targets: Select all monitoring targets to include in the group, and then click

Set rule template

The following describes how to set a rule template and save specific monitoring items as a template.

1. From the VPC environment of the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) menus, in that order.

2. Click the Configuration > Template menus, in that order.

3. Click the [Rule Template] tab, and then click the [Create rule template] button.

4. Enter the template settings as below, and then click the [Next] button.
   

   • Product Type: Cloud Hadoop(VPC)
   • Template name, Description: Enter the template name and description
   • Select the monitoring items (metrics) to include in the template from each category tab

5. Enter the monitoring conditions of each monitoring item by referring to below, and then click the [Save] button.
   

   • Dimension: Properties of the monitoring item
   • Level: Level of the event in case of event occurring
   • Condition: Event triggering condition
   • Method: Aggregation function of the monitoring item
   • Duration: The time of duration
   Note

   The following is an example of setting an Info level event trigger if the Cloud Hadoop (VPC)'s CPU/user_rto (cpu_idx:1) value continues to be 0 for one minute.

   

Set event

You can select monitoring targets and items, create events by setting monitoring conditions and notification actions, and view the status of created events.

The following shows how to set an event.

1. From the VPC environment of the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) menus, in that order.
2. Click the Configuration > Event Rule menus, in that order.
3. Click the [Event Rules] button.
4. Select Cloud Hadoop (VPC) from the Select monitored product item, and then click the [Next] button.
   
5. Select the individual monitoring target or monitoring group, and then click the [Next] button.
   • To create a new group, refer to Set target group.
     
6. Select the individual monitoring item or monitoring template, and then click the [Next] button.
   • To create a new template, refer to Set rule template.
     
7. Select the notification recipient group from the [Send notification message] tab, and then click the [Next] button.
   • To create a new notification recipient group, refer to Create notification recipient group.
     
8. After checking the set event details, click the [Create] button.
   

View event status

The following describes how to view the created event's status.

1. From the VPC environment of the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) menus, in that order.
2. Click the Event menu.
   

Create notification recipient group

The following describes how to create a notification recipient group to send event notification messages and add recipients.

1. From the VPC environment of the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) menus, in that order.
2. Click the Notification Recipient menu.
3. Click the button from the Target group list, enter the name of the group to create, and then click the button.
   
4. Click All targets from the Target group list.
5. Select targets to assign to the created group, and then click the [Assign] button.
   • To add new targets, click the [Add target] button, and add targets by referring to Cloud Insight Guide.
     
6. Enter the information of the notification recipient to add, complete the identity authentication process, and then click the [Register] button.

Cloud Hadoop Metric

You can monitor the indicators below for all clusters created. Cloud Insight collects data for metrics at 1-minute intervals.