Monitor Cloud Data Streaming Service with Cloud Insight

Available in VPC

NAVER Cloud Platform's Cloud Insight allows you to monitor the performance and operational metrics of your Cloud Data Streaming Service clusters and quickly identify and respond to any issues that may arise.

Preliminary tasks

Create a Cloud Data Streaming Service cluster by referring to Create and manage cluster.
Apply to use Cloud Insight by referring to the Cloud Insight user guide.

Configure dashboards

Once you've completed the preliminary tasks, you can create a dashboard and add widgets to it from the Cloud Insight console interface to monitor your Cloud Data Streaming Service cluster.

In the VPC environment on the NAVER Cloud Platform console, navigate to Menu > Services > Management & Governance > Cloud Insight (Monitoring).
Click [Create dashboard].
When the creation window appears, enter a name and description for the dashboard and click [Create].
Click [Add widget].
Enter a name for the widget, select a widget type, and then click [Next].
- This guide will cover how to add a Time Series widget.
Enter the data setting information for the widget.
- Product Type: Select Cloud Data Streaming Service (VPC).
- Target: Select the target for monitoring.
  - Group: Choose from user-configured target groups. For instructions on creating a group, see Target group configuration.
  - All resources possessed: Select from the entire target list.
- Metric: Select the item for monitoring.
  - Template: Choose from user-configured templates. For instructions on creating a template, see Rule template configuration.
  - All metrics: Select from the full list of metrics. After selecting a metric, click [Add selected item].
Set the Dimension (properties), Interval (aggregation interval), and Aggregation (aggregation function) of the monitoring items added to the Configuration data list.
Once data configuration is complete, click [Next].
After reviewing the widget settings, click [Create].
Check that the widget has been added to your dashboard.
- You can use the widget to monitor your Cloud Data Streaming Service cluster.

Target group and rule template configuration

To facilitate monitoring configuration and widget management, you can group specific monitoring targets or save specific metrics as templates for use.

Target group configuration

To group specific monitoring targets:

From the NAVER Cloud Platform console's VPC environment, navigate to Menu > Services > Management & Governance > Cloud Insight (Monitoring) > Configuration > Template.
In the Target Group tab, click [Create target group].
When the group creation window appears, enter the group information.
- Product Type: Select Cloud Data Streaming Service (VPC).
- Group name, Group description: Enter a group name and description.
Select the target you want to monitor from the list of selectable monitoring targets and click on the $ icon.
Click [Create].

Rule template configuration

To save specific monitoring items as a template:

From the NAVER Cloud Platform console's VPC environment, navigate to Menu > Services > Management & Governance > Cloud Insight (Monitoring) > Configuration > Template.
Click on the [Rule Template] tab, and then click [Create rule template].
When the template creation window appears, select the product type and enter the template information.
- Product Type: Select Cloud Data Streaming Service (VPC).
- Template name, Description: Enter a template name and description.
Select the metrics to include in the template from the tabs that appear at the bottom of the window, and then click [Next].
Set the monitoring conditions for each metric in the condition setting and confirmation step, and then click [Save].
- Dimension: Metric properties (not used in Cloud Data Streaming Service)
- Level: Level when an event occurs
- Condition: Event occurrence conditions
- Method: Aggregation function of metrics
- Duration: Duration

Set event

After selecting monitoring targets and metrics, you can create an event by configuring the monitoring conditions and notification actions, as well as check the status of the created event.

Note

This guide explains how to use the event notification action to send notification messages. For details on other notification actions, such as Integration, Cloud Functions, and Auto Scaling policies, see Event Rule in the Cloud Insight user guide.

To set up an event:

From the NAVER Cloud Platform console's VPC environment, navigate to Menu > Services > Management & Governance > Cloud Insight (Monitoring) > Configuration > Event Rule.
Click [Create Event Rules].
Under Select a product to monitor, select Cloud Data Streaming Service (VPC) and click [Next].
On the Monitoring target settings interface, select the group you want to monitor and click [Next].
- For instructions on how to create a group, see Target group configuration.
On the Metric settings interface, select the rule template to monitor and click [Next].
- For instructions on how to create a rule template, see Rule template configuration.
In the Send notification message tab, select the notification recipient group and click [Next].
- For instructions on how to create a notification recipient group, see Create recipient groups.
After reviewing the event settings, click [Create].

List of metrics for cluster failure monitoring

The following metric information can be set as event rules to quickly detect any failures in Cloud Data Streaming Service clusters.

Metric	Type	Unit	Description	Recommended condition
broker_node_count	FLOAT	num	Total number of running broker nodes.	< number of broker nodes
kafka_process_status	FLOAT	num	Kafka Process Status(1: alive, 0: dead)	< 1
disk_free	FLOAT	num	Free storage space(GB)	< 10% of broker node storage capacity (if capacity is 100 GB, < 10)

Caution

Note that the broker_node_count metric is only recorded on the manager node, so be careful when configuring the target.