- Print
- PDF
Managing Cloud Data Streaming Service permissions
- Print
- PDF
Available in VPC
You can use NAVER Cloud Platform's Cloud Insight to monitor Cloud Data Streaming Service cluster's performance and operation indicators, and quickly check and respond in case of failures.
Preparations
- Create a Cloud Data Streaming Service cluster by referring to Create and manage cluster.
- Request subscription to Cloud Insight by referring to the Cloud Insight Guide.
Configure dashboard
If you've completed preparations, then you can create a dashboard in the Cloud Insight console screen and add widgets for monitoring Cloud Data Streaming Service clusters.
- From the NAVER Cloud Platform console's VPC environment, click the Services > Management & Governance > Cloud Insight (Monitoring) menus, in that order.
- Click the [Create dashboard] button.
- When the creation window appears, enter the dashboard name and description, and then click the [Create] button.
- Click the [Add widget] button.
- Enter the widget name, select the widget type, and then click the [Next] button.
- This guide is based on adding the Time series widget.
- Enter the data configuration information of the widget.
- Product type: Select Cloud Data Streaming Service (VPC).
- Target: Select the monitoring target.
- Group: You can select from target groups you configured. For information on creating groups, refer to Set target group.
- All available resources: You can select from the complete list of targets.
- Metric: Select items to monitor.
- Template: You can select from he templates you've configured. For information on creating templates, refer to Set rule template.
- All metrics: You can select from the complete list of metrics. Select metrics and click the [Add selected item] button.
- Set Dimension (properties), Interval (aggregation interval), and Aggregation (aggregation function) of monitoring items added to Set data list.
- Once the data configuration is completed, click the [Next] button.
- After checking the set widget details, click the [Create] button.
- Check if the widget is added to the dashboard.
- You can monitor the Cloud Data Streaming Service cluster through the widget.
- You can monitor the Cloud Data Streaming Service cluster through the widget.
Set target group and rule template
You can group specific monitoring targets or save specific monitoring items (metrics) as templates so you can manage monitoring settings and widgets easily.
Set target group
The following describes how to group specific monitoring targets.
- From the VPC environment of the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) > Configuration > Template menus, in that order.
- In the Target group tab, click the [Create target group] button.
- When the Create group window appears, enter the group information.
- Product type: Select Cloud Data Streaming Service (VPC).
- Group name, Group description: Enter the group name and description.
- Select monitoring targets from the Available monitor targets list, and then click the $ icon.
- Click the [Create] button.
Set rule template
The following describes how to save specific monitoring targets as a template.
- From the VPC environment of the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) > Configuration > Template menus, in that order.
- Click the [Rule template] tab, and then click the [Create rule template] button.
- When the Create template window appears, select Product type and enter the template information.
- Product type: Select Cloud Data Streaming Service (VPC).
- Template name, Description: Enter the template name and description.
- From the tab that appears at the bottom of the window, select monitoring items (metrics) to include to the template, and then click the [Next] button.
- In Set and confirm conditions step, set the monitoring condition of each item, and then click the [Save] button.
- Dimension: properties of the monitoring item (not used in Cloud Data Streaming Service)
- Level: level of the event in case of event occurrence
- Condition: event triggering condition
- Method: aggregation function of the monitoring item
- Duration: the duration time
Set event
You can select monitoring targets and items, create events by setting monitoring conditions and notification actions, and view the status of created events.
This guide is based on using Send notification message as the event's notification action. For more information on other notification actions such as Integration, Cloud Functions, and Auto Scaling policies, refer to Event rule of the Cloud Insight guide.
The following describes how to set an event.
- From the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) > Configuration > Event Rule menus, in that order.
- Click the [Create event rule] button.
- Select Cloud Data Streaming Service (VPC) from the Select monitored product field, and then click the [Next] button.
- In the Set monitoring target page, select the group you want to monitor, and then click the [Next] button.
- For information on creating groups, refer to Set target group.
- For information on creating groups, refer to Set target group.
- In the Set monitoring item page, select the rule template you want to monitor, and then click the [Next] button.
- For information on creating rule templates, refer to Set rule template.
- For information on creating rule templates, refer to Set rule template.
- Select the notification recipient group from the Send notification message tab, and then click the [Next] button.
- For information on creating notification recipient groups, refer to Create recipient group.
- For information on creating notification recipient groups, refer to Create recipient group.
- After checking the set event details, click the [Create] button.
List of metrics suitable for detecting cluster failure
If you set the event rule with the following metrics, then you can quickly detect failures in Cloud Data Streaming Service clusters.
Indicator | Type | Unit | Description | Recommended condition |
---|---|---|---|---|
broker_node_count | FLOAT | num | Total number of running broker nodes. | < number of broker nodes |
kafka_process_status | FLOAT | num | Kafka Process Status(1: alive, 0: dead) | < 1 |
disk_free | FLOAT | num | Free storage space(GB) | < 10% of the broker node storage capacity (< 10 in case of 100 GB) |
The broker_node_count
metric is only recorded on the manager node. Be careful when you set targets.