Managing Cloud Data Streaming Service permissions
    • PDF

    Managing Cloud Data Streaming Service permissions

    • PDF

    Article Summary

    Available in VPC

    You can use NAVER Cloud Platform's Cloud Insight to monitor Cloud Data Streaming Service cluster's performance and operation indicators, and quickly check and respond in case of failures.

    Preparations

    1. Create a Cloud Data Streaming Service cluster by referring to Create and manage cluster.
    2. Request subscription to Cloud Insight by referring to the Cloud Insight Guide.

    Configure dashboard

    If you've completed preparations, then you can create a dashboard in the Cloud Insight console screen and add widgets for monitoring Cloud Data Streaming Service clusters.

    1. From the NAVER Cloud Platform console's VPC environment, click the Services > Management & Governance > Cloud Insight (Monitoring) menus, in that order.
    2. Click the [Create dashboard] button.
    3. When the creation window appears, enter the dashboard name and description, and then click the [Create] button.
    4. Click the [Add widget] button.
    5. Enter the widget name, select the widget type, and then click the [Next] button.
      • This guide is based on adding the Time series widget.
    6. Enter the data configuration information of the widget.
      cdss-example02_add01_en
      • Product type: Select Cloud Data Streaming Service (VPC).
      • Target: Select the monitoring target.
        • Group: You can select from target groups you configured. For information on creating groups, refer to Set target group.
        • All available resources: You can select from the complete list of targets.
      • Metric: Select items to monitor.
        • Template: You can select from he templates you've configured. For information on creating templates, refer to Set rule template.
        • All metrics: You can select from the complete list of metrics. Select metrics and click the [Add selected item] button.
    7. Set Dimension (properties), Interval (aggregation interval), and Aggregation (aggregation function) of monitoring items added to Set data list.
      cdss-example02_add02_en
    8. Once the data configuration is completed, click the [Next] button.
    9. After checking the set widget details, click the [Create] button.
    10. Check if the widget is added to the dashboard.
      • You can monitor the Cloud Data Streaming Service cluster through the widget.
        cdss-insight-8_vpc_en.png

    Set target group and rule template

    You can group specific monitoring targets or save specific monitoring items (metrics) as templates so you can manage monitoring settings and widgets easily.

    Set target group

    The following describes how to group specific monitoring targets.

    1. From the VPC environment of the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) > Configuration > Template menus, in that order.
    2. In the Target group tab, click the [Create target group] button.
    3. When the Create group window appears, enter the group information.
      cdss-example02_target01_en
      • Product type: Select Cloud Data Streaming Service (VPC).
      • Group name, Group description: Enter the group name and description.
    4. Select monitoring targets from the Available monitor targets list, and then click the $ icon.
    5. Click the [Create] button.

    Set rule template

    The following describes how to save specific monitoring targets as a template.

    1. From the VPC environment of the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) > Configuration > Template menus, in that order.
    2. Click the [Rule template] tab, and then click the [Create rule template] button.
    3. When the Create template window appears, select Product type and enter the template information.
      • Product type: Select Cloud Data Streaming Service (VPC).
      • Template name, Description: Enter the template name and description.
    4. From the tab that appears at the bottom of the window, select monitoring items (metrics) to include to the template, and then click the [Next] button.
      cdss-example02_rule1_en.png
    5. In Set and confirm conditions step, set the monitoring condition of each item, and then click the [Save] button.
      cdss-example02_rule2_en.png
      • Dimension: properties of the monitoring item (not used in Cloud Data Streaming Service)
      • Level: level of the event in case of event occurrence
      • Condition: event triggering condition
      • Method: aggregation function of the monitoring item
      • Duration: the duration time

    Set event

    You can select monitoring targets and items, create events by setting monitoring conditions and notification actions, and view the status of created events.

    Note

    This guide is based on using Send notification message as the event's notification action. For more information on other notification actions such as Integration, Cloud Functions, and Auto Scaling policies, refer to Event rule of the Cloud Insight guide.

    The following describes how to set an event.

    1. From the NAVER Cloud Platform console, click the Services > Management & Governance > Cloud Insight (Monitoring) > Configuration > Event Rule menus, in that order.
    2. Click the [Create event rule] button.
    3. Select Cloud Data Streaming Service (VPC) from the Select monitored product field, and then click the [Next] button.
    4. In the Set monitoring target page, select the group you want to monitor, and then click the [Next] button.
    5. In the Set monitoring item page, select the rule template you want to monitor, and then click the [Next] button.
    6. Select the notification recipient group from the Send notification message tab, and then click the [Next] button.
    7. After checking the set event details, click the [Create] button.

    List of metrics suitable for detecting cluster failure

    If you set the event rule with the following metrics, then you can quickly detect failures in Cloud Data Streaming Service clusters.

    IndicatorTypeUnitDescriptionRecommended condition
    broker_node_countFLOATnumTotal number of running broker nodes.< number of broker nodes
    kafka_process_statusFLOATnumKafka Process Status(1: alive, 0: dead)< 1
    disk_freeFLOATnumFree storage space(GB)< 10% of the broker node storage capacity
    (< 10 in case of 100 GB)
    Caution

    The broker_node_count metric is only recorded on the manager node. Be careful when you set targets.


    Was this article helpful?

    Changing your password will log you out immediately. Use the new password to log back in.
    First name must have atleast 2 characters. Numbers and special characters are not allowed.
    Last name must have atleast 1 characters. Numbers and special characters are not allowed.
    Enter a valid email
    Enter a valid password
    Your profile has been successfully updated.