Monitor CLOVA Studio using Cloud Insight

Prev Next

Available in Classic and VPC

You can monitor the performance and operational metrics of CLOVA Studio by integrating it with NAVER Cloud Platform's Cloud Insight. You can also set notifications by monitoring conditions to respond to any failures quickly.

Note

The feature of monitoring Cloud Studio's performance and operational metrics by integrating with Cloud Insight is provided only when you use the Exclusive plan in Cloud Studio. For any inquiries about using the Exclusive plan, contact Customer Support.

Preparations

You need to do the following tasks before monitoring the performance and operational metrics of CLOVA Studio:

  1. Complete subscribing Cloud Insight by referring to Subscribe to Cloud Insight.
  2. Check if you are using the Exclusive plan in CLOVA Studio.
    • Monitoring is available only after the inference usage occurs.

Monitor CLOVA Studio

Once you have completed preparations, you can monitor the performance and operational metrics of CLOVA Studio on the Cloud Insight console page at any time. The following describes how to monitor:

  1. From the NAVER Cloud Platform console, click i_menu > Services > Management & Governance > Cloud Insight (Monitoring) in order.
  2. Click the Dashboard menu.
  3. In the dashboard list, select Service Dashboard / CLOVA Studio Exclusive(VPC).
Note
  • See Metrics list for the metrics that can be checked from the dashboard.
  • Monitoring is available only after the inference usage occurs while using the Exclusive plan of CLOVA Studio.

Create dashboards and widgets

You can create dashboards and widgets to configure the custom monitoring environment where you can see the information you want only.

Note

This guide briefly describes only the necessary information to monitor CLOVA Studio. For more information on Cloud Insight's dashboard and widget, see Dashboard.

To create dashboards and widgets to monitor CLOVA Studio in Cloud Insight, follow these steps:

  1. From the NAVER Cloud Platform console, click i_menu > Services > Management & Governance > Cloud Insight (Monitoring) in order.
  2. Click the Dashboard menu.
  3. Click the [Create dashboard] button.
  4. When the creation popup window appears, enter a Name for the dashboard and click the [Create] button.
  5. Click the [Add widget] button.
  6. Enter a name for the widget, select the Widget type, and click the [Next] button.
  7. Enter the configuration details and click the [Next] button.
    • Product type: select CLOVA Studio Exclusive(VPC).
    • Target: select the monitoring target.
      • Group: select the monitoring target group. Click the [Create monitoring target group] button to create a group.
      • All owned resources: select among the resources created in CLOVA Studio (Exclusive contract)
    • Metric: select the item to monitor.
      • Template: select the monitoring template. Click the [Create monitoring template] button to create a template.
      • All metrics: select among all monitoring items (see (the following) for the entire monitoring items).
    • Setup data list: select the Dimension(properties), View cycle, and Aggregation method.
  8. After reviewing the widget settings, click the [Create] button.
    • The widget is added to the dashboard.

Set monitoring conditions and notifications

You can set the monitoring conditions and notification actions for CLOVA Studio by creating an event rule in Cloud Insight. You can set to receive notifications when events occur so that you can respond to failures quickly.

Note

This guide briefly describes only the necessary information to monitor CLOVA Studio metrics. For more information on even rules, see Manage event rules.

To create a monitoring rule in Cloud Insight and set to send notifications when events occur, follow these steps:

  1. From the NAVER Cloud Platform console, click i_menu > Services > Management & Governance > Cloud Insight (Monitoring) in order.
  2. Click Configuration > Event Rule, in order.
  3. Click the [Create event rules] button.
  4. Click CLOVA Studio Exclusive(VPC) and [Next].
  5. Set the monitoring target and click the [Next] button.
    • View groups: select the monitoring target group. Click the [Create group] button to create a group.
    • View all: select the monitoring target among the resources created in CLOVA Studio (Exclusive contract).
  6. Set the monitoring target and click the [Next] button.
    • View templates: select the monitoring template. Click the [Create template] button to create a template.
    • View all: select the monitoring item among all monitoring items and set event occurrence conditions.
  7. In the [Send notification messages] tab, select a Recipient group to receive notifications and the notification method and click the [Next] button.
    • Click the [Create recipient group] button to create a recipient group.
  8. Enter the Rule name, check the setup information, and click the [Create] button.

Metrics list

The following describes the metrics:

Metric Data type Unit Description Including service dashboard
request_count INTEGER num API request count; number of requests O
response_count_2xx INTEGER num API response count (Success); number of successful responses O
response_count_4xx INTEGER num API response count (4xx); number of response errors (4xx) -
response_count_5xx INTEGER num API response count (5xx); number of response errors (5xx) O
average_latency FLOAT millisecond(avg) Average latency per min.; average value of response time per minute (Latency) -
input_token_usage INTEGER num Input token usage; number of input tokens O
output_token_usage INTEGER num Output token usage; number of output tokens O
Note
  • See the description column for the default widget name displayed on the dashboard.
  • As for the average_latency metric, it collects the average value per minute as the original data, and the view cycle exceeding 1 minute is not supported. Therefore, if you set the view period of the dashboard to exceed 1 hour, you cannot check the metric from the relevant widget.