Managing statistics

Available in Classic and VPC

How users actually use the chatbot may be different to the utterance types expected in the chatbot design process, and all users' utterance patterns may not have been represented in modeling. That's why analyzing the statistics data and utterance records collected from the users is an important task. NAVER Cloud Platform provides various indicators that can be used to constantly enhance the conversation models. You can view statistics data by domain, and detailed statistics data of each domain.

Check statistics data

Click the Services > CLOVA Chatbot > Management menus in the NAVER Cloud Platform's console to check the statistics data about user or user conversation by domain.

Summary
The following statistics data can be checked regarding the users and user conversations of each domain.

• Active users, messages, number of sessions, and rate of change of domains in service
• Hourly average and peak number of users, messages, session information
• Average number of active users and average message information for each conversation session
• Number of conversation model builds and service deployments of the chatbot service
  

Active user
Information regarding the increase or decrease in the number of active chatbot users is provided.

• You can check the information of active users on an hourly basis by setting the period to a day.
• Information on the weekly and monthly trends of active users is provided.
  

Message
Information regarding the increase or decrease in the number of user messages is provided.

• You can check the number of messages on an hourly basis by setting the period to a day.
• Information on the weekly and monthly trends of messages is provided.
  

Session
Information regarding the increase or decrease in the number of chatbot conversation sessions is provided.

• You can check the number of all sessions on an hourly basis by setting the period to a day.
• Information on the weekly and monthly trends of conversation sessions is provided.
• You can also check the user's average message information for each session.
  

Build
Information about the domain admin's conversation model builds and service deployments is provided.

• You can check the information on the number of builds and build failures on an hourly basis by setting the period to a day.
• Information on the weekly and monthly conversation model builds and service deployments is provided.
  

Check integrated indicators

The following describes how to check a specific domain's integrated indicators.

1. From the NAVER Cloud Platform console, click the Services > CLOVA Chatbot > Domain menus, in that order.
2. Click the [Run builder] button of the domain you want to run the chatbot builder.
3. From the chatbot builder, click the [Integrated indicators] menu.

Integrated indicators
The following statistics data is provided regarding chatbot users and user conversations, and the recently reflected data time is displayed.

• The Chatbot service's active users, user messages, number of conversation sessions and rate of change, failed conversations, number of general messages, number of single answers, number of similar answers, number of customer center linkage, number of service linkage (LINE Pay, NAVER Pay, Knowledge search service), etc.
• Average number of active users, average message information and trends for each conversation session

Rank indicators
The following rank data regarding chatbot user conversations is provided, and the recently reflected data time is displayed.

• The ranking of conversation names, conversation types, and entities responded most frequently during a specific period

Operation indicators
The following statistics data on relearning from failed conversations and unsatisfactory conversations is provided, and the recently reflected data time is displayed.

• Number of failed (unsatisfactory) conversations, number of modifications, number of deferred reviews, number of review exceptions, total number of reviews

Feedback indicators
The following statistics data is provided on conversations related to feedback, and the recently reflected data time is displayed.

• Ratio of yes/no feedback, satisfaction rate and response rate of feedback, total number of feedback, number of feedback for each conversation name
  

Emotion analysis data with positive, negative, and neutral analysis of emotions implied in the user's question is provided on Korean domains. Click the data to check the questions classified by emotions.