---
title: "Create an evaluation"
slug: "rag-evaluations-create"
updated: 2026-09-17T09:33:50Z
published: 2026-09-17T09:33:50Z
canonical: "guide.ncloud-docs.com/rag-evaluations-create"
stale: true
---

> ## Documentation Index
> Fetch the complete documentation index at: https://guide.ncloud-docs.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Create an evaluation

Available in VPC.

## Evaluations interface

In the Evaluations interface, you can assess whether the service model retrieved the appropriate data to answer a question, and you can also evaluate the quality of the generated answer using the evaluation system.

![rag_evaluation01_ko.png](https://cdn.document360.io/6998976f-9d95-4df8-b847-d375892b92c2/Images/Documentation/rag_evaluation01_en.png?sv=2026-02-06&spr=https&st=2026-11-14T04%3A24%3A19Z&se=2026-11-14T05%3A24%3A19Z&sr=c&sp=r&sig=bjpXaADOFcLp%2FtrVwGWGh9NlNcVYEuI2KsfmW85HJ9c%3D)

| Component | Description |
| --- | --- |
| ① Menu name | - Current menu name. |
| ② Basic features | Features available on first entry to the **Evaluations** menu. - **[Create Evaluation]** button: Click to [create a new evaluation](/docs/en/rag-evaluations-create#%ED%8F%89%EA%B0%80%EC%83%9D%EC%84%B1) - **[Refresh]**: Reload the current page. |
| ③ Evaluation List | A list of created evaluations. - Evaluation name: The name entered when the evaluation was created. - Target service: The name of the service to be evaluated. - Evaluation creation date: The date and time the evaluation was created. - Evaluation set type: The type selected when creating the evaluation. - Progress status: Shows the current status of the service evaluation (Waiting for upload, Creating evaluation set, Evaluation set created, In progress, Completed, Stopped, Dataset creation failed, Dataset creation stopped, Failed) - Evaluation set: Upload the data to be used for evaluation. - Evaluation results: Download the completed evaluation results. |
| ④ Downloading evaluation set | Displayed when automatic evaluation set generation is selected and the set has been successfully generated. |
| ⑤ Upload evaluation set | **[Upload]**: Upload an evaluation set data file |
| ⑥ Download | **[Download]**: Download the completed evaluation results |
| ⑦ Expand/Collapse | Expand or collapse the evaluation information and evaluation management menu |

The evaluation creation process consists of the following steps:

- [Create an evaluation](/docs/en/rag-evaluations-create#%ED%8F%89%EA%B0%80%EC%83%9D%EC%84%B1)
  - [1. Evaluation settings](/docs/en/rag-evaluations-create#%ED%8F%89%EA%B0%80%EC%84%A4%EC%A0%95)
  - [2. Final confirmation](/docs/en/rag-evaluations-create#%EC%B5%9C%EC%A2%85%ED%99%95%EC%9D%B8)
- [View evaluation information](/docs/en/rag-evaluations-create#%ED%8F%89%EA%B0%80%EC%A0%95%EB%B3%B4%ED%99%95%EC%9D%B8)
- [Delete an evaluation](/docs/en/rag-evaluations-create#%ED%8F%89%EA%B0%80%EC%82%AD%EC%A0%9C)

## Create an evaluation

To create a service evaluation:

1. In the VPC environment of the NAVER Cloud Platform console, navigate to **Menu** > **All Services** > **AI Services** > **RAG**.
2. Click **Evaluations** menu.
3. Click **[Create Evaluation]** button.
4. On the **evaluation creation** page, enter the [evaluation settings](/docs/en/rag-evaluations-create#%ED%8F%89%EA%B0%80%EC%84%A4%EC%A0%95).
5. Click **[Next]** button.
6. Review the entered information in the [final confirmation](/docs/en/rag-evaluations-create#%EC%B5%9C%EC%A2%85%ED%99%95%EC%9D%B8) step.
7. Click **[Finish]** button.

### 1. Evaluation settings

Enter the following information to create an evaluation:

- Select evaluation target Select the service to evaluate.
  - Service: Choose from the list of registered services
  - Service description: Description set when creating the service
- Basic evaluation settings: Enter basic information for the evaluation.
  - Evaluation name: 3–20 characters; duplicate names allowed
  - Evaluation description: Up to 50 characters
- Select evaluation model: Select the model to use for evaluation.
  - Only the **default configured** model is currently available.
- Evaluation type: Select the Q&A type to evaluate.
  - Only **Question and Answer** type is currently provided.
- Evaluation metric & dataset Choose how to configure the evaluation dataset.
  - Evaluation metric: Only the **default setting** metric is available
  - Dataset configuration: Choose how to prepare the evaluation dataset
    - Automatic: System automatically generates the evaluation dataset (additional fees apply)
    - Manual: You manually create and upload the evaluation dataset

              Caution

              

Additional charges apply when choosing automatic evaluation dataset generation.

### 2. Final confirmation

Review the information entered in the [evaluation settings](/docs/en/rag-evaluations-create#%ED%8F%89%EA%B0%80%EC%84%A4%EC%A0%95) and click **[Finish]** button.

## View evaluation information

You can review created evaluations in the NAVER Cloud Platform console under **AI Services > RAG > Evaluations** menu.

To view evaluation details:

1. In the VPC environment of the NAVER Cloud Platform console, navigate to **Menu** > **All Services** > **AI Services** > **RAG**.
2. Click **Evaluations** menu.
3. In the evaluations list, click ![rag_common_button1.png](https://cdn.document360.io/6998976f-9d95-4df8-b847-d375892b92c2/Images/Documentation/rag_common_button1.png?sv=2026-02-06&spr=https&st=2026-11-14T04%3A24%3A19Z&se=2026-11-14T05%3A24%3A19Z&sr=c&sp=r&sig=bjpXaADOFcLp%2FtrVwGWGh9NlNcVYEuI2KsfmW85HJ9c%3D) button for the evaluation you want to view.
4. When the evaluation details section expands, review the evaluation information.
  - **Evaluation name**: Name entered during creation
  - **Evaluation description**: Description entered during creation
  - **Target service name**: Name of the target service selected when creating the evaluation
  - **Evaluation target service description**: Description of the target service selected when creating the evaluation
  - **Evaluation creation date**: The date and time the evaluation was created.
  - **Evaluation completion date**: The date and time the evaluation was completed.
  - **Progress status**: Indicates the current progress of the evaluation.
    - Generating evaluation set: Displayed when automatic evaluation set generation is selected.
    - Evaluation set generated: Displayed when automatic evaluation set generation has been completed.
    - Evaluation in progress: Displayed after an evaluation set is uploaded.
    - Evaluation completed: The evaluation has finished running.
    - Stopped: The evaluation has been manually stopped.
    - Failed: The evaluation has failed.
    - Dataset generation stopped: Displayed when the stop button is clicked during automatic evaluation set generation.
    - Dataset generation failed: Displayed when an error occurs during automatic evaluation set generation.
    - Waiting for upload: Displayed when manual evaluation set creation is selected.
  - **Evaluation set type**: The type selected (automatic/manual) in the dataset configuration step during evaluation creation.
  - **Automatically generated evaluation set**: Displayed when **Automatic** is selected in the dataset configuration step. (Not displayed when Manual is selected.)

## Delete an evaluation

To delete an evaluation from the evaluation list:

1. In the VPC environment of the NAVER Cloud Platform console, navigate to **Menu** > **All Services** > **AI Services** > **RAG**.
2. Click **Evaluations** menu.
3. In the evaluations list, click ![rag_common_button1.png](https://cdn.document360.io/6998976f-9d95-4df8-b847-d375892b92c2/Images/Documentation/rag_common_button1.png?sv=2026-02-06&spr=https&st=2026-11-14T04%3A24%3A19Z&se=2026-11-14T05%3A24%3A19Z&sr=c&sp=r&sig=bjpXaADOFcLp%2FtrVwGWGh9NlNcVYEuI2KsfmW85HJ9c%3D) button for the evaluation you want to delete.
4. Click ![rag_hambarger_button2.png](https://cdn.document360.io/6998976f-9d95-4df8-b847-d375892b92c2/Images/Documentation/rag_hambarger_button2.png?sv=2026-02-06&spr=https&st=2026-11-14T04%3A24%3A19Z&se=2026-11-14T05%3A24%3A19Z&sr=c&sp=r&sig=bjpXaADOFcLp%2FtrVwGWGh9NlNcVYEuI2KsfmW85HJ9c%3D) menu, then the **Delete** menu item.
5. In the **Delete evaluation** popup, click **[OK]** button.
6. The evaluation is deleted and removed from the list.

              Caution

              

Deleting an evaluation is irreversible. If the evaluation has already started, charges may apply for the portion that has been processed.