Index management

Available in VPC

The index refers to the results of media analysis. When a media asset is analyzed, an index is generated, allowing you to quickly locate information such as persons, keywords, speakers, and scripts within the media. Additionally, you can download a JSON file containing the extracted metadata after analysis.

Index details interface

The basic description of the index details interface is as follows:

Video asset index details interface

Image asset index details interface

View index details

To view index details:

1. Access the Media Intelligence workspace.
2. After clicking the analyzed media asset, click the view icon in the analysis results component of the analysis index list.
3. Once the index details page appears, check the analysis results.

Select scene

You can easily navigate to the desired segment of the video using the scene selection feature. To select a scene:

1. Open the index details page.
   • See View index details.
2. From the index details interface, click the scene list icon from the navigation component.
3. When the Scene list menu appears, click the scene you want to view.
   • The selected scene segments are displayed on the timeline.
   • You can view the detected people, keywords, and captions for the scene.

Keyword search

Video asset keyword search

You can quickly find sections related to a specific keyword in the video by using the keyword search feature. To search with keyword:

1. Open the index details page.
   • See View index details.
2. From the index details interface, click the keyword search icon from the navigation component.
3. You can use 2 types of filters in the Search filter component.
   • Confidence level: Displays only results meeting or exceeding the selected accuracy level ("Low," "Default," or "High").
   • Result scope: Adjusts the range of search results. "Broad" returns a wider set of results, while "Accurate" provides narrower, more specific ones.
4. Keywords detected in the video are shown in the keyword category below the search filters.
5. Click the desired keyword from the keyword menu.
   • You can select multiple keywords to search for scenes where they appear together.
   • You can select up to 7 keywords.
   • The segments where the selected keyword is detected are displayed on the timeline.
6. If a keyword is not in the default category, use the "Search by keyword" or "Search by script" options to filter results.

Image asset keyword search

You can quickly find sections related to a specific keyword in the image by using the keyword search feature. To search with keyword:

1. Open the index details page.
   • See View index details.
2. From the index details interface, click the keyword search icon from the navigation component.
3. You can use 2 types of filters in the Search filter component.
   • Confidence level: Displays only results meeting or exceeding the selected accuracy level ("Low," "Default," or "High").
   • Result scope: Adjusts the range of search results. "Broad" returns a wider set of results, while "Accurate" provides narrower, more specific ones.
4. Keywords detected in the image are shown in the keyword category below the search filters.
5. Click the desired keyword from the keyword menu.
   • The selected keywords appear highlighted in the Insights tab on the right.
6. If a keyword is not in the default category, use the "Search by keyword" option to filter results.
   • A message appears indicating whether any results were found based on your keyword search.

View insights

Use the view insights feature to view information about identified people and keywords in specific scenes or images. To view insights:

View video asset insights

To view video asset insights:

1. Open the index details page.
   • See View index details.
2. From the index details interface, click the scene list icon from the navigation component.
3. Click the scene you want to view in the Scene list menu.
4. Click the [Insights] tab on the right side of the interface.
   • Detected people and keywords are displayed.
5. Click a person or keyword to view details.
   • Segments where persons and keywords are detected are displayed on the timeline.

View image asset insights

To view image asset insights:

1. Open the index details page.
   • See View index details.
2. In the [Insights] tab on the right, check the detected persons and keyword information from the image.

Person labeling

You can assign person labeling to improve the accuracy of person identification. To assign person labeling in the insight panel:

1. Open the index details page.
   • See View index details.
2. From the index details interface, click the scene list icon from the navigation component.
3. For video assets, click the scene you want to view in the Scene list menu.
4. In the [Insights] tab on the right, check the detected persons and keyword information from the video or image.
5. Click the edit icon in the person component.
6. Persons similar to the one being labeled are automatically recommended.
   • If similar persons exist based on the person database, a recommendation list is shown with similarity scores.
   • If no highly similar persons are found, no recommendations are shown.
7. If recommended persons are listed, select the appropriate one and click [OK].
   • Click [OK] in the edit confirmation window.
   • After setting the scope of the edit, click [OK].
8. The label is replaced with the matched person's name and thumbnail.
9. When you click the add person button, a confirmation window appears where you can select the changes and their scope.
   • If the person's name is already registered, it cannot be added. Change the name and try again.

View script

You can view the transcribed text for a specific scene, separated by speaker. To view the script within a video:

1. Open the index details page.
   • See View index details.
2. From the index details interface, click the scene list icon from the navigation component.
3. Click the scene you want to view in the Scene list menu.
4. Click the [Script] tab on the right side of the interface.
   • The spoken audio in the video is transcribed and provided as text, separated by speaker.

Edit speaker

You can edit speaker names to help improve script comprehension. To edit speaker names in the insight panel:

1. Open the index details page.
   • See View index details.
2. From the index details interface, click the scene list icon from the navigation component.
3. Click the scene you want to view in the Scene list menu.
4. Click the [Script] tab on the right side of the interface.
   • The spoken audio in the video is transcribed and provided as text, separated by speaker.
   • The script search feature is not available.
5. Click the dialogue that needs speaker editing in the Script component.
6. Click the dropdown icon in the Speaker component.
   • A list of person labeling is shown.
7. Select a speaker from the list of person labeling.
   • You can select a speaker if there are detected results and labeled persons in the index.
   • If there are no detected results in the index or all results are anonymous, only the script can be edited.
8. Click [OK] in the edit confirmation window.
   • You can select the scope of the edit.

Edit dialogue

You can edit the dialogue to improve transcription accuracy. To edit dialogue in the insight panel:

1. Open the index details page.
   • See View index details.
2. From the index details interface, click the scene list icon from the navigation component.
3. Click the scene you want to view in the Scene list menu.
4. Click the [Script] tab on the right side of the interface.
   • The spoken audio in the video is transcribed and provided as text, separated by speaker.
   • The script search feature is not available.
5. Click the dialogue that needs editing in the Script component.
6. Edit the text in the Dialogue component.
7. Click the check icon on the right side of the dialogue component.

Scene summary

Scene summary is a VLM-based feature that generates context-aware summaries by integrating visual information, dialogue, and people in a video. It also analyzes metadata extracted through content indexing to provide natural language summaries for each scene.

Create scene summary

To create a scene summary:

1. Open the index details page.
   • See View index details.
2. Click the [Scene summary] tab on the right side of the interface.
   • If the scene summary has not been run yet, the feature description and [Create scene summary] are displayed.
3. Click [Create scene summary].
4. When the Create scene summary confirmation popup appears, click [OK].
   • Click [Cancel] or [X] to return to the initial Scene summary interface.
5. Scene summary analysis starts, and the right panel changes to the "Analysis in progress" status.
   • The message "Metadata cannot be edited while scene summary analysis is in progress." is displayed at the top of the index details screen.
   • Since scene summary analysis is processed asynchronously, you can perform other tasks until the analysis is complete.

View scene summary results

When the scene summary is completed, you can view summary information for each scene in the [Scene summary] tab of the right panel.

The following information is displayed based on the scene summary result:

Cancel scene summary

To cancel the Scene summary analysis while in progress:

1. On the scene summary analysis in progress interface, click [Cancel analysis].
2. When the Cancel analysis confirmation popup appears, click [Cancel analysis].
   • Click [Cancel] or [X] to keep scene summary running.
3. Analysis is canceled, and the initial scene summary interface appears again.
   • You are not charged when the analysis is canceled.

Edit scene summary

If the scene summary is completed successfully, you can edit the generated summary content. To edit a scene summary:

1. On the right side of the interface, check the scene summary information in the [Scene summary] tab.
2. Click [Edit] for the scene you want to edit.
   • The editing interface appears.
3. Edit the scene summary content.
4. Save your changes after editing.
   • Your edited summary information is saved separately.

Reanalyze scene summary

If the scene summary is completed successfully, you can run the reanalysis. If metadata, such as scripts or people labels, changes, you can run reanalysis to generate a scene summary with the latest information.

To reanalyze a scene summary:

1. On the right side of the interface, click [Reanalyze] in the [Scene summary] tab.
2. When the reanalysis confirmation popup appears, click [OK].
3. Scene summary analysis restarts.

During reanalysis, processing differs depending on whether metadata has changed.

Delete index

To delete an index:

1. Access the Media Intelligence workspace.
   • See Access workspace.
2. Click the project name.
3. After clicking the video asset, click the index ID from the analysis index list.
4. Once the index information window appears, click [Delete index].
   • Deleted indexes cannot be restored.

Keyboard shortcuts

You can use keyboard shortcuts in the workspace to quickly and conveniently check indexes. The basic description of the keyboard shortcuts is as follows: