Project creation

Prev Next

Available in Classic and VPC

This section explains how to synthesize voice for the content you uploaded by using the dubbing editing interface of a created project.

Dubbing editing interface

Project editing in CLOVA Dubbing is performed in the dubbing editing interface. The dubbing editing interface consists of the following components:

clovadubbing-builder_editor_02_ko

Component Description
Move to project list Click to return to the My projects interface
② Save project Click to save the current state of the project
③ Download project Click to download the project in the desired file format
  • Individual dubbing files: Download synthesized voices and sound effects as separate files
  • Audio file: Download synthesized voice and sound effects as a single audio file without images or videos
  • Video file: Download a video file combining the uploaded file with synthesized voice and sound effects
④ File upload component
  • Upload or delete video, image, or PDF files
  • You can preview the project while playing the timeline
⑤ Add dubbing and sound effects
  • Add dubbing: Select a voice and enter the text to synthesize
  • Add sound effect: Preview and add sound effects
  • [Edit voice] button: View all available voices, preview them, create MY Voice, and edit the favorites list
⑥ Project name Name of the project currently being edited
⑦ Playback controls Buttons to play the timeline from the beginning or from a selected time, pause playback, or move to the beginning or end of the timeline
⑧ Timeline and dubbing list Check and edit all project elements such as uploaded files, dubbing, and sound effects based on their timestamps
  • [Timeline] tab: View and edit uploaded files, synthesized voices, and sound effects in chronological order
  • [Dubbing list] tab: View dubbing details, delete items, change the voice, or edit/delete dubbing text

File upload component

The file upload component of the dubbing editing interface consists of the following:
clovadubbing-builder_editor_03_ko

Component Description
① Playback controls Buttons to play the timeline from the beginning or from a selected time, pause playback, or move to the beginning or end of the timeline
  • Displayed when you hover
② Background audio on/off Select whether to include background audio embedded in the uploaded file
③ Dubbing subtitles on/off Select whether to display subtitles for the dubbing text
  • When enabled, subtitles are automatically generated and displayed in the video
④ Replace video Delete the currently uploaded file and replace it with a new video file
  • Add PDF/image: When the uploaded file is an image or PDF, a [ + ] icon appears to add additional files
⑤ Delete Delete only the uploaded file, or delete the uploaded file together with all synthesized dubbing and sound effects

Add dubbing and sound effects

The dubbing and sound effect components in the dubbing editing interface is structured as follows.
clovadubbing-builder_editor_04_ko

Component Description
① Favorite voices Select a voice to synthesize from your favorites list.
② Voice settings View the list of available voices, edit your favorites, and create a MY Voice.
③ Dubbing text Enter the text to synthesize using the selected voice.
④ Timeline position The dubbing is added at the timestamp indicated by the timeline indicator.
⑤ Preview Preview how the selected voice reads the entered dubbing text.
⑥ Add dubbing Add synthesized dubbing to the timeline.
⑦ Preview sound effect Preview the selected sound effect.
⑧ Add sound effect Add the sound effect to the timeline.

Timeline Component

The timeline component in the dubbing editing interface is structured as follows.
clovadubbing-builder_editor_05_ko

Component Description
① Timeline time Displays the timestamp of the indicator position and the total duration of the timeline.
② Zoom in/out Adjusts the width of the timeline to expand or reduce the time intervals.
③ Undo and redo Reverses or restores timeline edits.
④ Dubbing settings
  • Change voice in bulk: Change the voice used in all dubbing clips on the timeline at once.
  • Dubbing interval settings: Configure settings related to dubbing intervals.
    • Default interval time: Set the default time interval between dubbing clips.
    • Push existing dubbing when overlapping: When enabled, if a newly added dubbing overlaps with an existing clip, the existing clip is automatically shifted backward.
⑤ Indicator A bar that marks a specific timestamp on the timeline
⑥ Slide blocks Displays uploaded files, separated into pages if the file is a PDF
  • Change order: Drag a slide block to rearrange its position
  • Adjust duration: Hover to display arrows, then drag to lengthen or shorten the slide duration
  • clovadubbing-builder_icon_06: Click to show options for adding slides before or after, selecting transition effects, adding slides, or deleting slides
⑦ Dubbing blocks Displays added dubbing clips; hover to check the voice type, start time, and dubbing text
  • Move dubbing block: Drag the dubbing block or open the dubbing editor and enter a timestamp in the hh:mm:ss format
  • Copy dubbing block: Click the block, then click clovadubbing-builder_icon_07 and select Copy, or use Ctrl+C
  • Cut dubbing block: Click the dubbing block, then click clovadubbing-builder_icon_07 and select Cut, or use Ctrl+X
  • Paste dubbing block: Click the location where you want to paste the copied or cut dubbing block to move the indicator, then use the shortcut, Ctrl+V
  • Delete dubbing block: Click the dubbing block and press [Backspace] or [Delete], or click clovadubbing-builder_icon_07 and select Delete
  • Dubbing edits: Click a dubbing block to open the dubbing editor where you can change the voice, edit the start time, modify text, preview, download the dubbing file, or delete it
  • Change voice: Click the dubbing block, then click clovadubbing-builder_icon_07 and select Change voice
⑧ Sound effect blocks Displays added sound effects; hover to check the effect type and start time
  • Move sound effect block: Drag the block, or select it and use the left/right arrow keys
  • Copy sound effect block: Click the sound effect block, then click clovadubbing-builder_icon_07 and select Copy, or use Ctrl+C
  • Cut sound effect: Click the sound effect block, then click clovadubbing-builder_icon_07 and select Cut, or use Ctrl+X
  • Paste sound effect: Click the location where you want to paste the copied or cut sound effect block to move the indicator, then use the shortcut, Ctrl+V
  • Delete sound effect: Click the sound effect block and press [Backspace] or [Delete], or click clovadubbing-builder_icon_07and select Delete

Dubbing list component

The dubbing list component in the dubbing editing interface is structured as follows.
clovadubbing-builder_editor_06_ko

Component Description
① Voice type Check and change the voice used for the dubbing.
② Start time Check and change the dubbing playback start time.
③ View and edit dubbing text View and edit the dubbing text and check the total playback duration.
④ Delete all dubbing Delete all dubbing clips added to the project.
⑤ Preview dubbing Preview how the selected voice reads the dubbing text.
⑥ Download dubbing Download the audio file for the selected dubbing.
⑦ Delete dubbing Delete only the selected dubbing.

Project editing

Project editing refers to placing voice and sound effects at the appropriate positions on the uploaded video or PDF file and synthesizing them. Project editing is performed in the dubbing editing interface. To edit a project in the dubbing editing interface:

Caution

You cannot edit a project in more than one browser simultaneously. Simultaneous editing may cause dubbing setting errors and may lead to download failures. If an error occurs due to simultaneous editing, refresh your browser and correct or delete the items marked with errors.

  1. From the NAVER Cloud Platform console, navigate to Menu > Services > AI Services > CLOVA Dubbing > Project Group > [Go to] for the project group whose builder you want to open.
  2. In the launched builder, double-click the project you want to edit or click clovadubbing-builder_icon_02.
  3. When the dubbing editing interface appears, follow these steps in order:

1. Upload a file

Upload the video or PDF file to which you want to add voice and sound effects. Check the file specifications before uploading.

Supported specifications Video file Image file PDF file
Capacity Up to 500 MB
-
Up to 100 MB
Number of slides
-
Up to 120 pages Up to 120 pages
Playback duration Up to 20 minutes Up to 20 minutes Up to 20 minutes
File extension *.mp4, *.mov *.jpeg, *.jpg, *.png *.pdf
Resolution Up to FHD (1920×1080 px)
  • Min: 200×200 px
  • Max: 1920x1080 px
  • Min: 200x200 px (106x106 mm)
  • Max: 1920x1080 px (678x381 mm)
  • Codec H.264
    -
    -

    To upload a file:

    1. Click [Upload file] button.
    2. When the file selection popup appears, upload your file and click [Close] button.
      • File upload tab: Select this option to upload a file stored on your local PC. Drag and drop a file, or click [Upload video] or [Upload PDF/Image] button to add a file.
      • Select from Object Storage tab: Select this option to upload a file stored in Object Storage. Select a file from the bucket and click [Start request] button.

    2. Add a voice

    After uploading a file, add a voice or sound effect to synthesize. To add items:

    1. To add a voice, click Add dubbing, then select the voice you want to use.
    2. Enter the dubbing text.
    3. Click [Add dubbing] button.
    4. To add a sound effect, click Add sound effect button, then click the [ + ] button icon for the sound effect you want to use.
    Caution
    • The preview audio provided by CLOVA Dubbing must not be used for any purpose other than previewing. However, after downloading a dubbing file as an audio file, you may use it in your video or edit parts of the audio.
    • Do not intentionally distort or degrade the quality of the voices provided by CLOVA Dubbing (for example, adjusting synthesis speed or deleting parts of the synthesized voice).

    Guidelines for natural dubbing input

    To generate more natural-sounding synthesized speech:

    • Enter text exactly as you want it to be read: Numbers, English words, symbols, and abbreviations can be pronounced in many ways depending on context. Whenever possible, write them out fully or spell them in Korean.
      Example Input
      1/3
      200G
    • Use correct spacing: Proper spacing results in more fluent and natural pronunciation.
    • Use punctuation to control pacing: Use commas to add slower pauses, and periods/question marks/exclamation marks to end sentences naturally. To have the voice read words or characters one by one, use ',' or '/.' A comma applies a relatively longer pause, while a slash applies a shorter one.
      Punctuation Role Example
      Period ( . )
      Question mark ( ? )
      Exclamation mark ( ! )
      Indicates a natural end of a sentence
      Comma ( , ) Adds a pause to create a more relaxed tone,
      or makes the system read words/characters with a relatively long pause
      Slash ( / ) Makes the system read words/characters with a relatively short pause

    Language-specific dubbing input guidelines

    CLOVA Dubbing is optimized to pronounce text in the language assigned to each voice. For example, Ara / Minsang are optimized for Korean, Clara / Matt for English, and Tomoko / Kenji for Japanese. If the language of the input text differs from the language supported by the selected voice, dubbing may not be generated correctly. Make sure the input language and the voice language match.

    Note

    Chinese characters (한자) can be synthesized by Korean, Chinese, and Japanese voices, but English and Spanish voices cannot synthesize them.

    3. Edit the timeline

    To place and test dubbing and sound effects at specific timestamps in the uploaded file:

    1. In the timeline and dubbing list editing components, drag the uploaded file, voices, and sound effects to the desired timestamps.
      • Minimum playback time per file: 1 second
      • Dubbing clips cannot overlap with other dubbing clips
      • Sound effects cannot overlap with other sound effects
      • Dubbing and sound effects cannot overlap with each other
      • You cannot add dubbing or sound effects outside the total playback duration
    2. Repeat the steps above as many times as needed.
    3. Click Play to review the created project.

    4. Save the project

    When you finish editing the project, click [Save project] button.

    Note

    Although project changes are saved automatically at regular intervals, it is recommended to click the [Save Project] button during editing to prevent unexpected data loss.