Workflow

Available in VPC

Explains the Workflow menu interface, workflow editor interface, and how to create a workflow.
Workflow is a serial process that configures the data pipeline such as reserving a schedule of a job that has a specified job order.
Workflow editor provides the GUI interface that allows workflow configuration without writing a code.

Workflow interface

The workflow interface includes the following components:

Check workflow information

To view the details of a created workflow:

1. In the VPC environment of the NAVER Cloud Platform console, navigate to Menu > All Services > Big Data & Analytics > Data Flow.
2. Click the Workflow menu.
3. When the workflow list appears, check the summarized information.
   • Workflow name: Unique name entered by the user when creating workflow.
   • Latest executed date and time: Latest workflow execution date and time. The latest date and time of on-demand run or reservation run due to trigger.
   • Execute option: Execute status of workflow
   • Reservation: Execution reserved status due to trigger
   • None: Execution not reserved due to trigger. When None has been selected from the Property information > Execute option trigger option.
   • Update date and time: Latest workflow update date and time. The latest date and time of editing workflow configuration.
   • [Details]: View detailed workflow information
4. To view the detailed information of workflow configuration, click [Details].
   • Go to Workflow editor interface to check the settings and node configuration of the workflow.

Create workflow

Workflow can be configured by combining the trigger node and the job node. Trigger node is a node that specifies job schedule, and the job node is a node that specifies which job to execute.
You can select a trigger node from the created trigger or create a new trigger. You can select a job node from the created job, but jobs that are currently in progress cannot be included in the workflow.

How to create a workflow:

1. In the VPC environment of the NAVER Cloud Platform console, navigate to Menu > All Services > Big Data & Analytics > Data Flow.
2. Click the Workflow menu.
3. Click [Create Workflow].
4. When the workflow editor interface appears, click the [Workflow configuration] tab and add the trigger node and job node to configure a workflow.
   • For more information on editor interface configuration, see Workflow editor interface.
5. Click [Trigger] on the workflow editor interface and select Create new or Add existing trigger from the menu.
   • Create new: Add a new trigger and enter the property information
   • Add existing trigger: Select a created trigger from the list and apply
6. When selecting Create new from 6, click the trigger box on the left and fill in the Properties information of the trigger node on the right.
   • Name: Enter the trigger name
   • Run option: Select from execute cycle, run on specific date, or none
   • When selecting Execute cycle execution option, select the Execution cycle from daily, weekly, or monthly
   • When selecting Execute cycle run option, Run time: Enter the time for the workflow to run. Example: 12:00
   • When selecting run option > execute cycle Weekly, Execution week: Select the week for the workflow to run. Multiple selections allowed.
   • When selecting run option > execute cycle Monthly, Execution date: Enter the date between 1 to 31. Separate multiple dates with commas (,). End-of-month selection available.
   • When selecting Run on specific date run option, Run date: Click the icon to select the date for the workflow to run
   • When selecting None run option: Additional enter field is not required
7. When selecting Add existing trigger from 6, click the trigger box on the left and select a specific trigger from the list that appears on the right.
8. Click [Job] on the workflow editor.
9. After clicking the added job box on the left, fill in the Property information and Execution option of the job on the right.
   • Property information: Selecting a job to be added to the workflow from the existing job list. Jobs currently in progress do not appear on the list.
   • Execute option: View execution option settings when creating a job. Editing the execution option is allowed.
     • Run container: Set how many containers to use for distributed jobs.
     • Number of retries: Set the maximum number of retries upon job failure.
     • Timeout: Set the waiting time for the job result when the job is run once.
     • Script path: Path for the job command script to be saved. When a job is created, the sub path of the automatically created Object Storage bucket is specified.
     • Run log: Path where the job run history is saved. Automatically specifies the sub path of the automatically created Object Storage bucket when an action is created.
     • Role name: Not used in the current released version (as of November 2023)
10. Click [Complete].
    • The workflow creation is complete and is displayed on the workflow list.
    • When a workflow is created, the execute is reserved due to a trigger.
    • The created workflow is registered as NAVER Cloud Platform resource. For more information, see Resource Manager concepts.

Workflow editor configuration

The workflow editor interface includes the following components:

After adding workflow component nodes (trigger/job) in the node display area (area ③) of the workflow editor's [Workflow configuration] tab, enter the properties and detailed settings for the workflow components in the settings area (area ④) of the workflow editor's [Workflow configuration] tab. [Complete] becomes enabled when each of the trigger node and job node is added. Jobs that are currently in progress cannot be included in the workflow.

View workflow execution list

To view the action run history:

1. In the VPC environment of the NAVER Cloud Platform console, navigate to Menu > All Services > Big Data & Analytics > Data Flow.
2. Click the Workflow menu.
3. Click [Details] for the specific workflow from the workflow list when it appears.
4. When the workflow editor interface appears, click the [Run list] tab.
   • You can check the workflow run list of the past month. The workflow run history is kept for 90 days.
   • The following items are the run list you can view:
     • Job name (ID): Job information configured in the workflow. Job ID is the unique name of the job entered by the user when the job was created.
     • Execute status: Job execution result configured in the workflow. Displays one of the following values: Succeeded, Failed, Running, or Pending.
     • Execute log: Click [Details] to move to the location of the workflow execution history file.
     • Container: Number of set container from the job execution option configured in the workflow
     • Trigger: Trigger information configured in the workflow
     • Execution start date and time: The starting date and time of the executed workflow. The executed date and time if executed due to trigger.
     • Execution end date and time: The ending date and time of the executed workflow. The end date and time if executed due to trigger.
     • Execute preparation time: Time prepared to execute a workflow
     • Execute time: The time used for workflow job execution
     • Number of retry: The number of retry of workflow job execution

Delete workflow

To delete a workflow:

1. In the VPC environment of the NAVER Cloud Platform console, navigate to Menu > All Services > Big Data & Analytics > Data Flow.
2. Click the Workflow menu.
3. Select the specific workflow from the workflow list and click [Delete].
   • The workflow is deleted from the workflow list.