Creating and managing apps
  • PDF

Creating and managing apps

  • PDF

It is available in a VPC environment.

This page explains information about the apps provided by Data Forest, and how to create and manage the apps. Data Forest provides 15 apps. All the apps can be run with Docker container, and the users can use Data Forest for building a big data system optimized to their needs.

Note

For information on the app types provided by Data Forest, refer to the Prerequisites for using Data Forest.

Create app

The following describes how to create an app.

  1. Create an account to own the app.

  2. Click Services > Big Data & Analytics > Data Forest > App > [Create app] button.

  3. Enter the details for the app you're going to create.
    df-app_1-1_vpc_ko

    Name Description
    Account name - account to own the app
    - Select the account that will access the app
    App type - Select the app type to create
    - Select Dev in the example
    App name - Designate the name of the app to create
    - Between 3 and 30 characters
    - Only English lowercase letters, numbers, and hyphens (-) are allowed
    Uptime - Running time (seconds) of the created app before it is ended
    - -1 (permanent), or 300 seconds (5 minutes) – 2,592,000 seconds (30 days)
    Version - The version that gets changed when the app configuration is modified
    - The number increases every time the version changes
    - Enter v1 when creating the app
    Queue - Specify the YARN queue to run the app
    - Dev: the shared development queue for development, test, or one-off jobs
    - Batch: the shared batch job queue for submitting batch jobs
    - Long lived: the shared queue for service apps
    - the default configuration is to submit jobs to Long lived.
    Application Master
    vCPU
    - The number of vCPUs required for running Application Master (fixed value at 1 vCPU)
    Application Master
    Memory
    - The memory required for running Application Master (fixed value at 4 GB)
    Component - The list of components that make up the app
    - Basic components are fixed for each app type, and the user can only set component resources
    - The default value is the recommended resources
  4. When the configuration is completed, click the [Next] button.

  5. After confirming the details finally, click the [Create] button.

    • Once app creation is completed, all the apps are immediately submitted to a YARN queue.
      df-app_1-2_vpc_ko
Note

Uptime: It means the time elapsed from when the app is started to when it's closed.
It is set as 604,800 seconds (7 days) by default and the app ends after 7 days.

View app details

The following describes how to check the app details.

  1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Forest menus, in that order.

  2. Click the App menu. You can see the list of apps that users run.
    df-app-control_01_vpc_(1)

    Item Description
    App name The app's name
    Account The account that can access the app
    Status App status The details need to be checked, even if the status is Running
    End Time The app's end time
    Elapsed Time The app's uptime
  3. To see the app details, click df-app_open at the end of the app list.
    df-dev_1-1_vpc_ko

    Item Description
    App type The app's type
    Status The app's status
    - ACCEPTED: The YARN scheduler received a request to run the application
    - RUNNING: Resources are assigned to Application Master and the application is running.
    - KILLED: The application has been closed unexpectedly. It can be closed down if its lifetime has expired.
    - FINISHED: The application has been closed normally by the user.
    - STOPPED: The application is stopped. It can be restarted. The restarted application will have the same ID
    - FAILED: The application has failed to create. The failure may be due to internal error. You can retry or send in a customer inquiry.
    - CHANGING: The application is being changed. It usually shows when the lifetime is being modified or flexed. The status changes to RUNNING when the change is done successfully.
    App name The app's name
    Lifetime The app's uptime left.
    The app is stopped when the app's uptime becomes 0 second.
    To extend the app's uptime, click the [Modify] button.
    Version The version is changed when the app configuration is modified.
    The number increases every time the version changes.
    Enter v1 when creating the app.
    Queue name The queue selected when creating the app
    Application ID The application ID received after the app has been submitted to YARN
    Account The account that can access the app
Note
  • Even when the app list's Status is Running, it is possible that the app hasn't been started completely. To make sure all the containers that make up the app are running normally, you should check if "Status" under the app details is "Stable."
  • The status in the app list means the YARN application status, and the status in the app details is the YARN service status.

Manage app

Kill the application manager node

If the app has problems and doesn't function normally, then you can restart Application Manager to check the status in the newly started Application Manager and normalize the app.

  1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Forest > App menus, in that order.
  2. Select the account, and then the app.
  3. Click the [Kill AM] button.

Adjust number of containers

You can adjust the number of containers for each component.

The following describes how to change the number of containers in a component.

  1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Forest > App menus, in that order.
  2. Select an account and the app to adjust the number of containers, and then click the [Flex] button.
  3. When the pop-up window appears, modify the number of containers, and then click the [Modify] button.
    df-app-control_04_vpc_ko
Caution

Changing the number of containers requires appropriate measures such as backup because data may be lost. Modify the number of containers only when absolutely necessary.

Start app

The following describes how to restart a closed app.

  1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Forest > App menus, in that order.
  2. Select an account and the app to start from the app list, and then click the [Start] button.

End app

The following describes how to close down an app.

  1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Forest > App menus, in that order.
  2. Select an account and the app to close from the app list, and then click the [End] button.

Delete app

The following describes how to delete an app.

  1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Forest > App menus, in that order.
  2. Select an account, and then check if the app to delete has been closed from the app list.
    • The app needs to be closed before being deleted.
  3. Click the app to delete, and then click the [Delete] button.

Was this article helpful?

What's Next