Using HDFS
    • PDF

    Using HDFS

    • PDF

    Article Summary

    Available in VPC

    This guide explains how to use HDFS in Data Forest.

    HDFS namespace

    HDFS provided by Data Forest uses namespace, which is a logical name of HDFS, instead of using name node server information (host name, ports) to access HDFS.
    The HDFS namespaces provided by Data Forest are "koya" and "tata".

    # HDFS NAMESPACE : koya
    hdfs://koya/<hdfs path>
    
    # HDFS NAMESPACE : tata
    hdfs://tata/<hdfs path>
    

    Check namespace quota information

    You can see the HDFS quota information set in each information in the account's details area.

    1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Forest > Account menus, in that order.
    2. Click the account area to view the account's details.
      • nameQuota (number of files): number of files that can be used in HDFS namespace
      • spaceQuota (capacity): capacity that can be used in a HDFS namespace
        df-eco-hdfs_01_vpc_en

    Change namespace quota settings

    The following describes how to change the number of files and capacity in a namespace.

    1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Forest > Account menus, in that order.
    2. Select the account, and then click the [Change account settings] > [Change HDFS quota] button.
      df-eco-hdfs_12_vpc_ko
    3. Select the namespace you want to change, enter the number of files and file capacity to change to, and then click the [Change] button.
      df-eco-hdfs_03_vpc_ko

    Upload files to HDFS using the HUE app

    The following describes how to upload the files to HDFS using the Apache HUE app.

    1. Log in to the HUE app.
      • Log in with the Data Forest account and password.
    2. Click the [Upload] button at the upper right corner of the page.
      df-eco-hdfs_10_vpc_ko
    3. Click the [Select Files] button.
    4. Upload files.
      df-eco-hdfs_11_vpc_ko
    5. When the file upload is complete, check if the list of files uploaded to HDFS appears.
      Example : When the bank.csv file is uploaded as a sample
      df-eco-hdfs_06_vpc_ko

    Download the HDFS file in the HUE app

    The following describes how to download the HDFS files in the HUE app.

    1. Log in to the HUE app.
      • Log in with the Data Forest account and password.
    2. Click [Files] in the left menu of the page.
    3. Select the files to download, and then click [Actions] > [Download].
      Example : When the "bank.csv" file is selected
      df-eco-hdfs_07_vpc_ko

    Was this article helpful?

    What's Next
    Changing your password will log you out immediately. Use the new password to log back in.
    First name must have atleast 2 characters. Numbers and special characters are not allowed.
    Last name must have atleast 1 characters. Numbers and special characters are not allowed.
    Enter a valid email
    Enter a valid password
    Your profile has been successfully updated.