Using HDFS

Available in VPC

This guide describes how to use HDFS in Data Forest.

HDFS namespace

The HDFS provided in Data Forest is accessed through a namespace, the logical name of HDFS, rather than using NameNode server information such as host name and port.
The HDFS namespaces in Data Forest are "koya" and "tata."

# HDFS NAMESPACE : koya
hdfs://koya/<hdfs path>

# HDFS NAMESPACE : tata
hdfs://tata/<hdfs path>

View namespace quota information

You can view the HDFS quota configured for each account in the account details section.

1. In the VPC environment on the NAVER Cloud Platform console, navigate to > Services > Big Data & Analytics > Data Forest > Accounts.
2. Click the account section to view account details.
   • name quota(file count): Number of files available for the HDFS namespace
   • space quota(capacity): Storage capacity available for the HDFS namespace
     

Change namespace quota settings

To change the file count and capacity for a namespace:

1. In the VPC environment on the NAVER Cloud Platform console, navigate to > Services > Big Data & Analytics > Data Forest > Accounts.
2. Select the account, and then click Change account settings > Change HDFS Quota.
   
3. Select the namespace to change, enter the new file count and storage capacity, and click [Change].
   

Upload file to HDFS using Hue app

To upload files to HDFS using the Apache Hue app:

1. Log in to the Hue app.
   • Log in with your Data Forest account and password.
2. Click [Upload] at the top right of the interface.
   
3. Click [Select Files].
4. Upload the file.
   
5. After the upload is complete, check whether the uploaded file appears in the HDFS file list.
   Example: Bank.csv uploaded as a sample file.
   

Download HDFS files using the Hue app

To download files from HDFS using the Hue app:

1. Log in to the Hue app.
   • Log in with your Data Forest account and password.
2. Click [Files] in the left menu.
3. Select the file to download and click [Actions] > Download.
   Example: Bank.csv selected.