Documentation Index

Fetch the complete documentation index at: https://guide.ncloud-docs.com/llms.txt

Use this file to discover all available pages before exploring further.

Getting started

Prev Next

Available in Classic

Once you've reviewed the Cloud Hadoop specifications, and quickstart, you're ready to start using the service. Your first step is creating a Cloud Hadoop cluster. You can create and manage Cloud Hadoop clusters from the NAVER Cloud Platform console.
The following summarizes what you can learn from this guide:

Preliminary task

  1. Create Object Storage.
    Before creating a cluster, you must have created an Object Storage bucket for storing and searching data. For more information, see Object Storage guides.

  2. Select a node type.
    Consider the expected usage and select a node type in advance.

Create cluster

To use NAVER Cloud Platform's Cloud Hadoop, you must create a cluster first.

To create a Cloud Hadoop cluster:

  1. Access the NAVER Cloud Platform console.
  2. In the top-right corner, click Region & Platform.
  3. Select your region and Classic platform, and then click [Apply].
  4. In the top-left corner, click Menu.
  5. Navigate to Services > Big Data & Analytics > Cloud Hadoop.
  6. Click [Create cluster].
  7. When the Create cluster page appears, proceed with the following steps in order:

1. Set up a cluster

Specify the cluster settings information and then click [Next].

  • Cluster version: Currently, Cloud Hadoop 1.0, 1.1 and 1.2 are available. For more information on cluster versions, see Cloud Hadoop release notes.
  • Cluster type: There are currently four cluster types: Core Hadoop, Presto, HBase, and Spark. You can select a type with the components you need pre-installed. If you need to add necessary services, you can use the Add Service feature in Ambari, which is a cluster managing tool.
  • Cluster admin account: Set the cluster account for accessing the management console of Ambari, Hue, and Zeppelin.
  • Cluster admin account password: Enter the cluster admin account's password.
  • Set ACG: Cloud Hadoop ACG is automatically created whenever you create a cluster. To set up network ACLs, you can select an automatically generated ACG and modify the rules. For more information on the ACG settings, see Firewall settings (ACG).

2. Set storage and server

After specifying the storage and node server settings information, click [Next].

  • Object Storage bucket: You can read and write data from the Object Storage bucket that you created in a preliminary task. When creating a cluster, select the Object Storage bucket created in a preliminary task. Locked buckets cannot be integrated with Cloud Hadoop. Keep this in mind when creating an Object Storage bucket.
  • Support high availability: Cloud Hadoop basically provides redundancy for HDFS Namenode, YARN Resource Manager, Oozie Server, and HiveServer. Since this is the specification that is required as a minimum, it cannot be deselected.
  • Edge node server type: Select a server type to use as a edge node. The server type can't be changed after the cluster is created. For the specifications of servers that can be used as edge nodes, see Supported server specifications by cluster node.
  • Number of edge nodes: The number of edge nodes is fixed at 1.
  • Master node server type: Select a server type to use as a master node. The server type can't be changed after the cluster is created.
  • Number of master nodes: Since Cloud Hadoop provides high availability as the minimum specifications, the number of master nodes is fixed at 2.
  • Master node storage type: Select a storage type. You can select between SSD and HDD. You cannot change the storage type after you create a cluster. For the specifications of servers that can be used as master nodes, see Supported server specifications by cluster node.
  • Master node storage capacity: Select the storage capacity. You can select from 100 GB to 2 TB, and adjust in 10 GB increments.
  • Worker node server type: Select a server type to use as a worker node. The server type can't be changed after the cluster is created. For specifications of servers that can be used as operator nodes, see Supported server specifications by cluster node.
  • Number of worker nodes: You can select 2-8 worker nodes. Worker nodes can be added or deleted even after the cluster is created.
  • Worker node storage type: Select a storage type. You can select between SSD and HDD. You cannot change the storage type after you create a cluster.
  • Worker node storage capacity: Select the storage capacity. You can select from 100 GB to 2 TB, and adjust in 10 GB increments.
  • Pricing plan: The pricing plan you selected when you created your account applies. For more pricing information, see Pricing information.
Note

After a cluster is created, server specifications cannot be adjusted (scaled up/down). When configuring a cluster, make your selections taking into account the expected usage and node roles (edge/master/worker).

3. Set authentication key

Set the SSH authentication key required for accessing the node yourself.
Select an authentication key you have or create a new one and click [Next].

  • To create a new authentication key, select Create new authentication key, enter the authentication key name, and click [Create and save authentication key].
Note

The authentication key is required to verify the admin password. Keep the saved .pem file in a safe location on your PC.

4. Final confirmation

Check the details and click [Create].

Note
  • Cloud Hadoop ACG is automatically created whenever you create a cluster. To set up network ACLs, you can select an automatically generated ACG and modify the rules. For more information on the ACG settings, see Firewall settings (ACG).
  • It takes approximately 30 to 50 minutes for a cluster to be created. Once the cluster is created and it starts running, you can see Running displayed in the Status column of the cluster list.

Delete cluster

To delete a Cloud Hadoop cluster:

  1. In the Classic environment of the NAVER Cloud Platform console, navigate to Menu > All Services > Big Data & Analytics > Cloud Hadoop.
  2. Select the cluster to delete from the cluster list, and then click [Delete].
  3. Enter the cluster name on the popup window to confirm deletion, and then click [Yes].
Note

It takes several minutes to delete a cluster. Once deleted, the cluster disappears from the cluster list.

Caution

If you delete a Cloud Hadoop cluster, the data saved in the node's local file system or HDFS will all be deleted as well. Back up the necessary files, for example, by copying them into the Object Storage bucket.

Delete Object Storage file or bucket

Select the file to delete from the Object Storage console and click [Edit] > Delete.
For more information on deleting Object Storage files or buckets, see Object Storage user guides.

Caution

Deleted Object Storage files or buckets cannot be restored. Consider carefully before proceeding.