Cloud Hadoop quickstart

Available in VPC

The Cloud Hadoop is subscribed by creating a Cloud Hadoop cluster in the NAVER Cloud Platform Console. Network and firewall settings and storage settings for accessing cluster nodes are also done from the console. You can then access the UI for each service offered and analyze various data.

To summarize the overall usage scenario of the Cloud Hadoop service, it is as follows:

1. Managing Cloud Hadoop Creation: Console

   • Create a server by selecting a server image and server type
   • User guide page for this step
     • Getting started

2. VPC, Subnet, ACG, SSL VPN Settings: Console

   • Proceed with VPC, Subnet, ACG, and SSL VPN settings for network access control
   • User guide page for this step
     • VPC and Subnet user guide
     • Firewall settings (ACG)
     • SSL VPN user guide (VPC)

3. Using and Managing Cloud Hadoop: Console

   • Check cluster information
   • Manage clusters (change the number of nodes, change specifications, reset admin passwords, back up settings)
   • Manage server connections (change cluster direct access authentication key, change public IP settings, manage authentication keys)
   • View the web UIs that are accessible and their access rules, then click the shortcut links to access them
   • User guide page for this step
     • Check and manage information of Cloud Hadoop

4. Access to Cluster Nodes and the Web UI: Terminal Program on a PC, Web Browser

   • User guide page for this step
     • Access a cluster node with SSH
     • UI access and password settings by service
     • Access the Web UI with Tunneling
     • Configuring Secure Hadoop (optional)

5. Using the Web UI: Terminal Program on a PC, Web Browser

   • Use built-in ecosystem Web UI pages by service, such as Ambari, Hue, etc.
   • User guide page for this step
     • Ambari UI
     • Using Ambari REST APIs
     • Submit Spark Job with Apache Livy
     • Using Hive
     • Run Hive UDF
     • Connect CVS files with Hive External Table
     • Using Hue
     • Create DB with MySQL Stored Procedure
     • Using OpenTSDB
     • Using Presto
     • Analyze Hive Warehouse Data with Presto
     • Set up Access Control with the Ranger Plugin
     • Manage HDFS access permissions by user with Ranger.
     • Submit Spark Scala Job
     • Using Sqoop
     • Using Zeppelin
     • Using Iceberg
     • Using NiFi

6. External integrations: PC's terminal program, Web UI, and each service integration

   • Analyze various data by linking DB with Cloud Hadoop applications
   • User guide page for this step
     • Integrating Apache Flume
     • Transfer data from CDB MongoDB to Hive
     • Monitoring Hadoop with Cloud Insight
     • Migrating CDB MySQL Data
     • Cloud DB for MySQL user guide
     • Integrating Presto with Cloud Data Streaming Service
     • Integrating Spark Streaming with Cloud Data Streaming Service
     • Cloud Data Streaming Service user guide
     • Integrating Object Storage and Sub Account
     • Data Migration with Object Storage
     • Object Storage user guide
     • Mounting NAS to Cloud Hadoop
     • NAS user guide
     • Integrating Tableau