Prerequisites for using Cloud Hadoop
- Print
- PDF
Prerequisites for using Cloud Hadoop
- Print
- PDF
Article Summary
Share feedback
Thanks for sharing your feedback!
Available in VPC
This page describes service specifications, preparations, and pricing information for smooth use of Cloud Hadoop.
Supported applications by cluster version
Applications where you can configure clusters by Cloud Hadoop version are as follows.
| Type | Cloud Hadoop Version | HDFS/Yarn | Hive | Hue | HBase | Livy | Tez | Spark | Zookeeper | Zeppelin | Ranger | Ranger KMS | Kafka | Presto | Impala | Kudu | Trino |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| VPC | 2.1 | 3.1.1 | 3.1.2 | 4.8.0 | 2.2.6 | 0.7.0 | 0.10.1 | 2.4.8 | 3.4.9 | 0.10.1 | 2.0.0 | 2.0.0 | 2.4.1 | 4.1.0 | 1.16.0 | 377 | |
| VPC | 2.0 | 3.1.1 | 3.1.2 | 4.8.0 | 2.2.6 | 0.7.0 | 0.10.1 | 2.4.8 | 3.4.9 | 0.10.1 | 2.0.0 | 2.0.0 | 2.4.1 | 4.1.0 | 1.16.0 | 377 | |
| VPC | 1.9 | 3.1.1 | 3.1.1 | 4.8.0 | 2.0.2 | 0.7.0 | 0.9.0 | 2.4.8 | 3.4.6 | 0.9.0 | 1.2.0 | 1.2.0 | 1.0.0 | 0.240 | 4.1.0 | 1.16.0 | |
| VPC | 1.8 | 3.1.1 | 3.1.1 | 4.8.0 | 2.0.2 | 0.7.0 | 0.9.0 | 2.4.8 | 3.4.6 | 0.9.0 | 1.2.0 | 1.2.0 | 1.0.0 | 0.240 | |||
| VPC | 1.7 | 3.1.1 | 3.1.1 | 4.8.0 | 2.0.2 | 0.7.0 | 0.9.0 | 2.4.8 | 3.4.6 | 0.9.0 | 1.2.0 | 1.2.0 | 1.0.0 | 0.240 | |||
| VPC | 1.6 | 3.1.1 | 3.1.1 | 4.3.0 | 2.0.2 | 0.7.0 | 0.9.0 | 2.4.8 | 3.4.6 | 0.9.0 | 1.2.0 | 1.2.0 | 1.0.0 | 0.240 | |||
| VPC | 1.5 | 3.1.1 | 3.1.1 | 4.3.0 | 2.0.2 | 0.6.0 | 0.9.0 | 2.4.8 | 3.4.6 | 0.8.0 | 1.2.0 | 1.2.0 | 1.0.0 | 0.240 | |||
| VPC | 1.4 | 3.1.1 | 3.1.1 | 4.3.0 | 2.0.2 | 0.6.0 | 0.9.0 | 2.3.2 | 3.4.6 | 0.8.0 | 1.2.0 | 1.2.0 | 1.0.0 | 0.240 | |||
| VPC | 1.3 | 3.1.1 | 3.1.1 | 4.3.0 | 2.0.2 | 0.6.0 | 0.7.0 | 1.6.3/2.3.0 | 3.4.6 | 0.7.3 | 0.7.0 | 0.7.0 | 0.10.1 | 0.214 | |||
| Classic | 1.2 | 2.7.3 | 1.2.1 | 4.3.0 | 1.1.2 | 0.6.0 | 0.7.0 | 1.6.3/2.3.0 | 3.4.6 | 0.7.3 | 0.7.0 | 0.7.0 | 0.10.1 | 0.214 | |||
| Classic | 1.1 | 2.7.3 | 1.2.1 | 4.3.0 | 1.1.2 | 0.6.0 | 0.7.0 | 1.6.3/2.3.0 | 3.4.6 | 0.7.3 | 0.7.0 | 0.7.0 | 0.10.1 | 0.214 | |||
| Classic | 1.0 | 2.7.3 | 1.2.1 | 4.3.0 | 1.1.2 | 0.6.0 | 0.7.0 | 1.6.3/2.3.0 | 3.4.6 | 0.7.3 | 0.7.0 | 0.7.0 | 0.10.1 | 0.214 |
Supported server specifications by cluster node
The available server specifications by cluster node are as follows.
- Edge node server type
| CPU | Memory | Disk (HDD) |
|---|---|---|
| 4 vCPUs | 16GB | 50GB |
| 4 vCPUs | 32GB | 50GB |
| 8 vCPUs | 16GB | 50GB |
| 8 vCPUs | 32GB | 50GB |
| 8 vCPUs | 64GB | 50GB |
- Master node server type
| CPU | Memory | Disk (HDD) |
|---|---|---|
| 4 vCPUs | 16GB | 50GB |
| 4 vCPUs | 32GB | 50GB |
| 8 vCPUs | 16GB | 50GB |
| 8 vCPUs | 32GB | 50GB |
| 8 vCPUs | 64GB | 50GB |
| 16 vCPUs | 32GB | 50GB |
| 16 vCPUs | 64GB | 50GB |
| 16 vCPUs | 128GB | 50GB |
| 32 vCPUs | 64GB | 50GB |
| 32 vCPUs | 128GB | 50GB |
| 32 vCPUs | 256GB | 50GB |
- Worker node server type
| CPU | Memory | Disk (HDD) |
|---|---|---|
| 4 vCPUs | 16GB | 50GB |
| 4 vCPUs | 32GB | 50GB |
| 8 vCPUs | 16GB | 50GB |
| 8 vCPUs | 32GB | 50GB |
| 8 vCPUs | 64GB | 50GB |
| 16 vCPUs | 32GB | 50GB |
| 16 vCPUs | 64GB | 50GB |
| 16 vCPUs | 128GB | 50GB |
| 32 vCPUs | 64GB | 50GB |
| 32 vCPUs | 128GB | 50GB |
| 32 vCPUs | 256GB | 50GB |
- Notebook node server type
| CPU | Memory | Disk (HDD) |
|---|---|---|
| 4 vCPUs | 16GB | 50GB |
| 4 vCPUs | 32GB | 50GB |
| 8 vCPUs | 16GB | 50GB |
| 8 vCPUs | 32GB | 50GB |
| 8 vCPUs | 64GB | 50GB |
Usage fees
- The user only pays as much as they've used from the point the cluster started to the end.
- Fee is charged per minute at a minimum charge of 1 minute.
- The data storage for storing the Cloud Hadoop data (Block Storage, Object Storage) is charged separately at an hourly rate, depending on the usage amount.
- For more details about the pricing standard for Cloud Hadoop, refer to the following page.
Was this article helpful?