Available in VPC
It describes how to integrate Cloud Hadoop's Hive Metastore storage with NAVER Cloud Platform Data Catalog.
Preliminary task
- Subscribe to the Data Catalog.
- For more information about using Data Catalog, see Getting started guide.
Use Hive Metastore with Data Catalog
- It can be integrated with Cloud Hadoop version 2.0 or higher.
- N number of Cloud Hadoop clusters can be freely integrated with Data Catalog storage.
Integrate with external Hive Metastore
Cloud Hadoop is automatically integrated with the Data Catalog service when it is created by checking whether the catalog is being used.
The Hive, Presto, Trino, Impala, and Spark services provided by Cloud Hadoop can also use Data Catalog as the metadata store.
You can check the status of the Data Catalog integrated with Cloud Hadoop through the cluster details.
To verify that the integration has been successfully completed, run the following command in Hue > Hive and confirm that the list of databases created in the Data Catalog service is displayed.
show databases;
Considerations when using Data Catalog
- If you create a Hive table without specifying a location, it will be saved to the object storage bucket address used when creating the data catalog.
- Even if you delete the Cloud Hadoop cluster, the table information created in the Data Catalog remains intact.