Table
    • PDF

    Table

    • PDF

    Article Summary

    The latest service changes have not yet been reflected in this content. We will update the content as soon as possible. Please refer to the Korean version for information on the latest updates.

    Available in VPC

    A table is a metadata definition with details and schema of the data. You can create a table through the scanner or by defining your own schema. In the Table menu, you can create and manage tables and view collected metadata.

    Table screen

    The following is the basic description of the Table menu for Data Catalog.
    datacatalog-table_screen_ko

    FieldDescription
    ① Menu nameMenu name currently being checked, number of tables being viewed
    ② Basic featuresFeatures displayed when initially entering the Table menu
  • [Create table] button: click and create a table (see Create table)
  • [Learn more about products] button: click and move to the Data Catalog page
  • [Refresh] button: click and refresh the table list
  • ③ Post-creation featuresFeatures activated after a table is created
  • [Edit] button: click and edit table settings (see Edit table)
  • [Delete] button: click and delete a table (see Delete table)
  • ④ Search windowYou can search by database name, table name, location, data format, and tag. You can also sort the order
    ⑤ Table listsList of tables being viewed, click to check detailed information
    ⑥ Information tabCheck the relevant information upon clicking each tab

    Create table

    You can create a table the way you want. You can create it as follows:

    Create tables with manual schema definition

    You can create tables by setting up your own database and schema.

    Note
    • Using Data Catalog as Cloud Hadoop's metastore, you can directly define and manage tables and table schemas. (will be supported)
    • Even during ETL work that converts source/target data, you can directly define the schema for conversion. (will be supported)

    The following describes how to generate tables with manual schema definition.

    1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Catalog menu, in order.
    2. Click the Table menu.
    3. Click the [Create table] button.
    4. Click Create tables with manual schema definition and click [Next].
    5. Enter basic information.
      • Database: click the drop-down menu to select a database to connect the table
        • Click the [Create database] button to create a database. (See Create database)
      • Table name: enter a table name
      • Location: where the data in the table exists
      • Description: enter a table description
    6. Click the [Add] button and enter the schema information to add a custom schema.
      • For more information on Data types, see Schema data type.
      • Click the check box of the schema and click the [Delete] button to delete an added schema.
      • If you do not add a custom schema, a schema with field name "default" will be added automatically.
    7. If you need to enter a partition key, click the Partition area and add the partition key.
      • After clicking the [Add] button, enter the partition key name in the input box to add the partition key.
      • You can select the partition by clicking its checkbox and then click the [Delete] button to delete the partition key.
    8. If necessary, click the Set tag area to add tags.
      • After clicking the [Add] button, enter the tag information in the input box to add the tag.
      • Click the check box of the tag to select it and click the [Delete] button to delete a tag.
      • Click the [Load tag template] button to display the pop-up window for loading tag templates.
        • Select and click a tag template and click the [Add] button to add a tag of the relevant tag template.
        • For more details about tag templates, see Tag template.
    9. Click the [Create] button.

    Schema data type

    The data types in the schema that can be defined manually and a description of each type are as follows:

    Data typeDescription
    tinyintInteger data (1 byte)
    smallintInteger data (2 bytes)
    intInteger data (4 bytes)
    bigintInteger data (8 bytes)
    floatFloating decimal data (4 bytes)
    doubleFloating decimal data (8 bytes)
    decimalFixed decimal data
  • Enter the length (1-38 bytes) in the input field
  • stringString data
    charFixed-length character type data
  • Enter the length (1-255 bytes) in the input field
  • varcharVariable length character type data
  • Enter the length (1-65,535 bytes) into the input field
  • booleanData with true or false values
    binaryBinary data in char format
    timestampDate and time representation data, timestamp
    datetimeDate, time representative data (YYYY-MM-DD HH:MM:SS)
    dateDate representative data (YYYY-MM-DD)
    arrayCollection of the data of the same type
  • Click the [Details] button and input detailed settings
  • mapData made of pairs of key and value
  • Click the [Details] button and enter detailed settings
  • structVarious including various types of data and related schema
  • Click the [Details] button and enter detailed settings
  • uniontypeType for storing various structure data types
  • Click the [Details] button and enter detailed settings
  • Examples of inputting detailed settings for each data type are as follows:

    • <example> Detailed configuration of array type
      ARRAY <
          STRUCT <
             place: STRING,
             start_year: INT
          >
      >
      
    • <example> Detailed configuration of map type
      MAP <
          STRING,
          ARRAY<STRING>
      >
      
    • <example> Detailed configuration of struct type
      STRUCT <
          place: STRING,
          start_year: INT
      >
      
    • <example> Detailed configuration of uniontype type
      UNIONTYPE <
          INT,
          DOUBLE,
          ARRAY<STRING>,
          STRUCT<a:INT,b:STRING>
      >
      

    Create table via scanner

    The following describes how to create a table by automatically defining the schema through the scanner.

    1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Catalog menu, in order.
    2. Click the Table menu.
    3. Click the [Create table] button.
    4. Click Create tables via scanner and click [Next].
      • Move to the scanner creation screen.
    5. Tables are created automatically when you create and run the scanner.
      • The table name is automatically set based on the name of the source data.
      • For details on creating and running a scanner, see Scanner.

    Search tables and check information

    The following describes how to search for the created table and check the information.

    1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Catalog menu, in order.
    2. Click the Table menu.
    3. Enter the search conditions and click i-datacatalog-search to search for the table.
    4. Click the table to check the information.
      • Database: name of the database the table belongs to
      • Table: table name
      • Location: where the data in the table exists
      • Data format: type of scanned data
      • Created date: date when a table was first created
      • Updated date: most recent date when editing a table’s information
      • [Schema] tab: click to check the schema registered to the table
      • [Partition] tab: click to check the partition registered to the table
      • [Schema version] tab: click to view the schema version list, click a version to view the schema of that version
      • [Tag] tab: click to check the tags registered in the table
      • [Property data] tab: click to check property information of table and source data

    Property data

    If you click the [Property data] tab in the table details area, you can check the property information of the table and source data. The following describes each information item.

    Property keyDescription
    created_timeMark unix time of table creation date and time
    last_modified_timeMark unix time of table update date and time
    dataFormatFormat of data source
    delimiterDelimiter if the source data is a CSV file
    dataTypeType of data source
    transient_lastDdlTimeMark unix time of table DDL last change date
    scannerNameScanner name of creating a table
    totalSizeTotal amount of data scanned when the scan target is a directory
    numFilesTotal number of files scanned when the scan target is a directory
    isDirectoryTRUE if the scan target is a directory
    EXTERNALExternal storage
    scannerIdScanner ID of creating a table
    connectionNameConnection name used to scan data
    inputFormatFormat for reading File into Object
    outputFormatFormat for writing File into Object
    serializationLibSerializer and Deserializer Library
    clusterNoCluster number of the scanned Cloud data base product
    connectionIdScanner connection ID that created a table
    mysqlCollationCharacter sort setting of MySQL table
    mysqlDataSizeData size of MySQL table
    mysqlIndexSizeIndex size of MySQL table
    mysqlIndexesNumber of index of MySQL table
    mysqlRowsNumber of saved row (record) of MySQL table
    mysqlTableSizeTotal size of MySQL table
    mssqlCollationCharacter sort setting of MSSQL table
    mssqlDataSizeData size of MSSQL table
    mssqlIndexSizeIndex size of MSSQL table
    mssqlIndexesNumber of index of MSSQL table
    mssqlRowsNumber of saved row (record) of MSSQL table
    mssqlTableSizeTotal size of MSSQL table
    postgresqlCollationCharacter sort setting of PostgreSQL table
    postgresqlDataSizeData size of PostgreSQL table
    postgresqlIndexSizeIndex size of PostgreSQL table
    postgresqlIndexesNumber of index of PostgreSQL table
    postgresqlRowsNumber of saved row (record) of PostgreSQL table
    postgresqlTableSizeTotal size of PostgreSQL table
    mongodbAvgObjSizeAverage document size of MongoDB collection
    mongodbFreeStorageSizeSize of available storage space in MongoDB database
    mongodbIndexSizeIndex size of MongoDB collection
    mongodbIndexesNumber of index of MongoDB collection
    mongodbRowCountNumber of saved row (record) of MongoDB collection
    mongodbSizeSize of MongoDB database
    mongodbStorageSizeStorage size of MongoDB database
    mongodbTotalSizeTotal size of MongoDB database

    Edit table

    The following describes how to edit the information of the created table or to select the schema version.

    Note

    The database included in the table name and the table cannot be edited.

    1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Catalog menu, in order.
    2. Click the Table menu.
    3. Click the table you want to edit and click the [Edit] button.
    4. Edit the table information on the table edit screen.
      • You can edit the source data's location, table description, source data format, schema, and tags.
      • Click the version drop-down menu in the schema area to select the schema version you want to edit.
      • For further information of each item, see Create table.
    5. Click the [Save] button.

    Delete table

    The following describes how to delete the created table.

    Caution
    • If deleting a table, all meta information in the table are also deleted.
    • If the deleted table is a Managed Table connected to Cloud Hadoop Hive, actual data may be deleted. (will be supported)
    • A deleted table cannot be recovered.
    1. From the NAVER Cloud Platform console, click the Services > Big Data & Analytics > Data Catalog menu, in order.
    2. Click the Table menu.
    3. Click the table you want to delete and click the [Delete] button.
    4. When the notification pop-up window appears, check the cautions and click [Delete].

    Was this article helpful?

    What's Next
    Changing your password will log you out immediately. Use the new password to log back in.
    First name must have atleast 2 characters. Numbers and special characters are not allowed.
    Last name must have atleast 1 characters. Numbers and special characters are not allowed.
    Enter a valid email
    Enter a valid password
    Your profile has been successfully updated.