Available in VPC
This section describes several concepts that are helpful to understand before using Cloud Data Streaming Service.
Apache Kafka
Apache Kafka is an open-source platform for building real-time streaming data pipelines and applications. Using the Cloud Data Streaming Service on NAVER Cloud Platform, you can build a Kafka cluster in minutes without installing or maintaining additional software.
NAVER Cloud Platform provides Kafka-UI, a management tool for Apache Kafka clusters. Apache Kafka, licensed under Apache 2.0, is installed and configured to be provided as a cluster.
Kafka-UI
Kafka-UI is an open-source platform that provides Apache Kafka cluster management functions, such as creating and modifying clusters and topics, and checking consumer groups.
Cloud Data Streaming Service component
The Cloud Data Streaming Service cluster consists of one manager node and three or more broker nodes, with a minimum of four servers. You can increase the number of broker nodes as needed.
-
Manager node
The manager node manages the Apache Kafka cluster through Kafka-UI. It provides convenience for Kafka operations management, such as creating and deleting topics and adding partitions. You can access Kafka-UI through the public domain. -
Broker node
A broker node is the server where actual data is stored. To access broker nodes, your VM must be in the same VPC where the Cloud Data Streaming Service cluster was created. -
Topic
A unit used to distinguish messages exchanged between producers and consumers in Kafka. -
Partition
A partition is a subdivision of a topic that enables fast processing of large volumes of messages.