Kafka in a Workspace
![](../../__attachments/143696348/enterprise%20-%20badge@500w.png?inst-v=fbc98f0a-f9ae-4d4c-828f-dc0defe966ca)
Information about the Kafka Operator
Apache Kafka is an open-source distributed event streaming platform used for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. The Kafka Operator is a Kubernetes operator to automate provisioning, management, autoscaling, and operations of Apache Kafka clusters deployed to Kubernetes. It works by watching custom resources, such as KafkaClusters
, KafkaUsers
, and KafkaTopics
, to provision underlying Kubernetes resources (i.e StatefulSets
) required for a production-ready Kafka Cluster.
Install
Follow these steps to install the Kafka operator in a workspace. This procedure results in a Kafka operator running in a workspace namespace, ready to manage and create Kafka clusters in any project namespaces. See the Kafka in a Project custom resource documentation for more information on creating Kafka clusters.
Only install the Kafka operator once per workspace.
Follow the generic installation instructions for workspace catalog applications on the Application Deployment page.
Within the
AppDeployment
, update theappRef
to specify the correctkafka-operator
App. You can find theappRef.name
by listing the availableApps
in the workspace namespace:CODEkubectl get apps -n ${WORKSPACE_NAMESPACE}
Refer to the Kafka operator Helm Chart documentation for details on custom configuration for the operator.
Uninstall via the CLI
Uninstalling the Kafka operator does not affect existing KafkaCluster
deployments. After uninstalling the operator, you must manually remove any remaining Custom Resource Definitions (CRDs) from the operator.
Delete all of the deployed Kafka custom resources (see Deleting Kafka Custom Resources).
Uninstall a Kafka operator
AppDeployment
:CODEkubectl -n <workspace namespace> delete AppDeployment <name of AppDeployment>
Remove Kafka CRDs:
NOTE: The CRDs are not finalized for deletion until you delete the associated custom resources.
CODEkubectl delete crds kafkaclusters.kafka.banzaicloud.io kafkausers.kafka.banzaicloud.io kafkatopics.kafka.banzaicloud.io