Table of Contents

Apache Kafka

We use Apache Kafka for messaging queues.

How to see kafka configurations of a running consumer

root@k8dc1:~# kush -n rnd cmkafka-0 
unset JMX_PORT
# list topics
/opt/bitnami/kafka/bin/kafka-topics.sh --bootstrap-server 127.0.0.1:9092 --list
# get details on topic play_placement
/opt/bitnami/kafka/bin/kafka-topics.sh --bootstrap-server 127.0.0.1:9092 --describe --topic play_placement

https://learn.conduktor.io/kafka/kafka-topics-cli-tutorial/

Increase amount of partitions

On CM farm: 

kush -n dev sys-dp
export KAFKA_ADDRESS=cmkafka2test:9092
export REPLICATION_FACTOR=1
/opt/bin/kafka_topics_set.py cm_events_batch_queue 10