====== Apache Kafka ======

We use [[https://kafka.apache.org/|Apache Kafka]] for messaging queues.

==== How to see kafka configurations of a running consumer ====

<code>
root@k8dc1:~# kush -n rnd cmkafka-0 
unset JMX_PORT
# list topics
/opt/bitnami/kafka/bin/kafka-topics.sh --bootstrap-server 127.0.0.1:9092 --list
# get details on topic play_placement
/opt/bitnami/kafka/bin/kafka-topics.sh --bootstrap-server 127.0.0.1:9092 --describe --topic play_placement
</code>

https://learn.conduktor.io/kafka/kafka-topics-cli-tutorial/

==== Increase amount of partitions ====

On CM farm:<code>
kush -n dev sys-dp
export KAFKA_ADDRESS=cmkafka2test:9092
export REPLICATION_FACTOR=1
/opt/bin/kafka_topics_set.py cm_events_batch_queue 10
</code>