问题描述
就像上图一样,如果消费者A从一个分区消费,消费者B从一个消费者组消费同一分区,那么Kafka如何在 __ consumer_offsets
中管理偏移量?
Just like the above image, if Consumer A consumes from a Partition and Consumer B from a Consumer Group consumes from the same Partition, how does Kafka manage offset in __consumer_offsets
?
我想知道Kafka如何在 .index
, .log
, .timeindex
文件中写入使用者偏移量.
I want to know how Kafka writes consumer offsets in .index
, .log
, .timeindex
files.
推荐答案
可从以下文档引用报价: https://kafka.apache.org/documentation/#impl_offsettracking
Quote from docs that can be found here: https://kafka.apache.org/documentation/#impl_offsettracking
Kafka provides the option to store all the offsets for a given consumer group in a designated broker.
因此,它是针对每个消费者组的,而不是针对每个消费者的.另外,本文可能对您有所帮助: https://medium.com/@ felipedutratine/kafka-consumer-offsets-topic-3d5483cda4a6 如果您从消费者补偿主题中读取,您将收到格式为 [groupId,topicName,partitionNumber]
的数据.
So, it is per consumer group, not per consumer. Also, this article can be helpful for you: https://medium.com/@felipedutratine/kafka-consumer-offsets-topic-3d5483cda4a6 If you read from consumer offsets topic you will receive data in format [groupId,topicName,partitionNumber]
.
这篇关于__consumer_offsets如何为两个使用者保持偏移量?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持!