From 00d5d44533dbd286c9118f00794e1e425e5e1461 Mon Sep 17 00:00:00 2001 From: hmao Date: Sat, 22 Aug 2020 06:41:13 -0700 Subject: [PATCH] Add files via upload --- Kafka.md | 10 ++++++++++ 1 file changed, 10 insertions(+) create mode 100644 Kafka.md diff --git a/Kafka.md b/Kafka.md new file mode 100644 index 0000000..5fa988e --- /dev/null +++ b/Kafka.md @@ -0,0 +1,10 @@ +Kafka: +__consumer_offsets: 如果你曾经惊讶于 Kafka 日志路径下冒出很多 __consumer_offsets-xxx 这样的目录,那么现在应该明白了吧,这就是 Kafka 自动帮你创建的位移主题啊。 + 位移主题分区 offsets.topic.num.partitions 它的默认值是 50 + 位移主题的 Key 中应该保存 3 部分内容: [groupId,topicName,partitionNumber] + 副本数或备份因子 offsets.topic.replication.factor 它的默认值是 3 + enable.auto.commit:如果值是 true,则 Consumer 在后台默默地为你定期提交位移 + auto.commit.interval.ms:提交间隔 + Log Compaction 策略来删除位移主题中的过期消息: The idea behind log compaction is selectively remove records where we have most recent update with the same primary key. + +