What are the advantages of partition design in kafka?
滿天的星座
滿天的星座 2017-06-23 09:13:28
0
1
1159

Is it possible to improve concurrent writing? Disk io can only write one file at the same time, right?
Is it possible to improve concurrent reading? Disk io can only read one file at a time, right?
Is it possible to increase the single write speed? It seems to have nothing to do with partition, right?
Is it possible to increase the single read speed? Wouldn’t it be solved with multiple segments?

滿天的星座
滿天的星座

reply all(1)
ringa_lee

Original answer: Isn’t it the scalability of the topic? Otherwise, the capacity of a single topic can only be limited to the physical machine
Updated answer:
The partitions in the log serve several purposes. First, they allow the log to scale beyond a size that will fit on a single server. Each inpidual partition must fit on the servers that host it, but a topic may have many partitions so it can handle an arbitrary amount of data. Second they act as the unit of parallelism—more on that in a bit.
Official documentation (see above) .
Partitions have two main purposes. 1. Enhance scalability so that it can handle any amount of data. 2. Use it as a parallel unit to improve parallel capabilities (mainly considering this point).
This is my first answer and I only remember the first point~~sorry

Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template