Quantcast
Channel: Apache Timeline
Viewing all articles
Browse latest Browse all 5648

Increasing the no. of partitions during runtime(programmatically)

$
0
0
Hello,

I'm new to Kafka. I was wondering if it's possible to increase the
no. of partitions of a topic during runtime(programmatically). I could see
that there're command line tools to achieve this. If I do not have any
other option, I was thinking of solving this by starting with excess no. of
partitions and adding the logic to Partitioner class to utilize only a few
partitions, initially. Later when the load goes up, by changing some hot
property, producer can be re-configured to push to additional partitions.
Is this a right way to do this? Please share if you've any ideas.

Thanks,
Kiran

Viewing all articles
Browse latest Browse all 5648

Trending Articles