Quantcast
Channel: Apache Timeline
Viewing all articles
Browse latest Browse all 5648

queued.max.message.chunks impact and consumer tuning

$
0
0
Hi Kafka Dev Team,

It seems that Maximum buffer size is set to 2 default. What is impact of
changing this to 2000 or so ? This will improve the consumer thread
performance ? More event will be buffered in memory. Or Is there any
other recommendation to tune High Level Consumers ?

Here is code from Kafka Trunk Branch:

val MaxQueuedChunks = 2
/** max number of message chunks buffered for consumption, each chunk can
be up to fetch.message.max.bytes*/
val queuedMaxMessages = props.getInt("queued.max.message.chunks",
MaxQueuedChunks)

Thanks,

Bhavesh

Viewing all articles
Browse latest Browse all 5648

Trending Articles