I can't seem to find much information to help me (being green to kafka) on
setting up a cluster on aws. Does anyone have any sources?
The question I have off the bat is, what methods have already been explored
to generate a unique broker id? If I spin up a new server, do I just need
to maintain my own broker-id list somewhere so I don't re-use an already
allocated broker id?
Also, I read an article about a broker going down and requiring a new
broker be spun up with the same id. Is this also something I need to
implement?
I want to setup a kafka auto-scaling group on AWS, so I can add brokers at
well or based on load. It doesn't seem too complicated, or maybe I'm too
green to see it, but I don't want to re-invent everything myself.
I know Loggly uses AWS/Kafka, so I'm hunting for more details on that too.
Thanks for any help
setting up a cluster on aws. Does anyone have any sources?
The question I have off the bat is, what methods have already been explored
to generate a unique broker id? If I spin up a new server, do I just need
to maintain my own broker-id list somewhere so I don't re-use an already
allocated broker id?
Also, I read an article about a broker going down and requiring a new
broker be spun up with the same id. Is this also something I need to
implement?
I want to setup a kafka auto-scaling group on AWS, so I can add brokers at
well or based on load. It doesn't seem too complicated, or maybe I'm too
green to see it, but I don't want to re-invent everything myself.
I know Loggly uses AWS/Kafka, so I'm hunting for more details on that too.
Thanks for any help