Quantcast
Channel: Apache Timeline
Viewing all articles
Browse latest Browse all 5648

Zookeeper for storing huge centralize data and Max possible No of zNodes - Please advise

$
0
0
Hi Folks,

I am planning to use ZooKeeper znodes to store my key value data.
Name of the znode will be my key and data present inside it will be my
value.

The problem is I can have millions of key/value pairs.

Is the zookeeper recommended to solve this type of problem. I read about
the zookeeper that
it is not an actual File system but a splitted File system and should be
used only for distributed coordination service.

My requirement is something like this that I need a global place to store
these key values so that all the jobs can access it and even if some job
create a new znode then my other jobs can see these changes with the help
of watcher.

Would you guys recommend using ZooKeeper for above problem statement ?

I have also read in one of the mail archive on the limitation of max no of
znodes , if this limitation still exists then may be this solution won't
work in my case.

http://zookeeper-user.578899.n2.nabble.com/Question-regarding-the-maximum-number-of-ZNODES-a-zookeeper-td6979604.html

Please advise

Many Thanks
Saurabh

Viewing all articles
Browse latest Browse all 5648

Trending Articles