I installed zookeeper 3.4.5 in a 3-node cluster and started it. I think
zookeeper works well because the HBase cluster, which relies on zookeeper,
indeed works well. But when I tried to query zookeeper's status, it
reported:
[root [ at ] imon-1 zookeeper-3.4.5]# bin/zkServer.sh status
JMX enabled by default
Using config: /usr/local/apache/zookeeper-3.4.5/bin/../conf/zoo.cfg
Error contacting service. It is probably not running.
I checked the log and found it reported the following:
2014-02-11 15:42:15,623 [myid:] - INFO [main:QuorumPeerConfig [ at ] 101] -
Reading configuration from:
/usr/local/apache/zookeeper-3.4.5/bin/../conf/zoo.cfg
2014-02-11 15:42:15,629 [myid:] - INFO [main:QuorumPeerConfig [ at ] 334] -
Defaulting to majority quorums
2014-02-11 15:42:15,652 [myid:1] - INFO [main:DatadirCleanupManager [ at ] 78] -
autopurge.snapRetainCount set to 3
2014-02-11 15:42:15,652 [myid:1] - INFO [main:DatadirCleanupManager [ at ] 79] -
autopurge.purgeInterval set to 0
2014-02-11 15:42:15,653 [myid:1] - INFO [main:DatadirCleanupManager [ at ] 101] -
Purge task is not scheduled.
2014-02-11 15:42:15,683 [myid:1] - INFO [main:QuorumPeerMain [ at ] 127] -
Starting quorum peer
2014-02-11 15:42:15,726 [myid:1] - INFO [main:NIOServerCnxnFactory [ at ] 94] -
binding to port 0.0.0.0/0.0.0.0:2181
2014-02-11 15:42:15,759 [myid:1] - INFO [main:QuorumPeer [ at ] 913] - tickTime
set to 2000
2014-02-11 15:42:15,760 [myid:1] - INFO [main:QuorumPeer [ at ] 933] -
minSessionTimeout set to -1
2014-02-11 15:42:15,760 [myid:1] - INFO [main:QuorumPeer [ at ] 944] -
maxSessionTimeout set to -1
2014-02-11 15:42:15,760 [myid:1] - INFO [main:QuorumPeer [ at ] 959] - initLimit
set to 10
2014-02-11 15:42:15,874 [myid:1] - INFO [main:FileSnap [ at ] 83] - Reading
snapshot /var/data/zk/dataDir/version-2/snapshot.100072a68
2014-02-11 15:42:18,211 [myid:1] - INFO
[Thread-1:QuorumCnxManager$Listener [ at ] 486] - My election bind port:
0.0.0.0/0.0.0.0:3888
2014-02-11 15:42:18,226 [myid:1] - INFO [QuorumPeer[myid=1]/0.0.0.0:2181
:QuorumPeer [ at ] 670] - LOOKING
2014-02-11 15:42:18,232 [myid:1] - INFO [QuorumPeer[myid=1]/0.0.0.0:2181
:FastLeaderElection [ at ] 740] - New election. My id = 1, proposed
zxid=0x1000735ac
2014-02-11 15:42:18,234 [myid:1] - INFO
[WorkerReceiver[myid=1]:FastLeaderElection [ at ] 542] - Notification: 1
(n.leader), 0x1000735ac (n.zxid), 0x1 (n.round), LOOKING (n.state), 1
(n.sid), 0x1 (n.peerEPoch), LOOKING (my state)
2014-02-11 15:42:18,256 [myid:1] - WARN
[WorkerSender[myid=1]:QuorumCnxManager [ at ] 368] - Cannot open channel to 2 at
election address imon-2/172.16.38.144:3888
java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at
org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:354)
at
org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:327)
at
org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:393)
at
org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:365)
at java.lang.Thread.run(Thread.java:662)
2014-02-11 15:42:18,268 [myid:1] - WARN
[WorkerSender[myid=1]:QuorumCnxManager [ at ] 368] - Cannot open channel to 3 at
election address imon-3/172.16.38.145:3888
java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at
org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:354)
at
org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:327)
at
org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:393)
at
org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:365)
at java.lang.Thread.run(Thread.java:662)
2014-02-11 15:42:18,436 [myid:1] - WARN [QuorumPeer[myid=1]/0.0.0.0:2181
:QuorumCnxManager [ at ] 368] - Cannot open channel to 2 at election address
imon-2/172.16.38.144:3888
java.net.ConnectException: Connection refused
... ...
Do these warnings matter? What is the reason.
zookeeper works well because the HBase cluster, which relies on zookeeper,
indeed works well. But when I tried to query zookeeper's status, it
reported:
[root [ at ] imon-1 zookeeper-3.4.5]# bin/zkServer.sh status
JMX enabled by default
Using config: /usr/local/apache/zookeeper-3.4.5/bin/../conf/zoo.cfg
Error contacting service. It is probably not running.
I checked the log and found it reported the following:
2014-02-11 15:42:15,623 [myid:] - INFO [main:QuorumPeerConfig [ at ] 101] -
Reading configuration from:
/usr/local/apache/zookeeper-3.4.5/bin/../conf/zoo.cfg
2014-02-11 15:42:15,629 [myid:] - INFO [main:QuorumPeerConfig [ at ] 334] -
Defaulting to majority quorums
2014-02-11 15:42:15,652 [myid:1] - INFO [main:DatadirCleanupManager [ at ] 78] -
autopurge.snapRetainCount set to 3
2014-02-11 15:42:15,652 [myid:1] - INFO [main:DatadirCleanupManager [ at ] 79] -
autopurge.purgeInterval set to 0
2014-02-11 15:42:15,653 [myid:1] - INFO [main:DatadirCleanupManager [ at ] 101] -
Purge task is not scheduled.
2014-02-11 15:42:15,683 [myid:1] - INFO [main:QuorumPeerMain [ at ] 127] -
Starting quorum peer
2014-02-11 15:42:15,726 [myid:1] - INFO [main:NIOServerCnxnFactory [ at ] 94] -
binding to port 0.0.0.0/0.0.0.0:2181
2014-02-11 15:42:15,759 [myid:1] - INFO [main:QuorumPeer [ at ] 913] - tickTime
set to 2000
2014-02-11 15:42:15,760 [myid:1] - INFO [main:QuorumPeer [ at ] 933] -
minSessionTimeout set to -1
2014-02-11 15:42:15,760 [myid:1] - INFO [main:QuorumPeer [ at ] 944] -
maxSessionTimeout set to -1
2014-02-11 15:42:15,760 [myid:1] - INFO [main:QuorumPeer [ at ] 959] - initLimit
set to 10
2014-02-11 15:42:15,874 [myid:1] - INFO [main:FileSnap [ at ] 83] - Reading
snapshot /var/data/zk/dataDir/version-2/snapshot.100072a68
2014-02-11 15:42:18,211 [myid:1] - INFO
[Thread-1:QuorumCnxManager$Listener [ at ] 486] - My election bind port:
0.0.0.0/0.0.0.0:3888
2014-02-11 15:42:18,226 [myid:1] - INFO [QuorumPeer[myid=1]/0.0.0.0:2181
:QuorumPeer [ at ] 670] - LOOKING
2014-02-11 15:42:18,232 [myid:1] - INFO [QuorumPeer[myid=1]/0.0.0.0:2181
:FastLeaderElection [ at ] 740] - New election. My id = 1, proposed
zxid=0x1000735ac
2014-02-11 15:42:18,234 [myid:1] - INFO
[WorkerReceiver[myid=1]:FastLeaderElection [ at ] 542] - Notification: 1
(n.leader), 0x1000735ac (n.zxid), 0x1 (n.round), LOOKING (n.state), 1
(n.sid), 0x1 (n.peerEPoch), LOOKING (my state)
2014-02-11 15:42:18,256 [myid:1] - WARN
[WorkerSender[myid=1]:QuorumCnxManager [ at ] 368] - Cannot open channel to 2 at
election address imon-2/172.16.38.144:3888
java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at
org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:354)
at
org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:327)
at
org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:393)
at
org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:365)
at java.lang.Thread.run(Thread.java:662)
2014-02-11 15:42:18,268 [myid:1] - WARN
[WorkerSender[myid=1]:QuorumCnxManager [ at ] 368] - Cannot open channel to 3 at
election address imon-3/172.16.38.145:3888
java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at
org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:354)
at
org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:327)
at
org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:393)
at
org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:365)
at java.lang.Thread.run(Thread.java:662)
2014-02-11 15:42:18,436 [myid:1] - WARN [QuorumPeer[myid=1]/0.0.0.0:2181
:QuorumCnxManager [ at ] 368] - Cannot open channel to 2 at election address
imon-2/172.16.38.144:3888
java.net.ConnectException: Connection refused
... ...
Do these warnings matter? What is the reason.