2025-08-26 21:29:52,474 [myid:] - INFO [main:QuorumPeerConfig@174] - Reading configuration from: /conf/zoo.cfg 2025-08-26 21:29:52,482 [myid:] - INFO [main:QuorumPeerConfig@441] - clientPortAddress is 10.0.0.22:2181 2025-08-26 21:29:52,482 [myid:] - INFO [main:QuorumPeerConfig@448] - secureClientPort is not set 2025-08-26 21:29:52,482 [myid:] - INFO [main:QuorumPeerConfig@464] - observerMasterPort is not set 2025-08-26 21:29:52,482 [myid:] - INFO [main:QuorumPeerConfig@481] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider 2025-08-26 21:29:52,494 [myid:2] - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3 2025-08-26 21:29:52,494 [myid:2] - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0 2025-08-26 21:29:52,494 [myid:2] - INFO [main:DatadirCleanupManager@101] - Purge task is not scheduled. 2025-08-26 21:29:52,494 [myid:2] - INFO [main:ManagedUtil@46] - Log4j 1.2 jmx support not found; jmx disabled. 2025-08-26 21:29:52,495 [myid:2] - INFO [main:QuorumPeerMain@152] - Starting quorum peer, myid=2 2025-08-26 21:29:52,511 [myid:2] - INFO [main:ServerMetrics@62] - ServerMetrics initialized with provider org.apache.zookeeper.metrics.impl.DefaultMetricsProvider@6bdf28bb 2025-08-26 21:29:52,514 [myid:2] - INFO [main:DigestAuthenticationProvider@47] - ACL digest algorithm is: SHA1 2025-08-26 21:29:52,514 [myid:2] - INFO [main:DigestAuthenticationProvider@61] - zookeeper.DigestAuthenticationProvider.enabled = true 2025-08-26 21:29:52,519 [myid:2] - INFO [main:ServerCnxnFactory@169] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory 2025-08-26 21:29:52,520 [myid:2] - WARN [main:ServerCnxnFactory@309] - maxCnxns is not configured, using default value 0. 2025-08-26 21:29:52,521 [myid:2] - INFO [main:NIOServerCnxnFactory@652] - Configuring NIO connection handler with 10s sessionless connection timeout, 1 selector thread(s), 8 worker threads, and 64 kB direct buffers. 2025-08-26 21:29:52,527 [myid:2] - INFO [main:NIOServerCnxnFactory@660] - binding to port /10.0.0.22:2181 2025-08-26 21:29:52,534 [myid:2] - INFO [main:QuorumPeer@797] - zookeeper.quorumCnxnTimeoutMs=-1 2025-08-26 21:29:52,541 [myid:2] - INFO [main:X509Util@77] - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation 2025-08-26 21:29:52,547 [myid:2] - INFO [main:FileTxnSnapLog@124] - zookeeper.snapshot.trust.empty : true 2025-08-26 21:29:52,552 [myid:2] - INFO [main:QuorumPeer@1747] - Local sessions disabled 2025-08-26 21:29:52,552 [myid:2] - INFO [main:QuorumPeer@1758] - Local session upgrading disabled 2025-08-26 21:29:52,552 [myid:2] - INFO [main:QuorumPeer@1725] - tickTime set to 2000 2025-08-26 21:29:52,553 [myid:2] - INFO [main:QuorumPeer@1769] - minSessionTimeout set to 4000 2025-08-26 21:29:52,553 [myid:2] - INFO [main:QuorumPeer@1780] - maxSessionTimeout set to 40000 2025-08-26 21:29:52,553 [myid:2] - INFO [main:QuorumPeer@1805] - initLimit set to 5 2025-08-26 21:29:52,553 [myid:2] - INFO [main:QuorumPeer@1992] - syncLimit set to 2 2025-08-26 21:29:52,554 [myid:2] - INFO [main:QuorumPeer@2007] - connectToLearnerMasterLimit set to 0 2025-08-26 21:29:52,584 [myid:2] - INFO [main:ZookeeperBanner@42] - 2025-08-26 21:29:52,585 [myid:2] - INFO [main:ZookeeperBanner@42] - ______ _ 2025-08-26 21:29:52,585 [myid:2] - INFO [main:ZookeeperBanner@42] - |___ / | | 2025-08-26 21:29:52,585 [myid:2] - INFO [main:ZookeeperBanner@42] - / / ___ ___ | | __ ___ ___ _ __ ___ _ __ 2025-08-26 21:29:52,587 [myid:2] - INFO [main:ZookeeperBanner@42] - / / / _ \ / _ \ | |/ / / _ \ / _ \ | '_ \ / _ \ | '__| 2025-08-26 21:29:52,587 [myid:2] - INFO [main:ZookeeperBanner@42] - / /__ | (_) | | (_) | | < | __/ | __/ | |_) | | __/ | | 2025-08-26 21:29:52,587 [myid:2] - INFO [main:ZookeeperBanner@42] - /_____| \___/ \___/ |_|\_\ \___| \___| | .__/ \___| |_| 2025-08-26 21:29:52,587 [myid:2] - INFO [main:ZookeeperBanner@42] - | | 2025-08-26 21:29:52,587 [myid:2] - INFO [main:ZookeeperBanner@42] - |_| 2025-08-26 21:29:52,587 [myid:2] - INFO [main:ZookeeperBanner@42] - 2025-08-26 21:29:52,590 [myid:2] - INFO [main:Environment@98] - Server environment:zookeeper.version=3.7.1-a2fb57c55f8e59cdd76c34b357ad5181df1258d5, built on 2022-05-07 06:45 UTC 2025-08-26 21:29:52,590 [myid:2] - INFO [main:Environment@98] - Server environment:host.name=cn-jenkins-deploy-platform-ansible-os-3945-2. 2025-08-26 21:29:52,590 [myid:2] - INFO [main:Environment@98] - Server environment:java.version=1.8.0_402 2025-08-26 21:29:52,590 [myid:2] - INFO [main:Environment@98] - Server environment:java.vendor=Red Hat, Inc. 2025-08-26 21:29:52,590 [myid:2] - INFO [main:Environment@98] - Server environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.402.b06-1.el7_9.x86_64/jre 2025-08-26 21:29:52,591 [myid:2] - INFO [main:Environment@98] - Server environment:java.class.path=/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/target/classes:/apache-zookeeper-3.7.1-bin/bin/../build/classes:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/target/lib/*.jar:/apache-zookeeper-3.7.1-bin/bin/../build/lib/*.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-prometheus-metrics-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-jute-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/snappy-java-1.1.7.7.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/slf4j-reload4j-1.7.35.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/slf4j-api-1.7.35.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_servlet-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_hotspot-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_common-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/reload4j-1.2.19.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-native-unix-common-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-native-epoll-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-classes-epoll-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-resolver-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-handler-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-common-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-codec-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-buffer-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/metrics-core-4.1.12.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jline-2.14.6.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-util-ajax-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-util-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-servlet-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-server-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-security-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-io-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-http-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-databind-2.13.2.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-core-2.13.2.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-annotations-2.13.2.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/commons-cli-1.4.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/audience-annotations-0.12.0.jar:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-*.jar:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/conf: 2025-08-26 21:29:52,593 [myid:2] - INFO [main:Environment@98] - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2025-08-26 21:29:52,593 [myid:2] - INFO [main:Environment@98] - Server environment:java.io.tmpdir=/tmp 2025-08-26 21:29:52,593 [myid:2] - INFO [main:Environment@98] - Server environment:java.compiler= 2025-08-26 21:29:52,594 [myid:2] - INFO [main:Environment@98] - Server environment:os.name=Linux 2025-08-26 21:29:52,594 [myid:2] - INFO [main:Environment@98] - Server environment:os.arch=amd64 2025-08-26 21:29:52,594 [myid:2] - INFO [main:Environment@98] - Server environment:os.version=5.15.0-100-generic 2025-08-26 21:29:52,594 [myid:2] - INFO [main:Environment@98] - Server environment:user.name=zookeeper 2025-08-26 21:29:52,594 [myid:2] - INFO [main:Environment@98] - Server environment:user.home=/home/zookeeper 2025-08-26 21:29:52,594 [myid:2] - INFO [main:Environment@98] - Server environment:user.dir=/apache-zookeeper-3.7.1-bin 2025-08-26 21:29:52,594 [myid:2] - INFO [main:Environment@98] - Server environment:os.memory.free=222MB 2025-08-26 21:29:52,595 [myid:2] - INFO [main:Environment@98] - Server environment:os.memory.max=889MB 2025-08-26 21:29:52,595 [myid:2] - INFO [main:Environment@98] - Server environment:os.memory.total=238MB 2025-08-26 21:29:52,595 [myid:2] - INFO [main:ZooKeeperServer@138] - zookeeper.enableEagerACLCheck = false 2025-08-26 21:29:52,596 [myid:2] - INFO [main:ZooKeeperServer@151] - zookeeper.digest.enabled = true 2025-08-26 21:29:52,596 [myid:2] - INFO [main:ZooKeeperServer@155] - zookeeper.closeSessionTxn.enabled = true 2025-08-26 21:29:52,596 [myid:2] - INFO [main:ZooKeeperServer@1505] - zookeeper.flushDelay=0 2025-08-26 21:29:52,596 [myid:2] - INFO [main:ZooKeeperServer@1514] - zookeeper.maxWriteQueuePollTime=0 2025-08-26 21:29:52,596 [myid:2] - INFO [main:ZooKeeperServer@1523] - zookeeper.maxBatchSize=1000 2025-08-26 21:29:52,596 [myid:2] - INFO [main:ZooKeeperServer@260] - zookeeper.intBufferStartingSizeBytes = 1024 2025-08-26 21:29:52,602 [myid:2] - INFO [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager 2025-08-26 21:29:52,603 [myid:2] - INFO [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager 2025-08-26 21:29:52,603 [myid:2] - INFO [main:ZKDatabase@133] - zookeeper.snapshotSizeFactor = 0.33 2025-08-26 21:29:52,603 [myid:2] - INFO [main:ZKDatabase@153] - zookeeper.commitLogCount=500 2025-08-26 21:29:52,630 [myid:2] - INFO [main:QuorumPeer@2071] - Using insecure (non-TLS) quorum communication 2025-08-26 21:29:52,640 [myid:2] - INFO [main:QuorumPeer@2077] - Port unification disabled 2025-08-26 21:29:52,640 [myid:2] - INFO [main:QuorumPeer@180] - multiAddress.enabled set to false 2025-08-26 21:29:52,640 [myid:2] - INFO [main:QuorumPeer@205] - multiAddress.reachabilityCheckEnabled set to true 2025-08-26 21:29:52,640 [myid:2] - INFO [main:QuorumPeer@192] - multiAddress.reachabilityCheckTimeoutMs set to 1000 2025-08-26 21:29:52,641 [myid:2] - INFO [main:QuorumPeer@2532] - QuorumPeer communication is not secured! (SASL auth disabled) 2025-08-26 21:29:52,641 [myid:2] - INFO [main:QuorumPeer@2557] - quorum.cnxn.threads.size set to 20 2025-08-26 21:29:52,646 [myid:2] - INFO [main:SnapStream@61] - zookeeper.snapshot.compression.method = CHECKED 2025-08-26 21:29:52,647 [myid:2] - INFO [main:FileTxnSnapLog@479] - Snapshotting: 0x0 to /data/version-2/snapshot.0 2025-08-26 21:29:52,649 [myid:2] - INFO [main:ZKDatabase@290] - Snapshot loaded in 8 ms, highest zxid is 0x0, digest is 1371985504 2025-08-26 21:29:52,651 [myid:2] - INFO [main:QuorumPeer@1157] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation 2025-08-26 21:29:52,657 [myid:2] - INFO [main:QuorumPeer@1185] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation 2025-08-26 21:29:52,678 [myid:2] - INFO [main:QuorumPeer@2574] - Using 4000ms as the quorum cnxn socket timeout 2025-08-26 21:29:52,700 [myid:2] - INFO [main:QuorumCnxManager$Listener@924] - Election port bind maximum retries is 3 2025-08-26 21:29:52,707 [myid:2] - INFO [main:FastLeaderElection@89] - zookeeper.fastleader.minNotificationInterval=200 2025-08-26 21:29:52,707 [myid:2] - INFO [main:FastLeaderElection@91] - zookeeper.fastleader.maxNotificationInterval=60000 2025-08-26 21:29:52,715 [myid:2] - INFO [ListenerHandler-/10.0.0.22:3888:QuorumCnxManager$Listener$ListenerHandler@1071] - 2 is accepting connections now, my election bind port: /10.0.0.22:3888 2025-08-26 21:29:52,718 [myid:2] - INFO [main:ZKAuditProvider@42] - ZooKeeper audit is disabled. 2025-08-26 21:29:52,731 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):QuorumPeer@1438] - LOOKING 2025-08-26 21:29:52,732 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):FastLeaderElection@945] - New election. My id = 2, proposed zxid=0x0 2025-08-26 21:29:52,746 [myid:2] - WARN [QuorumConnectionThread-[myid=2]-1:QuorumCnxManager@401] - Cannot open channel to 1 at election address /10.0.0.254:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-08-26 21:29:52,751 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:2, n.state:LOOKING, n.leader:2, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-08-26 21:29:52,754 [myid:2] - WARN [QuorumConnectionThread-[myid=2]-2:QuorumCnxManager@401] - Cannot open channel to 3 at election address /10.0.0.33:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-08-26 21:29:52,966 [myid:2] - WARN [QuorumConnectionThread-[myid=2]-3:QuorumCnxManager@401] - Cannot open channel to 1 at election address /10.0.0.254:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-08-26 21:29:52,967 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):FastLeaderElection@980] - Notification time out: 400 2025-08-26 21:29:52,969 [myid:2] - INFO [QuorumConnectionThread-[myid=2]-2:QuorumCnxManager@514] - Have smaller server identifier, so dropping the connection: (myId:2 --> sid:3) 2025-08-26 21:29:52,973 [myid:2] - INFO [ListenerHandler-/10.0.0.22:3888:QuorumCnxManager$Listener$ListenerHandler@1076] - Received connection request from /10.0.0.33:47646 2025-08-26 21:29:52,982 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:3, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-08-26 21:29:52,985 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:2, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-08-26 21:29:53,000 [myid:2] - WARN [QuorumConnectionThread-[myid=2]-2:QuorumCnxManager@401] - Cannot open channel to 1 at election address /10.0.0.254:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-08-26 21:29:53,185 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):QuorumPeer@902] - Peer state changed: following 2025-08-26 21:29:53,186 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):QuorumPeer@1520] - FOLLOWING 2025-08-26 21:29:53,190 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):Learner@130] - leaderConnectDelayDuringRetryMs: 100 2025-08-26 21:29:53,191 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):Learner@131] - TCP NoDelay set to: true 2025-08-26 21:29:53,191 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):Learner@132] - zookeeper.learner.asyncSending = false 2025-08-26 21:29:53,191 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):Learner@133] - zookeeper.learner.closeSocketAsync = false 2025-08-26 21:29:53,192 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):BlueThrottle@141] - Weighed connection throttling is disabled 2025-08-26 21:29:53,193 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):ZooKeeperServer@1306] - minSessionTimeout set to 4000 2025-08-26 21:29:53,194 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):ZooKeeperServer@1315] - maxSessionTimeout set to 40000 2025-08-26 21:29:53,194 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):ResponseCache@45] - getData response cache size is initialized with value 400. 2025-08-26 21:29:53,201 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):ResponseCache@45] - getChildren response cache size is initialized with value 400. 2025-08-26 21:29:53,202 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):RequestPathMetricsCollector@109] - zookeeper.pathStats.slotCapacity = 60 2025-08-26 21:29:53,202 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):RequestPathMetricsCollector@110] - zookeeper.pathStats.slotDuration = 15 2025-08-26 21:29:53,202 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):RequestPathMetricsCollector@111] - zookeeper.pathStats.maxDepth = 6 2025-08-26 21:29:53,203 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):RequestPathMetricsCollector@112] - zookeeper.pathStats.initialDelay = 5 2025-08-26 21:29:53,203 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):RequestPathMetricsCollector@113] - zookeeper.pathStats.delay = 5 2025-08-26 21:29:53,203 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):RequestPathMetricsCollector@114] - zookeeper.pathStats.enabled = false 2025-08-26 21:29:53,207 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):ZooKeeperServer@1542] - The max bytes for all large requests are set to 104857600 2025-08-26 21:29:53,207 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):ZooKeeperServer@1556] - The large request threshold is set to -1 2025-08-26 21:29:53,207 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):AuthenticationHelper@66] - zookeeper.enforce.auth.enabled = false 2025-08-26 21:29:53,207 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):AuthenticationHelper@67] - zookeeper.enforce.auth.schemes = [] 2025-08-26 21:29:53,208 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):ZooKeeperServer@361] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 clientPortListenBacklog -1 datadir /data/version-2 snapdir /data/version-2 2025-08-26 21:29:53,209 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):Follower@77] - FOLLOWING - LEADER ELECTION TOOK - 476 MS 2025-08-26 21:29:53,214 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - discovery 2025-08-26 21:29:53,217 [myid:2] - WARN [LeaderConnector-/10.0.0.33:2888:Learner$LeaderConnector@448] - Unexpected exception, tries=0, remaining init limit=10000, connecting to /10.0.0.33:2888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.Learner.sockConnect(Learner.java:305) at org.apache.zookeeper.server.quorum.Learner$LeaderConnector.connectToLeader(Learner.java:422) at org.apache.zookeeper.server.quorum.Learner$LeaderConnector.run(Learner.java:380) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-08-26 21:29:53,318 [myid:2] - INFO [LeaderConnector-/10.0.0.33:2888:Learner$LeaderConnector@384] - Successfully connected to leader, using address: /10.0.0.33:2888 2025-08-26 21:29:53,355 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - synchronization 2025-08-26 21:29:53,365 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):Learner@565] - Getting a diff from the leader 0x0 2025-08-26 21:29:53,365 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):QuorumPeer@921] - Peer state changed: following - synchronization - diff 2025-08-26 21:29:53,371 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):Learner@737] - Learner received NEWLEADER message 2025-08-26 21:29:53,372 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):QuorumPeer@1875] - Dynamic reconfig is disabled, we don't store the last seen config. 2025-08-26 21:29:53,389 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):QuorumPeer@921] - Peer state changed: following - synchronization 2025-08-26 21:29:53,393 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):CommitProcessor@491] - Configuring CommitProcessor with readBatchSize -1 commitBatchSize 1 2025-08-26 21:29:53,394 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):CommitProcessor@452] - Configuring CommitProcessor with 4 worker threads. 2025-08-26 21:29:53,398 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):FollowerRequestProcessor@59] - Initialized FollowerRequestProcessor with zookeeper.follower.skipLearnerRequestToNextProcessor as false 2025-08-26 21:29:53,401 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):RequestThrottler@75] - zookeeper.request_throttler.shutdownTimeout = 10000 2025-08-26 21:29:53,455 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):Learner@721] - Learner received UPTODATE message 2025-08-26 21:29:53,456 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - broadcast 2025-08-26 21:29:53,602 [myid:2] - INFO [ListenerHandler-/10.0.0.22:3888:QuorumCnxManager$Listener$ListenerHandler@1076] - Received connection request from /10.0.0.254:34506 2025-08-26 21:29:53,621 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:FOLLOWING; n.sid:1, n.state:LOOKING, n.leader:1, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-08-26 21:29:53,648 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:FOLLOWING; n.sid:1, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-08-26 21:30:48,534 [myid:2] - WARN [QuorumPeer[myid=2](plain=10.0.0.22:2181)(secure=disabled):Follower@169] - Got zxid 0x100000001 expected 0x1 2025-08-26 21:30:48,535 [myid:2] - INFO [SyncThread:2:FileTxnLog@284] - Creating new log file: log.100000001 2025-08-26 21:30:48,545 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001962550000 2025-08-26 21:30:49,076 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490000 2025-08-26 21:30:49,076 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490001 2025-08-26 21:30:49,114 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001962550001 2025-08-26 21:30:49,253 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001962550002 2025-08-26 21:30:49,449 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f330000 2025-08-26 21:30:49,589 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001962550003 2025-08-26 21:30:49,716 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001962550004 2025-08-26 21:30:49,789 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001962550005 2025-08-26 21:30:49,853 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490002 2025-08-26 21:30:49,899 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490003 2025-08-26 21:30:49,935 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f330001 2025-08-26 21:30:50,509 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f330002 2025-08-26 21:30:50,806 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f330003 2025-08-26 21:30:50,846 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490004 2025-08-26 21:31:12,121 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490005 2025-08-26 21:31:18,753 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f330004 2025-08-26 21:31:18,906 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f330005 2025-08-26 21:31:19,351 [myid:2] - WARN [NIOWorkerThread-5:NIOServerCnxn@371] - Unexpected exception EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /10.0.0.33:49734, session = 0x200001962550004 at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:170) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:333) at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:508) at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-08-26 21:31:21,966 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001962550006 2025-08-26 21:31:27,434 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f330006 2025-08-26 21:31:27,510 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f330007 2025-08-26 21:31:27,513 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f330008 2025-08-26 21:31:27,601 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490006 2025-08-26 21:32:31,734 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001962550007 2025-08-26 21:32:46,076 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001962550008 2025-08-26 21:32:46,125 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490007 2025-08-26 21:32:46,126 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001962550009 2025-08-26 21:32:47,090 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x20000196255000a 2025-08-26 21:32:47,150 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490008 2025-08-26 21:32:47,156 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490009 2025-08-26 21:32:51,945 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f330009 2025-08-26 21:32:51,982 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x20000196255000b 2025-08-26 21:32:52,094 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c49000a 2025-08-26 21:32:55,839 [myid:2] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x20000196255000a 2025-08-26 21:33:01,486 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c49000b 2025-08-26 21:33:02,143 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x20000196255000c 2025-08-26 21:33:03,789 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c49000c 2025-08-26 21:33:05,797 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c49000d 2025-08-26 21:33:05,957 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c49000e 2025-08-26 21:33:06,141 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x20000196255000d 2025-08-26 21:33:06,251 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c49000f 2025-08-26 21:33:06,635 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f33000a 2025-08-26 21:33:06,734 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490010 2025-08-26 21:33:15,037 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f33000b 2025-08-26 21:33:15,097 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490011 2025-08-26 21:33:15,118 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x20000196255000e 2025-08-26 21:33:15,218 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490012 2025-08-26 21:33:15,230 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x20000196255000f 2025-08-26 21:33:15,260 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f33000c 2025-08-26 21:33:15,363 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f33000d 2025-08-26 21:33:15,384 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f33000e 2025-08-26 21:33:15,403 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001962550010 2025-08-26 21:33:15,470 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001a8c490013 2025-08-26 21:33:15,537 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f33000f 2025-08-26 21:33:15,612 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000189f330010 2025-08-26 21:36:15,260 [myid:2] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x10000cac1 to /data/version-2/snapshot.10000cac1 2025-08-26 21:36:15,266 [myid:2] - INFO [SyncThread:2:FileTxnLog@284] - Creating new log file: log.10000cac3 2025-08-26 21:36:15,287 [myid:2] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 27 ms 2025-08-26 21:41:29,839 [myid:2] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x100021b87 to /data/version-2/snapshot.100021b87 2025-08-26 21:41:29,841 [myid:2] - INFO [SyncThread:2:FileTxnLog@284] - Creating new log file: log.100021b89 2025-08-26 21:41:29,846 [myid:2] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 7 ms 2025-08-26 21:46:17,743 [myid:2] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x10003533a to /data/version-2/snapshot.10003533a 2025-08-26 21:46:17,751 [myid:2] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 7 ms 2025-08-26 21:46:17,757 [myid:2] - INFO [SyncThread:2:FileTxnLog@284] - Creating new log file: log.10003533c 2025-08-26 21:50:22,615 [myid:2] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x100045e55 to /data/version-2/snapshot.100045e55 2025-08-26 21:50:22,620 [myid:2] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 5 ms 2025-08-26 21:50:22,622 [myid:2] - INFO [SyncThread:2:FileTxnLog@284] - Creating new log file: log.100045e56 2025-08-26 21:55:38,009 [myid:2] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x10005b64e to /data/version-2/snapshot.10005b64e 2025-08-26 21:55:38,010 [myid:2] - INFO [SyncThread:2:FileTxnLog@284] - Creating new log file: log.10005b650 2025-08-26 21:55:38,016 [myid:2] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 6 ms