2025-10-20 05:03:51,863 [myid:] - INFO [main:QuorumPeerConfig@174] - Reading configuration from: /conf/zoo.cfg 2025-10-20 05:03:51,872 [myid:] - INFO [main:QuorumPeerConfig@441] - clientPortAddress is 10.0.0.48:2181 2025-10-20 05:03:51,873 [myid:] - INFO [main:QuorumPeerConfig@448] - secureClientPort is not set 2025-10-20 05:03:51,873 [myid:] - INFO [main:QuorumPeerConfig@464] - observerMasterPort is not set 2025-10-20 05:03:51,874 [myid:] - INFO [main:QuorumPeerConfig@481] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider 2025-10-20 05:03:51,884 [myid:2] - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3 2025-10-20 05:03:51,884 [myid:2] - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0 2025-10-20 05:03:51,885 [myid:2] - INFO [main:DatadirCleanupManager@101] - Purge task is not scheduled. 2025-10-20 05:03:51,887 [myid:2] - INFO [main:ManagedUtil@46] - Log4j 1.2 jmx support not found; jmx disabled. 2025-10-20 05:03:51,888 [myid:2] - INFO [main:QuorumPeerMain@152] - Starting quorum peer, myid=2 2025-10-20 05:03:51,905 [myid:2] - INFO [main:ServerMetrics@62] - ServerMetrics initialized with provider org.apache.zookeeper.metrics.impl.DefaultMetricsProvider@6bdf28bb 2025-10-20 05:03:51,909 [myid:2] - INFO [main:DigestAuthenticationProvider@47] - ACL digest algorithm is: SHA1 2025-10-20 05:03:51,910 [myid:2] - INFO [main:DigestAuthenticationProvider@61] - zookeeper.DigestAuthenticationProvider.enabled = true 2025-10-20 05:03:51,917 [myid:2] - INFO [main:ServerCnxnFactory@169] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory 2025-10-20 05:03:51,917 [myid:2] - WARN [main:ServerCnxnFactory@309] - maxCnxns is not configured, using default value 0. 2025-10-20 05:03:51,919 [myid:2] - INFO [main:NIOServerCnxnFactory@652] - Configuring NIO connection handler with 10s sessionless connection timeout, 1 selector thread(s), 8 worker threads, and 64 kB direct buffers. 2025-10-20 05:03:51,926 [myid:2] - INFO [main:NIOServerCnxnFactory@660] - binding to port /10.0.0.48:2181 2025-10-20 05:03:51,933 [myid:2] - INFO [main:QuorumPeer@797] - zookeeper.quorumCnxnTimeoutMs=-1 2025-10-20 05:03:51,940 [myid:2] - INFO [main:X509Util@77] - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation 2025-10-20 05:03:51,943 [myid:2] - INFO [main:FileTxnSnapLog@124] - zookeeper.snapshot.trust.empty : true 2025-10-20 05:03:51,948 [myid:2] - INFO [main:QuorumPeer@1747] - Local sessions disabled 2025-10-20 05:03:51,949 [myid:2] - INFO [main:QuorumPeer@1758] - Local session upgrading disabled 2025-10-20 05:03:51,949 [myid:2] - INFO [main:QuorumPeer@1725] - tickTime set to 2000 2025-10-20 05:03:51,949 [myid:2] - INFO [main:QuorumPeer@1769] - minSessionTimeout set to 4000 2025-10-20 05:03:51,950 [myid:2] - INFO [main:QuorumPeer@1780] - maxSessionTimeout set to 40000 2025-10-20 05:03:51,950 [myid:2] - INFO [main:QuorumPeer@1805] - initLimit set to 5 2025-10-20 05:03:51,950 [myid:2] - INFO [main:QuorumPeer@1992] - syncLimit set to 2 2025-10-20 05:03:51,950 [myid:2] - INFO [main:QuorumPeer@2007] - connectToLearnerMasterLimit set to 0 2025-10-20 05:03:51,984 [myid:2] - INFO [main:ZookeeperBanner@42] - 2025-10-20 05:03:51,985 [myid:2] - INFO [main:ZookeeperBanner@42] - ______ _ 2025-10-20 05:03:51,985 [myid:2] - INFO [main:ZookeeperBanner@42] - |___ / | | 2025-10-20 05:03:51,985 [myid:2] - INFO [main:ZookeeperBanner@42] - / / ___ ___ | | __ ___ ___ _ __ ___ _ __ 2025-10-20 05:03:51,985 [myid:2] - INFO [main:ZookeeperBanner@42] - / / / _ \ / _ \ | |/ / / _ \ / _ \ | '_ \ / _ \ | '__| 2025-10-20 05:03:51,985 [myid:2] - INFO [main:ZookeeperBanner@42] - / /__ | (_) | | (_) | | < | __/ | __/ | |_) | | __/ | | 2025-10-20 05:03:51,985 [myid:2] - INFO [main:ZookeeperBanner@42] - /_____| \___/ \___/ |_|\_\ \___| \___| | .__/ \___| |_| 2025-10-20 05:03:51,986 [myid:2] - INFO [main:ZookeeperBanner@42] - | | 2025-10-20 05:03:51,986 [myid:2] - INFO [main:ZookeeperBanner@42] - |_| 2025-10-20 05:03:51,986 [myid:2] - INFO [main:ZookeeperBanner@42] - 2025-10-20 05:03:51,988 [myid:2] - INFO [main:Environment@98] - Server environment:zookeeper.version=3.7.1-a2fb57c55f8e59cdd76c34b357ad5181df1258d5, built on 2022-05-07 06:45 UTC 2025-10-20 05:03:51,988 [myid:2] - INFO [main:Environment@98] - Server environment:host.name=cn-jenkins-deploy-platform-ansible-os-4371-2. 2025-10-20 05:03:51,989 [myid:2] - INFO [main:Environment@98] - Server environment:java.version=1.8.0_402 2025-10-20 05:03:51,989 [myid:2] - INFO [main:Environment@98] - Server environment:java.vendor=Red Hat, Inc. 2025-10-20 05:03:51,989 [myid:2] - INFO [main:Environment@98] - Server environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.402.b06-1.el7_9.x86_64/jre 2025-10-20 05:03:51,990 [myid:2] - INFO [main:Environment@98] - Server environment:java.class.path=/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/target/classes:/apache-zookeeper-3.7.1-bin/bin/../build/classes:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/target/lib/*.jar:/apache-zookeeper-3.7.1-bin/bin/../build/lib/*.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-prometheus-metrics-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-jute-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/snappy-java-1.1.7.7.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/slf4j-reload4j-1.7.35.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/slf4j-api-1.7.35.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_servlet-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_hotspot-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_common-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/reload4j-1.2.19.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-native-unix-common-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-native-epoll-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-classes-epoll-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-resolver-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-handler-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-common-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-codec-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-buffer-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/metrics-core-4.1.12.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jline-2.14.6.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-util-ajax-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-util-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-servlet-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-server-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-security-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-io-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-http-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-databind-2.13.2.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-core-2.13.2.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-annotations-2.13.2.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/commons-cli-1.4.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/audience-annotations-0.12.0.jar:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-*.jar:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/conf: 2025-10-20 05:03:51,992 [myid:2] - INFO [main:Environment@98] - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2025-10-20 05:03:51,992 [myid:2] - INFO [main:Environment@98] - Server environment:java.io.tmpdir=/tmp 2025-10-20 05:03:51,992 [myid:2] - INFO [main:Environment@98] - Server environment:java.compiler= 2025-10-20 05:03:51,993 [myid:2] - INFO [main:Environment@98] - Server environment:os.name=Linux 2025-10-20 05:03:51,993 [myid:2] - INFO [main:Environment@98] - Server environment:os.arch=amd64 2025-10-20 05:03:51,993 [myid:2] - INFO [main:Environment@98] - Server environment:os.version=5.15.0-100-generic 2025-10-20 05:03:51,994 [myid:2] - INFO [main:Environment@98] - Server environment:user.name=zookeeper 2025-10-20 05:03:51,994 [myid:2] - INFO [main:Environment@98] - Server environment:user.home=/home/zookeeper 2025-10-20 05:03:51,994 [myid:2] - INFO [main:Environment@98] - Server environment:user.dir=/apache-zookeeper-3.7.1-bin 2025-10-20 05:03:51,994 [myid:2] - INFO [main:Environment@98] - Server environment:os.memory.free=222MB 2025-10-20 05:03:51,994 [myid:2] - INFO [main:Environment@98] - Server environment:os.memory.max=889MB 2025-10-20 05:03:51,994 [myid:2] - INFO [main:Environment@98] - Server environment:os.memory.total=238MB 2025-10-20 05:03:51,994 [myid:2] - INFO [main:ZooKeeperServer@138] - zookeeper.enableEagerACLCheck = false 2025-10-20 05:03:51,995 [myid:2] - INFO [main:ZooKeeperServer@151] - zookeeper.digest.enabled = true 2025-10-20 05:03:51,995 [myid:2] - INFO [main:ZooKeeperServer@155] - zookeeper.closeSessionTxn.enabled = true 2025-10-20 05:03:51,995 [myid:2] - INFO [main:ZooKeeperServer@1505] - zookeeper.flushDelay=0 2025-10-20 05:03:51,995 [myid:2] - INFO [main:ZooKeeperServer@1514] - zookeeper.maxWriteQueuePollTime=0 2025-10-20 05:03:51,995 [myid:2] - INFO [main:ZooKeeperServer@1523] - zookeeper.maxBatchSize=1000 2025-10-20 05:03:51,996 [myid:2] - INFO [main:ZooKeeperServer@260] - zookeeper.intBufferStartingSizeBytes = 1024 2025-10-20 05:03:52,001 [myid:2] - INFO [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager 2025-10-20 05:03:52,002 [myid:2] - INFO [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager 2025-10-20 05:03:52,003 [myid:2] - INFO [main:ZKDatabase@133] - zookeeper.snapshotSizeFactor = 0.33 2025-10-20 05:03:52,003 [myid:2] - INFO [main:ZKDatabase@153] - zookeeper.commitLogCount=500 2025-10-20 05:03:52,025 [myid:2] - INFO [main:QuorumPeer@2071] - Using insecure (non-TLS) quorum communication 2025-10-20 05:03:52,025 [myid:2] - INFO [main:QuorumPeer@2077] - Port unification disabled 2025-10-20 05:03:52,026 [myid:2] - INFO [main:QuorumPeer@180] - multiAddress.enabled set to false 2025-10-20 05:03:52,026 [myid:2] - INFO [main:QuorumPeer@205] - multiAddress.reachabilityCheckEnabled set to true 2025-10-20 05:03:52,026 [myid:2] - INFO [main:QuorumPeer@192] - multiAddress.reachabilityCheckTimeoutMs set to 1000 2025-10-20 05:03:52,026 [myid:2] - INFO [main:QuorumPeer@2532] - QuorumPeer communication is not secured! (SASL auth disabled) 2025-10-20 05:03:52,026 [myid:2] - INFO [main:QuorumPeer@2557] - quorum.cnxn.threads.size set to 20 2025-10-20 05:03:52,046 [myid:2] - INFO [main:SnapStream@61] - zookeeper.snapshot.compression.method = CHECKED 2025-10-20 05:03:52,047 [myid:2] - INFO [main:FileTxnSnapLog@479] - Snapshotting: 0x0 to /data/version-2/snapshot.0 2025-10-20 05:03:52,049 [myid:2] - INFO [main:ZKDatabase@290] - Snapshot loaded in 23 ms, highest zxid is 0x0, digest is 1371985504 2025-10-20 05:03:52,050 [myid:2] - INFO [main:QuorumPeer@1157] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation 2025-10-20 05:03:52,057 [myid:2] - INFO [main:QuorumPeer@1185] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation 2025-10-20 05:03:52,066 [myid:2] - INFO [main:QuorumPeer@2574] - Using 4000ms as the quorum cnxn socket timeout 2025-10-20 05:03:52,071 [myid:2] - INFO [main:QuorumCnxManager$Listener@924] - Election port bind maximum retries is 3 2025-10-20 05:03:52,072 [myid:2] - INFO [main:FastLeaderElection@89] - zookeeper.fastleader.minNotificationInterval=200 2025-10-20 05:03:52,072 [myid:2] - INFO [main:FastLeaderElection@91] - zookeeper.fastleader.maxNotificationInterval=60000 2025-10-20 05:03:52,079 [myid:2] - INFO [main:ZKAuditProvider@42] - ZooKeeper audit is disabled. 2025-10-20 05:03:52,082 [myid:2] - INFO [ListenerHandler-/10.0.0.48:3888:QuorumCnxManager$Listener$ListenerHandler@1071] - 2 is accepting connections now, my election bind port: /10.0.0.48:3888 2025-10-20 05:03:52,090 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):QuorumPeer@1438] - LOOKING 2025-10-20 05:03:52,092 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):FastLeaderElection@945] - New election. My id = 2, proposed zxid=0x0 2025-10-20 05:03:52,099 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:2, n.state:LOOKING, n.leader:2, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-10-20 05:03:52,103 [myid:2] - WARN [QuorumConnectionThread-[myid=2]-1:QuorumCnxManager@401] - Cannot open channel to 1 at election address /10.0.0.254:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-10-20 05:03:52,104 [myid:2] - WARN [QuorumConnectionThread-[myid=2]-2:QuorumCnxManager@401] - Cannot open channel to 3 at election address /10.0.0.49:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-10-20 05:03:52,302 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):FastLeaderElection@980] - Notification time out: 400 2025-10-20 05:03:52,303 [myid:2] - WARN [QuorumConnectionThread-[myid=2]-3:QuorumCnxManager@401] - Cannot open channel to 1 at election address /10.0.0.254:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-10-20 05:03:52,303 [myid:2] - WARN [QuorumConnectionThread-[myid=2]-2:QuorumCnxManager@401] - Cannot open channel to 3 at election address /10.0.0.49:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-10-20 05:03:52,395 [myid:2] - INFO [ListenerHandler-/10.0.0.48:3888:QuorumCnxManager$Listener$ListenerHandler@1076] - Received connection request from /10.0.0.49:48848 2025-10-20 05:03:52,402 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:3, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-10-20 05:03:52,406 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:2, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-10-20 05:03:52,408 [myid:2] - WARN [QuorumConnectionThread-[myid=2]-2:QuorumCnxManager@401] - Cannot open channel to 1 at election address /10.0.0.254:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-10-20 05:03:52,607 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):QuorumPeer@902] - Peer state changed: following 2025-10-20 05:03:52,607 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):QuorumPeer@1520] - FOLLOWING 2025-10-20 05:03:52,611 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):Learner@130] - leaderConnectDelayDuringRetryMs: 100 2025-10-20 05:03:52,611 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):Learner@131] - TCP NoDelay set to: true 2025-10-20 05:03:52,611 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):Learner@132] - zookeeper.learner.asyncSending = false 2025-10-20 05:03:52,611 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):Learner@133] - zookeeper.learner.closeSocketAsync = false 2025-10-20 05:03:52,612 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):BlueThrottle@141] - Weighed connection throttling is disabled 2025-10-20 05:03:52,614 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):ZooKeeperServer@1306] - minSessionTimeout set to 4000 2025-10-20 05:03:52,614 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):ZooKeeperServer@1315] - maxSessionTimeout set to 40000 2025-10-20 05:03:52,614 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):ResponseCache@45] - getData response cache size is initialized with value 400. 2025-10-20 05:03:52,614 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):ResponseCache@45] - getChildren response cache size is initialized with value 400. 2025-10-20 05:03:52,618 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):RequestPathMetricsCollector@109] - zookeeper.pathStats.slotCapacity = 60 2025-10-20 05:03:52,618 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):RequestPathMetricsCollector@110] - zookeeper.pathStats.slotDuration = 15 2025-10-20 05:03:52,618 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):RequestPathMetricsCollector@111] - zookeeper.pathStats.maxDepth = 6 2025-10-20 05:03:52,618 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):RequestPathMetricsCollector@112] - zookeeper.pathStats.initialDelay = 5 2025-10-20 05:03:52,618 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):RequestPathMetricsCollector@113] - zookeeper.pathStats.delay = 5 2025-10-20 05:03:52,618 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):RequestPathMetricsCollector@114] - zookeeper.pathStats.enabled = false 2025-10-20 05:03:52,620 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):ZooKeeperServer@1542] - The max bytes for all large requests are set to 104857600 2025-10-20 05:03:52,620 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):ZooKeeperServer@1556] - The large request threshold is set to -1 2025-10-20 05:03:52,621 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):AuthenticationHelper@66] - zookeeper.enforce.auth.enabled = false 2025-10-20 05:03:52,621 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):AuthenticationHelper@67] - zookeeper.enforce.auth.schemes = [] 2025-10-20 05:03:52,621 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):ZooKeeperServer@361] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 clientPortListenBacklog -1 datadir /data/version-2 snapdir /data/version-2 2025-10-20 05:03:52,622 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):Follower@77] - FOLLOWING - LEADER ELECTION TOOK - 530 MS 2025-10-20 05:03:52,624 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - discovery 2025-10-20 05:03:52,643 [myid:2] - WARN [LeaderConnector-/10.0.0.49:2888:Learner$LeaderConnector@448] - Unexpected exception, tries=0, remaining init limit=10000, connecting to /10.0.0.49:2888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.Learner.sockConnect(Learner.java:305) at org.apache.zookeeper.server.quorum.Learner$LeaderConnector.connectToLeader(Learner.java:422) at org.apache.zookeeper.server.quorum.Learner$LeaderConnector.run(Learner.java:380) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-10-20 05:03:52,744 [myid:2] - INFO [LeaderConnector-/10.0.0.49:2888:Learner$LeaderConnector@384] - Successfully connected to leader, using address: /10.0.0.49:2888 2025-10-20 05:03:52,784 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - synchronization 2025-10-20 05:03:52,790 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):Learner@565] - Getting a diff from the leader 0x0 2025-10-20 05:03:52,793 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):QuorumPeer@921] - Peer state changed: following - synchronization - diff 2025-10-20 05:03:52,798 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):Learner@737] - Learner received NEWLEADER message 2025-10-20 05:03:52,799 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):QuorumPeer@1875] - Dynamic reconfig is disabled, we don't store the last seen config. 2025-10-20 05:03:52,818 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):QuorumPeer@921] - Peer state changed: following - synchronization 2025-10-20 05:03:52,823 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):CommitProcessor@491] - Configuring CommitProcessor with readBatchSize -1 commitBatchSize 1 2025-10-20 05:03:52,823 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):CommitProcessor@452] - Configuring CommitProcessor with 4 worker threads. 2025-10-20 05:03:52,823 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):FollowerRequestProcessor@59] - Initialized FollowerRequestProcessor with zookeeper.follower.skipLearnerRequestToNextProcessor as false 2025-10-20 05:03:52,825 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):RequestThrottler@75] - zookeeper.request_throttler.shutdownTimeout = 10000 2025-10-20 05:03:52,946 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):Learner@721] - Learner received UPTODATE message 2025-10-20 05:03:52,947 [myid:2] - INFO [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: following - broadcast 2025-10-20 05:03:53,227 [myid:2] - INFO [ListenerHandler-/10.0.0.48:3888:QuorumCnxManager$Listener$ListenerHandler@1076] - Received connection request from /10.0.0.254:46024 2025-10-20 05:03:53,259 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:FOLLOWING; n.sid:1, n.state:LOOKING, n.leader:1, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-10-20 05:03:53,275 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:FOLLOWING; n.sid:1, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-10-20 05:04:52,492 [myid:2] - WARN [QuorumPeer[myid=2](plain=10.0.0.48:2181)(secure=disabled):Follower@169] - Got zxid 0x100000001 expected 0x1 2025-10-20 05:04:52,493 [myid:2] - INFO [SyncThread:2:FileTxnLog@284] - Creating new log file: log.100000001 2025-10-20 05:04:52,500 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340000 2025-10-20 05:04:52,651 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340001 2025-10-20 05:04:52,807 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10000 2025-10-20 05:04:53,026 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340002 2025-10-20 05:04:53,199 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f440000 2025-10-20 05:04:53,317 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340003 2025-10-20 05:04:53,451 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10001 2025-10-20 05:05:05,351 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340004 2025-10-20 05:05:05,529 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340005 2025-10-20 05:05:48,391 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340006 2025-10-20 05:05:48,573 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10002 2025-10-20 05:05:48,648 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f440001 2025-10-20 05:05:48,652 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340007 2025-10-20 05:05:48,705 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10003 2025-10-20 05:05:49,746 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f440002 2025-10-20 05:05:49,906 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340008 2025-10-20 05:06:54,311 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340009 2025-10-20 05:06:54,388 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f440003 2025-10-20 05:06:54,444 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f440004 2025-10-20 05:06:55,338 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f440005 2025-10-20 05:06:55,406 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f440006 2025-10-20 05:06:55,462 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae134000a 2025-10-20 05:07:00,396 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10004 2025-10-20 05:07:00,492 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10005 2025-10-20 05:07:00,534 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f440007 2025-10-20 05:07:06,933 [myid:2] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x200001a1f440005 2025-10-20 05:07:07,628 [myid:2] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x200001a1f440006 2025-10-20 05:07:12,453 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10006 2025-10-20 05:07:12,608 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae134000b 2025-10-20 05:07:13,617 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae134000c 2025-10-20 05:07:16,506 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10007 2025-10-20 05:07:17,070 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f440008 2025-10-20 05:07:18,276 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10008 2025-10-20 05:07:27,197 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10009 2025-10-20 05:07:27,284 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae134000d 2025-10-20 05:07:27,284 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae134000e 2025-10-20 05:07:27,366 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df1000a 2025-10-20 05:07:27,697 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae134000f 2025-10-20 05:07:28,756 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df1000b 2025-10-20 05:09:23,918 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f440009 2025-10-20 05:09:24,055 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f44000a 2025-10-20 05:09:28,858 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340010 2025-10-20 05:09:29,430 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df1000c 2025-10-20 05:10:29,781 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df1000d 2025-10-20 05:10:29,813 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f44000b 2025-10-20 05:10:29,883 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df1000e 2025-10-20 05:10:29,915 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340011 2025-10-20 05:10:30,381 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f44000c 2025-10-20 05:11:14,717 [myid:2] - WARN [NIOWorkerThread-3:NIOServerCnxn@371] - Unexpected exception EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /10.0.0.48:48412, session = 0x200001a1f440000 at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:170) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:333) at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:508) at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-10-20 05:11:18,615 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df1000f 2025-10-20 05:11:23,357 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f44000d 2025-10-20 05:11:23,424 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340012 2025-10-20 05:11:24,501 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10010 2025-10-20 05:11:24,596 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340013 2025-10-20 05:12:33,528 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x200001a1f44000e 2025-10-20 05:12:41,449 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x30000195df10011 2025-10-20 05:13:03,016 [myid:2] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x10000fc10 to /data/version-2/snapshot.10000fc10 2025-10-20 05:13:03,021 [myid:2] - INFO [SyncThread:2:FileTxnLog@284] - Creating new log file: log.10000fc12 2025-10-20 05:13:03,061 [myid:2] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 45 ms 2025-10-20 05:20:38,782 [myid:2] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x100027fba to /data/version-2/snapshot.100027fba 2025-10-20 05:20:38,784 [myid:2] - INFO [SyncThread:2:FileTxnLog@284] - Creating new log file: log.100027fbc 2025-10-20 05:20:38,794 [myid:2] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 12 ms 2025-10-20 05:22:42,909 [myid:2] - INFO [CommitProcessor:2:LearnerSessionTracker@116] - Committing global session 0x100001ae1340014