2025-11-24 06:44:11,306 [myid:] - INFO [main:QuorumPeerConfig@174] - Reading configuration from: /conf/zoo.cfg 2025-11-24 06:44:11,311 [myid:] - INFO [main:QuorumPeerConfig@441] - clientPortAddress is 10.0.0.33:2181 2025-11-24 06:44:11,311 [myid:] - INFO [main:QuorumPeerConfig@448] - secureClientPort is not set 2025-11-24 06:44:11,311 [myid:] - INFO [main:QuorumPeerConfig@464] - observerMasterPort is not set 2025-11-24 06:44:11,311 [myid:] - INFO [main:QuorumPeerConfig@481] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider 2025-11-24 06:44:11,318 [myid:3] - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3 2025-11-24 06:44:11,319 [myid:3] - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0 2025-11-24 06:44:11,319 [myid:3] - INFO [main:DatadirCleanupManager@101] - Purge task is not scheduled. 2025-11-24 06:44:11,319 [myid:3] - INFO [main:ManagedUtil@46] - Log4j 1.2 jmx support not found; jmx disabled. 2025-11-24 06:44:11,319 [myid:3] - INFO [main:QuorumPeerMain@152] - Starting quorum peer, myid=3 2025-11-24 06:44:11,336 [myid:3] - INFO [main:ServerMetrics@62] - ServerMetrics initialized with provider org.apache.zookeeper.metrics.impl.DefaultMetricsProvider@6bdf28bb 2025-11-24 06:44:11,340 [myid:3] - INFO [main:DigestAuthenticationProvider@47] - ACL digest algorithm is: SHA1 2025-11-24 06:44:11,340 [myid:3] - INFO [main:DigestAuthenticationProvider@61] - zookeeper.DigestAuthenticationProvider.enabled = true 2025-11-24 06:44:11,349 [myid:3] - INFO [main:ServerCnxnFactory@169] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory 2025-11-24 06:44:11,351 [myid:3] - WARN [main:ServerCnxnFactory@309] - maxCnxns is not configured, using default value 0. 2025-11-24 06:44:11,354 [myid:3] - INFO [main:NIOServerCnxnFactory@652] - Configuring NIO connection handler with 10s sessionless connection timeout, 1 selector thread(s), 8 worker threads, and 64 kB direct buffers. 2025-11-24 06:44:11,362 [myid:3] - INFO [main:NIOServerCnxnFactory@660] - binding to port /10.0.0.33:2181 2025-11-24 06:44:11,373 [myid:3] - INFO [main:QuorumPeer@797] - zookeeper.quorumCnxnTimeoutMs=-1 2025-11-24 06:44:11,386 [myid:3] - INFO [main:X509Util@77] - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation 2025-11-24 06:44:11,390 [myid:3] - INFO [main:FileTxnSnapLog@124] - zookeeper.snapshot.trust.empty : true 2025-11-24 06:44:11,396 [myid:3] - INFO [main:QuorumPeer@1747] - Local sessions disabled 2025-11-24 06:44:11,396 [myid:3] - INFO [main:QuorumPeer@1758] - Local session upgrading disabled 2025-11-24 06:44:11,399 [myid:3] - INFO [main:QuorumPeer@1725] - tickTime set to 2000 2025-11-24 06:44:11,399 [myid:3] - INFO [main:QuorumPeer@1769] - minSessionTimeout set to 4000 2025-11-24 06:44:11,399 [myid:3] - INFO [main:QuorumPeer@1780] - maxSessionTimeout set to 40000 2025-11-24 06:44:11,399 [myid:3] - INFO [main:QuorumPeer@1805] - initLimit set to 5 2025-11-24 06:44:11,399 [myid:3] - INFO [main:QuorumPeer@1992] - syncLimit set to 2 2025-11-24 06:44:11,400 [myid:3] - INFO [main:QuorumPeer@2007] - connectToLearnerMasterLimit set to 0 2025-11-24 06:44:11,438 [myid:3] - INFO [main:ZookeeperBanner@42] - 2025-11-24 06:44:11,438 [myid:3] - INFO [main:ZookeeperBanner@42] - ______ _ 2025-11-24 06:44:11,438 [myid:3] - INFO [main:ZookeeperBanner@42] - |___ / | | 2025-11-24 06:44:11,438 [myid:3] - INFO [main:ZookeeperBanner@42] - / / ___ ___ | | __ ___ ___ _ __ ___ _ __ 2025-11-24 06:44:11,438 [myid:3] - INFO [main:ZookeeperBanner@42] - / / / _ \ / _ \ | |/ / / _ \ / _ \ | '_ \ / _ \ | '__| 2025-11-24 06:44:11,438 [myid:3] - INFO [main:ZookeeperBanner@42] - / /__ | (_) | | (_) | | < | __/ | __/ | |_) | | __/ | | 2025-11-24 06:44:11,438 [myid:3] - INFO [main:ZookeeperBanner@42] - /_____| \___/ \___/ |_|\_\ \___| \___| | .__/ \___| |_| 2025-11-24 06:44:11,438 [myid:3] - INFO [main:ZookeeperBanner@42] - | | 2025-11-24 06:44:11,438 [myid:3] - INFO [main:ZookeeperBanner@42] - |_| 2025-11-24 06:44:11,438 [myid:3] - INFO [main:ZookeeperBanner@42] - 2025-11-24 06:44:11,440 [myid:3] - INFO [main:Environment@98] - Server environment:zookeeper.version=3.7.1-a2fb57c55f8e59cdd76c34b357ad5181df1258d5, built on 2022-05-07 06:45 UTC 2025-11-24 06:44:11,440 [myid:3] - INFO [main:Environment@98] - Server environment:host.name=cn-jenkins-deploy-platform-ansible-os-4805-3. 2025-11-24 06:44:11,440 [myid:3] - INFO [main:Environment@98] - Server environment:java.version=1.8.0_402 2025-11-24 06:44:11,440 [myid:3] - INFO [main:Environment@98] - Server environment:java.vendor=Red Hat, Inc. 2025-11-24 06:44:11,440 [myid:3] - INFO [main:Environment@98] - Server environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.402.b06-1.el7_9.x86_64/jre 2025-11-24 06:44:11,440 [myid:3] - INFO [main:Environment@98] - Server environment:java.class.path=/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/target/classes:/apache-zookeeper-3.7.1-bin/bin/../build/classes:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/target/lib/*.jar:/apache-zookeeper-3.7.1-bin/bin/../build/lib/*.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-prometheus-metrics-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-jute-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/snappy-java-1.1.7.7.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/slf4j-reload4j-1.7.35.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/slf4j-api-1.7.35.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_servlet-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_hotspot-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_common-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/reload4j-1.2.19.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-native-unix-common-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-native-epoll-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-classes-epoll-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-resolver-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-handler-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-common-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-codec-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-buffer-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/metrics-core-4.1.12.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jline-2.14.6.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-util-ajax-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-util-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-servlet-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-server-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-security-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-io-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-http-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-databind-2.13.2.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-core-2.13.2.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-annotations-2.13.2.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/commons-cli-1.4.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/audience-annotations-0.12.0.jar:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-*.jar:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/conf: 2025-11-24 06:44:11,440 [myid:3] - INFO [main:Environment@98] - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2025-11-24 06:44:11,440 [myid:3] - INFO [main:Environment@98] - Server environment:java.io.tmpdir=/tmp 2025-11-24 06:44:11,440 [myid:3] - INFO [main:Environment@98] - Server environment:java.compiler= 2025-11-24 06:44:11,441 [myid:3] - INFO [main:Environment@98] - Server environment:os.name=Linux 2025-11-24 06:44:11,441 [myid:3] - INFO [main:Environment@98] - Server environment:os.arch=amd64 2025-11-24 06:44:11,441 [myid:3] - INFO [main:Environment@98] - Server environment:os.version=5.15.0-100-generic 2025-11-24 06:44:11,441 [myid:3] - INFO [main:Environment@98] - Server environment:user.name=zookeeper 2025-11-24 06:44:11,441 [myid:3] - INFO [main:Environment@98] - Server environment:user.home=/home/zookeeper 2025-11-24 06:44:11,441 [myid:3] - INFO [main:Environment@98] - Server environment:user.dir=/apache-zookeeper-3.7.1-bin 2025-11-24 06:44:11,441 [myid:3] - INFO [main:Environment@98] - Server environment:os.memory.free=222MB 2025-11-24 06:44:11,441 [myid:3] - INFO [main:Environment@98] - Server environment:os.memory.max=889MB 2025-11-24 06:44:11,441 [myid:3] - INFO [main:Environment@98] - Server environment:os.memory.total=238MB 2025-11-24 06:44:11,441 [myid:3] - INFO [main:ZooKeeperServer@138] - zookeeper.enableEagerACLCheck = false 2025-11-24 06:44:11,441 [myid:3] - INFO [main:ZooKeeperServer@151] - zookeeper.digest.enabled = true 2025-11-24 06:44:11,441 [myid:3] - INFO [main:ZooKeeperServer@155] - zookeeper.closeSessionTxn.enabled = true 2025-11-24 06:44:11,442 [myid:3] - INFO [main:ZooKeeperServer@1505] - zookeeper.flushDelay=0 2025-11-24 06:44:11,442 [myid:3] - INFO [main:ZooKeeperServer@1514] - zookeeper.maxWriteQueuePollTime=0 2025-11-24 06:44:11,442 [myid:3] - INFO [main:ZooKeeperServer@1523] - zookeeper.maxBatchSize=1000 2025-11-24 06:44:11,442 [myid:3] - INFO [main:ZooKeeperServer@260] - zookeeper.intBufferStartingSizeBytes = 1024 2025-11-24 06:44:11,450 [myid:3] - INFO [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager 2025-11-24 06:44:11,451 [myid:3] - INFO [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager 2025-11-24 06:44:11,451 [myid:3] - INFO [main:ZKDatabase@133] - zookeeper.snapshotSizeFactor = 0.33 2025-11-24 06:44:11,451 [myid:3] - INFO [main:ZKDatabase@153] - zookeeper.commitLogCount=500 2025-11-24 06:44:11,492 [myid:3] - INFO [main:QuorumPeer@2071] - Using insecure (non-TLS) quorum communication 2025-11-24 06:44:11,492 [myid:3] - INFO [main:QuorumPeer@2077] - Port unification disabled 2025-11-24 06:44:11,492 [myid:3] - INFO [main:QuorumPeer@180] - multiAddress.enabled set to false 2025-11-24 06:44:11,492 [myid:3] - INFO [main:QuorumPeer@205] - multiAddress.reachabilityCheckEnabled set to true 2025-11-24 06:44:11,492 [myid:3] - INFO [main:QuorumPeer@192] - multiAddress.reachabilityCheckTimeoutMs set to 1000 2025-11-24 06:44:11,492 [myid:3] - INFO [main:QuorumPeer@2532] - QuorumPeer communication is not secured! (SASL auth disabled) 2025-11-24 06:44:11,493 [myid:3] - INFO [main:QuorumPeer@2557] - quorum.cnxn.threads.size set to 20 2025-11-24 06:44:11,525 [myid:3] - INFO [main:SnapStream@61] - zookeeper.snapshot.compression.method = CHECKED 2025-11-24 06:44:11,525 [myid:3] - INFO [main:FileTxnSnapLog@479] - Snapshotting: 0x0 to /data/version-2/snapshot.0 2025-11-24 06:44:11,536 [myid:3] - INFO [main:ZKDatabase@290] - Snapshot loaded in 43 ms, highest zxid is 0x0, digest is 1371985504 2025-11-24 06:44:11,541 [myid:3] - INFO [main:QuorumPeer@1157] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation 2025-11-24 06:44:11,551 [myid:3] - INFO [main:QuorumPeer@1185] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation 2025-11-24 06:44:11,560 [myid:3] - INFO [main:QuorumPeer@2574] - Using 4000ms as the quorum cnxn socket timeout 2025-11-24 06:44:11,579 [myid:3] - INFO [main:QuorumCnxManager$Listener@924] - Election port bind maximum retries is 3 2025-11-24 06:44:11,588 [myid:3] - INFO [main:FastLeaderElection@89] - zookeeper.fastleader.minNotificationInterval=200 2025-11-24 06:44:11,589 [myid:3] - INFO [main:FastLeaderElection@91] - zookeeper.fastleader.maxNotificationInterval=60000 2025-11-24 06:44:11,592 [myid:3] - INFO [main:ZKAuditProvider@42] - ZooKeeper audit is disabled. 2025-11-24 06:44:11,597 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):QuorumPeer@1438] - LOOKING 2025-11-24 06:44:11,598 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):FastLeaderElection@945] - New election. My id = 3, proposed zxid=0x0 2025-11-24 06:44:11,617 [myid:3] - WARN [QuorumConnectionThread-[myid=3]-1:QuorumCnxManager@401] - Cannot open channel to 1 at election address /10.0.0.38:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-11-24 06:44:11,632 [myid:3] - WARN [QuorumConnectionThread-[myid=3]-2:QuorumCnxManager@401] - Cannot open channel to 2 at election address /10.0.0.50:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-11-24 06:44:11,632 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:3, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-11-24 06:44:11,653 [myid:3] - INFO [ListenerHandler-/10.0.0.33:3888:QuorumCnxManager$Listener$ListenerHandler@1071] - 3 is accepting connections now, my election bind port: /10.0.0.33:3888 2025-11-24 06:44:11,753 [myid:3] - INFO [ListenerHandler-/10.0.0.33:3888:QuorumCnxManager$Listener$ListenerHandler@1076] - Received connection request from /10.0.0.38:57162 2025-11-24 06:44:11,776 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:1, n.state:LOOKING, n.leader:1, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-11-24 06:44:11,804 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:1, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-11-24 06:44:12,004 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):QuorumPeer@902] - Peer state changed: leading 2025-11-24 06:44:12,005 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):QuorumPeer@1532] - LEADING 2025-11-24 06:44:12,008 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):LearnerMaster@47] - zookeeper.leader.maxConcurrentSnapSyncs = 10 2025-11-24 06:44:12,008 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):LearnerMaster@50] - zookeeper.leader.maxConcurrentDiffSyncs = 100 2025-11-24 06:44:12,011 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):Leader@87] - TCP NoDelay set to: true 2025-11-24 06:44:12,011 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):Leader@108] - zookeeper.leader.ackLoggingFrequency = 1000 2025-11-24 06:44:12,011 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):Leader@1345] - zookeeper.leader.maxTimeToWaitForEpoch = -1ms 2025-11-24 06:44:12,014 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):BlueThrottle@141] - Weighed connection throttling is disabled 2025-11-24 06:44:12,017 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):ZooKeeperServer@1306] - minSessionTimeout set to 4000 2025-11-24 06:44:12,017 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):ZooKeeperServer@1315] - maxSessionTimeout set to 40000 2025-11-24 06:44:12,018 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):ResponseCache@45] - getData response cache size is initialized with value 400. 2025-11-24 06:44:12,019 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):ResponseCache@45] - getChildren response cache size is initialized with value 400. 2025-11-24 06:44:12,021 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):RequestPathMetricsCollector@109] - zookeeper.pathStats.slotCapacity = 60 2025-11-24 06:44:12,021 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):RequestPathMetricsCollector@110] - zookeeper.pathStats.slotDuration = 15 2025-11-24 06:44:12,022 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):RequestPathMetricsCollector@111] - zookeeper.pathStats.maxDepth = 6 2025-11-24 06:44:12,022 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):RequestPathMetricsCollector@112] - zookeeper.pathStats.initialDelay = 5 2025-11-24 06:44:12,022 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):RequestPathMetricsCollector@113] - zookeeper.pathStats.delay = 5 2025-11-24 06:44:12,022 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):RequestPathMetricsCollector@114] - zookeeper.pathStats.enabled = false 2025-11-24 06:44:12,026 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):ZooKeeperServer@1542] - The max bytes for all large requests are set to 104857600 2025-11-24 06:44:12,027 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):ZooKeeperServer@1556] - The large request threshold is set to -1 2025-11-24 06:44:12,028 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):AuthenticationHelper@66] - zookeeper.enforce.auth.enabled = false 2025-11-24 06:44:12,028 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):AuthenticationHelper@67] - zookeeper.enforce.auth.schemes = [] 2025-11-24 06:44:12,028 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):ZooKeeperServer@361] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 clientPortListenBacklog -1 datadir /data/version-2 snapdir /data/version-2 2025-11-24 06:44:12,035 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):Leader@584] - LEADING - LEADER ELECTION TOOK - 437 MS 2025-11-24 06:44:12,041 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: leading - discovery 2025-11-24 06:44:12,045 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):FileTxnSnapLog@479] - Snapshotting: 0x0 to /data/version-2/snapshot.0 2025-11-24 06:44:12,059 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):ZooKeeperServer@543] - Snapshot taken in 14 ms 2025-11-24 06:44:12,060 [myid:3] - INFO [ListenerHandler-/10.0.0.33:3888:QuorumCnxManager$Listener$ListenerHandler@1076] - Received connection request from /10.0.0.50:53076 2025-11-24 06:44:12,067 [myid:3] - INFO [LearnerCnxAcceptorHandler-/10.0.0.33:2888:LearnerHandler@75] - zookeeper.leader.closeSocketAsync = false 2025-11-24 06:44:12,072 [myid:3] - INFO [LearnerHandler-/10.0.0.38:58364:LearnerHandler@509] - Follower sid: 1 : info : 10.0.0.38:2888:3888:participant 2025-11-24 06:44:12,085 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LEADING; n.sid:2, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-11-24 06:44:12,085 [myid:3] - INFO [ListenerHandler-/10.0.0.33:3888:QuorumCnxManager$Listener$ListenerHandler@1076] - Received connection request from /10.0.0.50:53092 2025-11-24 06:44:12,088 [myid:3] - WARN [SendWorker:2:QuorumCnxManager$SendWorker@1292] - Exception when using channel: for id 2 my id = 3 java.net.SocketException: Socket closed at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:118) at java.net.SocketOutputStream.write(SocketOutputStream.java:134) at java.io.DataOutputStream.writeInt(DataOutputStream.java:197) at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.send(QuorumCnxManager.java:1234) at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:1285) 2025-11-24 06:44:12,090 [myid:3] - WARN [SendWorker:2:QuorumCnxManager$SendWorker@1300] - Send worker leaving thread id 2 my id = 3 2025-11-24 06:44:12,089 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):QuorumPeer@1875] - Dynamic reconfig is disabled, we don't store the last seen config. 2025-11-24 06:44:12,089 [myid:3] - WARN [RecvWorker:2:QuorumCnxManager$RecvWorker@1402] - Connection broken for id 2, my id = 3 java.net.SocketException: Socket closed at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:171) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read(BufferedInputStream.java:265) at java.io.DataInputStream.readInt(DataInputStream.java:387) at org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:1390) 2025-11-24 06:44:12,090 [myid:3] - WARN [RecvWorker:2:QuorumCnxManager$RecvWorker@1408] - Interrupting SendWorker thread from RecvWorker. sid: 2. myId: 3 2025-11-24 06:44:12,097 [myid:3] - INFO [LearnerHandler-/10.0.0.38:58364:ZKDatabase@346] - On disk txn sync enabled with snapshotSizeFactor 0.33 2025-11-24 06:44:12,097 [myid:3] - INFO [LearnerHandler-/10.0.0.38:58364:LearnerHandler@804] - Synchronizing with Learner sid: 1 maxCommittedLog=0x0 minCommittedLog=0x0 lastProcessedZxid=0x0 peerLastZxid=0x0 2025-11-24 06:44:12,097 [myid:3] - INFO [LearnerHandler-/10.0.0.38:58364:LearnerHandler@849] - Sending DIFF zxid=0x0 for peer sid: 1 2025-11-24 06:44:12,108 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: leading - synchronization 2025-11-24 06:44:12,133 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LEADING; n.sid:2, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-11-24 06:44:12,174 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):Leader@1495] - Have quorum of supporters, sids: [[1, 3]]; starting up and setting last processed zxid: 0x100000000 2025-11-24 06:44:12,174 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):Leader@1517] - Dynamic reconfig feature is disabled, skip designatedLeader calculation and reconfig processing. 2025-11-24 06:44:12,183 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):CommitProcessor@491] - Configuring CommitProcessor with readBatchSize -1 commitBatchSize 1 2025-11-24 06:44:12,184 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):CommitProcessor@452] - Configuring CommitProcessor with 4 worker threads. 2025-11-24 06:44:12,186 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):ProposalRequestProcessor@57] - zookeeper.forward_learner_requests_to_commit_processor_disabled = false 2025-11-24 06:44:12,196 [myid:3] - INFO [ProcessThread(sid:3 cport:-1)::PrepRequestProcessor@137] - PrepRequestProcessor (sid:3) started, reconfigEnabled=false 2025-11-24 06:44:12,198 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):ContainerManager@84] - Using checkIntervalMs=60000 maxPerMinute=10000 maxNeverUsedIntervalMs=0 2025-11-24 06:44:12,198 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):RequestThrottler@75] - zookeeper.request_throttler.shutdownTimeout = 10000 2025-11-24 06:44:12,277 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.33:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: leading - broadcast 2025-11-24 06:44:12,407 [myid:3] - INFO [LearnerHandler-/10.0.0.50:36420:LearnerHandler@509] - Follower sid: 2 : info : 10.0.0.50:2888:3888:participant 2025-11-24 06:44:12,415 [myid:3] - INFO [LearnerHandler-/10.0.0.50:36420:ZKDatabase@346] - On disk txn sync enabled with snapshotSizeFactor 0.33 2025-11-24 06:44:12,415 [myid:3] - INFO [LearnerHandler-/10.0.0.50:36420:LearnerHandler@804] - Synchronizing with Learner sid: 2 maxCommittedLog=0x0 minCommittedLog=0x0 lastProcessedZxid=0x100000000 peerLastZxid=0x0 2025-11-24 06:44:12,416 [myid:3] - INFO [LearnerHandler-/10.0.0.50:36420:LearnerHandler@571] - Sending snapshot last zxid of peer is 0x0, zxid of leader is 0x100000000, send zxid of db as 0x100000000, 1 concurrent snapshot sync, snapshot sync was exempt from throttle 2025-11-24 06:45:17,599 [myid:3] - INFO [SyncThread:3:FileTxnLog@284] - Creating new log file: log.100000001 2025-11-24 06:45:17,611 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90000 2025-11-24 06:45:17,638 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90001 2025-11-24 06:45:17,864 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90002 2025-11-24 06:45:17,923 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950000 2025-11-24 06:45:18,011 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950001 2025-11-24 06:45:18,359 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950002 2025-11-24 06:45:18,469 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90003 2025-11-24 06:45:18,827 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90004 2025-11-24 06:45:18,960 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x200001980010000 2025-11-24 06:45:19,091 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950003 2025-11-24 06:45:19,731 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x200001980010001 2025-11-24 06:45:19,868 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950004 2025-11-24 06:45:20,026 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x200001980010002 2025-11-24 06:45:20,064 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x200001980010003 2025-11-24 06:45:20,347 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950005 2025-11-24 06:45:37,011 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x200001980010004 2025-11-24 06:45:40,056 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90005 2025-11-24 06:45:40,178 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90006 2025-11-24 06:45:40,866 [myid:3] - WARN [NIOWorkerThread-4:NIOServerCnxn@371] - Unexpected exception EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /10.0.0.33:54476, session = 0x3000018c3950004 at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:170) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:333) at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:508) at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-11-24 06:45:45,227 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90007 2025-11-24 06:45:49,081 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950006 2025-11-24 06:45:49,162 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950007 2025-11-24 06:45:50,811 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950008 2025-11-24 06:45:50,973 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950009 2025-11-24 06:46:21,244 [myid:3] - INFO [SessionTracker:ZooKeeperServer@628] - Expiring session 0x3000018c3950004, timeout of 40000ms exceeded 2025-11-24 06:46:21,245 [myid:3] - INFO [SessionTracker:ZooKeeperServer@628] - Expiring session 0x100001a34e90006, timeout of 40000ms exceeded 2025-11-24 06:46:21,245 [myid:3] - INFO [SessionTracker:ZooKeeperServer@628] - Expiring session 0x100001a34e90005, timeout of 40000ms exceeded 2025-11-24 06:46:21,245 [myid:3] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x3000018c3950004 2025-11-24 06:46:21,245 [myid:3] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x100001a34e90006 2025-11-24 06:46:21,245 [myid:3] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x100001a34e90005 2025-11-24 06:46:23,244 [myid:3] - INFO [SessionTracker:ZooKeeperServer@628] - Expiring session 0x200001980010003, timeout of 40000ms exceeded 2025-11-24 06:46:23,244 [myid:3] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x200001980010003 2025-11-24 06:47:12,651 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c395000a 2025-11-24 06:47:42,892 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90008 2025-11-24 06:47:42,988 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c395000b 2025-11-24 06:47:43,101 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90009 2025-11-24 06:47:43,912 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x200001980010005 2025-11-24 06:47:44,011 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c395000c 2025-11-24 06:47:44,143 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e9000a 2025-11-24 06:47:49,103 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x200001980010006 2025-11-24 06:47:49,252 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x200001980010007 2025-11-24 06:47:49,328 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e9000b 2025-11-24 06:47:57,237 [myid:3] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x3000018c395000c 2025-11-24 06:48:02,119 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e9000c 2025-11-24 06:48:02,625 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c395000d 2025-11-24 06:48:04,715 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e9000d 2025-11-24 06:48:06,660 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x200001980010008 2025-11-24 06:48:06,743 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x200001980010009 2025-11-24 06:48:06,969 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e9000e 2025-11-24 06:48:07,205 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e9000f 2025-11-24 06:48:08,236 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x20000198001000a 2025-11-24 06:48:08,526 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90010 2025-11-24 06:48:20,195 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x20000198001000b 2025-11-24 06:48:20,224 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x20000198001000c 2025-11-24 06:48:20,554 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x20000198001000d 2025-11-24 06:48:20,555 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c395000e 2025-11-24 06:48:20,577 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x20000198001000e 2025-11-24 06:48:20,911 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x20000198001000f 2025-11-24 06:48:21,032 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x100001a34e90011 2025-11-24 06:48:21,052 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c395000f 2025-11-24 06:48:21,206 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x200001980010010 2025-11-24 06:48:21,320 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950010 2025-11-24 06:48:21,329 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950011 2025-11-24 06:48:21,730 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x3000018c3950012 2025-11-24 06:54:04,566 [myid:3] - INFO [SyncThread:3:FileTxnLog@284] - Creating new log file: log.100011c17 2025-11-24 06:54:04,566 [myid:3] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x100011c16 to /data/version-2/snapshot.100011c16 2025-11-24 06:54:04,593 [myid:3] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 27 ms 2025-11-24 07:00:40,360 [myid:3] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x1000255f2 to /data/version-2/snapshot.1000255f2 2025-11-24 07:00:40,361 [myid:3] - INFO [SyncThread:3:FileTxnLog@284] - Creating new log file: log.1000255f4 2025-11-24 07:00:40,368 [myid:3] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 8 ms 2025-11-24 07:06:41,840 [myid:3] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x100036c4a to /data/version-2/snapshot.100036c4a 2025-11-24 07:06:41,846 [myid:3] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 6 ms 2025-11-24 07:06:41,848 [myid:3] - INFO [SyncThread:3:FileTxnLog@284] - Creating new log file: log.100036c4c 2025-11-24 07:13:28,577 [myid:3] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x10004af2a to /data/version-2/snapshot.10004af2a 2025-11-24 07:13:28,580 [myid:3] - INFO [SyncThread:3:FileTxnLog@284] - Creating new log file: log.10004af2c 2025-11-24 07:13:28,583 [myid:3] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 6 ms