2025-02-10 Mon 02:04:21:668.646 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: vhost interface name : vhost0 2025-02-10 Mon 02:04:21:668.825 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: vhost IP Address : 10.0.0.38/24 2025-02-10 Mon 02:04:21:668.834 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: vhost gateway : 0.0.0.0 2025-02-10 Mon 02:04:21:668.840 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Ethernet ports : ens3 2025-02-10 Mon 02:04:21:668.892 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Loopback IP : 0.0.0.0 2025-02-10 Mon 02:04:21:668.902 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Xmpp Servers : 10.0.0.38:5269 2025-02-10 Mon 02:04:21:668.911 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Xmpp Authentication : 1 2025-02-10 Mon 02:04:21:668.917 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Xmpp Server Certificate : /etc/contrail/ssl/certs/server.pem 2025-02-10 Mon 02:04:21:668.922 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Xmpp Server Key : /etc/contrail/ssl/private/server-privkey.pem 2025-02-10 Mon 02:04:21:668.926 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Xmpp CA Certificate : /etc/contrail/ssl/certs/ca-cert.pem 2025-02-10 Mon 02:04:21:668.932 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Cluster-Name : 2025-02-10 Mon 02:04:21:668.938 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: DNS Servers : 10.0.0.38:53 2025-02-10 Mon 02:04:21:668.943 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: DNS client port : 8098 2025-02-10 Mon 02:04:21:668.948 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: DNS timeout : 3000 2025-02-10 Mon 02:04:21:668.953 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: DNS max retries : 2 2025-02-10 Mon 02:04:21:668.958 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Xmpp Dns Authentication : 1 2025-02-10 Mon 02:04:21:668.963 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Xmpp Server Certificate : /etc/contrail/ssl/certs/server.pem 2025-02-10 Mon 02:04:21:668.967 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Xmpp Server Key : /etc/contrail/ssl/private/server-privkey.pem 2025-02-10 Mon 02:04:21:668.972 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Xmpp CA Certificate : /etc/contrail/ssl/certs/ca-cert.pem 2025-02-10 Mon 02:04:21:668.977 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TSN Servers : [] 2025-02-10 Mon 02:04:21:668.982 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: COLLECTOR Servers : 10.0.0.38:8086 2025-02-10 Mon 02:04:21:668.987 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Tunnel-Type : MPLSoGRE 2025-02-10 Mon 02:04:21:668.992 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Metadata-Proxy Shared Secret: cc83ce16-e4e8-45df-8918-a468bed7a65e 2025-02-10 Mon 02:04:21:668.996 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Metadata-Proxy Port : 8097 2025-02-10 Mon 02:04:21:669.001 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Metadata-Proxy SSL Flag : 0 2025-02-10 Mon 02:04:21:669.019 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Max Vm Flows : 100 2025-02-10 Mon 02:04:21:669.028 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Linklocal Max System Flows : 16384 2025-02-10 Mon 02:04:21:669.033 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Linklocal Max Vm Flows : 16384 2025-02-10 Mon 02:04:21:669.038 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Flow cache timeout : 0 2025-02-10 Mon 02:04:21:669.043 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Stale Interface cleanup timeout : 60 2025-02-10 Mon 02:04:21:669.047 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Flow thread count : 1 2025-02-10 Mon 02:04:21:669.052 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Flow latency limit : 0 2025-02-10 Mon 02:04:21:669.057 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Flow index-mgr sm log count : 0 2025-02-10 Mon 02:04:21:669.062 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Flow add-tokens : 50 2025-02-10 Mon 02:04:21:669.067 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Flow ksync-tokens : 25 2025-02-10 Mon 02:04:21:669.072 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Flow del-tokens : 16 2025-02-10 Mon 02:04:21:669.076 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Flow update-tokens : 16 2025-02-10 Mon 02:04:21:669.089 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Pin flow netlink task to CPU: 2025-02-10 Mon 02:04:21:669.093 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Maximum sessions : 100 2025-02-10 Mon 02:04:21:669.098 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Maximum session aggregates : 8 2025-02-10 Mon 02:04:21:669.103 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Maximum session endpoints : 5 2025-02-10 Mon 02:04:21:669.108 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Fabric SNAT hash table size : 4096 2025-02-10 Mon 02:04:21:669.112 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Flow excluding Router ID in hash :0 2025-02-10 Mon 02:04:21:669.117 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Agent Mode : Vrouter 2025-02-10 Mon 02:04:21:669.122 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Gateway Mode : None 2025-02-10 Mon 02:04:21:669.127 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: DHCP Relay Mode : 0 2025-02-10 Mon 02:04:21:669.131 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Service instance netns cmd : /usr/local/bin/opencontrail-vrouter-netns 2025-02-10 Mon 02:04:21:669.136 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Service instance docker cmd : /usr/local/bin/opencontrail-vrouter-docker 2025-02-10 Mon 02:04:21:669.141 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Service instance workers : 0 2025-02-10 Mon 02:04:21:669.146 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Service instance timeout : 0 2025-02-10 Mon 02:04:21:669.150 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Service instance lb ssl : 2025-02-10 Mon 02:04:21:669.155 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Service instance lbaas auth : 2025-02-10 Mon 02:04:21:669.160 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Bgp as a service port range : 50000-50512 2025-02-10 Mon 02:04:21:669.177 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Services queue limit : 1024 2025-02-10 Mon 02:04:21:669.182 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: BGPAAS max shared sessions for service port : 4 2025-02-10 Mon 02:04:21:669.187 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Sandesh Key file : /etc/contrail/ssl/private/server-privkey.pem 2025-02-10 Mon 02:04:21:669.192 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Sandesh Cert file : /etc/contrail/ssl/certs/server.pem 2025-02-10 Mon 02:04:21:669.197 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Sandesh CA Cert : /etc/contrail/ssl/certs/ca-cert.pem 2025-02-10 Mon 02:04:21:669.202 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Sandesh SSL Enable : 1 2025-02-10 Mon 02:04:21:669.206 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Introspect SSL Enable : 1 2025-02-10 Mon 02:04:21:669.211 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Hypervisor mode : kvm 2025-02-10 Mon 02:04:21:669.313 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Ethernet Port Encap Type : 2025-02-10 Mon 02:04:21:669.320 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: Platform mode : Vrouter on host linux kernel 2025-02-10 Mon 02:04:21:669.554 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: Logging: DISABLED -> ENABLED 2025-02-10 Mon 02:04:21:669.588 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-02-10 Mon 02:04:21:669.639 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: VRouter [SYS_INFO]: VersionInfoLog: {"build-info":[{"build-version":"nightly","build-time":"2025-02-10 00:23:15.869602","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7708-1.novalocal","build-id":"unknown","build-number":"unknown"}]} src/contrail-common/base/misc_utils.cc 41 2025-02-10 Mon 02:04:21:695.546 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:21:695.580 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-routing-instance -> self 2025-02-10 Mon 02:04:21:695.588 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap routing-instance : self -> virtual-network-routing-instance 2025-02-10 Mon 02:04:21:695.594 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap routing-instance : virtual-network-routing-instance -> nil 2025-02-10 Mon 02:04:21:695.600 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:21:695.605 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-access-control-list -> self 2025-02-10 Mon 02:04:21:695.611 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap access-control-list : self -> virtual-network-access-control-list 2025-02-10 Mon 02:04:21:695.616 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap access-control-list : virtual-network-access-control-list -> nil 2025-02-10 Mon 02:04:21:695.623 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:21:695.634 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-network-ipam -> self 2025-02-10 Mon 02:04:21:695.640 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network-network-ipam : self -> virtual-network-network-ipam 2025-02-10 Mon 02:04:21:695.645 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network-network-ipam : virtual-network-network-ipam -> virtual-network-network-ipam 2025-02-10 Mon 02:04:21:695.651 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap network-ipam : virtual-network-network-ipam -> nil 2025-02-10 Mon 02:04:21:695.657 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:21:695.662 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-qos-config -> self 2025-02-10 Mon 02:04:21:695.668 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap qos-config : self -> virtual-network-qos-config 2025-02-10 Mon 02:04:21:695.687 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap qos-config : virtual-network-qos-config -> nil 2025-02-10 Mon 02:04:21:695.693 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:21:695.698 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-security-logging-object -> self 2025-02-10 Mon 02:04:21:695.704 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-logging-object : self -> virtual-network-security-logging-object 2025-02-10 Mon 02:04:21:695.709 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-logging-object : virtual-network-security-logging-object -> nil 2025-02-10 Mon 02:04:21:695.714 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:21:695.719 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : logical-router-virtual-network -> self 2025-02-10 Mon 02:04:21:695.725 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap logical-router-virtual-network : self -> logical-router-virtual-network 2025-02-10 Mon 02:04:21:695.730 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap logical-router-virtual-network : logical-router-virtual-network -> logical-router-virtual-network 2025-02-10 Mon 02:04:21:695.736 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap logical-router : self -> logical-router-virtual-network 2025-02-10 Mon 02:04:21:695.741 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap logical-router : logical-router-virtual-network -> nil 2025-02-10 Mon 02:04:21:695.747 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:21:695.752 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-multicast-policy -> self 2025-02-10 Mon 02:04:21:695.757 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap multicast-policy : self -> virtual-network-multicast-policy 2025-02-10 Mon 02:04:21:695.766 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap multicast-policy : virtual-network-multicast-policy -> nil 2025-02-10 Mon 02:04:21:695.772 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for routing-instance 2025-02-10 Mon 02:04:21:695.777 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap routing-instance : virtual-network-routing-instance -> self 2025-02-10 Mon 02:04:21:695.782 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-network-routing-instance 2025-02-10 Mon 02:04:21:695.787 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-provider-network -> virtual-network-routing-instance 2025-02-10 Mon 02:04:21:695.792 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-network-provider-network 2025-02-10 Mon 02:04:21:695.797 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-provider-network -> nil 2025-02-10 Mon 02:04:21:695.804 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for security-group 2025-02-10 Mon 02:04:21:695.842 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-group : security-group-access-control-list -> self 2025-02-10 Mon 02:04:21:695.856 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap access-control-list : self -> security-group-access-control-list 2025-02-10 Mon 02:04:21:695.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap access-control-list : security-group-access-control-list -> nil 2025-02-10 Mon 02:04:21:695.872 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for tag 2025-02-10 Mon 02:04:21:695.878 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : application-policy-set-tag -> self 2025-02-10 Mon 02:04:21:695.884 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:21:695.890 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : policy-management-application-policy-set -> application-policy-set-tag 2025-02-10 Mon 02:04:21:695.896 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap policy-management : policy-management-application-policy-set -> nil 2025-02-10 Mon 02:04:21:695.902 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:695.908 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-network -> self 2025-02-10 Mon 02:04:21:695.914 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:21:695.919 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-network-ipam -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:21:695.924 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network-network-ipam : self -> virtual-network-network-ipam 2025-02-10 Mon 02:04:21:695.934 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network-network-ipam : virtual-network-network-ipam -> nil 2025-02-10 Mon 02:04:21:695.940 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:695.945 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-machine -> self 2025-02-10 Mon 02:04:21:695.951 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine : self -> virtual-machine-interface-virtual-machine 2025-02-10 Mon 02:04:21:695.956 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine : virtual-machine-interface-virtual-machine -> nil 2025-02-10 Mon 02:04:21:695.962 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:695.967 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-sub-interface -> self 2025-02-10 Mon 02:04:21:695.972 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : self -> virtual-machine-interface-sub-interface 2025-02-10 Mon 02:04:21:695.978 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-sub-interface -> nil 2025-02-10 Mon 02:04:21:695.983 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:695.988 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-network -> self 2025-02-10 Mon 02:04:21:695.994 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:21:695.999 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-provider-network -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:21:696.004 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-network-provider-network 2025-02-10 Mon 02:04:21:696.010 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-provider-network -> nil 2025-02-10 Mon 02:04:21:696.016 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.021 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-routing-instance -> self 2025-02-10 Mon 02:04:21:696.027 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface-routing-instance : self -> virtual-machine-interface-routing-instance 2025-02-10 Mon 02:04:21:696.032 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface-routing-instance : virtual-machine-interface-routing-instance -> virtual-machine-interface-routing-instance 2025-02-10 Mon 02:04:21:696.038 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap routing-instance : self -> virtual-machine-interface-routing-instance 2025-02-10 Mon 02:04:21:696.071 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap routing-instance : virtual-machine-interface-routing-instance -> nil 2025-02-10 Mon 02:04:21:696.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.086 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-security-group -> self 2025-02-10 Mon 02:04:21:696.093 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-group : self -> virtual-machine-interface-security-group 2025-02-10 Mon 02:04:21:696.099 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-group : virtual-machine-interface-security-group -> nil 2025-02-10 Mon 02:04:21:696.106 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.111 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : alias-ip-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:696.118 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap alias-ip : self -> alias-ip-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.124 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap alias-ip : alias-ip-pool-alias-ip -> alias-ip-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.130 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap alias-ip-pool : virtual-network-alias-ip-pool -> alias-ip-pool-alias-ip 2025-02-10 Mon 02:04:21:696.136 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-network-alias-ip-pool 2025-02-10 Mon 02:04:21:696.142 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-alias-ip-pool -> nil 2025-02-10 Mon 02:04:21:696.148 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.153 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : floating-ip-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:696.159 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap floating-ip : self -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.164 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap floating-ip : floating-ip-pool-floating-ip -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.171 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap floating-ip-pool : virtual-network-floating-ip-pool -> floating-ip-pool-floating-ip 2025-02-10 Mon 02:04:21:696.176 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-network-floating-ip-pool 2025-02-10 Mon 02:04:21:696.181 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-provider-network -> virtual-network-floating-ip-pool 2025-02-10 Mon 02:04:21:696.186 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-network-provider-network 2025-02-10 Mon 02:04:21:696.194 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-provider-network -> nil 2025-02-10 Mon 02:04:21:696.200 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.205 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : floating-ip-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:696.210 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap floating-ip : self -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.215 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap floating-ip : floating-ip-pool-floating-ip -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.220 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap floating-ip-pool : virtual-network-floating-ip-pool -> floating-ip-pool-floating-ip 2025-02-10 Mon 02:04:21:696.225 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-network-floating-ip-pool 2025-02-10 Mon 02:04:21:696.230 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-routing-instance -> virtual-network-floating-ip-pool 2025-02-10 Mon 02:04:21:696.235 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap routing-instance : self -> virtual-network-routing-instance 2025-02-10 Mon 02:04:21:696.240 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap routing-instance : virtual-network-routing-instance -> nil 2025-02-10 Mon 02:04:21:696.246 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.250 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : floating-ip-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:696.255 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap floating-ip : self -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.261 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap floating-ip : instance-ip-floating-ip -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.266 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap instance-ip : instance-ip-virtual-network -> instance-ip-floating-ip 2025-02-10 Mon 02:04:21:696.271 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> instance-ip-virtual-network 2025-02-10 Mon 02:04:21:696.277 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : instance-ip-virtual-network -> nil 2025-02-10 Mon 02:04:21:696.282 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.287 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : instance-ip-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:696.292 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap instance-ip : self -> instance-ip-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.297 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap instance-ip : instance-ip-virtual-machine-interface -> nil 2025-02-10 Mon 02:04:21:696.307 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.317 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-route-table -> self 2025-02-10 Mon 02:04:21:696.323 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap interface-route-table : self -> virtual-machine-interface-route-table 2025-02-10 Mon 02:04:21:696.328 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap interface-route-table : virtual-machine-interface-route-table -> nil 2025-02-10 Mon 02:04:21:696.334 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.339 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : subnet-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:696.345 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap subnet : self -> subnet-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.350 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap subnet : subnet-virtual-machine-interface -> nil 2025-02-10 Mon 02:04:21:696.356 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.361 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : logical-interface-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:696.368 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap logical-interface : physical-interface-logical-interface -> logical-interface-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.374 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-interface : physical-router-physical-interface -> physical-interface-logical-interface 2025-02-10 Mon 02:04:21:696.380 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-router : self -> physical-router-physical-interface 2025-02-10 Mon 02:04:21:696.385 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-router : physical-router-physical-interface -> nil 2025-02-10 Mon 02:04:21:696.391 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.396 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-port-group-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:696.401 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-port-group : virtual-port-group-physical-interface -> virtual-port-group-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.406 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-interface : physical-router-physical-interface -> virtual-port-group-physical-interface 2025-02-10 Mon 02:04:21:696.411 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-router : self -> physical-router-physical-interface 2025-02-10 Mon 02:04:21:696.416 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-router : physical-router-physical-interface -> nil 2025-02-10 Mon 02:04:21:696.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.430 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : bgpaas-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:696.436 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bgp-as-a-service : self -> bgpaas-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.441 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bgp-as-a-service : bgpaas-bgp-router -> bgpaas-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.446 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bgp-router : self -> bgpaas-bgp-router 2025-02-10 Mon 02:04:21:696.451 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bgp-router : instance-bgp-router -> bgpaas-bgp-router 2025-02-10 Mon 02:04:21:696.456 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap routing-instance : self -> instance-bgp-router 2025-02-10 Mon 02:04:21:696.462 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap routing-instance : instance-bgp-router -> nil 2025-02-10 Mon 02:04:21:696.467 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.472 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : bgpaas-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:696.477 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bgp-as-a-service : self -> bgpaas-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.482 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bgp-as-a-service : bgpaas-health-check -> bgpaas-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.488 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap service-health-check : self -> bgpaas-health-check 2025-02-10 Mon 02:04:21:696.493 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap service-health-check : bgpaas-health-check -> nil 2025-02-10 Mon 02:04:21:696.498 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.503 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-qos-config -> self 2025-02-10 Mon 02:04:21:696.508 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap qos-config : self -> virtual-machine-interface-qos-config 2025-02-10 Mon 02:04:21:696.513 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap qos-config : virtual-machine-interface-qos-config -> nil 2025-02-10 Mon 02:04:21:696.555 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.564 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-security-logging-object -> self 2025-02-10 Mon 02:04:21:696.570 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-logging-object : self -> virtual-machine-interface-security-logging-object 2025-02-10 Mon 02:04:21:696.579 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-logging-object : virtual-machine-interface-security-logging-object -> nil 2025-02-10 Mon 02:04:21:696.586 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.591 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-bridge-domain -> self 2025-02-10 Mon 02:04:21:696.597 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface-bridge-domain : self -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:21:696.603 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface-bridge-domain : virtual-machine-interface-bridge-domain -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:21:696.609 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bridge-domain : self -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:21:696.614 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bridge-domain : virtual-network-bridge-domain -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:21:696.619 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-network-bridge-domain 2025-02-10 Mon 02:04:21:696.624 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-bridge-domain -> nil 2025-02-10 Mon 02:04:21:696.629 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.634 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-bridge-domain -> self 2025-02-10 Mon 02:04:21:696.639 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface-bridge-domain : self -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:21:696.644 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface-bridge-domain : virtual-machine-interface-bridge-domain -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:21:696.649 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bridge-domain : self -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:21:696.664 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bridge-domain : virtual-machine-interface-bridge-domain -> nil 2025-02-10 Mon 02:04:21:696.678 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.683 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-tag -> self 2025-02-10 Mon 02:04:21:696.688 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : self -> virtual-machine-interface-tag 2025-02-10 Mon 02:04:21:696.693 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : application-policy-set-tag -> virtual-machine-interface-tag 2025-02-10 Mon 02:04:21:696.698 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:21:696.707 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> application-policy-set-tag 2025-02-10 Mon 02:04:21:696.712 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.717 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.723 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.728 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:21:696.734 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.739 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-network -> self 2025-02-10 Mon 02:04:21:696.744 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:21:696.750 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-tag -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:21:696.755 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : self -> virtual-network-tag 2025-02-10 Mon 02:04:21:696.760 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : application-policy-set-tag -> virtual-network-tag 2025-02-10 Mon 02:04:21:696.765 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:21:696.770 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> application-policy-set-tag 2025-02-10 Mon 02:04:21:696.775 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.780 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.784 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.789 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:21:696.795 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.800 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-machine -> self 2025-02-10 Mon 02:04:21:696.808 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine : self -> virtual-machine-interface-virtual-machine 2025-02-10 Mon 02:04:21:696.813 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine : virtual-machine-tag -> virtual-machine-interface-virtual-machine 2025-02-10 Mon 02:04:21:696.818 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : self -> virtual-machine-tag 2025-02-10 Mon 02:04:21:696.823 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : application-policy-set-tag -> virtual-machine-tag 2025-02-10 Mon 02:04:21:696.828 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:21:696.833 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> application-policy-set-tag 2025-02-10 Mon 02:04:21:696.838 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.842 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.847 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.852 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:21:696.858 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-sub-interface -> self 2025-02-10 Mon 02:04:21:696.868 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : self -> virtual-machine-interface-sub-interface 2025-02-10 Mon 02:04:21:696.873 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-machine -> virtual-machine-interface-sub-interface 2025-02-10 Mon 02:04:21:696.878 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine : self -> virtual-machine-interface-virtual-machine 2025-02-10 Mon 02:04:21:696.883 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine : virtual-machine-tag -> virtual-machine-interface-virtual-machine 2025-02-10 Mon 02:04:21:696.888 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : self -> virtual-machine-tag 2025-02-10 Mon 02:04:21:696.893 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : application-policy-set-tag -> virtual-machine-tag 2025-02-10 Mon 02:04:21:696.897 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:21:696.902 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> application-policy-set-tag 2025-02-10 Mon 02:04:21:696.910 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.914 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.919 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.924 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:21:696.930 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:696.935 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : project-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:696.941 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap project : self -> project-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.946 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap project : project-tag -> project-virtual-machine-interface 2025-02-10 Mon 02:04:21:696.956 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : self -> project-tag 2025-02-10 Mon 02:04:21:696.961 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : application-policy-set-tag -> project-tag 2025-02-10 Mon 02:04:21:696.966 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:21:696.970 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> application-policy-set-tag 2025-02-10 Mon 02:04:21:696.975 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.980 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.985 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:696.990 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:21:696.996 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:697.000 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : port-tuple-interface -> self 2025-02-10 Mon 02:04:21:697.006 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap port-tuple : self -> port-tuple-interface 2025-02-10 Mon 02:04:21:697.011 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap port-tuple : port-tuple-interface -> port-tuple-interface 2025-02-10 Mon 02:04:21:697.016 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : self -> port-tuple-interface 2025-02-10 Mon 02:04:21:697.034 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : port-tuple-interface -> nil 2025-02-10 Mon 02:04:21:697.040 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:21:697.044 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : logical-router-interface -> self 2025-02-10 Mon 02:04:21:697.050 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap logical-router : self -> logical-router-interface 2025-02-10 Mon 02:04:21:697.062 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap logical-router : logical-router-interface -> nil 2025-02-10 Mon 02:04:21:697.068 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for physical-interface 2025-02-10 Mon 02:04:21:697.073 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-interface : physical-router-physical-interface -> self 2025-02-10 Mon 02:04:21:697.078 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-router : self -> physical-router-physical-interface 2025-02-10 Mon 02:04:21:697.083 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-router : physical-router-physical-interface -> nil 2025-02-10 Mon 02:04:21:697.088 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for physical-interface 2025-02-10 Mon 02:04:21:697.093 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-interface : virtual-port-group-physical-interface -> self 2025-02-10 Mon 02:04:21:697.099 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-port-group-physical-interface : self -> virtual-port-group-physical-interface 2025-02-10 Mon 02:04:21:697.104 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-port-group-physical-interface : virtual-port-group-physical-interface -> virtual-port-group-physical-interface 2025-02-10 Mon 02:04:21:697.109 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-port-group : self -> virtual-port-group-physical-interface 2025-02-10 Mon 02:04:21:697.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-port-group : virtual-port-group-physical-interface -> nil 2025-02-10 Mon 02:04:21:697.120 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for logical-interface 2025-02-10 Mon 02:04:21:697.124 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap logical-interface : physical-interface-logical-interface -> self 2025-02-10 Mon 02:04:21:697.129 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-interface : self -> physical-interface-logical-interface 2025-02-10 Mon 02:04:21:697.134 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-interface : physical-router-physical-interface -> physical-interface-logical-interface 2025-02-10 Mon 02:04:21:697.139 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-router : self -> physical-router-physical-interface 2025-02-10 Mon 02:04:21:697.147 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-router : physical-router-physical-interface -> nil 2025-02-10 Mon 02:04:21:697.152 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for logical-interface 2025-02-10 Mon 02:04:21:697.157 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap logical-interface : logical-interface-virtual-machine-interface -> self 2025-02-10 Mon 02:04:21:697.162 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : self -> logical-interface-virtual-machine-interface 2025-02-10 Mon 02:04:21:697.167 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : logical-interface-virtual-machine-interface -> nil 2025-02-10 Mon 02:04:21:697.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for logical-interface 2025-02-10 Mon 02:04:21:697.177 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap logical-interface : physical-router-logical-interface -> self 2025-02-10 Mon 02:04:21:697.182 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-router : self -> physical-router-logical-interface 2025-02-10 Mon 02:04:21:697.187 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-router : physical-router-logical-interface -> nil 2025-02-10 Mon 02:04:21:697.193 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for physical-router 2025-02-10 Mon 02:04:21:697.198 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-router : physical-router-physical-interface -> self 2025-02-10 Mon 02:04:21:697.203 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-interface : self -> physical-router-physical-interface 2025-02-10 Mon 02:04:21:697.208 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap physical-interface : physical-router-physical-interface -> nil 2025-02-10 Mon 02:04:21:697.214 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for service-health-check 2025-02-10 Mon 02:04:21:697.219 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap service-health-check : service-port-health-check -> self 2025-02-10 Mon 02:04:21:697.224 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : self -> service-port-health-check 2025-02-10 Mon 02:04:21:697.229 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-network -> service-port-health-check 2025-02-10 Mon 02:04:21:697.235 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-network-ipam -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:21:697.240 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network-network-ipam : self -> virtual-network-network-ipam 2025-02-10 Mon 02:04:21:697.245 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network-network-ipam : virtual-network-network-ipam -> nil 2025-02-10 Mon 02:04:21:697.251 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for service-health-check 2025-02-10 Mon 02:04:21:697.259 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap service-health-check : service-port-health-check -> self 2025-02-10 Mon 02:04:21:697.264 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : self -> service-port-health-check 2025-02-10 Mon 02:04:21:697.269 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : port-tuple-interface -> service-port-health-check 2025-02-10 Mon 02:04:21:697.274 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap port-tuple : self -> port-tuple-interface 2025-02-10 Mon 02:04:21:697.279 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap port-tuple : port-tuple-interface -> port-tuple-interface 2025-02-10 Mon 02:04:21:697.284 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : self -> port-tuple-interface 2025-02-10 Mon 02:04:21:697.289 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-network -> port-tuple-interface 2025-02-10 Mon 02:04:21:697.294 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-network-ipam -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:21:697.299 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network-network-ipam : self -> virtual-network-network-ipam 2025-02-10 Mon 02:04:21:697.303 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network-network-ipam : virtual-network-network-ipam -> nil 2025-02-10 Mon 02:04:21:697.309 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for qos-config 2025-02-10 Mon 02:04:21:697.314 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap qos-config : global-qos-config-qos-config -> self 2025-02-10 Mon 02:04:21:697.320 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap global-qos-config : global-qos-config-qos-config -> nil 2025-02-10 Mon 02:04:21:697.327 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for forwarding-class 2025-02-10 Mon 02:04:21:697.332 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap forwarding-class : forwarding-class-qos-queue -> self 2025-02-10 Mon 02:04:21:697.338 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap qos-queue : self -> forwarding-class-qos-queue 2025-02-10 Mon 02:04:21:697.343 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap qos-queue : forwarding-class-qos-queue -> nil 2025-02-10 Mon 02:04:21:697.349 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for security-logging-object 2025-02-10 Mon 02:04:21:697.354 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-logging-object : security-logging-object-network-policy -> self 2025-02-10 Mon 02:04:21:697.363 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap network-policy : self -> security-logging-object-network-policy 2025-02-10 Mon 02:04:21:697.368 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap network-policy : security-logging-object-network-policy -> nil 2025-02-10 Mon 02:04:21:697.379 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for security-logging-object 2025-02-10 Mon 02:04:21:697.384 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-logging-object : security-logging-object-security-group -> self 2025-02-10 Mon 02:04:21:697.389 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-group : self -> security-logging-object-security-group 2025-02-10 Mon 02:04:21:697.394 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-group : security-logging-object-security-group -> nil 2025-02-10 Mon 02:04:21:697.399 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for security-logging-object 2025-02-10 Mon 02:04:21:697.404 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-logging-object : firewall-policy-security-logging-object -> self 2025-02-10 Mon 02:04:21:697.442 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy-security-logging-object : self -> firewall-policy-security-logging-object 2025-02-10 Mon 02:04:21:697.449 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy-security-logging-object : firewall-policy-security-logging-object -> firewall-policy-security-logging-object 2025-02-10 Mon 02:04:21:697.456 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : firewall-policy-security-logging-object -> nil 2025-02-10 Mon 02:04:21:697.464 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for security-logging-object 2025-02-10 Mon 02:04:21:697.469 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap security-logging-object : firewall-rule-security-logging-object -> self 2025-02-10 Mon 02:04:21:697.505 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-rule-security-logging-object : self -> firewall-rule-security-logging-object 2025-02-10 Mon 02:04:21:697.512 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-rule-security-logging-object : firewall-rule-security-logging-object -> firewall-rule-security-logging-object 2025-02-10 Mon 02:04:21:697.519 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-rule : firewall-rule-security-logging-object -> nil 2025-02-10 Mon 02:04:21:697.534 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for bridge-domain 2025-02-10 Mon 02:04:21:697.540 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bridge-domain : virtual-network-bridge-domain -> self 2025-02-10 Mon 02:04:21:697.546 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-network-bridge-domain 2025-02-10 Mon 02:04:21:697.551 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-routing-instance -> virtual-network-bridge-domain 2025-02-10 Mon 02:04:21:697.557 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap routing-instance : self -> virtual-network-routing-instance 2025-02-10 Mon 02:04:21:697.562 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap routing-instance : virtual-network-routing-instance -> nil 2025-02-10 Mon 02:04:21:697.571 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for bridge-domain 2025-02-10 Mon 02:04:21:697.576 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap bridge-domain : virtual-network-bridge-domain -> self 2025-02-10 Mon 02:04:21:697.581 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : self -> virtual-network-bridge-domain 2025-02-10 Mon 02:04:21:697.586 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap virtual-network : virtual-network-bridge-domain -> nil 2025-02-10 Mon 02:04:21:697.592 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for application-policy-set 2025-02-10 Mon 02:04:21:697.598 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> self 2025-02-10 Mon 02:04:21:697.603 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:697.608 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:697.613 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:21:697.617 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:21:697.654 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for firewall-policy 2025-02-10 Mon 02:04:21:697.666 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : firewall-policy-firewall-rule -> self 2025-02-10 Mon 02:04:21:697.682 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy-firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.689 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy-firewall-rule : firewall-policy-firewall-rule -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.695 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.700 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-rule : firewall-rule-service-group -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.707 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap service-group : self -> firewall-rule-service-group 2025-02-10 Mon 02:04:21:697.712 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap service-group : firewall-rule-service-group -> nil 2025-02-10 Mon 02:04:21:697.719 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for firewall-policy 2025-02-10 Mon 02:04:21:697.724 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : firewall-policy-firewall-rule -> self 2025-02-10 Mon 02:04:21:697.729 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy-firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.738 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy-firewall-rule : firewall-policy-firewall-rule -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.743 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.748 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-rule : firewall-rule-address-group -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.754 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap address-group : self -> firewall-rule-address-group 2025-02-10 Mon 02:04:21:697.759 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap address-group : address-group-tag -> firewall-rule-address-group 2025-02-10 Mon 02:04:21:697.764 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : self -> address-group-tag 2025-02-10 Mon 02:04:21:697.769 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : address-group-tag -> nil 2025-02-10 Mon 02:04:21:697.775 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for firewall-policy 2025-02-10 Mon 02:04:21:697.779 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : firewall-policy-firewall-rule -> self 2025-02-10 Mon 02:04:21:697.784 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy-firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.789 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy-firewall-rule : firewall-policy-firewall-rule -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.794 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.799 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-rule : firewall-rule-tag -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.805 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : self -> firewall-rule-tag 2025-02-10 Mon 02:04:21:697.810 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap tag : firewall-rule-tag -> nil 2025-02-10 Mon 02:04:21:697.815 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Updating dependency tacker rules for firewall-policy 2025-02-10 Mon 02:04:21:697.820 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy : firewall-policy-firewall-rule -> self 2025-02-10 Mon 02:04:21:697.825 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy-firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.830 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-policy-firewall-rule : firewall-policy-firewall-rule -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.835 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:21:697.840 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Adding ReactorMap firewall-rule : firewall-policy-firewall-rule -> nil 2025-02-10 Mon 02:04:21:794.852 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.0.0.38:8097 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:04:21:795.996 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Current receive sock buffer size is 262144 2025-02-10 Mon 02:04:21:796.082 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674160154368, Pid 1129616]: KsyncTxQueue CPU pinning policy <>. KsyncTxQueuen not pinned to CPU 2025-02-10 Mon 02:04:21:797.259 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Vrouter family is 34 2025-02-10 Mon 02:04:21:797.493 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Flow table size : 20185088 2025-02-10 Mon 02:04:21:797.550 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Flow table size : 161218560 2025-02-10 Mon 02:04:21:797.561 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SetHugePages: Bridge table size:20185088 Flow table size:161218560 2025-02-10 Mon 02:04:21:797.579 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Mem mapping hugepage file:/dev/hugepages2M/bridge size:20185088 2025-02-10 Mon 02:04:21:798.412 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Mem mapped hugepage file:/dev/hugepages2M/bridge to addr:0x7f0869e00000 2025-02-10 Mon 02:04:21:798.777 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Mem mapping hugepage file:/dev/hugepages2M/flow size:161218560 2025-02-10 Mon 02:04:21:798.797 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Mem mapped hugepage file:/dev/hugepages2M/flow to addr:0x7f0860400000 2025-02-10 Mon 02:04:21:798.810 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Sending Huge Page configuration to VROUTER 2025-02-10 Mon 02:04:21:858.794 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Huge pages set successfully 2025-02-10 Mon 02:04:21:877.722 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Flow table size : 161218560 2025-02-10 Mon 02:04:21:877.876 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Flow table size : 20185088 2025-02-10 Mon 02:04:21:948.438 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: ROLE : Generator 2025-02-10 Mon 02:04:21:948.472 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: MODULE : contrail-vrouter-agent 2025-02-10 Mon 02:04:21:948.478 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: SOURCE : cn-jenkins-deploy-platform-juju-os-472-1 2025-02-10 Mon 02:04:21:948.484 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: NODE TYPE : Compute 2025-02-10 Mon 02:04:21:948.488 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: INSTANCE ID : 0 2025-02-10 Mon 02:04:21:948.494 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: HTTP SERVER PORT : 8085 2025-02-10 Mon 02:04:21:948.500 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-02-10 Mon 02:04:21:949.891 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: HTTP Introspect Init 2025-02-10 Mon 02:04:21:950.145 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8085 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:04:21:950.214 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Sandesh Http Server Port: 8085 2025-02-10 Mon 02:04:21:950.280 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: NOT Writing http_port 8085TO : /tmp/contrail-vrouter-agent.1128160.http_port 2025-02-10 Mon 02:04:21:950.287 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: CONNECT TO COLLECTOR: 1 2025-02-10 Mon 02:04:21:950.380 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Idle 2025-02-10 Mon 02:04:21:951.342 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: No Client: 1739153061950486 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 0 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:04:21:952.085 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvStart in state Idle 2025-02-10 Mon 02:04:21:952.720 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Disconnect 2025-02-10 Mon 02:04:21:952.822 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvCollectorUpdate in state Disconnect 2025-02-10 Mon 02:04:21:953.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:21:953.100 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:21:953.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: SANDESH: Send FAILED: 1739153061952702 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ], ] ] ] 2025-02-10 Mon 02:04:21:953.137 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:21:953.145 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:21:953.214 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: SANDESH: Send FAILED: 1739153061952811 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:04:21:953.224 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:21:953.238 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:21:953.300 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: SANDESH: Send FAILED: 1739153061952856 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:04:21:953.312 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:21:953.320 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:21:953.338 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: SANDESH: Send FAILED: 1739153061952876 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ], ] ] ] 2025-02-10 Mon 02:04:21:953.351 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:21:953.358 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:21:954.949 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: SANDESH: Send FAILED: 1739153061953065 AgentVrf [SYS_INFO]: VrfObjectLog: vrf= [ event = Addition name = default-domain:default-project:ip-fabric:__default__ index = 0 ] file = controller/src/vnsw/agent/oper/vrf.cc line = 414 2025-02-10 Mon 02:04:21:954.976 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Wrong state: Connect for event: EvSandeshSend message: VrfObjectLog 2025-02-10 Mon 02:04:21:954.993 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:21:955.118 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: SANDESH: Send FAILED: 1739153061953092 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 0 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:04:21:955.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:21:955.142 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:21:955.154 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: SANDESH: Send FAILED: 1739153061953103 AgentVrf [SYS_INFO]: VrfObjectLog: vrf= [ event = Addition name = default-domain:default-project:ip-fabric:ip-fabric index = 1 ] file = controller/src/vnsw/agent/oper/vrf.cc line = 414 2025-02-10 Mon 02:04:21:955.164 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Wrong state: Connect for event: EvSandeshSend message: VrfObjectLog 2025-02-10 Mon 02:04:21:955.279 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface lo flags 65609 2025-02-10 Mon 02:04:21:955.302 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface ens3 flags 69699 2025-02-10 Mon 02:04:21:955.341 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface fan-252 flags 69699 2025-02-10 Mon 02:04:21:955.347 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface ftun0 flags 69699 2025-02-10 Mon 02:04:21:955.378 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface lxdbr0 flags 4099 2025-02-10 Mon 02:04:21:955.388 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface veth0a3a2c61 flags 69699 2025-02-10 Mon 02:04:21:955.422 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface veth5a9fae9d flags 69699 2025-02-10 Mon 02:04:21:955.427 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface vethe9884a02 flags 69699 2025-02-10 Mon 02:04:21:955.454 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface veth151be4d9 flags 69699 2025-02-10 Mon 02:04:21:955.459 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface veth61a711a4 flags 69699 2025-02-10 Mon 02:04:21:955.487 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface vethadd41881 flags 69699 2025-02-10 Mon 02:04:21:955.530 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface veth52a07095 flags 69699 2025-02-10 Mon 02:04:21:955.568 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface veth824839ba flags 69699 2025-02-10 Mon 02:04:21:955.574 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface vethb535270f flags 69699 2025-02-10 Mon 02:04:21:955.602 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface veth8bdba501 flags 69699 2025-02-10 Mon 02:04:21:955.608 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface veth8db5e9bb flags 69699 2025-02-10 Mon 02:04:21:955.631 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface veth70b5a176 flags 69699 2025-02-10 Mon 02:04:21:955.637 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface docker0 flags 4099 2025-02-10 Mon 02:04:21:955.656 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface pkt1 flags 65601 2025-02-10 Mon 02:04:21:955.661 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface pkt3 flags 65601 2025-02-10 Mon 02:04:21:955.720 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface pkt2 flags 65601 2025-02-10 Mon 02:04:21:955.741 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface vhost0 flags 69699 2025-02-10 Mon 02:04:21:955.748 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink interface message RTM_NEWLINK for interface pkt0 flags 69699 2025-02-10 Mon 02:04:21:955.785 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink address message RTM_NEWADDR for interface lo 2025-02-10 Mon 02:04:21:955.796 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink address message RTM_NEWADDR for interface fan-252 2025-02-10 Mon 02:04:21:955.806 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink address message RTM_NEWADDR for interface lxdbr0 2025-02-10 Mon 02:04:21:955.816 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink address message RTM_NEWADDR for interface docker0 2025-02-10 Mon 02:04:21:955.827 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink address message RTM_NEWADDR for interface vhost0 2025-02-10 Mon 02:04:21:955.840 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink address message RTM_NEWADDR for interface lo 2025-02-10 Mon 02:04:21:955.889 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink address message RTM_NEWADDR for interface fan-252 2025-02-10 Mon 02:04:21:955.905 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink address message RTM_NEWADDR for interface ftun0 2025-02-10 Mon 02:04:21:955.917 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink address message RTM_NEWADDR for interface vhost0 2025-02-10 Mon 02:04:21:955.928 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink address message RTM_NEWADDR for interface pkt0 2025-02-10 Mon 02:04:21:955.969 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 254 type 1 scope 0 2025-02-10 Mon 02:04:21:955.983 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink route message RTM_NEWROUTE : 10.0.0.0/24 Interface vhost0 GW 0.0.0.0 2025-02-10 Mon 02:04:21:955.995 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink route message RTM_NEWROUTE : 10.0.0.0/24 Interface vhost0 GW 0.0.0.0 2025-02-10 Mon 02:04:21:956.005 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink route message RTM_NEWROUTE : 10.0.0.1/32 Interface vhost0 GW 0.0.0.0 2025-02-10 Mon 02:04:21:956.016 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink route message RTM_NEWROUTE : 10.0.0.2/32 Interface vhost0 GW 0.0.0.0 2025-02-10 Mon 02:04:21:956.997 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink route message RTM_NEWROUTE : 10.0.0.4/32 Interface vhost0 GW 0.0.0.0 2025-02-10 Mon 02:04:21:957.017 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink route message RTM_NEWROUTE : 10.22.176.0/24 Interface lxdbr0 GW 0.0.0.0 2025-02-10 Mon 02:04:21:957.025 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 254 type 1 scope 0 2025-02-10 Mon 02:04:21:957.038 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink route message RTM_NEWROUTE : 172.17.0.0/16 Interface docker0 GW 0.0.0.0 2025-02-10 Mon 02:04:21:957.054 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Handle netlink route message RTM_NEWROUTE : 252.0.0.0/8 Interface fan-252 GW 0.0.0.0 2025-02-10 Mon 02:04:21:957.060 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:21:957.065 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 255 type 3 scope 253 2025-02-10 Mon 02:04:21:957.070 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:21:957.075 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 255 type 3 scope 253 2025-02-10 Mon 02:04:21:957.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:21:957.085 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:21:957.090 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 255 type 3 scope 253 2025-02-10 Mon 02:04:21:957.095 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:21:957.100 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 255 type 3 scope 253 2025-02-10 Mon 02:04:21:957.104 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:21:957.109 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 2 table 255 type 3 scope 253 2025-02-10 Mon 02:04:21:957.122 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 254 type 1 scope 0 2025-02-10 Mon 02:04:21:957.127 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 254 type 1 scope 0 2025-02-10 Mon 02:04:21:957.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 254 type 1 scope 0 2025-02-10 Mon 02:04:21:957.137 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 254 type 1 scope 0 2025-02-10 Mon 02:04:21:957.141 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 254 type 1 scope 0 2025-02-10 Mon 02:04:21:957.146 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 255 type 2 scope 0 2025-02-10 Mon 02:04:21:957.151 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 255 type 4 scope 0 2025-02-10 Mon 02:04:21:957.156 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 255 type 4 scope 0 2025-02-10 Mon 02:04:21:957.160 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 255 type 2 scope 0 2025-02-10 Mon 02:04:21:957.165 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 255 type 2 scope 0 2025-02-10 Mon 02:04:21:957.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 255 type 5 scope 0 2025-02-10 Mon 02:04:21:957.178 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 255 type 5 scope 0 2025-02-10 Mon 02:04:21:957.183 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 255 type 5 scope 0 2025-02-10 Mon 02:04:21:957.187 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 255 type 5 scope 0 2025-02-10 Mon 02:04:21:957.192 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Ignoring Netlink route with family 10 table 255 type 5 scope 0 2025-02-10 Mon 02:04:21:961.831 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:49996::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:21:961.856 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:49996::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:21:961.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:49996::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:21:961.933 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:21:961.960 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:21:961.996 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: ClientInit 2025-02-10 Mon 02:04:21:962.024 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 1 2025-02-10 Mon 02:04:21:962.129 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:21:962.139 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:21:962.160 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: SANDESH: Send FAILED: 1739153061961989 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ], ] ] ] 2025-02-10 Mon 02:04:21:962.167 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:21:962.175 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:21:962.181 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:21:962.194 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:21:962.200 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:21:962.343 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: SANDESH: Send FAILED: 1739153061962121 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 2, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:04:21:962.364 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:21:964.328 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:49996::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:04:21:964.400 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:49996::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:21:964.410 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:49996::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:21:964.466 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:21:964.492 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:21:964.532 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Return to idle with 5000 2025-02-10 Mon 02:04:21:964.540 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Idle 2025-02-10 Mon 02:04:21:964.601 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:21:964.622 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: SANDESH: Send FAILED: 1739153061964517 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ], ] ] ] 2025-02-10 Mon 02:04:21:964.629 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:21:964.636 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:21:964.736 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:21:972.785 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: SANDESH: Send FAILED: 1739153061964593 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 1 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 2065 calls = 1 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 3, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 9, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:04:21:972.846 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:21:986.963 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:9091 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:04:21:987.126 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Router ID configured. Connection to controller initiated 2025-02-10 Mon 02:04:21:996.069 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:21:996.119 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: SANDESH: Send FAILED: 1739153061995526 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:21:996.180 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:21:997.096 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:21:997.133 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: SANDESH: Send FAILED: 1739153061996296 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, Collector connection down, No Configuration for self Number of connections:2, Expected: 3 ], ] ] ] 2025-02-10 Mon 02:04:21:997.142 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:21:997.151 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:21:997.163 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: SANDESH: Send FAILED: 1739153061996622 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:21:997.169 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:21:997.177 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:21:997.228 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: SANDESH: Send FAILED: 1739153061996646 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:21:997.246 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:21:999.393 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: TCP [SYS_ERR]: TcpServerMessageLog: Server TCP bind(fe80::f816:3eff:fe22:9bfd%vhost0:8097): Cannot assign requested address src/contrail-common/io/tcp_server.cc 111 2025-02-10 Mon 02:04:22:044.685 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:044.726 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: SANDESH: Send FAILED: 1739153062044638 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:22:044.737 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:22:044.809 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:044.827 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: SANDESH: Send FAILED: 1739153062044802 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect event = Connect Event local_port = 33097 remote_port = 8093 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:22:044.834 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:22:047.227 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:33097::10.0.0.38:8093 < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:22:047.256 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connected peer ip: 10.0.0.38 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295 2025-02-10 Mon 02:04:22:049.702 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:049.740 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: SANDESH: Send FAILED: 1739153062049680 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 33097 remote_port = 8093 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:22:049.750 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674168551168, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:22:051.108 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:055.430 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: SANDESH: Send FAILED: 1739153062051080 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:22:055.453 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:22:055.468 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:055.480 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: SANDESH: Send FAILED: 1739153062053188 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect event = Connect Event local_port = 45571 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:22:055.486 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674155955968, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:22:053.172 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:45571::10.0.0.38:5269 < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:22:055.511 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connected peer ip: 10.0.0.38 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295 2025-02-10 Mon 02:04:22:055.584 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:055.619 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: SANDESH: Send FAILED: 1739153062055565 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 45571 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:22:055.627 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674164352768, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:22:061.649 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:061.695 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: SANDESH: Send FAILED: 1739153062061622 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenSent next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:22:061.704 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:22:062.710 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:062.730 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: SANDESH: Send FAILED: 1739153062062694 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenSent next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:22:062.738 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:26:964.652 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:26:965.003 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:26:965.104 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:26:965.136 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: SANDESH: Send FAILED: 1739153066964842 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:26:965.146 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:26:965.155 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:26:965.285 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: SANDESH: Send FAILED: 1739153066965089 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 1 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 2065 calls = 1 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 9, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 23, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:04:26:965.304 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:26:972.104 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:52640::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:26:972.134 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:52640::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:26:972.141 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:52640::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:26:972.210 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:26:972.235 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:26:972.277 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: ClientInit 2025-02-10 Mon 02:04:26:972.336 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 2 2025-02-10 Mon 02:04:26:972.419 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:26:972.428 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:26:972.456 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: SANDESH: Send FAILED: 1739153066972266 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:26:972.464 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:26:972.471 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:26:972.478 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:26:972.488 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:26:972.494 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:26:972.621 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: SANDESH: Send FAILED: 1739153066972408 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 2 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 2065 calls = 1 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 10, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 25, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:04:26:972.642 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:26:973.683 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:52640::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:04:26:973.737 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:52640::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:26:973.745 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:52640::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:26:973.784 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:26:973.793 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:26:973.970 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Return to idle with 5000 2025-02-10 Mon 02:04:26:973.982 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Idle 2025-02-10 Mon 02:04:26:974.056 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:26:974.085 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: SANDESH: Send FAILED: 1739153066973952 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:26:974.098 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:26:974.106 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:26:974.156 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:26:974.276 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: SANDESH: Send FAILED: 1739153066974042 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 2 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4130 calls = 2 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 11, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 27, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:04:26:974.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674139162368, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:27:829.941 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34108 > SSL Handshake failed due to error: 336130315 category: asio.ssl message: wrong version number src/contrail-common/io/ssl_server.cc 96 2025-02-10 Mon 02:04:27:836.137 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34114 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:04:27:888.541 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34114 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:04:31:974.052 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:31:974.537 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:31:974.634 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:31:974.662 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: SANDESH: Send FAILED: 1739153071974114 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:31:974.682 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:31:974.693 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:31:974.816 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: SANDESH: Send FAILED: 1739153071974621 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 2 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4130 calls = 2 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 14, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 29, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:04:31:974.847 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674143360768, Pid 1129616]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:31:981.540 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:52926::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:31:981.563 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:52926::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:31:981.570 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:52926::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:31:981.614 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:31:981.627 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:31:981.663 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: ClientInit 2025-02-10 Mon 02:04:31:981.937 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 3 2025-02-10 Mon 02:04:31:982.016 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:31:982.024 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:31:982.058 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: SANDESH: Send FAILED: 1739153071981655 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:31:982.066 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:31:982.073 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:31:982.079 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:31:982.092 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:31:982.098 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:31:982.221 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: SANDESH: Send FAILED: 1739153071982005 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 3 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4130 calls = 2 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 15, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 31, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:04:31:982.234 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674151757568, Pid 1129616]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:31:983.663 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:52926::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:04:31:983.739 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:52926::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:31:983.747 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674317662528, Pid 1129616]: 10.0.0.38:52926::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:31:983.777 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:31:983.787 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:31:983.824 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: Return to idle with 5000 2025-02-10 Mon 02:04:31:983.831 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: Idle 2025-02-10 Mon 02:04:31:983.903 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:31:984.898 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: SANDESH: Send FAILED: 1739153071983812 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:31:984.931 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:31:984.944 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:31:984.996 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:31:985.130 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: SANDESH: Send FAILED: 1739153071983895 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 3 pid = 1129616 http_port = 8085 start_time = 1739153061950392 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 6195 calls = 3 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 16, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 3, ] ] ] 2025-02-10 Mon 02:04:31:985.144 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139674147559168, Pid 1129616]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:36:323.313 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: vhost interface name : vhost0 2025-02-10 Mon 02:04:36:323.408 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: vhost IP Address : 10.0.0.38/24 2025-02-10 Mon 02:04:36:323.419 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: vhost gateway : 0.0.0.0 2025-02-10 Mon 02:04:36:323.427 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Ethernet ports : ens3 2025-02-10 Mon 02:04:36:323.435 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Loopback IP : 0.0.0.0 2025-02-10 Mon 02:04:36:323.443 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Xmpp Servers : 10.0.0.38:5269 2025-02-10 Mon 02:04:36:323.454 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Xmpp Authentication : 1 2025-02-10 Mon 02:04:36:323.461 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Xmpp Server Certificate : /etc/contrail/ssl/certs/server.pem 2025-02-10 Mon 02:04:36:323.469 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Xmpp Server Key : /etc/contrail/ssl/private/server-privkey.pem 2025-02-10 Mon 02:04:36:323.476 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Xmpp CA Certificate : /etc/contrail/ssl/certs/ca-cert.pem 2025-02-10 Mon 02:04:36:323.483 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Cluster-Name : 2025-02-10 Mon 02:04:36:323.492 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: DNS Servers : 10.0.0.38:53 2025-02-10 Mon 02:04:36:323.500 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: DNS client port : 8098 2025-02-10 Mon 02:04:36:323.506 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: DNS timeout : 3000 2025-02-10 Mon 02:04:36:323.513 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: DNS max retries : 2 2025-02-10 Mon 02:04:36:323.520 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Xmpp Dns Authentication : 1 2025-02-10 Mon 02:04:36:323.526 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Xmpp Server Certificate : /etc/contrail/ssl/certs/server.pem 2025-02-10 Mon 02:04:36:323.532 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Xmpp Server Key : /etc/contrail/ssl/private/server-privkey.pem 2025-02-10 Mon 02:04:36:323.539 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Xmpp CA Certificate : /etc/contrail/ssl/certs/ca-cert.pem 2025-02-10 Mon 02:04:36:323.546 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TSN Servers : [] 2025-02-10 Mon 02:04:36:323.553 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: COLLECTOR Servers : 10.0.0.38:8086 2025-02-10 Mon 02:04:36:323.559 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Tunnel-Type : MPLSoGRE 2025-02-10 Mon 02:04:36:323.563 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Metadata-Proxy Shared Secret: cc83ce16-e4e8-45df-8918-a468bed7a65e 2025-02-10 Mon 02:04:36:323.568 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Metadata-Proxy Port : 8097 2025-02-10 Mon 02:04:36:323.573 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Metadata-Proxy SSL Flag : 0 2025-02-10 Mon 02:04:36:323.587 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Max Vm Flows : 100 2025-02-10 Mon 02:04:36:323.601 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Linklocal Max System Flows : 16384 2025-02-10 Mon 02:04:36:323.607 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Linklocal Max Vm Flows : 16384 2025-02-10 Mon 02:04:36:323.614 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Flow cache timeout : 0 2025-02-10 Mon 02:04:36:323.620 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Stale Interface cleanup timeout : 60 2025-02-10 Mon 02:04:36:323.627 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Flow thread count : 1 2025-02-10 Mon 02:04:36:323.633 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Flow latency limit : 0 2025-02-10 Mon 02:04:36:323.640 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Flow index-mgr sm log count : 0 2025-02-10 Mon 02:04:36:323.645 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Flow add-tokens : 50 2025-02-10 Mon 02:04:36:323.650 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Flow ksync-tokens : 25 2025-02-10 Mon 02:04:36:323.655 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Flow del-tokens : 16 2025-02-10 Mon 02:04:36:323.660 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Flow update-tokens : 16 2025-02-10 Mon 02:04:36:323.665 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Pin flow netlink task to CPU: 2025-02-10 Mon 02:04:36:323.727 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Maximum sessions : 100 2025-02-10 Mon 02:04:36:323.736 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Maximum session aggregates : 8 2025-02-10 Mon 02:04:36:323.742 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Maximum session endpoints : 5 2025-02-10 Mon 02:04:36:323.748 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Fabric SNAT hash table size : 4096 2025-02-10 Mon 02:04:36:323.753 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Flow excluding Router ID in hash :0 2025-02-10 Mon 02:04:36:323.758 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Agent Mode : Vrouter 2025-02-10 Mon 02:04:36:323.763 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Gateway Mode : None 2025-02-10 Mon 02:04:36:323.768 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: DHCP Relay Mode : 0 2025-02-10 Mon 02:04:36:323.773 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Service instance netns cmd : /usr/local/bin/opencontrail-vrouter-netns 2025-02-10 Mon 02:04:36:323.778 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Service instance docker cmd : /usr/local/bin/opencontrail-vrouter-docker 2025-02-10 Mon 02:04:36:323.783 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Service instance workers : 0 2025-02-10 Mon 02:04:36:323.788 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Service instance timeout : 0 2025-02-10 Mon 02:04:36:323.792 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Service instance lb ssl : 2025-02-10 Mon 02:04:36:323.797 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Service instance lbaas auth : 2025-02-10 Mon 02:04:36:323.802 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Bgp as a service port range : 50000-50512 2025-02-10 Mon 02:04:36:323.811 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Services queue limit : 1024 2025-02-10 Mon 02:04:36:323.816 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: BGPAAS max shared sessions for service port : 4 2025-02-10 Mon 02:04:36:323.821 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Sandesh Key file : /etc/contrail/ssl/private/server-privkey.pem 2025-02-10 Mon 02:04:36:323.826 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Sandesh Cert file : /etc/contrail/ssl/certs/server.pem 2025-02-10 Mon 02:04:36:323.831 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Sandesh CA Cert : /etc/contrail/ssl/certs/ca-cert.pem 2025-02-10 Mon 02:04:36:323.836 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Sandesh SSL Enable : 1 2025-02-10 Mon 02:04:36:323.840 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Introspect SSL Enable : 1 2025-02-10 Mon 02:04:36:323.845 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Hypervisor mode : kvm 2025-02-10 Mon 02:04:36:323.992 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Ethernet Port Encap Type : 2025-02-10 Mon 02:04:36:324.004 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: Platform mode : Vrouter on host linux kernel 2025-02-10 Mon 02:04:36:324.206 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: VRouter [SYS_INFO]: VersionInfoLog: {"build-info":[{"build-version":"nightly","build-time":"2025-02-10 00:23:15.869602","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7708-1.novalocal","build-id":"unknown","build-number":"unknown"}]} src/contrail-common/base/misc_utils.cc 41 2025-02-10 Mon 02:04:36:324.222 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Logging: DISABLED -> ENABLED 2025-02-10 Mon 02:04:36:324.254 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-02-10 Mon 02:04:36:330.147 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:36:330.176 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-routing-instance -> self 2025-02-10 Mon 02:04:36:330.183 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap routing-instance : self -> virtual-network-routing-instance 2025-02-10 Mon 02:04:36:330.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap routing-instance : virtual-network-routing-instance -> nil 2025-02-10 Mon 02:04:36:330.195 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:36:330.200 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-access-control-list -> self 2025-02-10 Mon 02:04:36:330.206 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap access-control-list : self -> virtual-network-access-control-list 2025-02-10 Mon 02:04:36:330.211 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap access-control-list : virtual-network-access-control-list -> nil 2025-02-10 Mon 02:04:36:330.218 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:36:330.231 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-network-ipam -> self 2025-02-10 Mon 02:04:36:330.236 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network-network-ipam : self -> virtual-network-network-ipam 2025-02-10 Mon 02:04:36:330.241 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network-network-ipam : virtual-network-network-ipam -> virtual-network-network-ipam 2025-02-10 Mon 02:04:36:330.247 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap network-ipam : virtual-network-network-ipam -> nil 2025-02-10 Mon 02:04:36:330.253 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:36:330.258 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-qos-config -> self 2025-02-10 Mon 02:04:36:330.263 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap qos-config : self -> virtual-network-qos-config 2025-02-10 Mon 02:04:36:330.269 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap qos-config : virtual-network-qos-config -> nil 2025-02-10 Mon 02:04:36:330.274 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:36:330.279 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-security-logging-object -> self 2025-02-10 Mon 02:04:36:330.285 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-logging-object : self -> virtual-network-security-logging-object 2025-02-10 Mon 02:04:36:330.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-logging-object : virtual-network-security-logging-object -> nil 2025-02-10 Mon 02:04:36:330.296 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:36:330.300 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : logical-router-virtual-network -> self 2025-02-10 Mon 02:04:36:330.306 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap logical-router-virtual-network : self -> logical-router-virtual-network 2025-02-10 Mon 02:04:36:330.311 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap logical-router-virtual-network : logical-router-virtual-network -> logical-router-virtual-network 2025-02-10 Mon 02:04:36:330.317 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap logical-router : self -> logical-router-virtual-network 2025-02-10 Mon 02:04:36:330.322 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap logical-router : logical-router-virtual-network -> nil 2025-02-10 Mon 02:04:36:330.328 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-network 2025-02-10 Mon 02:04:36:330.333 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-multicast-policy -> self 2025-02-10 Mon 02:04:36:330.339 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap multicast-policy : self -> virtual-network-multicast-policy 2025-02-10 Mon 02:04:36:330.347 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap multicast-policy : virtual-network-multicast-policy -> nil 2025-02-10 Mon 02:04:36:330.353 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for routing-instance 2025-02-10 Mon 02:04:36:330.358 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap routing-instance : virtual-network-routing-instance -> self 2025-02-10 Mon 02:04:36:330.363 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-network-routing-instance 2025-02-10 Mon 02:04:36:330.368 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-provider-network -> virtual-network-routing-instance 2025-02-10 Mon 02:04:36:330.373 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-network-provider-network 2025-02-10 Mon 02:04:36:330.378 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-provider-network -> nil 2025-02-10 Mon 02:04:36:330.385 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for security-group 2025-02-10 Mon 02:04:36:330.390 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-group : security-group-access-control-list -> self 2025-02-10 Mon 02:04:36:330.395 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap access-control-list : self -> security-group-access-control-list 2025-02-10 Mon 02:04:36:330.400 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap access-control-list : security-group-access-control-list -> nil 2025-02-10 Mon 02:04:36:330.407 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for tag 2025-02-10 Mon 02:04:36:330.412 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : application-policy-set-tag -> self 2025-02-10 Mon 02:04:36:330.418 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:36:330.423 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : policy-management-application-policy-set -> application-policy-set-tag 2025-02-10 Mon 02:04:36:330.429 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap policy-management : policy-management-application-policy-set -> nil 2025-02-10 Mon 02:04:36:330.434 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.439 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-network -> self 2025-02-10 Mon 02:04:36:330.445 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:36:330.450 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-network-ipam -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:36:330.455 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network-network-ipam : self -> virtual-network-network-ipam 2025-02-10 Mon 02:04:36:330.463 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network-network-ipam : virtual-network-network-ipam -> nil 2025-02-10 Mon 02:04:36:330.469 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.474 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-machine -> self 2025-02-10 Mon 02:04:36:330.479 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine : self -> virtual-machine-interface-virtual-machine 2025-02-10 Mon 02:04:36:330.484 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine : virtual-machine-interface-virtual-machine -> nil 2025-02-10 Mon 02:04:36:330.490 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.495 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-sub-interface -> self 2025-02-10 Mon 02:04:36:330.500 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : self -> virtual-machine-interface-sub-interface 2025-02-10 Mon 02:04:36:330.505 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-sub-interface -> nil 2025-02-10 Mon 02:04:36:330.510 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.515 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-network -> self 2025-02-10 Mon 02:04:36:330.520 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:36:330.525 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-provider-network -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:36:330.530 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-network-provider-network 2025-02-10 Mon 02:04:36:330.535 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-provider-network -> nil 2025-02-10 Mon 02:04:36:330.541 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.546 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-routing-instance -> self 2025-02-10 Mon 02:04:36:330.552 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface-routing-instance : self -> virtual-machine-interface-routing-instance 2025-02-10 Mon 02:04:36:330.557 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface-routing-instance : virtual-machine-interface-routing-instance -> virtual-machine-interface-routing-instance 2025-02-10 Mon 02:04:36:330.562 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap routing-instance : self -> virtual-machine-interface-routing-instance 2025-02-10 Mon 02:04:36:330.570 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap routing-instance : virtual-machine-interface-routing-instance -> nil 2025-02-10 Mon 02:04:36:330.576 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.581 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-security-group -> self 2025-02-10 Mon 02:04:36:330.586 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-group : self -> virtual-machine-interface-security-group 2025-02-10 Mon 02:04:36:330.591 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-group : virtual-machine-interface-security-group -> nil 2025-02-10 Mon 02:04:36:330.597 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.602 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : alias-ip-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:330.608 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap alias-ip : self -> alias-ip-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.613 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap alias-ip : alias-ip-pool-alias-ip -> alias-ip-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.618 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap alias-ip-pool : virtual-network-alias-ip-pool -> alias-ip-pool-alias-ip 2025-02-10 Mon 02:04:36:330.624 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-network-alias-ip-pool 2025-02-10 Mon 02:04:36:330.629 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-alias-ip-pool -> nil 2025-02-10 Mon 02:04:36:330.636 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.641 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : floating-ip-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:330.646 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap floating-ip : self -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.651 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap floating-ip : floating-ip-pool-floating-ip -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.657 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap floating-ip-pool : virtual-network-floating-ip-pool -> floating-ip-pool-floating-ip 2025-02-10 Mon 02:04:36:330.662 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-network-floating-ip-pool 2025-02-10 Mon 02:04:36:330.676 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-provider-network -> virtual-network-floating-ip-pool 2025-02-10 Mon 02:04:36:330.682 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-network-provider-network 2025-02-10 Mon 02:04:36:330.689 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-provider-network -> nil 2025-02-10 Mon 02:04:36:330.695 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.701 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : floating-ip-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:330.706 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap floating-ip : self -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.711 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap floating-ip : floating-ip-pool-floating-ip -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.716 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap floating-ip-pool : virtual-network-floating-ip-pool -> floating-ip-pool-floating-ip 2025-02-10 Mon 02:04:36:330.721 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-network-floating-ip-pool 2025-02-10 Mon 02:04:36:330.726 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-routing-instance -> virtual-network-floating-ip-pool 2025-02-10 Mon 02:04:36:330.731 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap routing-instance : self -> virtual-network-routing-instance 2025-02-10 Mon 02:04:36:330.736 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap routing-instance : virtual-network-routing-instance -> nil 2025-02-10 Mon 02:04:36:330.742 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.746 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : floating-ip-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:330.752 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap floating-ip : self -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.757 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap floating-ip : instance-ip-floating-ip -> floating-ip-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.762 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap instance-ip : instance-ip-virtual-network -> instance-ip-floating-ip 2025-02-10 Mon 02:04:36:330.767 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> instance-ip-virtual-network 2025-02-10 Mon 02:04:36:330.772 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : instance-ip-virtual-network -> nil 2025-02-10 Mon 02:04:36:330.778 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.782 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : instance-ip-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:330.853 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap instance-ip : self -> instance-ip-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap instance-ip : instance-ip-virtual-machine-interface -> nil 2025-02-10 Mon 02:04:36:330.874 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.885 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-route-table -> self 2025-02-10 Mon 02:04:36:330.892 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap interface-route-table : self -> virtual-machine-interface-route-table 2025-02-10 Mon 02:04:36:330.897 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap interface-route-table : virtual-machine-interface-route-table -> nil 2025-02-10 Mon 02:04:36:330.903 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.908 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : subnet-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:330.914 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap subnet : self -> subnet-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.919 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap subnet : subnet-virtual-machine-interface -> nil 2025-02-10 Mon 02:04:36:330.926 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.931 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : logical-interface-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:330.938 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap logical-interface : physical-interface-logical-interface -> logical-interface-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.944 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-interface : physical-router-physical-interface -> physical-interface-logical-interface 2025-02-10 Mon 02:04:36:330.950 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-router : self -> physical-router-physical-interface 2025-02-10 Mon 02:04:36:330.955 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-router : physical-router-physical-interface -> nil 2025-02-10 Mon 02:04:36:330.962 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:330.967 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-port-group-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:330.973 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-port-group : virtual-port-group-physical-interface -> virtual-port-group-virtual-machine-interface 2025-02-10 Mon 02:04:36:330.978 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-interface : physical-router-physical-interface -> virtual-port-group-physical-interface 2025-02-10 Mon 02:04:36:330.983 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-router : self -> physical-router-physical-interface 2025-02-10 Mon 02:04:36:330.988 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-router : physical-router-physical-interface -> nil 2025-02-10 Mon 02:04:36:330.996 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.001 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : bgpaas-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:331.007 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bgp-as-a-service : self -> bgpaas-virtual-machine-interface 2025-02-10 Mon 02:04:36:331.012 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bgp-as-a-service : bgpaas-bgp-router -> bgpaas-virtual-machine-interface 2025-02-10 Mon 02:04:36:331.044 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bgp-router : self -> bgpaas-bgp-router 2025-02-10 Mon 02:04:36:331.050 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bgp-router : instance-bgp-router -> bgpaas-bgp-router 2025-02-10 Mon 02:04:36:331.055 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap routing-instance : self -> instance-bgp-router 2025-02-10 Mon 02:04:36:331.060 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap routing-instance : instance-bgp-router -> nil 2025-02-10 Mon 02:04:36:331.066 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.071 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : bgpaas-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:331.076 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bgp-as-a-service : self -> bgpaas-virtual-machine-interface 2025-02-10 Mon 02:04:36:331.082 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bgp-as-a-service : bgpaas-health-check -> bgpaas-virtual-machine-interface 2025-02-10 Mon 02:04:36:331.088 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap service-health-check : self -> bgpaas-health-check 2025-02-10 Mon 02:04:36:331.093 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap service-health-check : bgpaas-health-check -> nil 2025-02-10 Mon 02:04:36:331.099 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.103 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-qos-config -> self 2025-02-10 Mon 02:04:36:331.109 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap qos-config : self -> virtual-machine-interface-qos-config 2025-02-10 Mon 02:04:36:331.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap qos-config : virtual-machine-interface-qos-config -> nil 2025-02-10 Mon 02:04:36:331.119 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.124 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-security-logging-object -> self 2025-02-10 Mon 02:04:36:331.130 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-logging-object : self -> virtual-machine-interface-security-logging-object 2025-02-10 Mon 02:04:36:331.139 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-logging-object : virtual-machine-interface-security-logging-object -> nil 2025-02-10 Mon 02:04:36:331.145 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.150 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-bridge-domain -> self 2025-02-10 Mon 02:04:36:331.156 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface-bridge-domain : self -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:36:331.161 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface-bridge-domain : virtual-machine-interface-bridge-domain -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:36:331.167 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bridge-domain : self -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:36:331.172 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bridge-domain : virtual-network-bridge-domain -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:36:331.177 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-network-bridge-domain 2025-02-10 Mon 02:04:36:331.183 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-bridge-domain -> nil 2025-02-10 Mon 02:04:36:331.188 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.193 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-bridge-domain -> self 2025-02-10 Mon 02:04:36:331.198 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface-bridge-domain : self -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:36:331.202 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface-bridge-domain : virtual-machine-interface-bridge-domain -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:36:331.208 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bridge-domain : self -> virtual-machine-interface-bridge-domain 2025-02-10 Mon 02:04:36:331.213 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bridge-domain : virtual-machine-interface-bridge-domain -> nil 2025-02-10 Mon 02:04:36:331.219 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.224 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-tag -> self 2025-02-10 Mon 02:04:36:331.229 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : self -> virtual-machine-interface-tag 2025-02-10 Mon 02:04:36:331.234 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : application-policy-set-tag -> virtual-machine-interface-tag 2025-02-10 Mon 02:04:36:331.239 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:36:331.247 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> application-policy-set-tag 2025-02-10 Mon 02:04:36:331.253 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.258 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.263 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.268 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:36:331.275 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.280 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-network -> self 2025-02-10 Mon 02:04:36:331.285 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:36:331.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-tag -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:36:331.295 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : self -> virtual-network-tag 2025-02-10 Mon 02:04:36:331.300 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : application-policy-set-tag -> virtual-network-tag 2025-02-10 Mon 02:04:36:331.305 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:36:331.310 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> application-policy-set-tag 2025-02-10 Mon 02:04:36:331.315 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.320 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.325 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.330 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:36:331.336 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.341 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-machine -> self 2025-02-10 Mon 02:04:36:331.346 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine : self -> virtual-machine-interface-virtual-machine 2025-02-10 Mon 02:04:36:331.354 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine : virtual-machine-tag -> virtual-machine-interface-virtual-machine 2025-02-10 Mon 02:04:36:331.359 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : self -> virtual-machine-tag 2025-02-10 Mon 02:04:36:331.364 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : application-policy-set-tag -> virtual-machine-tag 2025-02-10 Mon 02:04:36:331.370 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:36:331.374 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> application-policy-set-tag 2025-02-10 Mon 02:04:36:331.379 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.384 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.389 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.394 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:36:331.401 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.405 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-sub-interface -> self 2025-02-10 Mon 02:04:36:331.411 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : self -> virtual-machine-interface-sub-interface 2025-02-10 Mon 02:04:36:331.416 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-machine -> virtual-machine-interface-sub-interface 2025-02-10 Mon 02:04:36:331.421 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine : self -> virtual-machine-interface-virtual-machine 2025-02-10 Mon 02:04:36:331.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine : virtual-machine-tag -> virtual-machine-interface-virtual-machine 2025-02-10 Mon 02:04:36:331.430 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : self -> virtual-machine-tag 2025-02-10 Mon 02:04:36:331.435 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : application-policy-set-tag -> virtual-machine-tag 2025-02-10 Mon 02:04:36:331.440 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:36:331.445 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> application-policy-set-tag 2025-02-10 Mon 02:04:36:331.450 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.457 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.462 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.467 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:36:331.474 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.478 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : project-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:331.485 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap project : self -> project-virtual-machine-interface 2025-02-10 Mon 02:04:36:331.490 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap project : project-tag -> project-virtual-machine-interface 2025-02-10 Mon 02:04:36:331.495 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : self -> project-tag 2025-02-10 Mon 02:04:36:331.500 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : application-policy-set-tag -> project-tag 2025-02-10 Mon 02:04:36:331.505 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : self -> application-policy-set-tag 2025-02-10 Mon 02:04:36:331.509 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> application-policy-set-tag 2025-02-10 Mon 02:04:36:331.514 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.519 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.524 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:331.529 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:36:331.540 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.545 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : port-tuple-interface -> self 2025-02-10 Mon 02:04:36:331.551 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap port-tuple : self -> port-tuple-interface 2025-02-10 Mon 02:04:36:331.556 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap port-tuple : port-tuple-interface -> port-tuple-interface 2025-02-10 Mon 02:04:36:331.561 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : self -> port-tuple-interface 2025-02-10 Mon 02:04:36:331.569 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : port-tuple-interface -> nil 2025-02-10 Mon 02:04:36:331.575 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for virtual-machine-interface 2025-02-10 Mon 02:04:36:331.580 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : logical-router-interface -> self 2025-02-10 Mon 02:04:36:331.585 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap logical-router : self -> logical-router-interface 2025-02-10 Mon 02:04:36:331.590 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap logical-router : logical-router-interface -> nil 2025-02-10 Mon 02:04:36:331.597 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for physical-interface 2025-02-10 Mon 02:04:36:331.602 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-interface : physical-router-physical-interface -> self 2025-02-10 Mon 02:04:36:331.607 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-router : self -> physical-router-physical-interface 2025-02-10 Mon 02:04:36:331.612 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-router : physical-router-physical-interface -> nil 2025-02-10 Mon 02:04:36:331.618 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for physical-interface 2025-02-10 Mon 02:04:36:331.622 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-interface : virtual-port-group-physical-interface -> self 2025-02-10 Mon 02:04:36:331.628 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-port-group-physical-interface : self -> virtual-port-group-physical-interface 2025-02-10 Mon 02:04:36:331.633 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-port-group-physical-interface : virtual-port-group-physical-interface -> virtual-port-group-physical-interface 2025-02-10 Mon 02:04:36:331.638 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-port-group : self -> virtual-port-group-physical-interface 2025-02-10 Mon 02:04:36:331.643 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-port-group : virtual-port-group-physical-interface -> nil 2025-02-10 Mon 02:04:36:331.649 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for logical-interface 2025-02-10 Mon 02:04:36:331.654 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap logical-interface : physical-interface-logical-interface -> self 2025-02-10 Mon 02:04:36:331.659 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-interface : self -> physical-interface-logical-interface 2025-02-10 Mon 02:04:36:331.664 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-interface : physical-router-physical-interface -> physical-interface-logical-interface 2025-02-10 Mon 02:04:36:331.677 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-router : self -> physical-router-physical-interface 2025-02-10 Mon 02:04:36:331.682 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-router : physical-router-physical-interface -> nil 2025-02-10 Mon 02:04:36:331.697 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for logical-interface 2025-02-10 Mon 02:04:36:331.702 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap logical-interface : logical-interface-virtual-machine-interface -> self 2025-02-10 Mon 02:04:36:331.707 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : self -> logical-interface-virtual-machine-interface 2025-02-10 Mon 02:04:36:331.712 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : logical-interface-virtual-machine-interface -> nil 2025-02-10 Mon 02:04:36:331.718 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for logical-interface 2025-02-10 Mon 02:04:36:331.723 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap logical-interface : physical-router-logical-interface -> self 2025-02-10 Mon 02:04:36:331.728 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-router : self -> physical-router-logical-interface 2025-02-10 Mon 02:04:36:331.733 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-router : physical-router-logical-interface -> nil 2025-02-10 Mon 02:04:36:331.738 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for physical-router 2025-02-10 Mon 02:04:36:331.743 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-router : physical-router-physical-interface -> self 2025-02-10 Mon 02:04:36:331.748 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-interface : self -> physical-router-physical-interface 2025-02-10 Mon 02:04:36:331.753 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap physical-interface : physical-router-physical-interface -> nil 2025-02-10 Mon 02:04:36:331.760 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for service-health-check 2025-02-10 Mon 02:04:36:331.765 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap service-health-check : service-port-health-check -> self 2025-02-10 Mon 02:04:36:331.771 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : self -> service-port-health-check 2025-02-10 Mon 02:04:36:331.776 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-network -> service-port-health-check 2025-02-10 Mon 02:04:36:331.781 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-network-ipam -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:36:331.786 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network-network-ipam : self -> virtual-network-network-ipam 2025-02-10 Mon 02:04:36:331.791 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network-network-ipam : virtual-network-network-ipam -> nil 2025-02-10 Mon 02:04:36:331.798 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for service-health-check 2025-02-10 Mon 02:04:36:331.806 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap service-health-check : service-port-health-check -> self 2025-02-10 Mon 02:04:36:331.812 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : self -> service-port-health-check 2025-02-10 Mon 02:04:36:331.817 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : port-tuple-interface -> service-port-health-check 2025-02-10 Mon 02:04:36:331.822 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap port-tuple : self -> port-tuple-interface 2025-02-10 Mon 02:04:36:331.827 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap port-tuple : port-tuple-interface -> port-tuple-interface 2025-02-10 Mon 02:04:36:331.832 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : self -> port-tuple-interface 2025-02-10 Mon 02:04:36:331.837 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-machine-interface : virtual-machine-interface-virtual-network -> port-tuple-interface 2025-02-10 Mon 02:04:36:331.842 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-network-ipam -> virtual-machine-interface-virtual-network 2025-02-10 Mon 02:04:36:331.847 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network-network-ipam : self -> virtual-network-network-ipam 2025-02-10 Mon 02:04:36:331.852 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network-network-ipam : virtual-network-network-ipam -> nil 2025-02-10 Mon 02:04:36:331.858 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for qos-config 2025-02-10 Mon 02:04:36:331.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap qos-config : global-qos-config-qos-config -> self 2025-02-10 Mon 02:04:36:331.869 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap global-qos-config : global-qos-config-qos-config -> nil 2025-02-10 Mon 02:04:36:331.876 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for forwarding-class 2025-02-10 Mon 02:04:36:331.881 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap forwarding-class : forwarding-class-qos-queue -> self 2025-02-10 Mon 02:04:36:331.887 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap qos-queue : self -> forwarding-class-qos-queue 2025-02-10 Mon 02:04:36:331.892 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap qos-queue : forwarding-class-qos-queue -> nil 2025-02-10 Mon 02:04:36:331.899 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for security-logging-object 2025-02-10 Mon 02:04:36:331.903 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-logging-object : security-logging-object-network-policy -> self 2025-02-10 Mon 02:04:36:331.913 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap network-policy : self -> security-logging-object-network-policy 2025-02-10 Mon 02:04:36:331.919 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap network-policy : security-logging-object-network-policy -> nil 2025-02-10 Mon 02:04:36:331.924 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for security-logging-object 2025-02-10 Mon 02:04:36:331.932 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-logging-object : security-logging-object-security-group -> self 2025-02-10 Mon 02:04:36:331.937 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-group : self -> security-logging-object-security-group 2025-02-10 Mon 02:04:36:331.942 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-group : security-logging-object-security-group -> nil 2025-02-10 Mon 02:04:36:331.948 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for security-logging-object 2025-02-10 Mon 02:04:36:331.953 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-logging-object : firewall-policy-security-logging-object -> self 2025-02-10 Mon 02:04:36:331.958 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy-security-logging-object : self -> firewall-policy-security-logging-object 2025-02-10 Mon 02:04:36:331.963 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy-security-logging-object : firewall-policy-security-logging-object -> firewall-policy-security-logging-object 2025-02-10 Mon 02:04:36:331.969 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : firewall-policy-security-logging-object -> nil 2025-02-10 Mon 02:04:36:331.975 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for security-logging-object 2025-02-10 Mon 02:04:36:331.980 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap security-logging-object : firewall-rule-security-logging-object -> self 2025-02-10 Mon 02:04:36:331.985 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-rule-security-logging-object : self -> firewall-rule-security-logging-object 2025-02-10 Mon 02:04:36:331.990 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-rule-security-logging-object : firewall-rule-security-logging-object -> firewall-rule-security-logging-object 2025-02-10 Mon 02:04:36:331.996 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-rule : firewall-rule-security-logging-object -> nil 2025-02-10 Mon 02:04:36:332.009 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for bridge-domain 2025-02-10 Mon 02:04:36:332.014 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bridge-domain : virtual-network-bridge-domain -> self 2025-02-10 Mon 02:04:36:332.019 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-network-bridge-domain 2025-02-10 Mon 02:04:36:332.024 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-routing-instance -> virtual-network-bridge-domain 2025-02-10 Mon 02:04:36:332.030 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap routing-instance : self -> virtual-network-routing-instance 2025-02-10 Mon 02:04:36:332.035 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap routing-instance : virtual-network-routing-instance -> nil 2025-02-10 Mon 02:04:36:332.040 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for bridge-domain 2025-02-10 Mon 02:04:36:332.048 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap bridge-domain : virtual-network-bridge-domain -> self 2025-02-10 Mon 02:04:36:332.053 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : self -> virtual-network-bridge-domain 2025-02-10 Mon 02:04:36:332.058 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap virtual-network : virtual-network-bridge-domain -> nil 2025-02-10 Mon 02:04:36:332.064 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for application-policy-set 2025-02-10 Mon 02:04:36:332.069 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set : application-policy-set-firewall-policy -> self 2025-02-10 Mon 02:04:36:332.074 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:332.079 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap application-policy-set-firewall-policy : application-policy-set-firewall-policy -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:332.084 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : self -> application-policy-set-firewall-policy 2025-02-10 Mon 02:04:36:332.089 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : application-policy-set-firewall-policy -> nil 2025-02-10 Mon 02:04:36:332.096 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for firewall-policy 2025-02-10 Mon 02:04:36:332.102 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : firewall-policy-firewall-rule -> self 2025-02-10 Mon 02:04:36:332.107 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy-firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.113 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy-firewall-rule : firewall-policy-firewall-rule -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.118 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-rule : firewall-rule-service-group -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.129 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap service-group : self -> firewall-rule-service-group 2025-02-10 Mon 02:04:36:332.134 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap service-group : firewall-rule-service-group -> nil 2025-02-10 Mon 02:04:36:332.140 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for firewall-policy 2025-02-10 Mon 02:04:36:332.145 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : firewall-policy-firewall-rule -> self 2025-02-10 Mon 02:04:36:332.150 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy-firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.158 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy-firewall-rule : firewall-policy-firewall-rule -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.163 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.169 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-rule : firewall-rule-address-group -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.174 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap address-group : self -> firewall-rule-address-group 2025-02-10 Mon 02:04:36:332.179 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap address-group : address-group-tag -> firewall-rule-address-group 2025-02-10 Mon 02:04:36:332.184 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : self -> address-group-tag 2025-02-10 Mon 02:04:36:332.190 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : address-group-tag -> nil 2025-02-10 Mon 02:04:36:332.195 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for firewall-policy 2025-02-10 Mon 02:04:36:332.200 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : firewall-policy-firewall-rule -> self 2025-02-10 Mon 02:04:36:332.205 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy-firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.210 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy-firewall-rule : firewall-policy-firewall-rule -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.215 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.220 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-rule : firewall-rule-tag -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.225 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : self -> firewall-rule-tag 2025-02-10 Mon 02:04:36:332.230 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap tag : firewall-rule-tag -> nil 2025-02-10 Mon 02:04:36:332.236 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Updating dependency tacker rules for firewall-policy 2025-02-10 Mon 02:04:36:332.241 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy : firewall-policy-firewall-rule -> self 2025-02-10 Mon 02:04:36:332.245 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy-firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.250 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-policy-firewall-rule : firewall-policy-firewall-rule -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.255 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-rule : self -> firewall-policy-firewall-rule 2025-02-10 Mon 02:04:36:332.260 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Adding ReactorMap firewall-rule : firewall-policy-firewall-rule -> nil 2025-02-10 Mon 02:04:36:478.657 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.0.0.38:8097 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:04:36:478.858 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Current receive sock buffer size is 262144 2025-02-10 Mon 02:04:36:478.908 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316849694464, Pid 1141240]: KsyncTxQueue CPU pinning policy <>. KsyncTxQueuen not pinned to CPU 2025-02-10 Mon 02:04:36:478.922 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Vrouter family is 34 2025-02-10 Mon 02:04:36:479.012 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Flow table size : 20185088 2025-02-10 Mon 02:04:36:501.195 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Flow table size : 161218560 2025-02-10 Mon 02:04:36:501.241 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SetHugePages: Bridge table size:20185088 Flow table size:161218560 2025-02-10 Mon 02:04:36:501.263 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Mem mapping hugepage file:/dev/hugepages2M/bridge size:20185088 2025-02-10 Mon 02:04:36:501.311 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Mem mapped hugepage file:/dev/hugepages2M/bridge to addr:0x7f9e0ce00000 2025-02-10 Mon 02:04:36:501.324 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Mem mapping hugepage file:/dev/hugepages2M/flow size:161218560 2025-02-10 Mon 02:04:36:501.445 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Mem mapped hugepage file:/dev/hugepages2M/flow to addr:0x7f9e03400000 2025-02-10 Mon 02:04:36:501.470 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Sending Huge Page configuration to VROUTER 2025-02-10 Mon 02:04:36:501.542 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Vrouter using already allocated memory 2025-02-10 Mon 02:04:36:521.557 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Flow table size : 161218560 2025-02-10 Mon 02:04:36:521.742 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Flow table size : 20185088 2025-02-10 Mon 02:04:36:609.046 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: ROLE : Generator 2025-02-10 Mon 02:04:36:609.071 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: MODULE : contrail-vrouter-agent 2025-02-10 Mon 02:04:36:609.076 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: SOURCE : cn-jenkins-deploy-platform-juju-os-472-1 2025-02-10 Mon 02:04:36:609.082 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: NODE TYPE : Compute 2025-02-10 Mon 02:04:36:609.087 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: INSTANCE ID : 0 2025-02-10 Mon 02:04:36:609.092 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: HTTP SERVER PORT : 8085 2025-02-10 Mon 02:04:36:609.098 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-02-10 Mon 02:04:36:609.414 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: HTTP Introspect Init 2025-02-10 Mon 02:04:36:609.598 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8085 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:04:36:609.653 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Sandesh Http Server Port: 8085 2025-02-10 Mon 02:04:36:609.731 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: NOT Writing http_port 8085TO : /tmp/contrail-vrouter-agent.1140276.http_port 2025-02-10 Mon 02:04:36:609.738 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: CONNECT TO COLLECTOR: 1 2025-02-10 Mon 02:04:36:609.815 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Idle 2025-02-10 Mon 02:04:36:610.026 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: No Client: 1739153076609960 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 0 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:04:36:610.320 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvStart in state Idle 2025-02-10 Mon 02:04:36:610.407 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Disconnect 2025-02-10 Mon 02:04:36:610.486 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvCollectorUpdate in state Disconnect 2025-02-10 Mon 02:04:36:610.991 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:36:611.051 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:36:611.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153076610370 AgentVrf [SYS_INFO]: VrfObjectLog: vrf= [ event = Addition name = default-domain:default-project:ip-fabric:__default__ index = 0 ] file = controller/src/vnsw/agent/oper/vrf.cc line = 414 2025-02-10 Mon 02:04:36:611.087 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: VrfObjectLog 2025-02-10 Mon 02:04:36:611.105 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:36:611.171 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153076610398 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ], ] ] ] 2025-02-10 Mon 02:04:36:611.178 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:36:611.186 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:36:611.196 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153076610404 AgentVrf [SYS_INFO]: VrfObjectLog: vrf= [ event = Addition name = default-domain:default-project:ip-fabric:ip-fabric index = 1 ] file = controller/src/vnsw/agent/oper/vrf.cc line = 414 2025-02-10 Mon 02:04:36:611.202 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: VrfObjectLog 2025-02-10 Mon 02:04:36:611.225 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface lo flags 65609 2025-02-10 Mon 02:04:36:611.251 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface ens3 flags 69699 2025-02-10 Mon 02:04:36:611.227 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:36:611.286 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface fan-252 flags 69699 2025-02-10 Mon 02:04:36:611.372 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153076610478 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:04:36:611.400 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface ftun0 flags 69699 2025-02-10 Mon 02:04:36:611.418 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:36:611.450 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:36:611.471 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface lxdbr0 flags 4099 2025-02-10 Mon 02:04:36:611.483 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface veth0a3a2c61 flags 69699 2025-02-10 Mon 02:04:36:611.516 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface veth5a9fae9d flags 69699 2025-02-10 Mon 02:04:36:611.521 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface vethe9884a02 flags 69699 2025-02-10 Mon 02:04:36:611.526 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153076610521 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:04:36:611.540 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:36:611.548 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:36:611.553 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface veth151be4d9 flags 69699 2025-02-10 Mon 02:04:36:611.571 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface veth61a711a4 flags 69699 2025-02-10 Mon 02:04:36:611.576 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153076610533 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ], ] ] ] 2025-02-10 Mon 02:04:36:611.583 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:36:611.591 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:36:611.604 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface vethadd41881 flags 69699 2025-02-10 Mon 02:04:36:611.613 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface veth52a07095 flags 69699 2025-02-10 Mon 02:04:36:611.646 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface veth824839ba flags 69699 2025-02-10 Mon 02:04:36:611.651 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface vethb535270f flags 69699 2025-02-10 Mon 02:04:36:611.654 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153076611042 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 0 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:04:36:611.692 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface veth8bdba501 flags 69699 2025-02-10 Mon 02:04:36:611.703 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface veth8db5e9bb flags 69699 2025-02-10 Mon 02:04:36:611.691 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:36:611.733 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface veth70b5a176 flags 69699 2025-02-10 Mon 02:04:36:611.739 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface docker0 flags 4099 2025-02-10 Mon 02:04:36:611.761 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface pkt1 flags 65601 2025-02-10 Mon 02:04:36:611.767 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface pkt3 flags 65601 2025-02-10 Mon 02:04:36:611.779 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface pkt2 flags 65601 2025-02-10 Mon 02:04:36:611.791 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface vhost0 flags 69699 2025-02-10 Mon 02:04:36:611.796 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink interface message RTM_NEWLINK for interface pkt0 flags 69699 2025-02-10 Mon 02:04:36:611.843 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink address message RTM_NEWADDR for interface lo 2025-02-10 Mon 02:04:36:611.855 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink address message RTM_NEWADDR for interface fan-252 2025-02-10 Mon 02:04:36:611.864 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink address message RTM_NEWADDR for interface lxdbr0 2025-02-10 Mon 02:04:36:611.873 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink address message RTM_NEWADDR for interface docker0 2025-02-10 Mon 02:04:36:611.883 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink address message RTM_NEWADDR for interface vhost0 2025-02-10 Mon 02:04:36:611.900 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink address message RTM_NEWADDR for interface lo 2025-02-10 Mon 02:04:36:611.909 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink address message RTM_NEWADDR for interface fan-252 2025-02-10 Mon 02:04:36:611.918 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink address message RTM_NEWADDR for interface ftun0 2025-02-10 Mon 02:04:36:611.927 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink address message RTM_NEWADDR for interface vhost0 2025-02-10 Mon 02:04:36:611.935 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink address message RTM_NEWADDR for interface pkt0 2025-02-10 Mon 02:04:36:611.983 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 254 type 1 scope 0 2025-02-10 Mon 02:04:36:611.997 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink route message RTM_NEWROUTE : 10.0.0.0/24 Interface vhost0 GW 0.0.0.0 2025-02-10 Mon 02:04:36:612.007 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink route message RTM_NEWROUTE : 10.0.0.0/24 Interface vhost0 GW 0.0.0.0 2025-02-10 Mon 02:04:36:612.017 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink route message RTM_NEWROUTE : 10.0.0.1/32 Interface vhost0 GW 0.0.0.0 2025-02-10 Mon 02:04:36:612.027 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink route message RTM_NEWROUTE : 10.0.0.2/32 Interface vhost0 GW 0.0.0.0 2025-02-10 Mon 02:04:36:612.038 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink route message RTM_NEWROUTE : 10.0.0.4/32 Interface vhost0 GW 0.0.0.0 2025-02-10 Mon 02:04:36:612.048 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink route message RTM_NEWROUTE : 10.22.176.0/24 Interface lxdbr0 GW 0.0.0.0 2025-02-10 Mon 02:04:36:612.053 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 254 type 1 scope 0 2025-02-10 Mon 02:04:36:612.063 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink route message RTM_NEWROUTE : 172.17.0.0/16 Interface docker0 GW 0.0.0.0 2025-02-10 Mon 02:04:36:612.079 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Handle netlink route message RTM_NEWROUTE : 252.0.0.0/8 Interface fan-252 GW 0.0.0.0 2025-02-10 Mon 02:04:36:612.085 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:36:612.090 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 255 type 3 scope 253 2025-02-10 Mon 02:04:36:612.095 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:36:612.099 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 255 type 3 scope 253 2025-02-10 Mon 02:04:36:612.104 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:36:612.109 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:36:612.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 255 type 3 scope 253 2025-02-10 Mon 02:04:36:612.118 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:36:612.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 255 type 3 scope 253 2025-02-10 Mon 02:04:36:612.128 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 255 type 2 scope 254 2025-02-10 Mon 02:04:36:612.133 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 2 table 255 type 3 scope 253 2025-02-10 Mon 02:04:36:612.146 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 254 type 1 scope 0 2025-02-10 Mon 02:04:36:612.151 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 254 type 1 scope 0 2025-02-10 Mon 02:04:36:612.156 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 254 type 1 scope 0 2025-02-10 Mon 02:04:36:612.160 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 254 type 1 scope 0 2025-02-10 Mon 02:04:36:612.165 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 254 type 1 scope 0 2025-02-10 Mon 02:04:36:612.170 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 2 scope 0 2025-02-10 Mon 02:04:36:612.175 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 4 scope 0 2025-02-10 Mon 02:04:36:612.179 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 4 scope 0 2025-02-10 Mon 02:04:36:612.184 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 4 scope 0 2025-02-10 Mon 02:04:36:612.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 2 scope 0 2025-02-10 Mon 02:04:36:612.197 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 2 scope 0 2025-02-10 Mon 02:04:36:612.201 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 2 scope 0 2025-02-10 Mon 02:04:36:612.206 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 5 scope 0 2025-02-10 Mon 02:04:36:612.211 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 5 scope 0 2025-02-10 Mon 02:04:36:612.216 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 5 scope 0 2025-02-10 Mon 02:04:36:612.221 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 5 scope 0 2025-02-10 Mon 02:04:36:612.225 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Ignoring Netlink route with family 10 table 255 type 5 scope 0 2025-02-10 Mon 02:04:36:618.966 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:47210::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:36:618.995 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:47210::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:36:619.003 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:47210::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:36:619.054 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:36:619.065 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:36:619.101 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: ClientInit 2025-02-10 Mon 02:04:36:619.687 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 1 2025-02-10 Mon 02:04:36:619.800 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:36:619.812 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:36:619.836 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153076619094 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ], ] ] ] 2025-02-10 Mon 02:04:36:619.844 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:36:619.852 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:36:619.858 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:36:619.882 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:36:619.888 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:36:620.041 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153076619789 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 2, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:04:36:620.056 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:36:622.666 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:47210::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:04:36:622.762 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:47210::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:36:622.773 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:47210::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:36:623.065 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:36:623.090 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:36:623.133 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:04:36:623.177 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Idle 2025-02-10 Mon 02:04:36:623.254 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:623.276 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153076623118 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ], ] ] ] 2025-02-10 Mon 02:04:36:623.283 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:36:623.291 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:36:623.354 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:623.465 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153076623246 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 1 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 2065 calls = 1 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 3, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 9, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:04:36:623.485 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:36:630.124 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:9091 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:04:36:630.285 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Router ID configured. Connection to controller initiated 2025-02-10 Mon 02:04:36:631.045 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:631.070 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153076630736 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:631.078 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:631.091 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:631.110 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153076630792 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, Collector connection down, No Configuration for self Number of connections:2, Expected: 3 ], ] ] ] 2025-02-10 Mon 02:04:36:631.117 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:36:631.124 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:631.133 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153076630991 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:631.139 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:631.145 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:631.167 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153076631006 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:36:631.172 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:36:631.954 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server [fe80::f816:3eff:fe22:9bfd%vhost0]:8097 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:04:36:679.590 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:679.636 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153076679555 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:679.646 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:681.753 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:37803::10.0.0.38:8093 < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:36:681.790 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connected peer ip: 10.0.0.38 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295 2025-02-10 Mon 02:04:36:681.960 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:681.986 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153076681838 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect event = Connect Event local_port = 37803 remote_port = 8093 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:681.994 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:682.300 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:682.320 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153076682279 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 37803 remote_port = 8093 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:682.327 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:682.702 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:682.738 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153076682680 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenSent next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:682.746 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:684.345 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:684.373 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153076684166 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:684.382 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:684.391 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:684.403 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153076684296 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect event = Connect Event local_port = 43421 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:684.408 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:686.586 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:43421::10.0.0.38:5269 < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:36:686.610 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connected peer ip: 10.0.0.38 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295 2025-02-10 Mon 02:04:36:686.722 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:686.751 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153076686708 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 43421 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:686.759 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:688.908 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:688.944 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153076688893 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenSent next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:688.963 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:37:688.501 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:04:41:623.212 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:41:623.450 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:41:623.543 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:41:623.573 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153081623275 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:41:623.581 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:41:623.589 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:41:623.732 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153081623527 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 1 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 2065 calls = 1 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 10, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 23, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:04:41:623.753 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:41:630.168 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:47488::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:41:630.212 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:47488::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:41:630.221 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:47488::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:41:630.283 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:41:630.310 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:41:630.349 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit 2025-02-10 Mon 02:04:41:630.492 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 2 2025-02-10 Mon 02:04:41:630.606 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:41:630.616 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:41:630.645 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153081630341 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:41:630.658 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:41:630.666 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:41:630.681 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:41:630.691 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:41:630.697 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:41:630.847 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153081630594 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 2 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 2065 calls = 1 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 11, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 25, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:04:41:630.862 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:41:631.545 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:47488::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:04:41:631.606 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:47488::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:41:631.615 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:47488::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:41:631.652 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:41:631.719 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:41:631.759 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:04:41:631.767 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Idle 2025-02-10 Mon 02:04:41:631.853 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:41:631.879 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153081631744 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:41:631.887 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:41:631.894 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:41:631.955 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:41:632.101 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153081631840 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 2 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4130 calls = 2 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 12, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 27, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:04:41:632.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:46:631.892 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:46:632.177 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:46:632.279 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:46:632.310 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153086631963 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:46:632.319 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:46:632.330 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:46:632.466 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153086632268 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 2 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4130 calls = 2 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 12, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 29, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:04:46:632.488 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:46:638.692 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:57852::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:46:638.719 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:57852::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:46:638.727 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:57852::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:46:638.785 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:46:638.809 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:46:638.851 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit 2025-02-10 Mon 02:04:46:638.877 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 3 2025-02-10 Mon 02:04:46:638.966 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:46:638.975 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:46:638.997 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153086638843 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:46:639.004 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:46:639.012 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:46:639.018 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:46:639.030 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:46:639.036 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:46:639.163 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153086638958 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 3 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4130 calls = 2 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 13, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 31, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:04:46:639.180 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:46:639.994 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:57852::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:04:46:640.047 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:57852::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:46:640.055 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:57852::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:46:640.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:46:640.138 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:46:640.186 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:04:46:640.193 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Idle 2025-02-10 Mon 02:04:46:640.255 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:46:640.280 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153086640169 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:46:640.288 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:46:640.296 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:46:640.353 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:46:640.491 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153086640248 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 3 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 6195 calls = 3 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 14, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 3, ] ] ] 2025-02-10 Mon 02:04:46:640.506 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:49:700.333 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:52506 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:04:49:750.325 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:52506 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:04:51:640.277 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:51:641.512 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:51:641.627 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:51:641.656 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153091640340 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:51:641.664 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:51:641.679 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:51:641.812 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153091641604 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 3 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 6195 calls = 3 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 16, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 3, ] ] ] 2025-02-10 Mon 02:04:51:641.829 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:51:648.936 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:58104::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:51:648.966 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:58104::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:51:648.974 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:58104::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:51:649.044 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:51:649.055 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:51:649.091 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: ClientInit 2025-02-10 Mon 02:04:51:649.413 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 4 2025-02-10 Mon 02:04:51:649.489 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:51:649.497 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:51:649.519 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153091649083 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:51:649.526 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:51:649.537 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:51:649.543 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:51:649.554 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:51:649.560 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:51:649.705 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153091649477 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 4 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 6195 calls = 3 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 17, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 3, ] ] ] 2025-02-10 Mon 02:04:51:649.720 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:51:651.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:58104::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:04:51:651.146 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:58104::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:51:651.155 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:58104::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:51:651.293 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:51:651.310 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:51:651.368 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:04:51:651.376 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Idle 2025-02-10 Mon 02:04:51:651.469 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:51:651.503 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153091651353 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:51:651.511 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:51:651.519 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:51:652.158 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:51:652.353 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153091651456 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 4 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 8260 calls = 4 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 18, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 39, _iter59->first = sent _iter59->second = 4, ] ] ] 2025-02-10 Mon 02:04:51:652.377 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:56:651.469 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:56:651.746 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:56:651.876 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:56:651.917 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153096651544 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:56:651.930 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:56:651.943 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:56:652.188 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153096651854 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 4 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 8260 calls = 4 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 18, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 41, _iter59->first = sent _iter59->second = 4, ] ] ] 2025-02-10 Mon 02:04:56:652.217 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:56:658.727 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:48486::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:56:658.754 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:48486::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:56:658.762 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:48486::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:56:658.819 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:56:658.853 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:56:658.893 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: ClientInit 2025-02-10 Mon 02:04:56:658.916 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 5 2025-02-10 Mon 02:04:56:659.022 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:56:659.031 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:56:659.055 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153096658883 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:56:659.071 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:56:659.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:56:659.086 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:56:659.096 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:56:659.101 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:56:659.335 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153096659013 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 5 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 8260 calls = 4 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 19, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 43, _iter59->first = sent _iter59->second = 4, ] ] ] 2025-02-10 Mon 02:04:56:659.358 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:56:661.257 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:48486::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:04:56:661.314 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:48486::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:56:661.324 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:48486::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:56:661.386 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:56:661.416 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:56:661.473 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:04:56:661.481 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Idle 2025-02-10 Mon 02:04:56:661.554 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:56:661.578 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153096661455 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:04:56:661.586 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:56:661.594 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:56:661.639 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:56:661.830 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153096661545 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 5 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 10325 calls = 5 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 20, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 5, ] ] ] 2025-02-10 Mon 02:04:56:661.857 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:01:661.582 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:01:661.831 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:01:661.945 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:01:661.976 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153101661654 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:01:661.984 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:01:662.001 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:01:662.143 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153101661931 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 5 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 10325 calls = 5 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 20, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 47, _iter59->first = sent _iter59->second = 5, ] ] ] 2025-02-10 Mon 02:05:01:662.160 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:01:669.056 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:48780::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:01:669.088 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:48780::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:01:669.097 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:48780::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:01:669.163 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:01:669.199 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:01:669.247 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit 2025-02-10 Mon 02:05:01:669.274 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 6 2025-02-10 Mon 02:05:01:669.366 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:01:669.375 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:01:669.397 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153101669239 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:01:669.405 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:01:669.412 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:01:669.418 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:01:669.430 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:01:669.436 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:01:669.577 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153101669358 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 6 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 10325 calls = 5 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 21, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 49, _iter59->first = sent _iter59->second = 5, ] ] ] 2025-02-10 Mon 02:05:01:669.594 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:01:670.756 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:48780::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:01:670.814 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:48780::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:01:670.823 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:48780::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:01:670.854 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:01:670.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:01:670.903 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:05:01:670.911 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Idle 2025-02-10 Mon 02:05:01:670.978 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:01:671.003 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153101670889 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:01:671.019 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:01:671.027 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:01:671.077 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:01:671.201 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153101670970 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 6 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 12390 calls = 6 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 22, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 51, _iter59->first = sent _iter59->second = 6, ] ] ] 2025-02-10 Mon 02:05:01:671.216 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:06:325.828 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:06:325.887 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153106325771 [SYS_NOTICE]: UveVrouterAgent: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 interface_list= [ [ ] ] error_intf_list= [ [ ] ] no_config_intf_list= [ [ (*_iter151) = 00000000-0000-0000-0000-000000000000, ] ] vmi_count= [ active = 1 ] down_interface_count = 1 ] 2025-02-10 Mon 02:05:06:325.908 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: UveVrouterAgent 2025-02-10 Mon 02:05:06:325.991 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:06:326.065 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153106325971 [SYS_NOTICE]: UveVirtualNetworkAgentTrace: data= [ name = __UNKNOWN__ vrf_stats_list= [ [ [ name = __untitled__ diag_packet_count = 0 unknown_unicast_floods = 0 arp_packet_counts= [ from_vm_interface= [ stats= [ proxies = 0 stitches = 0 floods = 0 ] ] from_physical_interface= [ stats= [ proxies = 0 stitches = 0 floods = 0 ] ] ] offload_packet_counts= [ gro = 0 ] nh_packet_counts= [ discards = 0 resolves = 0 l3_receives = 0 l2_receives = 0 local_vm_l3_forwards = 0 local_vm_l2_forwards = 0 vrf_translates = 0 ecmp_forwards = 0 tunnel_nh_stats= [ udp_encaps = 0 mpls_over_udp_encaps = 0 mpls_over_gre_encaps = 0 vxlan_encaps = 0 ] comp_nh_stats= [ source_replication_forwards = 0 edge_replication_forwards = 0 local_vm_l3_forwards = 0 total_multicast_forwards = 0 ] ] ], ] ] ] 2025-02-10 Mon 02:05:06:326.076 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: UveVirtualNetworkAgentTrace 2025-02-10 Mon 02:05:06:610.289 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:06:610.370 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153106610139 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 61 dequeues = 61 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 86 dequeues = 86 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1739153101670910 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1739153106325983 ] max_sm_queue_count = 7 ] 2025-02-10 Mon 02:05:06:610.382 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:06:610.393 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:06:610.566 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153106610249 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 6 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 12390 calls = 6 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 22, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 55, _iter59->first = sent _iter59->second = 6, ] ] ] 2025-02-10 Mon 02:05:06:610.586 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:06:612.548 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:06:612.646 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153106612505 [SYS_NOTICE]: UveVrouterAgent: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 xmpp_peer_list= [ [ [ ip = 10.0.0.38 status = 0 setup_time = 0 primary = 1 ], ] ] self_ip_list= [ [ (*_iter146) = 10.0.0.38, ] ] build_info = {"build-info":[{"build-version":"nightly","build-time":"2025-02-10 00:23:15.869602","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7708-1.novalocal","build-id":"unknown","build-number":"unknown"}]} phy_if= [ [ [ name = ens3 mac_address = fa:16:3e:22:9b:fd ], ] ] vhost_if= [ name = vhost0 mac_address = fa:16:3e:22:9b:fd ] log_file = /var/log/contrail/vrouter-agent/contrail-vrouter-agent.log config_file = /etc/contrail/contrail-vrouter-agent.conf log_local = 1 log_level = SYS_DEBUG log_category = sandesh_http_port = 8085 dns_servers= [ [ (*_iter149) = 10.0.0.38, ] ] vhost_cfg= [ name = vhost0 ip = 10.0.0.38 ip_prefix_len = 24 gateway = 10.0.0.1 ] eth_name= [ [ (*_iter150) = ens3, ] ] tunnel_type = MPLSoGRE hypervisor = kvm control_ip = 10.0.0.38 dns_server_list_cfg= [ [ (*_iter152) = 10.0.0.38:53, ] ] control_node_list_cfg= [ [ (*_iter153) = 10.0.0.38:5269, ] ] hostname_cfg = cn-jenkins-deploy-platform-juju-os-472-1 flow_cache_timeout_cfg = 0 ll_max_system_flows_cfg = 16384 ll_max_vm_flows_cfg = 16384 max_vm_flows_cfg = 100 gateway_cfg_list= [ [ ] ] headless_mode_cfg = 1 collector_server_list_cfg= [ [ (*_iter155) = 10.0.0.38:8086, ] ] log_flow = 0 mode = VROUTER platform = HOST vr_limits= [ max_labels = 5120 max_nexthops = 524288 max_interfaces = 4355 max_vrfs = 4096 max_mirror_entries = 255 vrouter_max_bridge_entries = 262144 vrouter_max_oflow_bridge_entries = 53248 vrouter_build_info = {"build-info": [{"build-version": "nightly", "build-time": "2025-02-10 00:20:50.600607", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-7708-1.novalocal"}]} vrouter_max_flow_entries = 524288 vrouter_max_oflow_entries = 105472 vrouter_priority_tagging = 1 ] bgpaas_enabled = 0 port_mirror_enabled = 0 subcluster_name = vr_high_watermark = 80 vr_low_watermark = 75 vr_limit_exceeded_list= [ [ ] ] res_limit = 0 res_table_limit = 0 loopback_ip = 0.0.0.0 gateway_list= [ [ (*_iter161) = 10.0.0.1, ] ] ] 2025-02-10 Mon 02:05:06:612.703 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: UveVrouterAgent 2025-02-10 Mon 02:05:06:612.716 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:06:612.854 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153106612562 [SYS_NOTICE]: VrouterStats: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 in_tpkts = 36 in_bytes = 2174 out_tpkts = 38 out_bytes = 1915 exception_packets = 24 exception_packets_dropped = 10 exception_packets_allowed = 14 total_flows = 0 aged_flows = 0 uptime = 1739153076324395 phy_if_info= [ [ _iter254->first = ens3 [ speed = -1 duplexity = 255 ], ] ] raw_vhost_stats= [ name = vhost0 in_pkts = 36 in_bytes = 2174 out_pkts = 38 out_bytes = 1915 speed = -1 duplexity = -1 ] raw_vhost_drop_stats= [ ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 0 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 1 ] raw_drop_stats= [ ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 0 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 1 ] flow_rate= [ added_flows = 0 max_flow_adds_per_second = 0 min_flow_adds_per_second = 0 deleted_flows = 0 max_flow_deletes_per_second = 0 min_flow_deletes_per_second = 0 active_flows = 0 hold_flows = 0 ] raw_phy_if_stats= [ [ _iter262->first = ens3 [ in_pkts = 18 in_bytes = 1075 out_pkts = 39 out_bytes = 2259 ], ] ] raw_phy_if_drop_stats= [ [ _iter263->first = ens3 [ ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 0 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 0 ], ] ] ] 2025-02-10 Mon 02:05:06:612.870 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: VrouterStats 2025-02-10 Mon 02:05:06:613.241 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:06:613.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153106613210 [SYS_NOTICE]: VrouterControlStatsTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 raw_xmpp_stats= [ [ _iter306->first = 10.0.0.38 [ reconnects = 0 in_msgs = 0 out_msgs = 0 ], ] ] raw_ifmap_stats= [ [ _iter307->first = link_delete_parse_errors _iter307->second = 0, _iter307->first = link_update_parse_errors _iter307->second = 0, _iter307->first = node_delete_parse_errors _iter307->second = 0, _iter307->first = node_update_parse_errors _iter307->second = 0, ] ] raw_rt_table_size= [ [ _iter308->first = default-domain:default-project:ip-fabric:__default__ [ inet4_unicast = 8 inet4_multicast = 0 evpn = 0 bridge = 6 inet6_unicast = 2 ], _iter308->first = default-domain:default-project:ip-fabric:ip-fabric [ inet4_unicast = 2 inet4_multicast = 0 evpn = 1 bridge = 2 inet6_unicast = 0 ], ] ] ] 2025-02-10 Mon 02:05:06:613.300 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: VrouterControlStatsTrace 2025-02-10 Mon 02:05:06:671.018 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:06:671.247 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:06:671.358 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:06:671.385 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153106671089 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:06:671.393 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:06:671.402 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:06:671.618 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153106671345 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 6 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 12390 calls = 6 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 22, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 60, _iter59->first = sent _iter59->second = 6, ] ] ] 2025-02-10 Mon 02:05:06:671.647 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:06:677.852 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:46078::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:06:677.879 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:46078::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:06:677.886 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:46078::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:06:677.951 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:06:677.977 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:06:678.020 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit 2025-02-10 Mon 02:05:06:678.043 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 7 2025-02-10 Mon 02:05:06:678.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:06:678.141 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:06:678.163 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153106678011 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:06:678.170 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:06:678.177 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:06:678.183 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:06:678.194 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:06:678.200 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:06:678.380 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153106678121 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 7 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 12390 calls = 6 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 23, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 62, _iter59->first = sent _iter59->second = 6, ] ] ] 2025-02-10 Mon 02:05:06:678.403 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:06:679.133 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:46078::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:06:679.180 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:46078::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:06:679.187 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:46078::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:06:679.225 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:06:679.242 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:06:679.282 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:05:06:679.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Idle 2025-02-10 Mon 02:05:06:679.358 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:06:679.382 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153106679268 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:06:679.390 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:06:679.398 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:06:679.446 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:06:679.619 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153106679342 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 7 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 14455 calls = 7 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 24, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 64, _iter59->first = sent _iter59->second = 7, ] ] ] 2025-02-10 Mon 02:05:06:679.710 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:06:683.046 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1/dns:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:11:679.377 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:11:680.372 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:11:680.496 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:11:680.524 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153111680028 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:11:680.533 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:11:680.542 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:11:680.804 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153111680482 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 7 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 14455 calls = 7 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 25, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 7, ] ] ] 2025-02-10 Mon 02:05:11:680.859 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:11:687.361 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:46298::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:11:687.447 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:46298::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:11:687.455 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:46298::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:11:687.516 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:11:687.541 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:11:687.585 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit 2025-02-10 Mon 02:05:11:687.765 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 8 2025-02-10 Mon 02:05:11:687.874 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:11:687.884 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:11:687.906 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153111687577 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:11:687.914 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:11:687.921 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:11:687.928 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:11:687.940 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:11:687.946 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:11:688.133 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153111687863 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 8 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 14455 calls = 7 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 19 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 26, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 68, _iter59->first = sent _iter59->second = 7, ] ] ] 2025-02-10 Mon 02:05:11:688.161 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:11:689.357 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:46298::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:11:689.413 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:46298::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:11:689.421 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:46298::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:11:689.454 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:11:689.463 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:11:689.500 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:05:11:689.507 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Idle 2025-02-10 Mon 02:05:11:689.584 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:11:689.612 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153111689487 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:11:689.620 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:11:689.628 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:11:689.690 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:11:689.869 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153111689570 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 8 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 16520 calls = 8 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 27, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 70, _iter59->first = sent _iter59->second = 8, ] ] ] 2025-02-10 Mon 02:05:11:689.966 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:16:689.606 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:16:689.930 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:16:690.100 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:16:690.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153116689676 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:16:690.141 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:16:690.149 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:16:690.321 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153116690083 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 8 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 16520 calls = 8 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 27, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 72, _iter59->first = sent _iter59->second = 8, ] ] ] 2025-02-10 Mon 02:05:16:690.344 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:16:696.893 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:43394::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:16:696.918 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:43394::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:16:696.926 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:43394::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:16:696.987 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:16:697.012 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:16:697.051 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: ClientInit 2025-02-10 Mon 02:05:16:697.073 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 9 2025-02-10 Mon 02:05:16:697.156 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:16:697.164 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:16:697.187 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153116697044 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:16:697.194 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:16:697.202 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:16:697.208 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:16:697.220 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:16:697.225 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:16:697.404 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153116697145 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 9 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 16520 calls = 8 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 28, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 74, _iter59->first = sent _iter59->second = 8, ] ] ] 2025-02-10 Mon 02:05:16:697.426 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:16:698.752 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:43394::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:16:698.830 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:43394::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:16:698.843 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:43394::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:16:698.896 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:16:698.917 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:16:698.954 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:05:16:698.961 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Idle 2025-02-10 Mon 02:05:16:699.030 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:16:699.056 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153116698942 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:16:699.064 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:16:699.071 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:16:699.137 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:16:699.301 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153116699019 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 9 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 18585 calls = 9 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 22 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 29, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 76, _iter59->first = sent _iter59->second = 9, ] ] ] 2025-02-10 Mon 02:05:16:699.318 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:21:699.528 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:21:700.697 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:21:700.817 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:21:700.847 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153121699587 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:21:700.856 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:21:700.864 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:21:701.040 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153121700798 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 9 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 18585 calls = 9 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 22 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 29, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 78, _iter59->first = sent _iter59->second = 9, ] ] ] 2025-02-10 Mon 02:05:21:701.062 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:21:707.414 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:43626::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:21:707.437 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:43626::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:21:707.445 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:43626::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:21:707.485 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:21:707.497 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:21:707.528 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: ClientInit 2025-02-10 Mon 02:05:21:707.904 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 10 2025-02-10 Mon 02:05:21:707.990 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:21:707.999 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:21:708.023 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153121707522 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:21:708.030 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:21:708.038 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:21:708.044 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:21:708.054 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:21:708.065 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:21:708.230 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153121707982 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 10 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 18585 calls = 9 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 23 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 30, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 80, _iter59->first = sent _iter59->second = 9, ] ] ] 2025-02-10 Mon 02:05:21:708.246 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:21:709.571 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:43626::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:21:709.632 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:43626::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:21:709.641 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:43626::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:21:709.690 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:21:709.700 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:21:709.731 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:05:21:709.739 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Idle 2025-02-10 Mon 02:05:21:710.244 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:21:710.270 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153121709722 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:21:710.282 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:21:710.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:21:710.339 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:21:710.556 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153121710228 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 10 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 20652 calls = 10 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 24 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 31, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 82, _iter59->first = sent _iter59->second = 10, ] ] ] 2025-02-10 Mon 02:05:21:710.578 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:26:709.885 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:26:710.229 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:26:710.343 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:26:710.374 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153126709963 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:26:710.382 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:26:710.390 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:26:710.620 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153126710332 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 10 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 20652 calls = 10 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 24 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 31, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 84, _iter59->first = sent _iter59->second = 10, ] ] ] 2025-02-10 Mon 02:05:26:710.658 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:26:719.755 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:35020::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:26:719.783 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:35020::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:26:719.791 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:35020::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:26:719.844 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:26:720.066 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:26:720.120 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit 2025-02-10 Mon 02:05:26:720.148 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 11 2025-02-10 Mon 02:05:26:720.261 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:26:720.270 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:26:720.295 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153126720109 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:26:720.302 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:26:720.328 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:26:720.335 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:26:720.349 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:26:720.354 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:26:720.521 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153126720246 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 11 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 20652 calls = 10 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 32, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 86, _iter59->first = sent _iter59->second = 10, ] ] ] 2025-02-10 Mon 02:05:26:720.537 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:26:721.618 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:35020::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:26:721.697 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:35020::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:26:721.707 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:35020::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:26:721.758 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:26:721.788 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:26:721.836 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:05:26:721.845 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Idle 2025-02-10 Mon 02:05:26:721.944 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:26:721.972 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153126721819 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Idle ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:26:721.988 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:26:721.998 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:26:722.065 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:26:722.276 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153126721929 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 11 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 22719 calls = 11 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 11 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 26 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 33, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 88, _iter59->first = sent _iter59->second = 11, ] ] ] 2025-02-10 Mon 02:05:26:722.297 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:28:690.856 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connection Closed peer ip: 10.0.0.38 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-02-10 Mon 02:05:28:691.003 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:28:691.032 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153128690948 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Active event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:28:691.043 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:28:695.651 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connection Closed peer ip: 10.0.0.38 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-02-10 Mon 02:05:28:695.774 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:28:695.801 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153128695737 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Active event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:28:695.809 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:29:609.133 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:29:609.179 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153129609044 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:29:609.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:29:609.877 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer RECV Mode Client: Event: Tcp Connect Fail peer ip: 10.0.0.38 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302 2025-02-10 Mon 02:05:29:609.920 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-02-10 Mon 02:05:29:609.976 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:29:609.995 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153129609900 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect event = Connect Event local_port = 38455 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:29:610.002 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:29:610.009 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:29:610.018 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153129609941 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:29:610.024 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:29:757.955 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:29:758.311 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer RECV Mode Client: Event: Tcp Connect Fail peer ip: 10.0.0.38 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302 2025-02-10 Mon 02:05:29:759.651 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153129757856 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:29:759.681 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:29:759.694 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:29:759.708 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153129758328 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect event = Connect Event local_port = 45367 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:29:759.714 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:29:759.788 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-02-10 Mon 02:05:29:759.856 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:29:759.869 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153129759812 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:29:759.875 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:536.158 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:536.203 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153131536043 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:536.217 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:539.157 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:38681::10.0.0.38:8093 < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:31:539.191 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connected peer ip: 10.0.0.38 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295 2025-02-10 Mon 02:05:31:539.338 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:539.359 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153131539227 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect event = Connect Event local_port = 38681 remote_port = 8093 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:539.367 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:539.375 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:539.395 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153131539325 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 38681 remote_port = 8093 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:539.401 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:669.027 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:669.068 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153131668821 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:669.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:688.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:43535::10.0.0.38:5269 < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:31:688.165 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connected peer ip: 10.0.0.38 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295 2025-02-10 Mon 02:05:31:688.285 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:688.309 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153131688211 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect event = Connect Event local_port = 43535 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:688.317 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:688.556 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:688.574 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153131688546 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 43535 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:688.581 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:692.341 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:31:692.376 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:692.391 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153131692274 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenSent next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:692.407 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:692.414 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:692.424 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153131692308 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Sent Start Tls, OpenConfirm Feature Negotiation event = EvStreamFeatureRequest ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:692.430 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:694.350 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:31:694.377 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:694.392 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153131694328 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Trigger Client Ssl Handshake event = EvTlsProceed identifier = network-control@contrailsystems.com ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:694.399 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:699.404 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_DEBUG]: XmppSslHandShakeMessage: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV success controller/src/xmpp/xmpp_connection.cc 402 2025-02-10 Mon 02:05:31:702.387 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:702.423 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153131702354 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = OpenConfirm Feature Negotiation Success event = EvTlsHandShakeSuccess ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:702.431 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:703.532 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:43535::10.0.0.38:5269 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:31:703.593 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connection Closed peer ip: 10.0.0.38 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-02-10 Mon 02:05:31:703.653 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:703.706 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153131703634 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:703.715 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:703.723 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:703.734 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153131703659 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Established next_state = Active event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:703.744 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:703.752 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:703.776 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153131703698 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Up description = OpenConfirm ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:31:703.783 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:31:703.807 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:703.845 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153131703794 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:31:703.853 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:31:721.899 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:31:725.531 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:31:725.691 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:31:725.720 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153131722634 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:31:725.729 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:31:725.739 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:31:725.934 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153131725673 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 11 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 22719 calls = 11 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 11 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 31 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 48, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 112, _iter59->first = sent _iter59->second = 11, ] ] ] 2025-02-10 Mon 02:05:31:725.956 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:31:732.284 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:35200::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:31:732.311 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:35200::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:31:732.324 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:35200::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:31:732.371 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:31:732.544 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:31:732.585 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit 2025-02-10 Mon 02:05:31:732.615 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 12 2025-02-10 Mon 02:05:31:732.757 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:31:732.768 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:31:732.792 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153131732578 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:31:732.800 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:31:732.807 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:31:732.813 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:31:732.828 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:31:732.834 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:31:733.010 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153131732745 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 12 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 22719 calls = 11 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 11 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 32 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 49, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 114, _iter59->first = sent _iter59->second = 11, ] ] ] 2025-02-10 Mon 02:05:31:734.787 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:31:737.355 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:35200::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:31:737.415 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:35200::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:31:737.424 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:35200::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:31:737.463 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:31:737.472 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:31:737.517 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:05:31:737.525 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Idle 2025-02-10 Mon 02:05:31:737.604 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:737.629 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153131737502 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:31:737.637 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:31:737.644 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:31:737.723 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:739.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153131737596 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 12 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 24786 calls = 12 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 33 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 50, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 116, _iter59->first = sent _iter59->second = 12, ] ] ] 2025-02-10 Mon 02:05:31:739.158 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:35:339.878 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:339.935 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153135339784 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:339.947 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:342.694 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:32929::10.0.0.38:5269 < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:35:342.726 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connected peer ip: 10.0.0.38 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295 2025-02-10 Mon 02:05:35:342.885 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:342.905 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153135342764 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect event = Connect Event local_port = 32929 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:342.913 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:342.921 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:342.943 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153135342874 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 32929 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:342.950 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:344.262 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:344.337 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153135344247 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenSent next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:344.347 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:344.355 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:344.365 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153135344286 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Sent Start Tls, OpenConfirm Feature Negotiation event = EvStreamFeatureRequest ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:344.371 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:344.305 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:35:346.149 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:346.186 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153135346126 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Trigger Client Ssl Handshake event = EvTlsProceed identifier = network-control@contrailsystems.com ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:346.194 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:346.151 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:35:348.766 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_DEBUG]: XmppSslHandShakeMessage: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV success controller/src/xmpp/xmpp_connection.cc 402 2025-02-10 Mon 02:05:35:349.097 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:349.129 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153135349071 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = OpenConfirm Feature Negotiation Success event = EvTlsHandShakeSuccess ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:349.137 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:353.350 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:32929::10.0.0.38:5269 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:35:353.422 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connection Closed peer ip: 10.0.0.38 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-02-10 Mon 02:05:35:353.576 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:353.593 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153135353478 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:353.600 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:353.608 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:353.617 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153135353512 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Established next_state = Active event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:353.623 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:353.629 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:353.638 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153135353515 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:353.643 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:353.849 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:353.874 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153135353687 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Up description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:35:353.891 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:35:353.900 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:353.914 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153135353798 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:35:353.921 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:36:610.463 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:36:611.293 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153136610339 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 11 dequeues = 11 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 142 dequeues = 142 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 12 dequeues = 12 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 12 dequeues = 12 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 12 dequeues = 12 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 191 dequeues = 191 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1739153131737524 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1739153135353898 ] max_sm_queue_count = 7 ] 2025-02-10 Mon 02:05:36:611.316 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:36:611.326 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:36:611.514 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153136610437 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 12 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 24786 calls = 12 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 57, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 130, _iter59->first = sent _iter59->second = 12, ] ] ] 2025-02-10 Mon 02:05:36:611.539 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:36:612.728 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:36:612.777 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153136612699 [SYS_NOTICE]: UveVrouterAgent: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 xmpp_peer_list= [ [ [ ip = 10.0.0.38 status = 0 setup_time = 1739153135353690 primary = 0 ], ] ] ] 2025-02-10 Mon 02:05:36:612.787 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: UveVrouterAgent 2025-02-10 Mon 02:05:36:613.374 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:36:613.555 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153136613334 [SYS_NOTICE]: VrouterStats: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 cpu_info= [ num_cpu = 8 sys_mem_info= [ total = 25602048 used = 0 free = 390000174 buffers = 32670 cached = 25465888 node_type = ] meminfo= [ virt = 32670 peakvirt = 375966104 res = 32670 ] cpuload= [ one_min_avg = 0.99125 five_min_avg = 0.71625 fifteen_min_avg = 0.42125 ] cpu_share = 0.41154 ] ] 2025-02-10 Mon 02:05:36:613.567 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: VrouterStats 2025-02-10 Mon 02:05:36:613.577 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:36:613.593 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153136613369 [SYS_NOTICE]: ComputeCpuStateTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 cpu_info= [ [ [ mem_virt = 32670 cpu_share = 0.41154 used_sys_mem = 4269468738 one_min_cpuload = 0.99125 mem_res = 32670 ], ] ] ] 2025-02-10 Mon 02:05:36:613.601 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: ComputeCpuStateTrace 2025-02-10 Mon 02:05:36:613.608 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:36:613.776 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153136613397 [SYS_NOTICE]: VrouterStats: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 in_tpkts = 68 in_bytes = 4259 out_tpkts = 71 out_bytes = 3962 exception_packets = 27 exception_packets_dropped = 11 exception_packets_allowed = 16 raw_vhost_stats= [ name = vhost0 in_pkts = 68 in_bytes = 4259 out_pkts = 71 out_bytes = 3962 speed = -1 duplexity = -1 ] raw_vhost_drop_stats= [ ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 0 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 1 ] raw_drop_stats= [ ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 0 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 1 ] flow_rate= [ added_flows = 0 max_flow_adds_per_second = 0 min_flow_adds_per_second = 0 deleted_flows = 0 max_flow_deletes_per_second = 0 min_flow_deletes_per_second = 0 active_flows = 0 hold_flows = 0 ] raw_phy_if_stats= [ [ _iter262->first = ens3 [ in_pkts = 36 in_bytes = 2492 out_pkts = 71 out_bytes = 4344 ], ] ] raw_phy_if_drop_stats= [ [ _iter263->first = ens3 [ ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 0 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 0 ], ] ] ] 2025-02-10 Mon 02:05:36:613.787 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: VrouterStats 2025-02-10 Mon 02:05:36:613.798 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:36:613.836 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153136613424 [SYS_NOTICE]: VrouterControlStatsTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 raw_xmpp_stats= [ [ _iter306->first = 10.0.0.38 [ reconnects = 2 in_msgs = 0 out_msgs = 2 ], ] ] raw_ifmap_stats= [ [ _iter307->first = link_delete_parse_errors _iter307->second = 0, _iter307->first = link_update_parse_errors _iter307->second = 0, _iter307->first = node_delete_parse_errors _iter307->second = 0, _iter307->first = node_update_parse_errors _iter307->second = 0, ] ] raw_rt_table_size= [ [ _iter308->first = default-domain:default-project:ip-fabric:__default__ [ inet4_unicast = 8 inet4_multicast = 0 evpn = 0 bridge = 6 inet6_unicast = 2 ], _iter308->first = default-domain:default-project:ip-fabric:ip-fabric [ inet4_unicast = 2 inet4_multicast = 0 evpn = 1 bridge = 2 inet6_unicast = 0 ], ] ] ] 2025-02-10 Mon 02:05:36:613.843 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: VrouterControlStatsTrace 2025-02-10 Mon 02:05:36:737.645 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:36:737.989 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:36:738.112 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:36:738.143 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153136737761 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:36:738.152 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:36:738.160 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:36:738.352 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153136738093 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 12 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 24786 calls = 12 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ComputeCpuStateTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 42 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 57, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 137, _iter59->first = sent _iter59->second = 12, ] ] ] 2025-02-10 Mon 02:05:36:738.379 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:36:744.822 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:42370::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:36:744.864 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:42370::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:36:744.875 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:42370::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:36:744.943 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:36:744.967 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:36:745.008 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: ClientInit 2025-02-10 Mon 02:05:36:745.031 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 13 2025-02-10 Mon 02:05:36:745.122 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:36:745.130 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:36:745.153 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153136744999 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:36:745.170 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:36:745.178 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:36:745.184 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:36:745.214 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:36:745.221 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:36:745.419 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153136745109 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 13 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 24786 calls = 12 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ComputeCpuStateTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 36 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 58, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 139, _iter59->first = sent _iter59->second = 12, ] ] ] 2025-02-10 Mon 02:05:36:745.437 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:36:746.652 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:42370::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:36:746.739 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:42370::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:36:746.748 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:42370::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:36:746.791 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:36:746.818 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:36:746.946 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:05:36:746.958 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Idle 2025-02-10 Mon 02:05:36:747.075 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:36:747.135 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153136746892 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:36:747.148 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:36:747.159 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:36:747.232 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:36:747.426 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153136747064 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 13 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 26853 calls = 13 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ComputeCpuStateTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 45 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 13 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 37 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 59, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 141, _iter59->first = sent _iter59->second = 13, ] ] ] 2025-02-10 Mon 02:05:36:747.450 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:41:747.044 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:41:798.525 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:41:798.702 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:41:798.730 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153141798302 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:41:798.739 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:41:798.747 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:41:798.975 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: SANDESH: Send FAILED: 1739153141798688 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 13 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 26853 calls = 13 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ComputeCpuStateTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 46 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 13 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 45 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 37 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 59, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 143, _iter59->first = sent _iter59->second = 13, ] ] ] 2025-02-10 Mon 02:05:41:799.003 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:41:806.348 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:42540::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:41:816.758 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:42540::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:41:816.779 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:42540::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:41:816.854 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:41:816.882 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:41:816.925 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit 2025-02-10 Mon 02:05:41:817.047 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 14 2025-02-10 Mon 02:05:41:817.155 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:41:817.164 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:41:817.188 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153141816917 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:41:817.205 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:41:817.213 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:41:817.219 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:41:817.232 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:41:817.238 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:41:817.582 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153141817145 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 14 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 26853 calls = 13 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ComputeCpuStateTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 47 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 13 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 46 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 38 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 60, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 145, _iter59->first = sent _iter59->second = 13, ] ] ] 2025-02-10 Mon 02:05:41:817.627 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:41:818.495 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:42540::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:41:818.572 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:42540::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:41:818.585 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:42540::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:41:818.640 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:41:818.658 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:41:818.709 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Return to idle with 5000 2025-02-10 Mon 02:05:41:818.716 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Idle 2025-02-10 Mon 02:05:41:818.785 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:41:818.809 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153141818694 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:41:818.817 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:41:818.824 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:41:818.884 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:41:819.064 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153141818776 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Idle successful_connections = 14 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 28920 calls = 14 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ComputeCpuStateTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 48 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 14 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 47 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 61, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 147, _iter59->first = sent _iter59->second = 14, ] ] ] 2025-02-10 Mon 02:05:41:819.088 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:43:561.794 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:561.851 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153143561696 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:561.865 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:565.401 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:45167::10.0.0.38:5269 < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:43:565.445 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connected peer ip: 10.0.0.38 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295 2025-02-10 Mon 02:05:43:565.596 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:565.622 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153143565479 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect event = Connect Event local_port = 45167 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:565.629 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:565.641 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:565.653 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153143565579 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 45167 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:565.659 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:568.487 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:568.517 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153143568446 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenSent next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:568.525 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:568.592 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:43:568.605 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:568.616 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: SANDESH: Send FAILED: 1739153143568580 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Sent Start Tls, OpenConfirm Feature Negotiation event = EvStreamFeatureRequest ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:568.622 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:570.302 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:43:570.323 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:570.337 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153143570281 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Trigger Client Ssl Handshake event = EvTlsProceed identifier = network-control@contrailsystems.com ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:570.343 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:574.373 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_DEBUG]: XmppSslHandShakeMessage: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV success controller/src/xmpp/xmpp_connection.cc 402 2025-02-10 Mon 02:05:43:574.532 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:574.553 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153143574506 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = OpenConfirm Feature Negotiation Success event = EvTlsHandShakeSuccess ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:574.560 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:577.315 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:45167::10.0.0.38:5269 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:43:577.386 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connection Closed peer ip: 10.0.0.38 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-02-10 Mon 02:05:43:577.544 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:577.560 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153143577440 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:577.567 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:577.574 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:577.584 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153143577469 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Established next_state = Active event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:577.590 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:577.596 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:577.605 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: SANDESH: Send FAILED: 1739153143577472 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:577.610 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:577.886 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:577.918 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: SANDESH: Send FAILED: 1739153143577644 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Up description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:43:577.927 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:43:578.345 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:578.411 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: SANDESH: Send FAILED: 1739153143578296 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:43:578.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:44:767.372 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:57190 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:05:44:809.481 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:57190 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:46:818.812 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:46:819.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:46:819.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:46:819.347 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153146818882 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:46:819.362 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:46:819.374 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:46:819.613 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SANDESH: Send FAILED: 1739153146819279 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = Connect successful_connections = 14 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 28920 calls = 14 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ComputeCpuStateTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 51 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 14 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 48 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 43 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 50 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 70, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 161, _iter59->first = sent _iter59->second = 14, ] ] ] 2025-02-10 Mon 02:05:46:819.643 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:46:828.705 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:59864::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:46:828.738 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:59864::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:46:828.746 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: 10.0.0.38:59864::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:46:828.861 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:46:828.896 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:46:828.942 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit 2025-02-10 Mon 02:05:46:829.421 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-vrouter-agent:0:Compute count 15 2025-02-10 Mon 02:05:46:829.513 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:46:829.522 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit : EvSandeshSend : XmppConnectionLog 2025-02-10 Mon 02:05:46:829.536 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:46:829.543 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:46:829.579 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153146828934 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] ] 2025-02-10 Mon 02:05:46:829.587 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:46:829.594 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:46:829.601 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:46:829.609 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:46:829.615 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:46:829.889 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1/dns:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:46:829.895 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: SANDESH: Send FAILED: 1739153146829503 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 15 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 28920 calls = 14 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ComputeCpuStateTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 52 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 14 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 49 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 44 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 50 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 71, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 163, _iter59->first = sent _iter59->second = 14, ] ] ] 2025-02-10 Mon 02:05:46:829.950 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:46:829.962 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:46:829.969 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: ClientInit : EvSandeshSend : XmppConnectionLog 2025-02-10 Mon 02:05:46:829.988 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenSent next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:46:830.079 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Sent Start Tls, OpenConfirm Feature Negotiation event = EvStreamFeatureRequest ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:46:832.469 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:46:832.497 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: ClientInit : EvSandeshSend : XmppConnectionLog 2025-02-10 Mon 02:05:46:832.526 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Trigger Client Ssl Handshake event = EvTlsProceed identifier = network-dns@contrailsystems.com ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:46:832.469 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1/dns:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:46:838.566 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: OnMessage control in state: ClientInit 2025-02-10 Mon 02:05:46:839.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-02-10 Mon 02:05:46:839.092 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: ClientInit : EvSandeshMessageRecv 2025-02-10 Mon 02:05:46:839.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Received Ctrl Message with size 0 2025-02-10 Mon 02:05:46:839.150 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncUVE Syncing ObjectVRouter val name = cn-jenkins-deploy-platform-juju-os-472-1 cpu_info= [ [ [ mem_virt = 32670 cpu_share = 0.41154 used_sys_mem = 4269468738 one_min_cpuload = 0.99125 mem_res = 32670 ], ] ] proxy seq 1 2025-02-10 Mon 02:05:46:839.164 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for ComputeCpuState:0 period 0 cycle 0 without seqno , total = 1 2025-02-10 Mon 02:05:46:839.419 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-juju-os-472-1:Compute:contrail-vrouter-agent:0 client_info= [ status = ClientInit successful_connections = 15 pid = 1141240 http_port = 8085 start_time = 1739153076609826 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 28920 calls = 14 average_bytes = 2065 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 11 dequeues = 11 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 142 dequeues = 142 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 12 dequeues = 12 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 12 dequeues = 12 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 12 dequeues = 12 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 191 dequeues = 191 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1739153131737524 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1739153135353898 ] msg_type_agg= [ [ _iter58->first = ComputeCpuStateTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 52 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 14 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 49 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 44 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVirtualNetworkAgentTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveVrouterAgent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrfObjectLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterControlStatsTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = VrouterStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 50 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 71, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 163, _iter59->first = sent _iter59->second = 14, ] ] max_sm_queue_count = 7 proxy seq 51 2025-02-10 Mon 02:05:46:841.501 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_DEBUG]: XmppSslHandShakeMessage: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV success controller/src/xmpp/xmpp_connection.cc 402 2025-02-10 Mon 02:05:46:842.935 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-02-10 Mon 02:05:46:842.972 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncUVE Syncing ObjectVRouter val name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = XMPP name = control-node:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:5269, ] ] status = Down description = Established ], [ type = XMPP name = dns-server:10.0.0.38 server_addrs= [ [ (*_iter6) = 10.0.0.38:53, ] ] status = Down description = Idle ], [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], ] ] flag_infos= [ [ ] ] description = XMPP:control-node:10.0.0.38, XMPP:dns-server:10.0.0.38, Collector connection down, No Configuration for self ], ] ] proxy seq 53 2025-02-10 Mon 02:05:46:842.986 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-02-10 Mon 02:05:46:843.003 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:46:843.010 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:46:843.017 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for ProuterData:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:46:843.024 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for UveLogicalInterfaceAgent:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:46:843.030 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for UvePhysicalInterfaceAgent:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:46:843.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for UveVMInterfaceAgent:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:46:843.056 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for UveVirtualMachineAgent:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:46:843.097 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncUVE Syncing ObjectVNTable val name = __UNKNOWN__ vrf_stats_list= [ [ [ name = __untitled__ diag_packet_count = 0 unknown_unicast_floods = 0 arp_packet_counts= [ from_vm_interface= [ stats= [ proxies = 0 stitches = 0 floods = 0 ] ] from_physical_interface= [ stats= [ proxies = 0 stitches = 0 floods = 0 ] ] ] offload_packet_counts= [ gro = 0 ] nh_packet_counts= [ discards = 0 resolves = 0 l3_receives = 0 l2_receives = 0 local_vm_l3_forwards = 0 local_vm_l2_forwards = 0 vrf_translates = 0 ecmp_forwards = 0 tunnel_nh_stats= [ udp_encaps = 0 mpls_over_udp_encaps = 0 mpls_over_gre_encaps = 0 vxlan_encaps = 0 ] comp_nh_stats= [ source_replication_forwards = 0 edge_replication_forwards = 0 local_vm_l3_forwards = 0 total_multicast_forwards = 0 ] ] ], ] ] proxy seq 1 2025-02-10 Mon 02:05:46:843.107 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for UveVirtualNetworkAgent:0 period 0 cycle 0 without seqno , total = 1 2025-02-10 Mon 02:05:46:843.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for VMIStats:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:46:843.122 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for VMITags:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:46:843.129 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for VirtualMachineStats:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:46:843.205 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncUVE Syncing ObjectVRouter val name = cn-jenkins-deploy-platform-juju-os-472-1 interface_list= [ [ ] ] xmpp_peer_list= [ [ [ ip = 10.0.0.38 status = 0 setup_time = 1739153135353690 primary = 0 ], ] ] self_ip_list= [ [ (*_iter146) = 10.0.0.38, ] ] build_info = {"build-info":[{"build-version":"nightly","build-time":"2025-02-10 00:23:15.869602","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7708-1.novalocal","build-id":"unknown","build-number":"unknown"}]} error_intf_list= [ [ ] ] phy_if= [ [ [ name = ens3 mac_address = fa:16:3e:22:9b:fd ], ] ] vhost_if= [ name = vhost0 mac_address = fa:16:3e:22:9b:fd ] log_file = /var/log/contrail/vrouter-agent/contrail-vrouter-agent.log config_file = /etc/contrail/contrail-vrouter-agent.conf log_local = 1 log_level = SYS_DEBUG log_category = sandesh_http_port = 8085 dns_servers= [ [ (*_iter149) = 10.0.0.38, ] ] vhost_cfg= [ name = vhost0 ip = 10.0.0.38 ip_prefix_len = 24 gateway = 10.0.0.1 ] eth_name= [ [ (*_iter150) = ens3, ] ] tunnel_type = MPLSoGRE hypervisor = kvm control_ip = 10.0.0.38 no_config_intf_list= [ [ (*_iter151) = 00000000-0000-0000-0000-000000000000, ] ] vmi_count= [ active = 1 ] down_interface_count = 1 dns_server_list_cfg= [ [ (*_iter152) = 10.0.0.38:53, ] ] control_node_list_cfg= [ [ (*_iter153) = 10.0.0.38:5269, ] ] hostname_cfg = cn-jenkins-deploy-platform-juju-os-472-1 flow_cache_timeout_cfg = 0 ll_max_system_flows_cfg = 16384 ll_max_vm_flows_cfg = 16384 max_vm_flows_cfg = 100 gateway_cfg_list= [ [ ] ] headless_mode_cfg = 1 collector_server_list_cfg= [ [ (*_iter155) = 10.0.0.38:8086, ] ] log_flow = 0 mode = VROUTER platform = HOST vr_limits= [ max_labels = 5120 max_nexthops = 524288 max_interfaces = 4355 max_vrfs = 4096 max_mirror_entries = 255 vrouter_max_bridge_entries = 262144 vrouter_max_oflow_bridge_entries = 53248 vrouter_build_info = {"build-info": [{"build-version": "nightly", "build-time": "2025-02-10 00:20:50.600607", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-7708-1.novalocal"}]} vrouter_max_flow_entries = 524288 vrouter_max_oflow_entries = 105472 vrouter_priority_tagging = 1 ] bgpaas_enabled = 0 port_mirror_enabled = 0 subcluster_name = vr_high_watermark = 80 vr_low_watermark = 75 vr_limit_exceeded_list= [ [ ] ] res_limit = 0 res_table_limit = 0 loopback_ip = 0.0.0.0 gateway_list= [ [ (*_iter161) = 10.0.0.1, ] ] proxy seq 3 2025-02-10 Mon 02:05:46:843.222 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for VrouterAgent:0 period 0 cycle 0 without seqno , total = 1 2025-02-10 Mon 02:05:46:843.253 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncUVE Syncing ObjectVRouter val name = cn-jenkins-deploy-platform-juju-os-472-1 raw_xmpp_stats= [ [ _iter306->first = 10.0.0.38 [ reconnects = 2 in_msgs = 0 out_msgs = 2 ], ] ] raw_ifmap_stats= [ [ _iter307->first = link_delete_parse_errors _iter307->second = 0, _iter307->first = link_update_parse_errors _iter307->second = 0, _iter307->first = node_delete_parse_errors _iter307->second = 0, _iter307->first = node_update_parse_errors _iter307->second = 0, ] ] raw_rt_table_size= [ [ _iter308->first = default-domain:default-project:ip-fabric:__default__ [ inet4_unicast = 8 inet4_multicast = 0 evpn = 0 bridge = 6 inet6_unicast = 2 ], _iter308->first = default-domain:default-project:ip-fabric:ip-fabric [ inet4_unicast = 2 inet4_multicast = 0 evpn = 1 bridge = 2 inet6_unicast = 0 ], ] ] proxy seq 2 2025-02-10 Mon 02:05:46:843.264 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for VrouterControlStats:0 period 0 cycle 0 without seqno , total = 1 2025-02-10 Mon 02:05:46:846.466 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncUVE Syncing ObjectVRouter val name = cn-jenkins-deploy-platform-juju-os-472-1 in_tpkts = 68 in_bytes = 4259 out_tpkts = 71 out_bytes = 3962 cpu_info= [ num_cpu = 8 sys_mem_info= [ total = 25602048 used = 0 free = 390000174 buffers = 32670 cached = 25465888 node_type = ] meminfo= [ virt = 32670 peakvirt = 375966104 res = 32670 ] cpuload= [ one_min_avg = 0.99125 five_min_avg = 0.71625 fifteen_min_avg = 0.42125 ] cpu_share = 0.41154 ] exception_packets = 27 exception_packets_dropped = 11 exception_packets_allowed = 16 total_flows = 0 aged_flows = 0 uptime = 1739153076324395 phy_if_info= [ [ _iter254->first = ens3 [ speed = -1 duplexity = 255 ], ] ] raw_vhost_stats= [ name = vhost0 in_pkts = 68 in_bytes = 4259 out_pkts = 71 out_bytes = 3962 speed = -1 duplexity = -1 ] raw_vhost_drop_stats= [ ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 0 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 1 ] raw_drop_stats= [ ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 0 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 1 ] flow_rate= [ added_flows = 0 max_flow_adds_per_second = 0 min_flow_adds_per_second = 0 deleted_flows = 0 max_flow_deletes_per_second = 0 min_flow_deletes_per_second = 0 active_flows = 0 hold_flows = 0 ] raw_phy_if_stats= [ [ _iter262->first = ens3 [ in_pkts = 36 in_bytes = 2492 out_pkts = 71 out_bytes = 4344 ], ] ] raw_phy_if_drop_stats= [ [ _iter263->first = ens3 [ ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 0 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 0 ], ] ] proxy seq 3 2025-02-10 Mon 02:05:46:846.539 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for VrouterStatsAgent:0 period 0 cycle 0 without seqno , total = 1 2025-02-10 Mon 02:05:46:846.548 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:46:846.594 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: Established 2025-02-10 Mon 02:05:46:846.817 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = OpenConfirm Feature Negotiation Success event = EvTlsHandShakeSuccess ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:46:854.752 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:52:484.597 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:39304 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:05:52:538.508 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:39304 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:06:00:569.673 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:572.074 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:44363::10.0.0.38:5269 < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:06:00:572.108 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Event: Tcp Connected peer ip: 10.0.0.38 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295 2025-02-10 Mon 02:06:00:572.214 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect event = Connect Event local_port = 44363 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:572.377 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 44363 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:573.916 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenSent next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:574.043 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Sent Start Tls, OpenConfirm Feature Negotiation event = EvStreamFeatureRequest ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:574.046 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:06:00:577.300 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Trigger Client Ssl Handshake event = EvTlsProceed identifier = network-control@contrailsystems.com ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:577.368 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Client: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:06:00:580.768 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: XMPP [SYS_DEBUG]: XmppSslHandShakeMessage: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV success controller/src/xmpp/xmpp_connection.cc 402 2025-02-10 Mon 02:06:00:581.418 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = OpenConfirm Feature Negotiation Success event = EvTlsHandShakeSuccess ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:583.381 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:06:090.393 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: AgentVn [SYS_INFO]: VnObjectLog: vn= [ event = Addition uuid = 3ff1924d-09d2-4a02-b4b9-1648c4836064 name = default-domain:default-project:ip-fabric acl_uuid = bebfe230-31df-43ab-89fc-27d5b3d385a6 vrf = default-domain:default-project:ip-fabric:ip-fabric ipv4_forwarding = 1 bridging = 1 admin_state = 1 ] file = controller/src/vnsw/agent/oper/vn.cc line = 1391 2025-02-10 Mon 02:06:06:131.307 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: AgentVn [SYS_INFO]: VnObjectLog: vn= [ event = Modification uuid = 3ff1924d-09d2-4a02-b4b9-1648c4836064 name = default-domain:default-project:ip-fabric acl_uuid = bebfe230-31df-43ab-89fc-27d5b3d385a6 vrf = default-domain:default-project:ip-fabric:ip-fabric ipv4_forwarding = 1 bridging = 1 admin_state = 1 ] file = controller/src/vnsw/agent/oper/vn.cc line = 1391 2025-02-10 Mon 02:06:06:345.443 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:06:36:331.058 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:07:06:331.042 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:07:36:331.358 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:08:06:331.565 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:08:34:071.511 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:50124 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:08:34:113.565 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:50124 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:08:36:331.223 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:08:38:642.400 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:46414 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:08:38:685.475 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:46414 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:08:43:880.403 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:46426 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:08:43:925.692 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:46426 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:09:06:332.980 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:09:36:332.930 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:10:06:334.842 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:10:16:983.479 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:57024 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:10:17:025.711 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:57024 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:10:36:334.776 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:11:06:336.484 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:11:36:338.204 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:12:06:339.704 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:12:36:341.337 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:13:06:343.289 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:13:36:343.323 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:13:43:827.687 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:41510 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:13:43:873.519 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:41510 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:13:48:507.310 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34038 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:13:48:553.548 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34038 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:13:53:695.505 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34054 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:13:53:737.482 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34054 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:14:06:343.216 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:14:17:123.318 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:43578 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:14:17:165.426 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:43578 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:14:36:344.913 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:15:06:345.145 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:15:36:346.636 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:16:06:347.402 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:16:36:347.657 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:17:06:347.998 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:17:36:347.691 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:17:58:095.816 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34394 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:17:58:137.510 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34394 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:18:02:571.716 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34406 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:18:02:613.345 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34406 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:18:06:349.345 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:18:07:603.208 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:47882 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:18:07:645.418 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:47882 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:18:36:353.606 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:19:06:349.501 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:19:27:895.674 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34622 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:19:27:941.697 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:34622 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:19:36:352.308 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:20:06:351.658 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:20:36:352.815 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:21:06:354.440 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:21:36:355.094 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:22:06:357.479 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:22:36:359.921 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:22:43:543.487 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:60066 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:22:43:585.536 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:60066 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:22:48:011.334 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:39164 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:22:48:053.516 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:39164 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:22:53:179.267 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:39166 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:22:53:221.492 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:39166 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:23:06:359.567 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:23:36:360.810 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:23:41:111.301 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:54662 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:23:41:153.554 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:54662 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:24:06:361.396 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:24:36:362.499 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:25:06:362.659 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:25:36:364.178 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:26:06:364.364 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:26:36:364.418 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:27:00:831.343 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:49048 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:27:00:873.388 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:49048 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:27:05:283.575 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:49054 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:27:05:325.472 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:49054 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:27:06:364.492 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:27:10:163.846 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:40460 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:27:10:209.482 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:40460 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:27:36:366.515 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:28:06:366.466 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:28:36:366.366 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:28:40:735.363 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:43532 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:28:40:777.413 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:43532 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:29:06:368.051 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:29:36:368.014 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:30:06:368.350 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:30:36:368.319 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:31:06:370.177 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:31:36:370.072 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:32:06:370.230 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:32:27:998.969 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:41240 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:32:28:048.011 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:41240 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:32:36:373.668 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:32:37:059.595 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:36462 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:32:37:115.611 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:36462 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:32:42:675.321 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:36478 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:32:42:717.533 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:36478 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:33:06:374.035 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:33:36:373.906 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:34:06:374.113 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:34:29:107.810 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:42036 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:34:29:149.459 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:42036 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:34:36:374.252 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:35:06:374.387 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:35:36:374.582 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:36:06:375.069 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:36:36:402.335 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:37:06:380.839 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:37:36:382.025 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316837099264, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:38:00:663.559 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:43202 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:38:00:709.427 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:43202 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:38:05:304.806 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:43218 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:38:05:353.420 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:43218 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:38:06:383.622 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:38:10:199.238 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:46726 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:38:10:241.386 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:46726 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:38:36:383.859 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:39:06:385.720 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:39:36:385.552 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:39:40:279.200 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:36254 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:39:40:321.351 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:36254 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:40:06:387.215 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:40:36:389.039 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:41:06:388.948 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:41:36:388.901 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:42:06:390.335 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:42:36:391.960 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:43:04:147.424 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:45500 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:43:04:193.560 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:45500 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:43:06:392.288 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:43:08:543.292 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:33882 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:43:08:589.654 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:33882 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:43:13:635.240 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:33892 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:43:13:677.268 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:33892 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:43:36:391.907 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:44:01:663.699 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:45338 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:44:01:705.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:45338 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:44:06:393.619 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316845496064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:44:36:393.707 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316828702464, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:45:06:393.897 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316832900864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:45:36:394.053 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316841297664, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:46:06:394.081 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316853892864, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:46:36:395.570 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140316824504064, Pid 1141240]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135 2025-02-10 Mon 02:46:55:486.921 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:48470 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:46:55:529.410 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140317003004224, Pid 1141240]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8085::10.0.0.38:48470 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504