2025-10-14 12:57:39,121 - INFO - Domain Default found not creating
2025-10-14 12:57:39,591 - INFO - Project ctest-TestvifStats-85630309 not found, creating it
2025-10-14 12:57:40,228 - INFO - Created Project:ctest-TestvifStats-85630309, ID : e6a56a0f-a25c-4491-821d-240329969970 
2025-10-14 12:57:41,729 - INFO - ================================================================================
2025-10-14 12:57:41,729 - INFO - STARTING TEST    : test_vif_statistics
2025-10-14 12:57:41,729 - INFO - TEST DESCRIPTION :  
        Description: 
            Verify vif statistics
            Vm's across compute node
        steps:
            1. create 1 VN and launch 2 VMs in compute node 
            2. client and server VMs on same node
            3. send icmp traffic assert if ping is not working
            4. get_vif_stats to check vif interface 
            5. clear_vif_stats to clear vif interface stats
            6. Repeat step4
        Pass criteria:
            1. If output of vif stats/clear execute successfully from compute 
        
2025-10-14 12:57:43,037 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.17': '0', '10.20.0.210': '0'}, '10.0.0.22': {'10.20.0.210': '0', '10.20.0.14': '0'}} with
2025-10-14 12:57:43,037 - INFO - Initial checks done. Running the testcase now
2025-10-14 12:57:43,037 - INFO - 
2025-10-14 12:57:43,765 - DEBUG - Response for create_network : {'network': {'id': '0e2832f2-160c-4ed5-a9cc-2670cabfe86b', 'name': 'ctest-vn-10371953', 'tenant_id': 'e6a56a0fa25c4491821d240329969970', 'project_id': 'e6a56a0fa25c4491821d240329969970', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestvifStats-85630309', 'ctest-vn-10371953'], 'port_security_enabled': True, 'description': ''}}
2025-10-14 12:57:44,062 - DEBUG - Response for create_subnet : {'subnet': {'id': 'faf19156-7a36-490e-b8b6-89bd3ed1d1d6', 'name': '', 'tenant_id': 'e6a56a0fa25c4491821d240329969970', 'network_id': '0e2832f2-160c-4ed5-a9cc-2670cabfe86b', 'ip_version': 4, 'cidr': '49.45.8.128/26', 'allocation_pools': [{'start': '49.45.8.130', 'end': '49.45.8.190'}], 'gateway_ip': '49.45.8.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '49.45.8.130', 'tags': [], 'project_id': 'e6a56a0fa25c4491821d240329969970'}}
2025-10-14 12:57:44,085 - INFO - Created VN ctest-vn-10371953
2025-10-14 12:57:44,098 - DEBUG - VN ctest-vn-10371953 UUID is 0e2832f2-160c-4ed5-a9cc-2670cabfe86b
2025-10-14 12:57:44,175 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-10-14 12:57:44,473 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-10-14 12:57:44,505 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241
2025-10-14 12:57:44,523 - DEBUG - Requesting: http://10.0.0.254:8082/project/e6a56a0f-a25c-4491-821d-240329969970
2025-10-14 12:57:44,618 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0e2832f2-160c-4ed5-a9cc-2670cabfe86b
2025-10-14 12:57:44,631 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0e2832f2-160c-4ed5-a9cc-2670cabfe86b
2025-10-14 12:57:44,641 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cbd46883-200d-49d0-b091-5c549c8f92da
2025-10-14 12:57:44,651 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cbd46883-200d-49d0-b091-5c549c8f92da
2025-10-14 12:57:44,659 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/58bdcead-69ec-4c67-8221-4d00c5324209
2025-10-14 12:57:44,666 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-14 12:57:44,666 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0e2832f2-160c-4ed5-a9cc-2670cabfe86b
2025-10-14 12:57:44,675 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cbd46883-200d-49d0-b091-5c549c8f92da
2025-10-14 12:57:44,694 - INFO - Verified VN network id 14 for VN 0e2832f2-160c-4ed5-a9cc-2670cabfe86b
2025-10-14 12:57:44,694 - INFO - Verifications in API Server for VN ctest-vn-10371953 passed
2025-10-14 12:57:44,694 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0e2832f2-160c-4ed5-a9cc-2670cabfe86b
2025-10-14 12:57:44,706 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cbd46883-200d-49d0-b091-5c549c8f92da
2025-10-14 12:57:44,714 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cbd46883-200d-49d0-b091-5c549c8f92da
2025-10-14 12:57:44,722 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/58bdcead-69ec-4c67-8221-4d00c5324209
2025-10-14 12:57:44,736 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestvifStats-85630309', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1020121330932797141', 'uuid-lslong': '12235196553538562155'}, 'enable': 'true', 'created': '2025-10-14T12:57:43', 'last-modified': '2025-10-14T12:57:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.736992'}
2025-10-14 12:57:44,742 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-14 12:57:44,747 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestvifStats-85630309', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1020121330932797141', 'uuid-lslong': '12235196553538562155'}, 'enable': 'true', 'created': '2025-10-14T12:57:43', 'last-modified': '2025-10-14T12:57:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.746673'}
2025-10-14 12:57:44,754 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-14 12:57:44,760 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestvifStats-85630309', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1020121330932797141', 'uuid-lslong': '12235196553538562155'}, 'enable': 'true', 'created': '2025-10-14T12:57:43', 'last-modified': '2025-10-14T12:57:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.760842'}
2025-10-14 12:57:44,767 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-14 12:57:44,767 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-10371953 passed
2025-10-14 12:57:44,767 - DEBUG - ====Verifying policy data for ctest-vn-10371953 in API_Server ======
2025-10-14 12:57:44,767 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-10-14 12:57:44,774 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241
2025-10-14 12:57:44,786 - DEBUG - Requesting: http://10.0.0.254:8082/project/e6a56a0f-a25c-4491-821d-240329969970
2025-10-14 12:57:44,883 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0e2832f2-160c-4ed5-a9cc-2670cabfe86b
2025-10-14 12:57:44,893 - DEBUG - =>VN ctest-vn-10371953 has no policy to be verified
2025-10-14 12:57:44,893 - DEBUG - Verifying the vn in opserver
2025-10-14 12:57:44,893 - DEBUG - Verifying the default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 virtual network link  through opserver 10.0.0.254
2025-10-14 12:57:44,893 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-10-14 12:57:45,189 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-10-14 12:57:45,248 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953?flat'}
2025-10-14 12:57:45,248 - DEBUG - Verifying the default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 virtual network link  through opserver 10.0.0.50
2025-10-14 12:57:45,248 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-10-14 12:57:45,539 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-10-14 12:57:45,604 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953?flat'}
2025-10-14 12:57:45,604 - DEBUG - Verifying the default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 virtual network link  through opserver 10.0.0.33
2025-10-14 12:57:45,604 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2025-10-14 12:57:45,899 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2025-10-14 12:57:45,963 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953?flat'}
2025-10-14 12:57:45,963 - INFO - Validated that VN default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 is found in opserver
2025-10-14 12:57:45,983 - DEBUG - Do not have enough data to verify VN in agent
2025-10-14 12:57:45,994 - DEBUG - VRF ids for VN ctest-vn-10371953: {}
2025-10-14 12:57:46,021 - DEBUG - Services list from nova: [, , , ]
2025-10-14 12:57:46,021 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4312-30', 'an-jenkins-deploy-platform-ansible-os-4312-1']}
2025-10-14 12:57:46,021 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4312-30', 'an-jenkins-deploy-platform-ansible-os-4312-1']}
2025-10-14 12:57:47,360 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-30), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-30)
2025-10-14 12:57:47,360 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4312-30', 'an-jenkins-deploy-platform-ansible-os-4312-1']}
2025-10-14 12:57:48,908 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-30), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-30)
2025-10-14 12:57:48,908 - INFO - Waiting for VM ctest-TestvifStats-85630309-13703283 to be up..
2025-10-14 12:57:49,019 - DEBUG - VM  is still in BUILD state, Expected: ACTIVE
2025-10-14 12:57:54,122 - DEBUG - VM  is in ACTIVE state now
2025-10-14 12:57:54,123 - INFO - VM name : ctest-TestvifStats-85630309-13703283
2025-10-14 12:57:54,216 - DEBUG - VM ctest-TestvifStats-85630309-13703283 ID is 1f608d60-6d24-4c01-a2a2-2cafc4fe8726
2025-10-14 12:57:54,242 - DEBUG - VM ctest-TestvifStats-85630309-13703283 launched on Node an-jenkins-deploy-platform-ansible-os-4312-30
2025-10-14 12:57:54,336 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/1f608d60-6d24-4c01-a2a2-2cafc4fe8726
2025-10-14 12:57:54,643 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/1f608d60-6d24-4c01-a2a2-2cafc4fe8726
2025-10-14 12:57:54,681 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/b041e711-c9d1-4cf9-83b0-0a94ed5606a1
2025-10-14 12:57:57,870 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms')
2025-10-14 12:57:57,871 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-85630309-13703283 failed!
2025-10-14 12:57:57,887 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 is 49.45.8.129 and allocation pool is NOT set
2025-10-14 12:58:01,972 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2025-10-14 12:58:01,972 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-85630309-13703283 failed!
2025-10-14 12:58:01,987 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 is 49.45.8.129 and allocation pool is NOT set
2025-10-14 12:58:06,066 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms')
2025-10-14 12:58:06,066 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-85630309-13703283 failed!
2025-10-14 12:58:06,085 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 is 49.45.8.129 and allocation pool is NOT set
2025-10-14 12:58:10,160 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2025-10-14 12:58:10,160 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-85630309-13703283 failed!
2025-10-14 12:58:10,179 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 is 49.45.8.129 and allocation pool is NOT set
2025-10-14 12:58:14,252 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms')
2025-10-14 12:58:14,252 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-85630309-13703283 failed!
2025-10-14 12:58:14,268 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 is 49.45.8.129 and allocation pool is NOT set
2025-10-14 12:58:18,349 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2025-10-14 12:58:18,349 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-85630309-13703283 failed!
2025-10-14 12:58:18,368 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 is 49.45.8.129 and allocation pool is NOT set
2025-10-14 12:58:22,444 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-10-14 12:58:22,444 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-85630309-13703283 failed!
2025-10-14 12:58:22,461 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 is 49.45.8.129 and allocation pool is NOT set
2025-10-14 12:58:26,542 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-14 12:58:26,542 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-85630309-13703283 failed!
2025-10-14 12:58:26,558 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 is 49.45.8.129 and allocation pool is NOT set
2025-10-14 12:58:30,640 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2025-10-14 12:58:30,640 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-85630309-13703283 failed!
2025-10-14 12:58:30,657 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-85630309:ctest-vn-10371953 is 49.45.8.129 and allocation pool is NOT set
2025-10-14 12:58:32,733 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=49.5 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.45 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.452/26.454/49.456/23.002 ms')
2025-10-14 12:58:32,733 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-85630309-13703283 passed
2025-10-14 12:58:32,808 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-14 12:58:32,809 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-85630309-13703283, IP 49.45.8.131, Port 22
2025-10-14 12:58:32,876 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-14 12:58:32,975 - DEBUG - VM ctest-TestvifStats-85630309-13703283 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-14 12:58:37,976 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-14 12:58:37,977 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-85630309-13703283, IP 49.45.8.131, Port 22
2025-10-14 12:58:38,032 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-14 12:58:38,131 - DEBUG - VM ctest-TestvifStats-85630309-13703283 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-14 12:58:43,132 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-14 12:58:43,132 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-85630309-13703283, IP 49.45.8.131, Port 22
2025-10-14 12:58:43,200 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-14 12:58:43,297 - DEBUG - VM ctest-TestvifStats-85630309-13703283 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-14 12:58:48,297 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-14 12:58:48,298 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-85630309-13703283, IP 49.45.8.131, Port 22
2025-10-14 12:58:48,357 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-14 12:58:48,451 - DEBUG - VM ctest-TestvifStats-85630309-13703283 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-14 12:58:53,452 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-14 12:58:53,453 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-85630309-13703283, IP 49.45.8.131, Port 22
2025-10-14 12:58:53,628 - DEBUG - VM ctest-TestvifStats-85630309-13703283 is ready for SSH connections
2025-10-14 12:58:53,628 - INFO - Waiting for VM ctest-TestvifStats-85630309-48244138 to be up..
2025-10-14 12:58:53,722 - DEBUG - VM  is in ACTIVE state now
2025-10-14 12:58:53,722 - INFO - VM name : ctest-TestvifStats-85630309-48244138
2025-10-14 12:58:53,903 - DEBUG - VM ctest-TestvifStats-85630309-48244138 ID is f4401e7a-c00b-4eb4-9b57-ce29c3662adc
2025-10-14 12:58:53,904 - DEBUG - VM ctest-TestvifStats-85630309-48244138 launched on Node an-jenkins-deploy-platform-ansible-os-4312-30
2025-10-14 12:58:54,001 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/f4401e7a-c00b-4eb4-9b57-ce29c3662adc
2025-10-14 12:58:54,013 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/df3b0e32-ce30-4e68-b89e-302bbee869c6
2025-10-14 12:58:55,184 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.28 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.63 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.632/2.958/4.284/1.326 ms')
2025-10-14 12:58:55,185 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestvifStats-85630309-48244138 passed
2025-10-14 12:58:55,261 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-14 12:58:55,261 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-85630309-48244138, IP 49.45.8.132, Port 22
2025-10-14 12:58:55,435 - DEBUG - VM ctest-TestvifStats-85630309-48244138 is ready for SSH connections
2025-10-14 12:58:55,435 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-14 12:58:55,435 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  49.45.8.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2025-10-14 12:58:55,435 - DEBUG - ping -s 56 -c 3 -W 1  49.45.8.132
2025-10-14 12:59:18,777 - DEBUG - PING 49.45.8.132 (49.45.8.132) 56(84) bytes of data.
64 bytes from 49.45.8.132: icmp_req=1 ttl=64 time=11.2 ms
64 bytes from 49.45.8.132: icmp_req=2 ttl=64 time=1.02 ms
64 bytes from 49.45.8.132: icmp_req=3 ttl=64 time=0.748 ms
--- 49.45.8.132 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 0.748/4.335/11.232/4.878 ms
2025-10-14 12:59:18,777 - INFO - Ping to IP 49.45.8.132 from VM ctest-TestvifStats-85630309-13703283 passed
2025-10-14 12:59:18,777 - INFO - 10.0.0.22
2025-10-14 12:59:18,777 - INFO - vif --get 0 | grep "RX packets" | tr  -s ' ' | cut -f1-3 -d ' '
2025-10-14 12:59:18,880 - INFO - Deleting VM ctest-TestvifStats-85630309-48244138
2025-10-14 12:59:19,073 - INFO - Deleting VM ctest-TestvifStats-85630309-13703283
2025-10-14 12:59:19,147 - INFO - Deleting VN ctest-vn-10371953 
2025-10-14 12:59:19,214 - DEBUG - VN 0e2832f2-160c-4ed5-a9cc-2670cabfe86b still in use: Unable to complete operation on network 0e2832f2-160c-4ed5-a9cc-2670cabfe86b. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-63197429-06b1-4f3a-968a-860c1a773c61']
2025-10-14 12:59:19,214 - WARNING - Deleting VN ctest-vn-10371953 failed..Will retry
2025-10-14 12:59:21,426 - DEBUG - Response for deleting network ()
2025-10-14 12:59:21,426 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cbd46883-200d-49d0-b091-5c549c8f92da
2025-10-14 12:59:21,434 - DEBUG - Response Code: 404
2025-10-14 12:59:21,434 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-10-14 12:59:21,443 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241
2025-10-14 12:59:21,511 - DEBUG - Requesting: http://10.0.0.254:8082/project/e6a56a0f-a25c-4491-821d-240329969970
2025-10-14 12:59:21,602 - INFO - Validated that VN ctest-vn-10371953 is not found in API Server
2025-10-14 12:59:21,615 - DEBUG - VN ctest-vn-10371953 is not present in Agent 10.0.0.65 
2025-10-14 12:59:21,630 - DEBUG - VN ctest-vn-10371953 is not present in Agent 10.0.0.22 
2025-10-14 12:59:21,630 - INFO - Validated that VN ctest-vn-10371953 is not in any agent
2025-10-14 12:59:21,680 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-10371953 info
2025-10-14 12:59:22,968 - ERROR - AssertionError
Python 3.9.21: /usr/bin/python3
Tue Oct 14 12:59:18 2025
A problem occurred in a Python script.  Here is the sequence of
function calls leading up to the error, in the order they occurred.
 /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
   78             log.info('Initial checks done. Running the testcase now')
   79             log.info('')
   80             result = function(self, *args, **kwargs)
   81             if self.inputs.upgrade:
   82                 pid = os.getpid()
result = None
function = 
self = 
args = ()
kwargs = {}
 /contrail-test/scripts/vrouter/test_vif_stats.py in test_vif_statistics(self=)
   89         assert client_fixtures[0].ping_with_certainty(server_fixtures[0].vm_ip, expectation=True), "ping failed"
   90         compute_ip = server_fixtures[0].vm_node_ip
   91         stats_pre_clr = self.get_vif_stats(compute_ip)
   92         self.clear_vif_stats(compute_ip)
   93         stats_post_clr = self.get_vif_stats(compute_ip)
stats_pre_clr undefined
self = 
self.get_vif_stats = >
compute_ip = '10.0.0.22'
 /contrail-test/scripts/vrouter/test_vif_stats.py in get_vif_stats(self=, compute_ip='10.0.0.22')
   28             assert vif_out, "vif stats for %s is not working" % vif_rx_cmd
   29             if not "RX packets" in vif_out:
   30                 assert False, "RX packets is not available"
   31             else:
   32                 result = vif_out.split()
AssertionError: RX packets is not available
    __cause__ = None
    __class__ = 
    __context__ = None
    __delattr__ = 
    __dict__ = {}
    __dir__ = 
    __doc__ = 'Assertion failed.'
    __eq__ = 
    __format__ = 
    __ge__ = 
    __getattribute__ = 
    __gt__ = 
    __hash__ = 
    __init__ = 
    __init_subclass__ = 
    __le__ = 
    __lt__ = 
    __ne__ = 
    __new__ = 
    __reduce__ = 
    __reduce_ex__ = 
    __repr__ = 
    __setattr__ = 
    __setstate__ = 
    __sizeof__ = 
    __str__ = 
    __subclasshook__ = 
    __suppress_context__ = False
    __traceback__ = 
    args = ('RX packets is not available',)
    with_traceback = 
The above is a description of an error in a Python program.  Here is
the original traceback:
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/vrouter/test_vif_stats.py", line 91, in test_vif_statistics
    stats_pre_clr = self.get_vif_stats(compute_ip)
  File "/contrail-test/scripts/vrouter/test_vif_stats.py", line 30, in get_vif_stats
    assert False, "RX packets is not available"
AssertionError: RX packets is not available
2025-10-14 12:59:22,981 - DEBUG - No XMPP flaps were noticed during the test
2025-10-14 12:59:22,981 - INFO - 
2025-10-14 12:59:22,981 - INFO - END TEST : test_vif_statistics : FAILED[0:01:41]
2025-10-14 12:59:22,981 - INFO - --------------------------------------------------------------------------------
2025-10-14 12:59:23,777 - INFO - Deleted project: ctest-TestvifStats-85630309, ID : e6a56a0f-a25c-4491-821d-240329969970