2026-03-16 03:36:27,284 - INFO - Domain Default found not creating
2026-03-16 03:36:27,490 - INFO - Project ctest-TestvifStats-92776434 not found, creating it
2026-03-16 03:36:28,152 - INFO - Created Project:ctest-TestvifStats-92776434, ID : a3d5da1a-bffc-4425-ab4a-0d9510649286
2026-03-16 03:36:29,738 - INFO - ================================================================================
2026-03-16 03:36:29,738 - INFO - STARTING TEST : test_vif_statistics
2026-03-16 03:36:29,739 - INFO - TEST DESCRIPTION :
Description:
Verify vif statistics
Vm's across compute node
steps:
1. create 1 VN and launch 2 VMs in compute node
2. client and server VMs on same node
3. send icmp traffic assert if ping is not working
4. get_vif_stats to check vif interface
5. clear_vif_stats to clear vif interface stats
6. Repeat step4
Pass criteria:
1. If output of vif stats/clear execute successfully from compute
2026-03-16 03:36:31,019 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.193': '0', '10.20.0.129': '0'}, '10.0.0.240': {'10.20.0.193': '0', '10.20.0.129': '0'}} with
2026-03-16 03:36:31,019 - INFO - Initial checks done. Running the testcase now
2026-03-16 03:36:31,019 - INFO -
2026-03-16 03:36:31,752 - DEBUG - Response for create_network : {'network': {'id': 'e2cce46f-e63b-4cfe-b6ec-d152b4c9a50e', 'name': 'ctest-vn-58576544', 'tenant_id': 'a3d5da1abffc4425ab4a0d9510649286', 'project_id': 'a3d5da1abffc4425ab4a0d9510649286', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestvifStats-92776434', 'ctest-vn-58576544'], 'port_security_enabled': True, 'description': ''}}
2026-03-16 03:36:32,078 - DEBUG - Response for create_subnet : {'subnet': {'id': 'df69a4a0-785a-45fc-9d89-c7a66845f5e7', 'name': '', 'tenant_id': 'a3d5da1abffc4425ab4a0d9510649286', 'network_id': 'e2cce46f-e63b-4cfe-b6ec-d152b4c9a50e', 'ip_version': 4, 'cidr': '52.227.201.128/26', 'allocation_pools': [{'start': '52.227.201.130', 'end': '52.227.201.190'}], 'gateway_ip': '52.227.201.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '52.227.201.130', 'tags': [], 'project_id': 'a3d5da1abffc4425ab4a0d9510649286'}}
2026-03-16 03:36:32,105 - INFO - Created VN ctest-vn-58576544
2026-03-16 03:36:32,121 - DEBUG - VN ctest-vn-58576544 UUID is e2cce46f-e63b-4cfe-b6ec-d152b4c9a50e
2026-03-16 03:36:32,214 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-16 03:36:32,514 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-16 03:36:32,559 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d1af4696-a589-4518-a8ed-3c39c5e9266b
2026-03-16 03:36:32,582 - DEBUG - Requesting: http://10.0.0.38:8082/project/a3d5da1a-bffc-4425-ab4a-0d9510649286
2026-03-16 03:36:32,703 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e2cce46f-e63b-4cfe-b6ec-d152b4c9a50e
2026-03-16 03:36:32,716 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e2cce46f-e63b-4cfe-b6ec-d152b4c9a50e
2026-03-16 03:36:32,730 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/17899539-6133-41be-a770-eb28bc985ca4
2026-03-16 03:36:32,738 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/17899539-6133-41be-a770-eb28bc985ca4
2026-03-16 03:36:32,746 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/7050fe9b-2dbe-413a-8d7d-5959f8e7c30c
2026-03-16 03:36:32,753 - DEBUG - Route Targets: ['target:64512:8000004']
2026-03-16 03:36:32,753 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e2cce46f-e63b-4cfe-b6ec-d152b4c9a50e
2026-03-16 03:36:32,765 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/17899539-6133-41be-a770-eb28bc985ca4
2026-03-16 03:36:32,785 - INFO - Verified VN network id 14 for VN e2cce46f-e63b-4cfe-b6ec-d152b4c9a50e
2026-03-16 03:36:32,786 - INFO - Verifications in API Server for VN ctest-vn-58576544 passed
2026-03-16 03:36:32,786 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e2cce46f-e63b-4cfe-b6ec-d152b4c9a50e
2026-03-16 03:36:32,801 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/17899539-6133-41be-a770-eb28bc985ca4
2026-03-16 03:36:32,811 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/17899539-6133-41be-a770-eb28bc985ca4
2026-03-16 03:36:32,822 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/7050fe9b-2dbe-413a-8d7d-5959f8e7c30c
2026-03-16 03:36:32,839 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestvifStats-92776434', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16342688317075836158', 'uuid-lslong': '13181140362557236494'}, 'enable': 'true', 'created': '2026-03-16T03:36:31', 'last-modified': '2026-03-16T03:36:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.841858'}
2026-03-16 03:36:32,850 - DEBUG - Route Targets: ['target:64512:8000004']
2026-03-16 03:36:32,857 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestvifStats-92776434', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16342688317075836158', 'uuid-lslong': '13181140362557236494'}, 'enable': 'true', 'created': '2026-03-16T03:36:31', 'last-modified': '2026-03-16T03:36:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.851455'}
2026-03-16 03:36:32,876 - DEBUG - Route Targets: ['target:64512:8000004']
2026-03-16 03:36:32,883 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestvifStats-92776434', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16342688317075836158', 'uuid-lslong': '13181140362557236494'}, 'enable': 'true', 'created': '2026-03-16T03:36:31', 'last-modified': '2026-03-16T03:36:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.892604'}
2026-03-16 03:36:32,891 - DEBUG - Route Targets: ['target:64512:8000004']
2026-03-16 03:36:32,891 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-58576544 passed
2026-03-16 03:36:32,891 - DEBUG - ====Verifying policy data for ctest-vn-58576544 in API_Server ======
2026-03-16 03:36:32,891 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-16 03:36:32,900 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d1af4696-a589-4518-a8ed-3c39c5e9266b
2026-03-16 03:36:32,912 - DEBUG - Requesting: http://10.0.0.38:8082/project/a3d5da1a-bffc-4425-ab4a-0d9510649286
2026-03-16 03:36:33,024 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e2cce46f-e63b-4cfe-b6ec-d152b4c9a50e
2026-03-16 03:36:33,041 - DEBUG - =>VN ctest-vn-58576544 has no policy to be verified
2026-03-16 03:36:33,041 - DEBUG - Verifying the vn in opserver
2026-03-16 03:36:33,041 - DEBUG - Verifying the default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 virtual network link through opserver 10.0.0.38
2026-03-16 03:36:33,041 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-03-16 03:36:33,373 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-03-16 03:36:33,450 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544?flat'}
2026-03-16 03:36:33,450 - DEBUG - Verifying the default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 virtual network link through opserver 10.0.0.22
2026-03-16 03:36:33,450 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-03-16 03:36:33,750 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-03-16 03:36:33,817 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544?flat'}
2026-03-16 03:36:33,817 - DEBUG - Verifying the default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 virtual network link through opserver 10.0.0.23
2026-03-16 03:36:33,817 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-03-16 03:36:34,125 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-03-16 03:36:34,203 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544?flat'}
2026-03-16 03:36:34,204 - INFO - Validated that VN default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is found in opserver
2026-03-16 03:36:34,227 - DEBUG - Do not have enough data to verify VN in agent
2026-03-16 03:36:34,238 - DEBUG - VRF ids for VN ctest-vn-58576544: {}
2026-03-16 03:36:34,264 - DEBUG - Services list from nova: [, , , ]
2026-03-16 03:36:34,264 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5469-1', 'an-jenkins-deploy-platform-ansible-os-5469-2']}
2026-03-16 03:36:34,264 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5469-1', 'an-jenkins-deploy-platform-ansible-os-5469-2']}
2026-03-16 03:36:35,432 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5469-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5469-1)
2026-03-16 03:36:35,432 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5469-1', 'an-jenkins-deploy-platform-ansible-os-5469-2']}
2026-03-16 03:36:36,876 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5469-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5469-1)
2026-03-16 03:36:36,876 - INFO - Waiting for VM ctest-TestvifStats-92776434-06595793 to be up..
2026-03-16 03:36:36,964 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-16 03:36:42,065 - DEBUG - VM is in ACTIVE state now
2026-03-16 03:36:42,066 - INFO - VM name : ctest-TestvifStats-92776434-06595793
2026-03-16 03:36:42,170 - DEBUG - VM ctest-TestvifStats-92776434-06595793 ID is 0786994e-7e5a-4d14-a280-ee44b717b79d
2026-03-16 03:36:42,197 - DEBUG - VM ctest-TestvifStats-92776434-06595793 launched on Node an-jenkins-deploy-platform-ansible-os-5469-1
2026-03-16 03:36:42,292 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/0786994e-7e5a-4d14-a280-ee44b717b79d
2026-03-16 03:36:42,598 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/0786994e-7e5a-4d14-a280-ee44b717b79d
2026-03-16 03:36:42,643 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/621ca9ae-6fad-4062-bc9d-edf7e39e35d7
2026-03-16 03:36:45,834 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms')
2026-03-16 03:36:45,834 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 failed!
2026-03-16 03:36:45,851 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is 52.227.201.129 and allocation pool is NOT set
2026-03-16 03:36:49,931 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2026-03-16 03:36:49,931 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 failed!
2026-03-16 03:36:49,950 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is 52.227.201.129 and allocation pool is NOT set
2026-03-16 03:36:54,029 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2026-03-16 03:36:54,029 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 failed!
2026-03-16 03:36:54,047 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is 52.227.201.129 and allocation pool is NOT set
2026-03-16 03:36:58,132 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2026-03-16 03:36:58,132 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 failed!
2026-03-16 03:36:58,149 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is 52.227.201.129 and allocation pool is NOT set
2026-03-16 03:37:02,217 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2026-03-16 03:37:02,217 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 failed!
2026-03-16 03:37:02,235 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is 52.227.201.129 and allocation pool is NOT set
2026-03-16 03:37:06,320 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms')
2026-03-16 03:37:06,320 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 failed!
2026-03-16 03:37:06,338 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is 52.227.201.129 and allocation pool is NOT set
2026-03-16 03:37:10,416 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms')
2026-03-16 03:37:10,416 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 failed!
2026-03-16 03:37:10,434 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is 52.227.201.129 and allocation pool is NOT set
2026-03-16 03:37:14,505 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms')
2026-03-16 03:37:14,505 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 failed!
2026-03-16 03:37:14,524 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is 52.227.201.129 and allocation pool is NOT set
2026-03-16 03:37:18,608 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms')
2026-03-16 03:37:18,608 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 failed!
2026-03-16 03:37:18,624 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is 52.227.201.129 and allocation pool is NOT set
2026-03-16 03:37:22,705 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2026-03-16 03:37:22,705 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 failed!
2026-03-16 03:37:22,723 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is 52.227.201.129 and allocation pool is NOT set
2026-03-16 03:37:26,800 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms')
2026-03-16 03:37:26,801 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 failed!
2026-03-16 03:37:26,817 - DEBUG - Gateway for vn default-domain:ctest-TestvifStats-92776434:ctest-vn-58576544 is 52.227.201.129 and allocation pool is NOT set
2026-03-16 03:37:28,887 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.28 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.595 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.595/3.935/7.276/3.340 ms')
2026-03-16 03:37:28,887 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestvifStats-92776434-06595793 passed
2026-03-16 03:37:28,964 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:37:28,964 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-92776434-06595793, IP 52.227.201.131, Port 22
2026-03-16 03:37:29,031 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-16 03:37:29,129 - DEBUG - VM ctest-TestvifStats-92776434-06595793 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-16 03:37:34,129 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:37:34,130 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-92776434-06595793, IP 52.227.201.131, Port 22
2026-03-16 03:37:34,201 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-16 03:37:34,307 - DEBUG - VM ctest-TestvifStats-92776434-06595793 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-16 03:37:39,308 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:37:39,308 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-92776434-06595793, IP 52.227.201.131, Port 22
2026-03-16 03:37:39,376 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-16 03:37:39,474 - DEBUG - VM ctest-TestvifStats-92776434-06595793 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-16 03:37:44,475 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:37:44,475 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-92776434-06595793, IP 52.227.201.131, Port 22
2026-03-16 03:37:44,533 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-16 03:37:44,624 - DEBUG - VM ctest-TestvifStats-92776434-06595793 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-16 03:37:49,625 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:37:49,625 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-92776434-06595793, IP 52.227.201.131, Port 22
2026-03-16 03:37:49,795 - DEBUG - VM ctest-TestvifStats-92776434-06595793 is ready for SSH connections
2026-03-16 03:37:49,795 - INFO - Waiting for VM ctest-TestvifStats-92776434-31500190 to be up..
2026-03-16 03:37:49,915 - DEBUG - VM is in ACTIVE state now
2026-03-16 03:37:49,915 - INFO - VM name : ctest-TestvifStats-92776434-31500190
2026-03-16 03:37:50,021 - DEBUG - VM ctest-TestvifStats-92776434-31500190 ID is 03022b62-f7a0-45dc-bea3-d638eccf02ab
2026-03-16 03:37:50,021 - DEBUG - VM ctest-TestvifStats-92776434-31500190 launched on Node an-jenkins-deploy-platform-ansible-os-5469-1
2026-03-16 03:37:50,111 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/03022b62-f7a0-45dc-bea3-d638eccf02ab
2026-03-16 03:37:50,123 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/c7a62710-2a24-4a1f-b369-9450c8cf884b
2026-03-16 03:37:51,307 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=1.82 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.91 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.822/2.368/2.914/0.546 ms')
2026-03-16 03:37:51,307 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestvifStats-92776434-31500190 passed
2026-03-16 03:37:51,393 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:37:51,393 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-92776434-31500190, IP 52.227.201.132, Port 22
2026-03-16 03:37:51,463 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-16 03:37:51,570 - DEBUG - VM ctest-TestvifStats-92776434-31500190 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-16 03:37:56,571 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:37:56,571 - DEBUG - Waiting to SSH to VM ctest-TestvifStats-92776434-31500190, IP 52.227.201.132, Port 22
2026-03-16 03:37:56,744 - DEBUG - VM ctest-TestvifStats-92776434-31500190 is ready for SSH connections
2026-03-16 03:37:56,744 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:37:56,744 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 52.227.201.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-03-16 03:37:56,744 - DEBUG - ping -s 56 -c 3 -W 1 52.227.201.132
2026-03-16 03:38:21,343 - DEBUG - PING 52.227.201.132 (52.227.201.132) 56(84) bytes of data.
64 bytes from 52.227.201.132: icmp_req=1 ttl=64 time=13.9 ms
64 bytes from 52.227.201.132: icmp_req=2 ttl=64 time=1.06 ms
64 bytes from 52.227.201.132: icmp_req=3 ttl=64 time=1.03 ms
--- 52.227.201.132 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.030/5.333/13.910/6.064 ms
2026-03-16 03:38:21,343 - INFO - Ping to IP 52.227.201.132 from VM ctest-TestvifStats-92776434-06595793 passed
2026-03-16 03:38:21,343 - INFO - 10.0.0.41
2026-03-16 03:38:21,344 - INFO - vif --get 0 | grep "RX packets" | tr -s ' ' | cut -f1-3 -d ' '
2026-03-16 03:38:21,462 - INFO - 14728
2026-03-16 03:38:21,578 - INFO - TX packets:13896
2026-03-16 03:38:21,578 - INFO - 13896
2026-03-16 03:38:21,578 - INFO - vif --get 1 | grep "RX packets" | tr -s ' ' | cut -f1-3 -d ' '
2026-03-16 03:38:21,698 - INFO - 21551
2026-03-16 03:38:21,815 - INFO - TX packets:22969
2026-03-16 03:38:21,815 - INFO - 22969
2026-03-16 03:38:21,815 - INFO - vif --get 2 | grep "RX packets" | tr -s ' ' | cut -f1-3 -d ' '
2026-03-16 03:38:21,937 - INFO - 9404
2026-03-16 03:38:22,040 - INFO - TX packets:8011
2026-03-16 03:38:22,040 - INFO - 8011
2026-03-16 03:38:22,040 - INFO - vif --get 3 | grep "RX packets" | tr -s ' ' | cut -f1-3 -d ' '
2026-03-16 03:38:22,144 - INFO - 264
2026-03-16 03:38:22,251 - INFO - TX packets:324
2026-03-16 03:38:22,251 - INFO - 324
2026-03-16 03:38:22,251 - INFO - vif --get 4 | grep "RX packets" | tr -s ' ' | cut -f1-3 -d ' '
2026-03-16 03:38:22,359 - INFO - 219
2026-03-16 03:38:22,467 - INFO - TX packets:259
2026-03-16 03:38:22,468 - INFO - 259
2026-03-16 03:38:22,468 - INFO - 10.0.0.41
2026-03-16 03:38:22,572 - INFO - Vif stats cleared successfully on all cores for all interfaces
2026-03-16 03:38:22,572 - INFO - 10.0.0.41
2026-03-16 03:38:22,572 - INFO - vif --get 0 | grep "RX packets" | tr -s ' ' | cut -f1-3 -d ' '
2026-03-16 03:38:22,679 - INFO - 0
2026-03-16 03:38:22,784 - INFO - TX packets:1
2026-03-16 03:38:22,784 - INFO - 1
2026-03-16 03:38:22,784 - INFO - vif --get 1 | grep "RX packets" | tr -s ' ' | cut -f1-3 -d ' '
2026-03-16 03:38:22,891 - INFO - 2
2026-03-16 03:38:22,999 - INFO - TX packets:2
2026-03-16 03:38:22,999 - INFO - 2
2026-03-16 03:38:22,999 - INFO - vif --get 2 | grep "RX packets" | tr -s ' ' | cut -f1-3 -d ' '
2026-03-16 03:38:23,107 - INFO - 2
2026-03-16 03:38:23,220 - INFO - TX packets:2
2026-03-16 03:38:23,220 - INFO - 2
2026-03-16 03:38:23,220 - INFO - vif --get 3 | grep "RX packets" | tr -s ' ' | cut -f1-3 -d ' '
2026-03-16 03:38:23,323 - INFO - 1
2026-03-16 03:38:23,432 - INFO - TX packets:1
2026-03-16 03:38:23,432 - INFO - 1
2026-03-16 03:38:23,432 - INFO - vif --get 4 | grep "RX packets" | tr -s ' ' | cut -f1-3 -d ' '
2026-03-16 03:38:23,550 - INFO - 1
2026-03-16 03:38:23,652 - INFO - TX packets:1
2026-03-16 03:38:23,652 - INFO - 1
2026-03-16 03:38:23,652 - INFO - Deleting VM ctest-TestvifStats-92776434-31500190
2026-03-16 03:38:23,759 - INFO - Deleting VM ctest-TestvifStats-92776434-06595793
2026-03-16 03:38:23,858 - INFO - Deleting VN ctest-vn-58576544
2026-03-16 03:38:23,903 - DEBUG - VN e2cce46f-e63b-4cfe-b6ec-d152b4c9a50e still in use: Unable to complete operation on network e2cce46f-e63b-4cfe-b6ec-d152b4c9a50e. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-9e7406bb-286d-455b-86b4-1c215cf3c553']
2026-03-16 03:38:23,903 - WARNING - Deleting VN ctest-vn-58576544 failed..Will retry
2026-03-16 03:38:26,126 - DEBUG - Response for deleting network ()
2026-03-16 03:38:26,126 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/17899539-6133-41be-a770-eb28bc985ca4
2026-03-16 03:38:26,139 - DEBUG - Response Code: 404
2026-03-16 03:38:26,139 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-16 03:38:26,152 - DEBUG - Requesting: http://10.0.0.38:8082/domain/d1af4696-a589-4518-a8ed-3c39c5e9266b
2026-03-16 03:38:26,177 - DEBUG - Requesting: http://10.0.0.38:8082/project/a3d5da1a-bffc-4425-ab4a-0d9510649286
2026-03-16 03:38:26,291 - INFO - Validated that VN ctest-vn-58576544 is not found in API Server
2026-03-16 03:38:26,308 - DEBUG - VN ctest-vn-58576544 is not present in Agent 10.0.0.41
2026-03-16 03:38:26,319 - DEBUG - VN ctest-vn-58576544 is not present in Agent 10.0.0.240
2026-03-16 03:38:26,319 - INFO - Validated that VN ctest-vn-58576544 is not in any agent
2026-03-16 03:38:26,353 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-58576544 info
2026-03-16 03:38:27,638 - DEBUG - No XMPP flaps were noticed during the test
2026-03-16 03:38:27,638 - INFO - END TEST : test_vif_statistics : PASSED[0:01:58]
2026-03-16 03:38:27,638 - INFO - --------------------------------------------------------------------------------
2026-03-16 03:38:28,420 - INFO - Deleted project: ctest-TestvifStats-92776434, ID : a3d5da1a-bffc-4425-ab4a-0d9510649286