2026-08-24 04:54:38,427 - INFO - Domain Default found not creating 2026-08-24 04:54:38,607 - INFO - Project ctest-TestDropStats-62721536 not found, creating it 2026-08-24 04:54:39,202 - INFO - Created Project:ctest-TestDropStats-62721536, ID : f59a56f7-cdbf-4081-a43b-4476e9482816 2026-08-24 04:54:40,914 - INFO - ================================================================================ 2026-08-24 04:54:40,914 - INFO - STARTING TEST : test_flow_action_drop_stats 2026-08-24 04:54:40,914 - INFO - TEST DESCRIPTION : Description: Verify flow action drop stats Steps: 1. Create 2 VNs and launch 1 VM in each VN, on different nodes on multi node setup 2. Add policy to deny pkts between VNs. 3. Ping VM2 from VM1 Pass criteria: 1. Verify flow action count gets incremented, get it from introspect 2. Verify flow action count gets incremented for the vmi of VM1, get it from introspect 2026-08-24 04:54:42,208 - DEBUG - Skipping xmpp flap check 2026-08-24 04:54:42,208 - INFO - Initial checks done. Running the testcase now 2026-08-24 04:54:42,209 - INFO - 2026-08-24 04:54:42,234 - DEBUG - Services list from nova: [, , , ] 2026-08-24 04:54:42,234 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6211-1', 'an-jenkins-deploy-platform-ansible-os-6211-2']} 2026-08-24 04:54:42,964 - DEBUG - Response for create_network : {'network': {'id': 'ca995b53-f744-4bc5-bb9b-fb36cd929b03', 'name': 'ctest-vn-88160273', 'tenant_id': 'f59a56f7cdbf4081a43b4476e9482816', 'project_id': 'f59a56f7cdbf4081a43b4476e9482816', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDropStats-62721536', 'ctest-vn-88160273'], 'port_security_enabled': True, 'description': ''}} 2026-08-24 04:54:43,290 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c2708877-0c9d-4107-85fb-da1cf8b6c60a', 'name': '', 'tenant_id': 'f59a56f7cdbf4081a43b4476e9482816', 'network_id': 'ca995b53-f744-4bc5-bb9b-fb36cd929b03', 'ip_version': 4, 'cidr': '56.31.216.128/26', 'allocation_pools': [{'start': '56.31.216.130', 'end': '56.31.216.190'}], 'gateway_ip': '56.31.216.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '56.31.216.130', 'tags': [], 'project_id': 'f59a56f7cdbf4081a43b4476e9482816'}} 2026-08-24 04:54:43,316 - INFO - Created VN ctest-vn-88160273 2026-08-24 04:54:43,345 - DEBUG - VN ctest-vn-88160273 UUID is ca995b53-f744-4bc5-bb9b-fb36cd929b03 2026-08-24 04:54:43,833 - DEBUG - Response for create_network : {'network': {'id': '3faa87f3-f912-4a13-8f22-b33dc558be51', 'name': 'ctest-vn-81666655', 'tenant_id': 'f59a56f7cdbf4081a43b4476e9482816', 'project_id': 'f59a56f7cdbf4081a43b4476e9482816', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDropStats-62721536', 'ctest-vn-81666655'], 'port_security_enabled': True, 'description': ''}} 2026-08-24 04:54:44,175 - DEBUG - Response for create_subnet : {'subnet': {'id': '11ff58ed-ee36-4030-85c9-0b6f377d90cb', 'name': '', 'tenant_id': 'f59a56f7cdbf4081a43b4476e9482816', 'network_id': '3faa87f3-f912-4a13-8f22-b33dc558be51', 'ip_version': 4, 'cidr': '210.80.29.192/26', 'allocation_pools': [{'start': '210.80.29.194', 'end': '210.80.29.254'}], 'gateway_ip': '210.80.29.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '210.80.29.194', 'tags': [], 'project_id': 'f59a56f7cdbf4081a43b4476e9482816'}} 2026-08-24 04:54:44,223 - INFO - Created VN ctest-vn-81666655 2026-08-24 04:54:44,239 - DEBUG - VN ctest-vn-81666655 UUID is 3faa87f3-f912-4a13-8f22-b33dc558be51 2026-08-24 04:54:45,027 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6211-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6211-1) 2026-08-24 04:54:45,702 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6211-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6211-2) 2026-08-24 04:54:45,702 - INFO - Waiting for VM ctest-vm1-34637189 to be up.. 2026-08-24 04:54:45,774 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-24 04:54:50,884 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-24 04:54:55,983 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-24 04:55:01,097 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-24 04:55:06,199 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-24 04:55:11,292 - DEBUG - VM is in ACTIVE state now 2026-08-24 04:55:11,292 - INFO - VM name : ctest-vm1-34637189 2026-08-24 04:55:11,380 - DEBUG - VM ctest-vm1-34637189 ID is 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:11,411 - DEBUG - VM ctest-vm1-34637189 launched on Node an-jenkins-deploy-platform-ansible-os-6211-1 2026-08-24 04:55:11,498 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:11,843 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:11,878 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/632cf3ed-a18e-43ee-9a0b-61388032515b 2026-08-24 04:55:15,067 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-08-24 04:55:15,067 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-34637189 failed! 2026-08-24 04:55:15,086 - DEBUG - Gateway for vn default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 is 56.31.216.129 and allocation pool is NOT set 2026-08-24 04:55:17,154 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=14.2 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=4.50 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 4.501/9.337/14.173/4.836 ms') 2026-08-24 04:55:17,154 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-34637189 passed 2026-08-24 04:55:17,225 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-08-24 04:55:17,226 - DEBUG - Waiting to SSH to VM ctest-vm1-34637189, IP 56.31.216.131, Port 22 2026-08-24 04:55:17,292 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-08-24 04:55:17,382 - DEBUG - VM ctest-vm1-34637189 is NOT ready for SSH connections, VM status: ACTIVE 2026-08-24 04:55:22,383 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-08-24 04:55:22,383 - DEBUG - Waiting to SSH to VM ctest-vm1-34637189, IP 56.31.216.131, Port 22 2026-08-24 04:55:22,556 - DEBUG - VM ctest-vm1-34637189 is ready for SSH connections 2026-08-24 04:55:22,556 - INFO - Waiting for VM ctest-vm2-35163375 to be up.. 2026-08-24 04:55:22,667 - DEBUG - VM is in ACTIVE state now 2026-08-24 04:55:22,667 - INFO - VM name : ctest-vm2-35163375 2026-08-24 04:55:22,782 - DEBUG - VM ctest-vm2-35163375 ID is ae3afc2f-9942-4e51-ba7e-e739c4778ea8 2026-08-24 04:55:22,782 - DEBUG - VM ctest-vm2-35163375 launched on Node an-jenkins-deploy-platform-ansible-os-6211-2 2026-08-24 04:55:22,872 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8 2026-08-24 04:55:22,884 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/d22c2a7d-1551-486c-82fa-526eda40527f 2026-08-24 04:55:24,067 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.87 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.732 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.732/3.299/5.867/2.567 ms') 2026-08-24 04:55:24,068 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vm2-35163375 passed 2026-08-24 04:55:24,141 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-08-24 04:55:24,141 - DEBUG - Waiting to SSH to VM ctest-vm2-35163375, IP 210.80.29.195, Port 22 2026-08-24 04:55:24,311 - DEBUG - VM ctest-vm2-35163375 is ready for SSH connections 2026-08-24 04:55:24,415 - DEBUG - VM is in ACTIVE state now 2026-08-24 04:55:24,415 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-08-24 04:55:24,415 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:24,425 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/632cf3ed-a18e-43ee-9a0b-61388032515b 2026-08-24 04:55:24,438 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:24,448 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/632cf3ed-a18e-43ee-9a0b-61388032515b 2026-08-24 04:55:24,459 - DEBUG - Requesting: http://10.0.0.191:8082/instance-ip/6b47ad38-d51b-45ff-809e-bc746b7d156f 2026-08-24 04:55:24,471 - DEBUG - Verifying in api server 10.0.0.191 2026-08-24 04:55:24,471 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:24,480 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/632cf3ed-a18e-43ee-9a0b-61388032515b 2026-08-24 04:55:24,491 - DEBUG - Requesting: http://10.0.0.191:8082/instance-ip/6b47ad38-d51b-45ff-809e-bc746b7d156f 2026-08-24 04:55:24,500 - INFO - VM ctest-vm1-34637189 verfication in all API Servers passed 2026-08-24 04:55:24,520 - DEBUG - VM ctest-vm1-34637189 Tap interface: {'index': '3', 'name': 'tap632cf3ed-a1', 'uuid': '632cf3ed-a18e-43ee-9a0b-61388032515b', 'vrf_name': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273:ctest-vn-88160273', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '24', 'l2_label': '29', 'vxlan_id': '6', 'vn_name': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273', 'vm_uuid': '8c868fc2-bfa0-4b69-8ae8-c111d31bd57c', 'vm_name': 'ctest-vm1-34637189', 'ip_addr': '56.31.216.131', 'mac_addr': '02:63:2c:f3:ed:a1', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '140', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b', 'sg_uuid_list': ['f12db7f4-72bd-4c95-ba81-50c52a6a81d3'], 'static_route_list': None, 'vm_project_uuid': 'f59a56f7-cdbf-4081-a43b-4476e9482816', 'admin_state': 'Enabled', 'flow_key_idx': '23', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-08-24 04:55:24,520 - DEBUG - Agent 10.0.0.162 vrf name: default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273:ctest-vn-88160273 2026-08-24 04:55:24,525 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273:ctest-vn-88160273', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273', 'table_label': '-1', 'vxlan_id': '6', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.193:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-08-24 04:55:24,608 - DEBUG - VM ctest-vm1-34637189 : Tap interface tap632cf3ed-a1 is set to Active 2026-08-24 04:55:24,608 - DEBUG - Tap interface tap632cf3ed-a1 detail : {'index': '3', 'name': 'tap632cf3ed-a1', 'uuid': '632cf3ed-a18e-43ee-9a0b-61388032515b', 'vrf_name': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273:ctest-vn-88160273', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '24', 'l2_label': '29', 'vxlan_id': '6', 'vn_name': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273', 'vm_uuid': '8c868fc2-bfa0-4b69-8ae8-c111d31bd57c', 'vm_name': 'ctest-vm1-34637189', 'ip_addr': '56.31.216.131', 'mac_addr': '02:63:2c:f3:ed:a1', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '140', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b', 'sg_uuid_list': ['f12db7f4-72bd-4c95-ba81-50c52a6a81d3'], 'static_route_list': None, 'vm_project_uuid': 'f59a56f7-cdbf-4081-a43b-4476e9482816', 'admin_state': 'Enabled', 'flow_key_idx': '23', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-08-24 04:55:24,729 - DEBUG - Starting Layer 2 verification in Agent 2026-08-24 04:55:24,741 - DEBUG - Layer 2 path is seen for VM MAC 02:63:2c:f3:ed:a1 in agent 10.0.0.162 2026-08-24 04:55:24,741 - DEBUG - Active layer 2 route in agent is present for VMI tap632cf3ed-a1 2026-08-24 04:55:24,741 - DEBUG - L2 label(29) matches bw route table and interface table 2026-08-24 04:55:24,749 - DEBUG - VN default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 is found in Agent of node 10.0.0.162 2026-08-24 04:55:24,898 - DEBUG - VRF IDs of VN default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 is consistent in agent 10.0.0.162 2026-08-24 04:55:24,898 - DEBUG - Route for VM IP ['56.31.216.131'] is consistent in agent 10.0.0.162 2026-08-24 04:55:24,899 - DEBUG - VN default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 verification for VM ctest-vm1-34637189 in Agent 10.0.0.162 passed 2026-08-24 04:55:25,022 - DEBUG - Starting all layer 2 verification in agent 10.0.0.162 2026-08-24 04:55:25,036 - DEBUG - Route for VM MAC 02:63:2c:f3:ed:a1 is consistent in agent 10.0.0.162 2026-08-24 04:55:25,044 - INFO - VM ctest-vm1-34637189 verifications in Compute nodes passed 2026-08-24 04:55:25,320 - DEBUG - Validated VM route 56.31.216.131 in vrouter of 10.0.0.162 2026-08-24 04:55:25,328 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-08-24 04:55:25,328 - INFO - Validated routes of VM ctest-vm1-34637189 in all vrouters 2026-08-24 04:55:25,890 - DEBUG - Starting all layer2 verification in 10.0.0.191 Control Node 2026-08-24 04:55:26,024 - DEBUG - Layer2 route found for VM MAC 02:63:2c:f3:ed:a1 in Control-node 10.0.0.191 2026-08-24 04:55:26,025 - DEBUG - L2 Label for VM ctest-vm1-34637189 same between Control-node 10.0.0.191 and Agent, Expected: 29, Seen: 29 2026-08-24 04:55:26,025 - DEBUG - Starting all layer2 verification in 10.0.0.50 Control Node 2026-08-24 04:55:26,156 - DEBUG - Layer2 route found for VM MAC 02:63:2c:f3:ed:a1 in Control-node 10.0.0.50 2026-08-24 04:55:26,156 - DEBUG - L2 Label for VM ctest-vm1-34637189 same between Control-node 10.0.0.50 and Agent, Expected: 29, Seen: 29 2026-08-24 04:55:26,156 - INFO - Verification in Control-nodes for VM ctest-vm1-34637189 passed 2026-08-24 04:55:26,157 - DEBUG - Verifying the vm in opserver 2026-08-24 04:55:26,157 - DEBUG - Verifying in collector 10.0.0.191 ... 2026-08-24 04:55:26,159 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c?flat 2026-08-24 04:55:26,502 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c?flat 2026-08-24 04:55:26,571 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b?flat 2026-08-24 04:55:26,914 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b?flat 2026-08-24 04:55:26,979 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b?flat 2026-08-24 04:55:27,037 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c?flat 2026-08-24 04:55:27,092 - DEBUG - Verifying vm in vn uve 2026-08-24 04:55:27,093 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b?flat 2026-08-24 04:55:27,154 - DEBUG - VM uve shows interface as {'virtual_network': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273', 'active': False, 'label': 0, '__T': 1787547300353284, 'port_mirror_enabled': False, 'admin_state': True, 'ip6_address': '::', 'fixed_ip4_list': ['56.31.216.131'], 'is_health_check_active': True, 'vm_name': 'ctest-vm1-34637189', 'vn_uuid': 'ca995b53-f744-4bc5-bb9b-fb36cd929b03', 'ip_address': '56.31.216.131', 'ip4_active': False, 'vhostuser_mode': 0, 'uuid': '632cf3ed-a18e-43ee-9a0b-61388032515b', 'gateway': '56.31.216.129', 'tx_vlan': 65535, 'rx_vlan': 65535, 'vm_uuid': '8c868fc2-bfa0-4b69-8ae8-c111d31bd57c', 'l2_active': False, 'mac_address': '02:63:2c:f3:ed:a1', 'ip6_active': False} 2026-08-24 04:55:27,154 - DEBUG - VM uve shows ip address as ['56.31.216.131', '::'] 2026-08-24 04:55:27,154 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 2026-08-24 04:55:27,154 - INFO - Verifying through opserver in 10.0.0.190 2026-08-24 04:55:27,154 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273?flat 2026-08-24 04:55:27,178 - DEBUG - expected vm list 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:27,178 - DEBUG - Extracted vm list ['8c868fc2-bfa0-4b69-8ae8-c111d31bd57c'] 2026-08-24 04:55:27,178 - INFO - VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is present in default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 2026-08-24 04:55:27,178 - DEBUG - Verifying vm in vrouter uve 2026-08-24 04:55:27,179 - DEBUG - Getting info from collector 10.0.0.191.. 2026-08-24 04:55:27,179 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c?flat 2026-08-24 04:55:27,232 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-6211-1'] 2026-08-24 04:55:27,232 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-1:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:27,295 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-1?flat 2026-08-24 04:55:27,328 - DEBUG - VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is present in vrouter an-jenkins-deploy-platform-ansible-os-6211-1 uve 2026-08-24 04:55:27,328 - DEBUG - Validated that VM ctest-vm1-34637189 is in Vrouter an-jenkins-deploy-platform-ansible-os-6211-1 UVE 2026-08-24 04:55:27,328 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-08-24 04:55:27,337 - DEBUG - Expected tap interface of VM uuid 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b 2026-08-24 04:55:27,337 - DEBUG - Expected VN of VM uuid 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 2026-08-24 04:55:27,337 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-1:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:27,387 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-1?flat 2026-08-24 04:55:27,420 - DEBUG - VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is present in vrouter an-jenkins-deploy-platform-ansible-os-6211-1 uve 2026-08-24 04:55:27,420 - INFO - tap interface default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b of vm 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is present in vrouter an-jenkins-deploy-platform-ansible-os-6211-1 uve 2026-08-24 04:55:27,420 - DEBUG - Connected network default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 of vm 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is present in vrouter an-jenkins-deploy-platform-ansible-os-6211-1 uve 2026-08-24 04:55:27,420 - DEBUG - Verifying the 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c virtual network link through opserver 10.0.0.190 2026-08-24 04:55:27,420 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machines 2026-08-24 04:55:27,434 - DEBUG - VM link and name as {'name': '8c868fc2-bfa0-4b69-8ae8-c111d31bd57c', 'href': 'http://10.0.0.190:8081/analytics/uves/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c?flat'} 2026-08-24 04:55:27,434 - DEBUG - Verifying the 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c virtual network link through opserver 10.0.0.50 2026-08-24 04:55:27,434 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-08-24 04:55:27,760 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-08-24 04:55:27,816 - DEBUG - VM link and name as {'name': '8c868fc2-bfa0-4b69-8ae8-c111d31bd57c', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c?flat'} 2026-08-24 04:55:27,816 - DEBUG - Verifying the 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c virtual network link through opserver 10.0.0.191 2026-08-24 04:55:27,816 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machines 2026-08-24 04:55:27,834 - DEBUG - VM link and name as {'name': '8c868fc2-bfa0-4b69-8ae8-c111d31bd57c', 'href': 'http://10.0.0.191:8081/analytics/uves/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c?flat'} 2026-08-24 04:55:27,834 - INFO - VM ctest-vm1-34637189 validations in Opserver passed 2026-08-24 04:55:27,931 - DEBUG - VM is in ACTIVE state now 2026-08-24 04:55:27,931 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-08-24 04:55:27,931 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8 2026-08-24 04:55:27,940 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/d22c2a7d-1551-486c-82fa-526eda40527f 2026-08-24 04:55:27,952 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8 2026-08-24 04:55:27,962 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/d22c2a7d-1551-486c-82fa-526eda40527f 2026-08-24 04:55:27,973 - DEBUG - Requesting: http://10.0.0.191:8082/instance-ip/e5feded8-a872-40c7-ad2e-9acdf0959e24 2026-08-24 04:55:27,985 - DEBUG - Verifying in api server 10.0.0.191 2026-08-24 04:55:27,985 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8 2026-08-24 04:55:27,994 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/d22c2a7d-1551-486c-82fa-526eda40527f 2026-08-24 04:55:28,006 - DEBUG - Requesting: http://10.0.0.191:8082/instance-ip/e5feded8-a872-40c7-ad2e-9acdf0959e24 2026-08-24 04:55:28,015 - INFO - VM ctest-vm2-35163375 verfication in all API Servers passed 2026-08-24 04:55:28,037 - DEBUG - VM ctest-vm2-35163375 Tap interface: {'index': '3', 'name': 'tapd22c2a7d-15', 'uuid': 'd22c2a7d-1551-486c-82fa-526eda40527f', 'vrf_name': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655:ctest-vn-81666655', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '24', 'l2_label': '29', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655', 'vm_uuid': 'ae3afc2f-9942-4e51-ba7e-e739c4778ea8', 'vm_name': 'ctest-vm2-35163375', 'ip_addr': '210.80.29.195', 'mac_addr': '02:d2:2c:2a:7d:15', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '110', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-62721536:d22c2a7d-1551-486c-82fa-526eda40527f', 'sg_uuid_list': ['f12db7f4-72bd-4c95-ba81-50c52a6a81d3'], 'static_route_list': None, 'vm_project_uuid': 'f59a56f7-cdbf-4081-a43b-4476e9482816', 'admin_state': 'Enabled', 'flow_key_idx': '23', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-08-24 04:55:28,037 - DEBUG - Agent 10.0.0.185 vrf name: default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655:ctest-vn-81666655 2026-08-24 04:55:28,044 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655:ctest-vn-81666655', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655', 'table_label': '-1', 'vxlan_id': '7', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.129:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-08-24 04:55:28,132 - DEBUG - VM ctest-vm2-35163375 : Tap interface tapd22c2a7d-15 is set to Active 2026-08-24 04:55:28,132 - DEBUG - Tap interface tapd22c2a7d-15 detail : {'index': '3', 'name': 'tapd22c2a7d-15', 'uuid': 'd22c2a7d-1551-486c-82fa-526eda40527f', 'vrf_name': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655:ctest-vn-81666655', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '24', 'l2_label': '29', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655', 'vm_uuid': 'ae3afc2f-9942-4e51-ba7e-e739c4778ea8', 'vm_name': 'ctest-vm2-35163375', 'ip_addr': '210.80.29.195', 'mac_addr': '02:d2:2c:2a:7d:15', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '110', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-62721536:d22c2a7d-1551-486c-82fa-526eda40527f', 'sg_uuid_list': ['f12db7f4-72bd-4c95-ba81-50c52a6a81d3'], 'static_route_list': None, 'vm_project_uuid': 'f59a56f7-cdbf-4081-a43b-4476e9482816', 'admin_state': 'Enabled', 'flow_key_idx': '23', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-08-24 04:55:28,244 - DEBUG - Starting Layer 2 verification in Agent 2026-08-24 04:55:28,255 - DEBUG - Layer 2 path is seen for VM MAC 02:d2:2c:2a:7d:15 in agent 10.0.0.185 2026-08-24 04:55:28,255 - DEBUG - Active layer 2 route in agent is present for VMI tapd22c2a7d-15 2026-08-24 04:55:28,255 - DEBUG - L2 label(29) matches bw route table and interface table 2026-08-24 04:55:28,268 - DEBUG - VN default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655 is found in Agent of node 10.0.0.185 2026-08-24 04:55:28,400 - DEBUG - VRF IDs of VN default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655 is consistent in agent 10.0.0.185 2026-08-24 04:55:28,400 - DEBUG - Route for VM IP ['210.80.29.195'] is consistent in agent 10.0.0.185 2026-08-24 04:55:28,401 - DEBUG - VN default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655 verification for VM ctest-vm2-35163375 in Agent 10.0.0.185 passed 2026-08-24 04:55:28,518 - DEBUG - Starting all layer 2 verification in agent 10.0.0.185 2026-08-24 04:55:28,531 - DEBUG - Route for VM MAC 02:d2:2c:2a:7d:15 is consistent in agent 10.0.0.185 2026-08-24 04:55:28,531 - INFO - VM ctest-vm2-35163375 verifications in Compute nodes passed 2026-08-24 04:55:28,775 - DEBUG - Validated VM route 210.80.29.195 in vrouter of 10.0.0.185 2026-08-24 04:55:28,780 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-08-24 04:55:28,780 - INFO - Validated routes of VM ctest-vm2-35163375 in all vrouters 2026-08-24 04:55:29,295 - DEBUG - Starting all layer2 verification in 10.0.0.191 Control Node 2026-08-24 04:55:29,431 - DEBUG - Layer2 route found for VM MAC 02:d2:2c:2a:7d:15 in Control-node 10.0.0.191 2026-08-24 04:55:29,432 - DEBUG - L2 Label for VM ctest-vm2-35163375 same between Control-node 10.0.0.191 and Agent, Expected: 29, Seen: 29 2026-08-24 04:55:29,432 - DEBUG - Starting all layer2 verification in 10.0.0.50 Control Node 2026-08-24 04:55:29,563 - DEBUG - Layer2 route found for VM MAC 02:d2:2c:2a:7d:15 in Control-node 10.0.0.50 2026-08-24 04:55:29,563 - DEBUG - L2 Label for VM ctest-vm2-35163375 same between Control-node 10.0.0.50 and Agent, Expected: 29, Seen: 29 2026-08-24 04:55:29,563 - INFO - Verification in Control-nodes for VM ctest-vm2-35163375 passed 2026-08-24 04:55:29,563 - DEBUG - Verifying the vm in opserver 2026-08-24 04:55:29,563 - DEBUG - Verifying in collector 10.0.0.191 ... 2026-08-24 04:55:29,563 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8?flat 2026-08-24 04:55:29,585 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-62721536:d22c2a7d-1551-486c-82fa-526eda40527f?flat 2026-08-24 04:55:29,604 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-62721536:d22c2a7d-1551-486c-82fa-526eda40527f?flat 2026-08-24 04:55:29,623 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8?flat 2026-08-24 04:55:29,641 - DEBUG - Verifying vm in vn uve 2026-08-24 04:55:29,641 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-62721536:d22c2a7d-1551-486c-82fa-526eda40527f?flat 2026-08-24 04:55:29,660 - DEBUG - VM uve shows interface as {'virtual_network': 'default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655', 'active': False, 'label': 31, '__T': 1787547308806715, 'port_mirror_enabled': False, 'admin_state': True, 'ip6_address': '::', 'fixed_ip4_list': ['210.80.29.195'], 'is_health_check_active': True, 'vm_name': 'ctest-vm2-35163375', 'vn_uuid': '3faa87f3-f912-4a13-8f22-b33dc558be51', 'ip_address': '210.80.29.195', 'ip4_active': False, 'vhostuser_mode': 0, 'uuid': 'd22c2a7d-1551-486c-82fa-526eda40527f', 'gateway': '210.80.29.193', 'tx_vlan': 65535, 'rx_vlan': 65535, 'vm_uuid': 'ae3afc2f-9942-4e51-ba7e-e739c4778ea8', 'l2_active': False, 'mac_address': '02:d2:2c:2a:7d:15', 'ip6_active': False} 2026-08-24 04:55:29,660 - DEBUG - VM uve shows ip address as ['210.80.29.195', '::'] 2026-08-24 04:55:29,660 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655 2026-08-24 04:55:29,660 - INFO - Verifying through opserver in 10.0.0.190 2026-08-24 04:55:29,660 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655?flat 2026-08-24 04:55:29,683 - DEBUG - expected vm list ae3afc2f-9942-4e51-ba7e-e739c4778ea8 2026-08-24 04:55:29,683 - DEBUG - Extracted vm list ['ae3afc2f-9942-4e51-ba7e-e739c4778ea8'] 2026-08-24 04:55:29,683 - INFO - VM ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is present in default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655 2026-08-24 04:55:29,683 - DEBUG - Verifying vm in vrouter uve 2026-08-24 04:55:29,684 - DEBUG - Getting info from collector 10.0.0.191.. 2026-08-24 04:55:29,684 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8?flat 2026-08-24 04:55:29,701 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-6211-2'] 2026-08-24 04:55:29,701 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-2:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:29,762 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-2?flat 2026-08-24 04:55:29,799 - DEBUG - VM ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is present in vrouter an-jenkins-deploy-platform-ansible-os-6211-2 uve 2026-08-24 04:55:29,799 - DEBUG - Validated that VM ctest-vm2-35163375 is in Vrouter an-jenkins-deploy-platform-ansible-os-6211-2 UVE 2026-08-24 04:55:29,799 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-08-24 04:55:29,810 - DEBUG - Expected tap interface of VM uuid ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is default-domain:ctest-TestDropStats-62721536:d22c2a7d-1551-486c-82fa-526eda40527f 2026-08-24 04:55:29,810 - DEBUG - Expected VN of VM uuid ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655 2026-08-24 04:55:29,810 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-2:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:29,868 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-2?flat 2026-08-24 04:55:29,902 - DEBUG - VM ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is present in vrouter an-jenkins-deploy-platform-ansible-os-6211-2 uve 2026-08-24 04:55:29,902 - INFO - tap interface default-domain:ctest-TestDropStats-62721536:d22c2a7d-1551-486c-82fa-526eda40527f of vm ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is present in vrouter an-jenkins-deploy-platform-ansible-os-6211-2 uve 2026-08-24 04:55:29,902 - DEBUG - Connected network default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655 of vm ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is present in vrouter an-jenkins-deploy-platform-ansible-os-6211-2 uve 2026-08-24 04:55:29,902 - DEBUG - Verifying the ae3afc2f-9942-4e51-ba7e-e739c4778ea8 virtual network link through opserver 10.0.0.190 2026-08-24 04:55:29,902 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machines 2026-08-24 04:55:29,916 - DEBUG - VM link and name as {'name': 'ae3afc2f-9942-4e51-ba7e-e739c4778ea8', 'href': 'http://10.0.0.190:8081/analytics/uves/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8?flat'} 2026-08-24 04:55:29,916 - DEBUG - Verifying the ae3afc2f-9942-4e51-ba7e-e739c4778ea8 virtual network link through opserver 10.0.0.50 2026-08-24 04:55:29,916 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-08-24 04:55:29,966 - DEBUG - VM link and name as {'name': 'ae3afc2f-9942-4e51-ba7e-e739c4778ea8', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8?flat'} 2026-08-24 04:55:29,966 - DEBUG - Verifying the ae3afc2f-9942-4e51-ba7e-e739c4778ea8 virtual network link through opserver 10.0.0.191 2026-08-24 04:55:29,966 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machines 2026-08-24 04:55:29,980 - DEBUG - VM link and name as {'name': 'ae3afc2f-9942-4e51-ba7e-e739c4778ea8', 'href': 'http://10.0.0.191:8081/analytics/uves/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8?flat'} 2026-08-24 04:55:29,980 - INFO - VM ctest-vm2-35163375 validations in Opserver passed 2026-08-24 04:55:30,012 - INFO - Deleting VM ctest-vm2-35163375 2026-08-24 04:55:30,083 - DEBUG - Verifying in api server 10.0.0.191 2026-08-24 04:55:30,083 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8 2026-08-24 04:55:30,093 - DEBUG - VM ID ae3afc2f-9942-4e51-ba7e-e739c4778ea8 of VM ctest-vm2-35163375 is still found in API Server 2026-08-24 04:55:32,094 - DEBUG - Verifying in api server 10.0.0.191 2026-08-24 04:55:32,094 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8 2026-08-24 04:55:32,103 - DEBUG - VM ID ae3afc2f-9942-4e51-ba7e-e739c4778ea8 of VM ctest-vm2-35163375 is still found in API Server 2026-08-24 04:55:34,104 - DEBUG - Verifying in api server 10.0.0.191 2026-08-24 04:55:34,104 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8 2026-08-24 04:55:34,112 - DEBUG - Response Code: 404 2026-08-24 04:55:34,113 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8 2026-08-24 04:55:34,120 - DEBUG - Response Code: 404 2026-08-24 04:55:34,120 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/ae3afc2f-9942-4e51-ba7e-e739c4778ea8 2026-08-24 04:55:34,127 - DEBUG - Response Code: 404 2026-08-24 04:55:34,127 - INFO - VM ctest-vm2-35163375 is fully removed in API-Server 2026-08-24 04:55:34,279 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-08-24 04:55:34,327 - DEBUG - Validated that vrouter 10.0.0.162 does not have VMs route for VN default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655 2026-08-24 04:55:34,341 - DEBUG - Validated that vrouter 10.0.0.185 does not have VMs route for VN default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655 2026-08-24 04:55:34,341 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655 2026-08-24 04:55:34,341 - INFO - VM ctest-vm2-35163375 is removed in Compute, and routes are removed in all compute nodes 2026-08-24 04:55:34,587 - INFO - Routes for VM ctest-vm2-35163375 is removed in all control-nodes 2026-08-24 04:55:34,587 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-2:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:34,645 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-2?flat 2026-08-24 04:55:34,682 - DEBUG - VM ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is still present in vrouter an-jenkins-deploy-platform-ansible-os-6211-2 uve 2026-08-24 04:55:34,682 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-24 04:55:34,683 - DEBUG - interface for vm ae3afc2f-9942-4e51-ba7e-e739c4778ea8 deleted from vrouter uve ... 2026-08-24 04:55:37,683 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-2:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:37,741 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-2?flat 2026-08-24 04:55:37,775 - DEBUG - VM ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is still present in vrouter an-jenkins-deploy-platform-ansible-os-6211-2 uve 2026-08-24 04:55:37,775 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-24 04:55:37,775 - DEBUG - interface for vm ae3afc2f-9942-4e51-ba7e-e739c4778ea8 deleted from vrouter uve ... 2026-08-24 04:55:40,776 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-2:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:40,840 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-2?flat 2026-08-24 04:55:40,875 - DEBUG - VM ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is not present in vrouter an-jenkins-deploy-platform-ansible-os-6211-2 uve 2026-08-24 04:55:40,875 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-24 04:55:40,875 - DEBUG - interface for vm ae3afc2f-9942-4e51-ba7e-e739c4778ea8 deleted from vrouter uve ... 2026-08-24 04:55:40,875 - DEBUG - Deleted interface not in error interface list ... 2026-08-24 04:55:40,875 - DEBUG - Validated that VM ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is removed in Vrouter UVE 2026-08-24 04:55:40,875 - DEBUG - Verifying through opserver in 10.0.0.190 2026-08-24 04:55:40,875 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655?flat 2026-08-24 04:55:40,895 - DEBUG - ae3afc2f-9942-4e51-ba7e-e739c4778ea8 BM not in default-domain:ctest-TestDropStats-62721536:ctest-vn-81666655 uve 2026-08-24 04:55:40,896 - DEBUG - Validated that VM ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is not present in the VN UVE 2026-08-24 04:55:40,896 - DEBUG - Verifying the ae3afc2f-9942-4e51-ba7e-e739c4778ea8 virtual network link through opserver 10.0.0.190 2026-08-24 04:55:40,896 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machines 2026-08-24 04:55:40,910 - INFO - ae3afc2f-9942-4e51-ba7e-e739c4778ea8 vm uve deleted from opserver 2026-08-24 04:55:40,910 - DEBUG - Verifying the ae3afc2f-9942-4e51-ba7e-e739c4778ea8 virtual network link through opserver 10.0.0.50 2026-08-24 04:55:40,910 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-08-24 04:55:40,985 - INFO - ae3afc2f-9942-4e51-ba7e-e739c4778ea8 vm uve deleted from opserver 2026-08-24 04:55:40,985 - DEBUG - Verifying the ae3afc2f-9942-4e51-ba7e-e739c4778ea8 virtual network link through opserver 10.0.0.191 2026-08-24 04:55:40,985 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machines 2026-08-24 04:55:41,000 - INFO - ae3afc2f-9942-4e51-ba7e-e739c4778ea8 vm uve deleted from opserver 2026-08-24 04:55:41,000 - INFO - Validated that VM ae3afc2f-9942-4e51-ba7e-e739c4778ea8 is removed from Opserver 2026-08-24 04:55:41,001 - INFO - Deleting VM ctest-vm1-34637189 2026-08-24 04:55:41,080 - DEBUG - Verifying in api server 10.0.0.191 2026-08-24 04:55:41,080 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:41,090 - DEBUG - VM ID 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c of VM ctest-vm1-34637189 is still found in API Server 2026-08-24 04:55:43,091 - DEBUG - Verifying in api server 10.0.0.191 2026-08-24 04:55:43,091 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:43,099 - DEBUG - VM ID 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c of VM ctest-vm1-34637189 is still found in API Server 2026-08-24 04:55:45,099 - DEBUG - Verifying in api server 10.0.0.191 2026-08-24 04:55:45,099 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:45,107 - DEBUG - Response Code: 404 2026-08-24 04:55:45,107 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:45,114 - DEBUG - Response Code: 404 2026-08-24 04:55:45,114 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:55:45,122 - DEBUG - Response Code: 404 2026-08-24 04:55:45,122 - INFO - VM ctest-vm1-34637189 is fully removed in API-Server 2026-08-24 04:55:45,293 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-08-24 04:55:45,336 - DEBUG - Validated that vrouter 10.0.0.162 does not have VMs route for VN default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 2026-08-24 04:55:45,350 - DEBUG - Validated that vrouter 10.0.0.185 does not have VMs route for VN default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 2026-08-24 04:55:45,350 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 2026-08-24 04:55:45,350 - INFO - VM ctest-vm1-34637189 is removed in Compute, and routes are removed in all compute nodes 2026-08-24 04:55:45,590 - INFO - Routes for VM ctest-vm1-34637189 is removed in all control-nodes 2026-08-24 04:55:45,590 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-1:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:45,645 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-1?flat 2026-08-24 04:55:45,683 - DEBUG - VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6211-1 uve 2026-08-24 04:55:45,683 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-24 04:55:45,683 - DEBUG - interface for vm 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c deleted from vrouter uve ... 2026-08-24 04:55:45,683 - DEBUG - Deleted interface not in error interface list ... 2026-08-24 04:55:48,684 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-1:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:48,743 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-1?flat 2026-08-24 04:55:48,779 - DEBUG - VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6211-1 uve 2026-08-24 04:55:48,779 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-24 04:55:48,779 - DEBUG - interface for vm 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c deleted from vrouter uve ... 2026-08-24 04:55:48,779 - DEBUG - Deleted interface not in error interface list ... 2026-08-24 04:55:51,779 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-1:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:51,831 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-1?flat 2026-08-24 04:55:51,870 - DEBUG - VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6211-1 uve 2026-08-24 04:55:51,870 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-24 04:55:51,870 - DEBUG - interface for vm 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c deleted from vrouter uve ... 2026-08-24 04:55:51,870 - DEBUG - Deleted interface not in error interface list ... 2026-08-24 04:55:54,871 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-1:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:54,926 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-1?flat 2026-08-24 04:55:54,962 - DEBUG - VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6211-1 uve 2026-08-24 04:55:54,962 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-24 04:55:54,962 - DEBUG - interface for vm 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c deleted from vrouter uve ... 2026-08-24 04:55:54,962 - DEBUG - Deleted interface not in error interface list ... 2026-08-24 04:55:57,963 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-1:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:55:58,028 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-1?flat 2026-08-24 04:55:58,160 - DEBUG - VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6211-1 uve 2026-08-24 04:55:58,160 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-24 04:55:58,160 - DEBUG - interface for vm 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c deleted from vrouter uve ... 2026-08-24 04:55:58,160 - DEBUG - Deleted interface not in error interface list ... 2026-08-24 04:56:01,161 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6211-1:Compute:contrail-vrouter-agent:0?flat 2026-08-24 04:56:01,215 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6211-1?flat 2026-08-24 04:56:01,254 - DEBUG - VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is not present in vrouter an-jenkins-deploy-platform-ansible-os-6211-1 uve 2026-08-24 04:56:01,255 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-24 04:56:01,255 - DEBUG - interface for vm 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c deleted from vrouter uve ... 2026-08-24 04:56:01,255 - DEBUG - Deleted interface not in error interface list ... 2026-08-24 04:56:01,255 - DEBUG - Validated that VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is removed in Vrouter UVE 2026-08-24 04:56:01,255 - DEBUG - Verifying through opserver in 10.0.0.190 2026-08-24 04:56:01,255 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273?flat 2026-08-24 04:56:01,279 - DEBUG - 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c BM not in default-domain:ctest-TestDropStats-62721536:ctest-vn-88160273 uve 2026-08-24 04:56:01,279 - DEBUG - Validated that VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is not present in the VN UVE 2026-08-24 04:56:01,279 - DEBUG - Verifying the 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c virtual network link through opserver 10.0.0.190 2026-08-24 04:56:01,279 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machines 2026-08-24 04:56:01,294 - DEBUG - No links retuned for 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:56:01,294 - INFO - 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c vm uve deleted from opserver 2026-08-24 04:56:01,294 - DEBUG - Verifying the 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c virtual network link through opserver 10.0.0.50 2026-08-24 04:56:01,295 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-08-24 04:56:01,310 - DEBUG - No links retuned for 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:56:01,310 - INFO - 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c vm uve deleted from opserver 2026-08-24 04:56:01,310 - DEBUG - Verifying the 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c virtual network link through opserver 10.0.0.191 2026-08-24 04:56:01,310 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machines 2026-08-24 04:56:01,324 - DEBUG - No links retuned for 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c 2026-08-24 04:56:01,324 - INFO - 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c vm uve deleted from opserver 2026-08-24 04:56:01,324 - INFO - Validated that VM 8c868fc2-bfa0-4b69-8ae8-c111d31bd57c is removed from Opserver 2026-08-24 04:56:01,325 - INFO - Deleting VN ctest-vn-81666655 2026-08-24 04:56:01,570 - DEBUG - Response for deleting network () 2026-08-24 04:56:01,570 - INFO - Deleting VN ctest-vn-88160273 2026-08-24 04:56:01,812 - DEBUG - Response for deleting network () 2026-08-24 04:56:03,143 - ERROR - IndexError Python 3.9.25: /usr/bin/python3 Mon Aug 24 04:55:30 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vrouter/test_drop_stats.py in test_flow_action_drop_stats(self=) 36 raise self.skipTest("Skipping test case,this test needs atleast 2 compute nodes") 37 38 assert self.verify_flow_action_drop_stats() 39 return True 40 # end test_drop_stats self = self.verify_flow_action_drop_stats = > /contrail-test/common/vrouter/base_drop_stats.py in verify_flow_action_drop_stats(self=, drop_type='ds_flow_action_drop') 51 fq_name = intf_details[0]['config_name'] 52 53 vif_dict_before = self.get_drop_stats_dict(compute0, fq_name)[1] 54 self.print_drop_stats_dict(vif_dict_before) 55 vif_dict_before undefined self = self.get_drop_stats_dict = .deco_retry....on_drop_stats[dev_reg,sanity] id=0x7fac5308a580>> compute0 = '10.0.0.162' fq_name = 'default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b' /contrail-test/tcutils/util.py in f_retry(*args=(, '10.0.0.162', 'default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b'), **kwargs={}) 82 mtries, mdelay = tries, delay # make mutable 83 84 result = f(*args, **kwargs) # first attempt 85 rv = result 86 final = False result undefined f = args = (, '10.0.0.162', 'default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b') kwargs = {} /contrail-test/common/vrouter/base_drop_stats.py in get_drop_stats_dict(self=, compute='10.0.0.162', fq_name='default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b', module='vif') 29 drop_stats_list = self.agent_inspect_h[compute].get_agent_vrouter_drop_stats() 30 else: 31 drop_stats_list = self.agent_inspect_h[compute].get_agent_vm_interface_drop_stats(fq_name) 32 33 if drop_stats_list is not None: drop_stats_list undefined self = self.agent_inspect_h = {} compute = '10.0.0.162' ].get_agent_vm_interface_drop_stats undefined fq_name = 'default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b' /contrail-test/tcutils/agent/vna_introspect_utils.py in get_agent_vm_interface_drop_stats(self=, fq_name='default-domain:ctest-TestDropStats-62721536:632cf3ed-a18e-43ee-9a0b-61388032515b') 1039 except IndexError: 1040 return None 1041 return l[0] 1042 # end get_agent_vm_interface_drop_stats 1043 l = [] IndexError: list index out of range __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Sequence index out of range.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('list index out of range',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vrouter/test_drop_stats.py", line 38, in test_flow_action_drop_stats assert self.verify_flow_action_drop_stats() File "/contrail-test/common/vrouter/base_drop_stats.py", line 53, in verify_flow_action_drop_stats vif_dict_before = self.get_drop_stats_dict(compute0, fq_name)[1] File "/contrail-test/tcutils/util.py", line 84, in f_retry result = f(*args, **kwargs) # first attempt File "/contrail-test/common/vrouter/base_drop_stats.py", line 31, in get_drop_stats_dict drop_stats_list = self.agent_inspect_h[compute].get_agent_vm_interface_drop_stats(fq_name) File "/contrail-test/tcutils/agent/vna_introspect_utils.py", line 1041, in get_agent_vm_interface_drop_stats return l[0] IndexError: list index out of range 2026-08-24 04:56:03,144 - DEBUG - Skipping xmpp flap check 2026-08-24 04:56:03,144 - INFO -
2026-08-24 04:56:03,144 - INFO - END TEST : test_flow_action_drop_stats : FAILED[0:01:23]
2026-08-24 04:56:03,144 - INFO - -------------------------------------------------------------------------------- 2026-08-24 04:56:04,002 - INFO - Deleted project: ctest-TestDropStats-62721536, ID : f59a56f7-cdbf-4081-a43b-4476e9482816