2026-08-17 04:51:06,230 - INFO - Domain Default found not creating 2026-08-17 04:51:06,403 - INFO - Project ctest-TestDropStats-00253436 not found, creating it 2026-08-17 04:51:06,988 - INFO - Created Project:ctest-TestDropStats-00253436, ID : 29c6a20a-8968-46dc-a0fc-797dcbf3d005 2026-08-17 04:51:08,783 - INFO - ================================================================================ 2026-08-17 04:51:08,783 - INFO - STARTING TEST : test_flow_action_drop_stats 2026-08-17 04:51:08,783 - INFO - TEST DESCRIPTION : Description: Verify flow action drop stats Steps: 1. Create 2 VNs and launch 1 VM in each VN, on different nodes on multi node setup 2. Add policy to deny pkts between VNs. 3. Ping VM2 from VM1 Pass criteria: 1. Verify flow action count gets incremented, get it from introspect 2. Verify flow action count gets incremented for the vmi of VM1, get it from introspect 2026-08-17 04:51:10,107 - DEBUG - Skipping xmpp flap check 2026-08-17 04:51:10,107 - INFO - Initial checks done. Running the testcase now 2026-08-17 04:51:10,107 - INFO - 2026-08-17 04:51:10,134 - DEBUG - Services list from nova: [, , , ] 2026-08-17 04:51:10,134 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6167-1', 'an-jenkins-deploy-platform-ansible-os-6167-2']} 2026-08-17 04:51:11,008 - DEBUG - Response for create_network : {'network': {'id': 'd6f23deb-0920-4ebc-a19c-d4472872acd2', 'name': 'ctest-vn-15983432', 'tenant_id': '29c6a20a896846dca0fc797dcbf3d005', 'project_id': '29c6a20a896846dca0fc797dcbf3d005', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDropStats-00253436', 'ctest-vn-15983432'], 'port_security_enabled': True, 'description': ''}} 2026-08-17 04:51:11,331 - DEBUG - Response for create_subnet : {'subnet': {'id': '4d9b6256-7e09-4fd6-bf5e-ce485cb92dd7', 'name': '', 'tenant_id': '29c6a20a896846dca0fc797dcbf3d005', 'network_id': 'd6f23deb-0920-4ebc-a19c-d4472872acd2', 'ip_version': 4, 'cidr': '4.206.99.192/26', 'allocation_pools': [{'start': '4.206.99.194', 'end': '4.206.99.254'}], 'gateway_ip': '4.206.99.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '4.206.99.194', 'tags': [], 'project_id': '29c6a20a896846dca0fc797dcbf3d005'}} 2026-08-17 04:51:11,353 - INFO - Created VN ctest-vn-15983432 2026-08-17 04:51:11,367 - DEBUG - VN ctest-vn-15983432 UUID is d6f23deb-0920-4ebc-a19c-d4472872acd2 2026-08-17 04:51:11,733 - DEBUG - Response for create_network : {'network': {'id': '01b287a6-7fd7-4d70-8579-a2c49ca8eaea', 'name': 'ctest-vn-77719520', 'tenant_id': '29c6a20a896846dca0fc797dcbf3d005', 'project_id': '29c6a20a896846dca0fc797dcbf3d005', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDropStats-00253436', 'ctest-vn-77719520'], 'port_security_enabled': True, 'description': ''}} 2026-08-17 04:51:11,994 - DEBUG - Response for create_subnet : {'subnet': {'id': 'de94ce20-77b0-4b95-a277-20ed03a21164', 'name': '', 'tenant_id': '29c6a20a896846dca0fc797dcbf3d005', 'network_id': '01b287a6-7fd7-4d70-8579-a2c49ca8eaea', 'ip_version': 4, 'cidr': '5.71.168.0/26', 'allocation_pools': [{'start': '5.71.168.2', 'end': '5.71.168.62'}], 'gateway_ip': '5.71.168.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '5.71.168.2', 'tags': [], 'project_id': '29c6a20a896846dca0fc797dcbf3d005'}} 2026-08-17 04:51:12,016 - INFO - Created VN ctest-vn-77719520 2026-08-17 04:51:12,028 - DEBUG - VN ctest-vn-77719520 UUID is 01b287a6-7fd7-4d70-8579-a2c49ca8eaea 2026-08-17 04:51:12,828 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6167-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6167-1) 2026-08-17 04:51:13,335 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6167-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6167-2) 2026-08-17 04:51:13,336 - INFO - Waiting for VM ctest-vm1-87328390 to be up.. 2026-08-17 04:51:13,393 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-17 04:51:18,500 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-17 04:51:23,593 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-17 04:51:28,687 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-17 04:51:33,838 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-17 04:51:38,932 - DEBUG - VM is in ACTIVE state now 2026-08-17 04:51:38,932 - INFO - VM name : ctest-vm1-87328390 2026-08-17 04:51:39,033 - DEBUG - VM ctest-vm1-87328390 ID is d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:51:39,062 - DEBUG - VM ctest-vm1-87328390 launched on Node an-jenkins-deploy-platform-ansible-os-6167-1 2026-08-17 04:51:39,147 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:51:39,533 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:51:39,566 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/f4e3536b-7583-48bd-91e5-b63a1364f6de 2026-08-17 04:51:42,810 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1035ms') 2026-08-17 04:51:42,810 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-87328390 failed! 2026-08-17 04:51:42,826 - DEBUG - Gateway for vn default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 is 4.206.99.193 and allocation pool is NOT set 2026-08-17 04:51:44,893 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.64 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.46 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.464/5.552/9.641/4.088 ms') 2026-08-17 04:51:44,893 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-87328390 passed 2026-08-17 04:51:44,967 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-08-17 04:51:44,967 - DEBUG - Waiting to SSH to VM ctest-vm1-87328390, IP 4.206.99.195, Port 22 2026-08-17 04:51:45,138 - DEBUG - VM ctest-vm1-87328390 is ready for SSH connections 2026-08-17 04:51:45,139 - INFO - Waiting for VM ctest-vm2-51671122 to be up.. 2026-08-17 04:51:45,234 - DEBUG - VM is in ACTIVE state now 2026-08-17 04:51:45,234 - INFO - VM name : ctest-vm2-51671122 2026-08-17 04:51:45,327 - DEBUG - VM ctest-vm2-51671122 ID is 36188c05-85c4-46fb-817b-5eddf68ac31c 2026-08-17 04:51:45,327 - DEBUG - VM ctest-vm2-51671122 launched on Node an-jenkins-deploy-platform-ansible-os-6167-2 2026-08-17 04:51:45,413 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c 2026-08-17 04:51:45,424 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/d626eb69-5b62-406a-916f-fab26222020f 2026-08-17 04:51:46,585 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.76 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.531 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.531/2.147/3.764/1.616 ms') 2026-08-17 04:51:46,586 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vm2-51671122 passed 2026-08-17 04:51:46,658 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-08-17 04:51:46,658 - DEBUG - Waiting to SSH to VM ctest-vm2-51671122, IP 5.71.168.3, Port 22 2026-08-17 04:51:46,831 - DEBUG - VM ctest-vm2-51671122 is ready for SSH connections 2026-08-17 04:51:46,922 - DEBUG - VM is in ACTIVE state now 2026-08-17 04:51:46,922 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-08-17 04:51:46,922 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:51:46,930 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/f4e3536b-7583-48bd-91e5-b63a1364f6de 2026-08-17 04:51:46,941 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:51:46,949 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/f4e3536b-7583-48bd-91e5-b63a1364f6de 2026-08-17 04:51:46,960 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/dad05c8d-9c65-45e6-8150-f2fef9562cb9 2026-08-17 04:51:46,971 - DEBUG - Verifying in api server 10.0.0.38 2026-08-17 04:51:46,972 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:51:46,980 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/f4e3536b-7583-48bd-91e5-b63a1364f6de 2026-08-17 04:51:46,992 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/dad05c8d-9c65-45e6-8150-f2fef9562cb9 2026-08-17 04:51:47,001 - INFO - VM ctest-vm1-87328390 verfication in all API Servers passed 2026-08-17 04:51:47,023 - DEBUG - VM ctest-vm1-87328390 Tap interface: {'index': '3', 'name': 'tapf4e3536b-75', 'uuid': 'f4e3536b-7583-48bd-91e5-b63a1364f6de', 'vrf_name': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432:ctest-vn-15983432', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '5', 'vn_name': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432', 'vm_uuid': 'd749a7b4-d046-468d-95f3-a1937a699e0c', 'vm_name': 'ctest-vm1-87328390', 'ip_addr': '4.206.99.195', 'mac_addr': '02:f4:e3:53:6b:75', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '140', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de', 'sg_uuid_list': ['c76b6989-5c26-47d5-ab5c-6382ba3f0a6d'], 'static_route_list': None, 'vm_project_uuid': '29c6a20a-8968-46dc-a0fc-797dcbf3d005', 'admin_state': 'Enabled', 'flow_key_idx': '23', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-08-17 04:51:47,023 - DEBUG - Agent 10.0.0.50 vrf name: default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432:ctest-vn-15983432 2026-08-17 04:51:47,030 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432:ctest-vn-15983432', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432', 'table_label': '-1', 'vxlan_id': '5', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.29:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-08-17 04:51:47,114 - DEBUG - VM ctest-vm1-87328390 : Tap interface tapf4e3536b-75 is set to Active 2026-08-17 04:51:47,114 - DEBUG - Tap interface tapf4e3536b-75 detail : {'index': '3', 'name': 'tapf4e3536b-75', 'uuid': 'f4e3536b-7583-48bd-91e5-b63a1364f6de', 'vrf_name': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432:ctest-vn-15983432', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '5', 'vn_name': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432', 'vm_uuid': 'd749a7b4-d046-468d-95f3-a1937a699e0c', 'vm_name': 'ctest-vm1-87328390', 'ip_addr': '4.206.99.195', 'mac_addr': '02:f4:e3:53:6b:75', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '140', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de', 'sg_uuid_list': ['c76b6989-5c26-47d5-ab5c-6382ba3f0a6d'], 'static_route_list': None, 'vm_project_uuid': '29c6a20a-8968-46dc-a0fc-797dcbf3d005', 'admin_state': 'Enabled', 'flow_key_idx': '23', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-08-17 04:51:47,230 - DEBUG - Starting Layer 2 verification in Agent 2026-08-17 04:51:47,242 - DEBUG - Layer 2 path is seen for VM MAC 02:f4:e3:53:6b:75 in agent 10.0.0.50 2026-08-17 04:51:47,242 - DEBUG - Active layer 2 route in agent is present for VMI tapf4e3536b-75 2026-08-17 04:51:47,242 - DEBUG - L2 label(29) matches bw route table and interface table 2026-08-17 04:51:47,250 - DEBUG - VN default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 is found in Agent of node 10.0.0.50 2026-08-17 04:51:47,382 - DEBUG - VRF IDs of VN default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 is consistent in agent 10.0.0.50 2026-08-17 04:51:47,382 - DEBUG - Route for VM IP ['4.206.99.195'] is consistent in agent 10.0.0.50 2026-08-17 04:51:47,382 - DEBUG - VN default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 verification for VM ctest-vm1-87328390 in Agent 10.0.0.50 passed 2026-08-17 04:51:47,495 - DEBUG - Starting all layer 2 verification in agent 10.0.0.50 2026-08-17 04:51:47,507 - DEBUG - Route for VM MAC 02:f4:e3:53:6b:75 is consistent in agent 10.0.0.50 2026-08-17 04:51:47,515 - INFO - VM ctest-vm1-87328390 verifications in Compute nodes passed 2026-08-17 04:51:47,732 - DEBUG - Validated VM route 4.206.99.195 in vrouter of 10.0.0.50 2026-08-17 04:51:47,738 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-08-17 04:51:47,738 - INFO - Validated routes of VM ctest-vm1-87328390 in all vrouters 2026-08-17 04:51:48,282 - DEBUG - Starting all layer2 verification in 10.0.0.190 Control Node 2026-08-17 04:51:48,454 - DEBUG - Layer2 route found for VM MAC 02:f4:e3:53:6b:75 in Control-node 10.0.0.190 2026-08-17 04:51:48,455 - DEBUG - L2 Label for VM ctest-vm1-87328390 same between Control-node 10.0.0.190 and Agent, Expected: 29, Seen: 29 2026-08-17 04:51:48,455 - DEBUG - Starting all layer2 verification in 10.0.0.177 Control Node 2026-08-17 04:51:48,602 - DEBUG - Layer2 route found for VM MAC 02:f4:e3:53:6b:75 in Control-node 10.0.0.177 2026-08-17 04:51:48,602 - DEBUG - L2 Label for VM ctest-vm1-87328390 same between Control-node 10.0.0.177 and Agent, Expected: 29, Seen: 29 2026-08-17 04:51:48,602 - INFO - Verification in Control-nodes for VM ctest-vm1-87328390 passed 2026-08-17 04:51:48,602 - DEBUG - Verifying the vm in opserver 2026-08-17 04:51:48,602 - DEBUG - Verifying in collector 10.0.0.38 ... 2026-08-17 04:51:48,603 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c?flat 2026-08-17 04:51:48,981 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c?flat 2026-08-17 04:51:49,045 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de?flat 2026-08-17 04:51:49,421 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de?flat 2026-08-17 04:51:49,483 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de?flat 2026-08-17 04:51:49,548 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c?flat 2026-08-17 04:51:49,605 - DEBUG - Verifying vm in vn uve 2026-08-17 04:51:49,605 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de?flat 2026-08-17 04:51:49,672 - DEBUG - VM uve shows interface as {'ip6_address': '::', 'ip4_active': False, 'fixed_ip4_list': ['4.206.99.195'], 'vm_name': 'ctest-vm1-87328390', 'mac_address': '02:f4:e3:53:6b:75', 'ip_address': '4.206.99.195', 'virtual_network': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432', 'tx_vlan': 65535, 'is_health_check_active': True, 'vhostuser_mode': 0, 'vm_uuid': 'd749a7b4-d046-468d-95f3-a1937a699e0c', 'l2_active': False, 'gateway': '4.206.99.193', 'label': 1007225097, 'active': False, 'uuid': 'f4e3536b-7583-48bd-91e5-b63a1364f6de', 'port_mirror_enabled': False, 'vn_uuid': 'd6f23deb-0920-4ebc-a19c-d4472872acd2', '__T': 1786942291107602, 'ip6_active': False, 'rx_vlan': 65535, 'admin_state': True} 2026-08-17 04:51:49,672 - DEBUG - VM uve shows ip address as ['4.206.99.195', '::'] 2026-08-17 04:51:49,672 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 2026-08-17 04:51:49,672 - INFO - Verifying through opserver in 10.0.0.177 2026-08-17 04:51:49,672 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432?flat 2026-08-17 04:51:49,692 - DEBUG - expected vm list d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:51:49,692 - DEBUG - Extracted vm list ['d749a7b4-d046-468d-95f3-a1937a699e0c'] 2026-08-17 04:51:49,692 - INFO - VM d749a7b4-d046-468d-95f3-a1937a699e0c is present in default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 2026-08-17 04:51:49,692 - DEBUG - Verifying vm in vrouter uve 2026-08-17 04:51:49,692 - DEBUG - Getting info from collector 10.0.0.38.. 2026-08-17 04:51:49,692 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c?flat 2026-08-17 04:51:49,749 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-6167-1'] 2026-08-17 04:51:49,749 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-1:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:51:49,802 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-1?flat 2026-08-17 04:51:49,834 - DEBUG - VM d749a7b4-d046-468d-95f3-a1937a699e0c is present in vrouter an-jenkins-deploy-platform-ansible-os-6167-1 uve 2026-08-17 04:51:49,834 - DEBUG - Validated that VM ctest-vm1-87328390 is in Vrouter an-jenkins-deploy-platform-ansible-os-6167-1 UVE 2026-08-17 04:51:49,834 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-08-17 04:51:49,842 - DEBUG - Expected tap interface of VM uuid d749a7b4-d046-468d-95f3-a1937a699e0c is default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de 2026-08-17 04:51:49,842 - DEBUG - Expected VN of VM uuid d749a7b4-d046-468d-95f3-a1937a699e0c is default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 2026-08-17 04:51:49,842 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-1:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:51:49,890 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-1?flat 2026-08-17 04:51:49,924 - DEBUG - VM d749a7b4-d046-468d-95f3-a1937a699e0c is present in vrouter an-jenkins-deploy-platform-ansible-os-6167-1 uve 2026-08-17 04:51:49,924 - INFO - tap interface default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de of vm d749a7b4-d046-468d-95f3-a1937a699e0c is present in vrouter an-jenkins-deploy-platform-ansible-os-6167-1 uve 2026-08-17 04:51:49,925 - DEBUG - Connected network default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 of vm d749a7b4-d046-468d-95f3-a1937a699e0c is present in vrouter an-jenkins-deploy-platform-ansible-os-6167-1 uve 2026-08-17 04:51:49,925 - DEBUG - Verifying the d749a7b4-d046-468d-95f3-a1937a699e0c virtual network link through opserver 10.0.0.177 2026-08-17 04:51:49,925 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-machines 2026-08-17 04:51:49,938 - DEBUG - VM link and name as {'name': 'd749a7b4-d046-468d-95f3-a1937a699e0c', 'href': 'http://10.0.0.177:8081/analytics/uves/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c?flat'} 2026-08-17 04:51:49,938 - DEBUG - Verifying the d749a7b4-d046-468d-95f3-a1937a699e0c virtual network link through opserver 10.0.0.190 2026-08-17 04:51:49,939 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machines 2026-08-17 04:51:50,302 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machines 2026-08-17 04:51:50,358 - DEBUG - VM link and name as {'name': 'd749a7b4-d046-468d-95f3-a1937a699e0c', 'href': 'http://10.0.0.190:8081/analytics/uves/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c?flat'} 2026-08-17 04:51:50,358 - DEBUG - Verifying the d749a7b4-d046-468d-95f3-a1937a699e0c virtual network link through opserver 10.0.0.38 2026-08-17 04:51:50,358 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2026-08-17 04:51:50,372 - DEBUG - VM link and name as {'name': 'd749a7b4-d046-468d-95f3-a1937a699e0c', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c?flat'} 2026-08-17 04:51:50,372 - INFO - VM ctest-vm1-87328390 validations in Opserver passed 2026-08-17 04:51:50,476 - DEBUG - VM is in ACTIVE state now 2026-08-17 04:51:50,476 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-08-17 04:51:50,476 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c 2026-08-17 04:51:50,485 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/d626eb69-5b62-406a-916f-fab26222020f 2026-08-17 04:51:50,496 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c 2026-08-17 04:51:50,506 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/d626eb69-5b62-406a-916f-fab26222020f 2026-08-17 04:51:50,518 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/e2952161-b5a1-4f8d-a15a-797bac07efc1 2026-08-17 04:51:50,542 - DEBUG - Verifying in api server 10.0.0.38 2026-08-17 04:51:50,542 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c 2026-08-17 04:51:50,550 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/d626eb69-5b62-406a-916f-fab26222020f 2026-08-17 04:51:50,561 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/e2952161-b5a1-4f8d-a15a-797bac07efc1 2026-08-17 04:51:50,571 - INFO - VM ctest-vm2-51671122 verfication in all API Servers passed 2026-08-17 04:51:50,590 - DEBUG - VM ctest-vm2-51671122 Tap interface: {'index': '3', 'name': 'tapd626eb69-5b', 'uuid': 'd626eb69-5b62-406a-916f-fab26222020f', 'vrf_name': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520:ctest-vn-77719520', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520', 'vm_uuid': '36188c05-85c4-46fb-817b-5eddf68ac31c', 'vm_name': 'ctest-vm2-51671122', 'ip_addr': '5.71.168.3', 'mac_addr': '02:d6:26:eb:69:5b', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '110', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-00253436:d626eb69-5b62-406a-916f-fab26222020f', 'sg_uuid_list': ['c76b6989-5c26-47d5-ab5c-6382ba3f0a6d'], 'static_route_list': None, 'vm_project_uuid': '29c6a20a-8968-46dc-a0fc-797dcbf3d005', 'admin_state': 'Enabled', 'flow_key_idx': '24', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-08-17 04:51:50,590 - DEBUG - Agent 10.0.0.186 vrf name: default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520:ctest-vn-77719520 2026-08-17 04:51:50,596 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520:ctest-vn-77719520', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520', 'table_label': '-1', 'vxlan_id': '7', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.193:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-08-17 04:51:50,678 - DEBUG - VM ctest-vm2-51671122 : Tap interface tapd626eb69-5b is set to Active 2026-08-17 04:51:50,679 - DEBUG - Tap interface tapd626eb69-5b detail : {'index': '3', 'name': 'tapd626eb69-5b', 'uuid': 'd626eb69-5b62-406a-916f-fab26222020f', 'vrf_name': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520:ctest-vn-77719520', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520', 'vm_uuid': '36188c05-85c4-46fb-817b-5eddf68ac31c', 'vm_name': 'ctest-vm2-51671122', 'ip_addr': '5.71.168.3', 'mac_addr': '02:d6:26:eb:69:5b', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '110', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-00253436:d626eb69-5b62-406a-916f-fab26222020f', 'sg_uuid_list': ['c76b6989-5c26-47d5-ab5c-6382ba3f0a6d'], 'static_route_list': None, 'vm_project_uuid': '29c6a20a-8968-46dc-a0fc-797dcbf3d005', 'admin_state': 'Enabled', 'flow_key_idx': '24', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-08-17 04:51:50,793 - DEBUG - Starting Layer 2 verification in Agent 2026-08-17 04:51:50,806 - DEBUG - Layer 2 path is seen for VM MAC 02:d6:26:eb:69:5b in agent 10.0.0.186 2026-08-17 04:51:50,806 - DEBUG - Active layer 2 route in agent is present for VMI tapd626eb69-5b 2026-08-17 04:51:50,806 - DEBUG - L2 label(29) matches bw route table and interface table 2026-08-17 04:51:50,818 - DEBUG - VN default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520 is found in Agent of node 10.0.0.186 2026-08-17 04:51:50,955 - DEBUG - VRF IDs of VN default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520 is consistent in agent 10.0.0.186 2026-08-17 04:51:50,955 - DEBUG - Route for VM IP ['5.71.168.3'] is consistent in agent 10.0.0.186 2026-08-17 04:51:50,955 - DEBUG - VN default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520 verification for VM ctest-vm2-51671122 in Agent 10.0.0.186 passed 2026-08-17 04:51:51,069 - DEBUG - Starting all layer 2 verification in agent 10.0.0.186 2026-08-17 04:51:51,080 - DEBUG - Route for VM MAC 02:d6:26:eb:69:5b is consistent in agent 10.0.0.186 2026-08-17 04:51:51,081 - INFO - VM ctest-vm2-51671122 verifications in Compute nodes passed 2026-08-17 04:51:51,335 - DEBUG - Validated VM route 5.71.168.3 in vrouter of 10.0.0.186 2026-08-17 04:51:51,341 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-08-17 04:51:51,341 - INFO - Validated routes of VM ctest-vm2-51671122 in all vrouters 2026-08-17 04:51:51,848 - DEBUG - Starting all layer2 verification in 10.0.0.190 Control Node 2026-08-17 04:51:51,981 - DEBUG - Layer2 route found for VM MAC 02:d6:26:eb:69:5b in Control-node 10.0.0.190 2026-08-17 04:51:51,981 - DEBUG - L2 Label for VM ctest-vm2-51671122 same between Control-node 10.0.0.190 and Agent, Expected: 29, Seen: 29 2026-08-17 04:51:51,981 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2026-08-17 04:51:52,109 - DEBUG - Layer2 route found for VM MAC 02:d6:26:eb:69:5b in Control-node 10.0.0.38 2026-08-17 04:51:52,109 - DEBUG - L2 Label for VM ctest-vm2-51671122 same between Control-node 10.0.0.38 and Agent, Expected: 29, Seen: 29 2026-08-17 04:51:52,109 - INFO - Verification in Control-nodes for VM ctest-vm2-51671122 passed 2026-08-17 04:51:52,109 - DEBUG - Verifying the vm in opserver 2026-08-17 04:51:52,109 - DEBUG - Verifying in collector 10.0.0.38 ... 2026-08-17 04:51:52,109 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c?flat 2026-08-17 04:51:52,126 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-00253436:d626eb69-5b62-406a-916f-fab26222020f?flat 2026-08-17 04:51:52,148 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-00253436:d626eb69-5b62-406a-916f-fab26222020f?flat 2026-08-17 04:51:52,169 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c?flat 2026-08-17 04:51:52,185 - DEBUG - Verifying vm in vn uve 2026-08-17 04:51:52,185 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-00253436:d626eb69-5b62-406a-916f-fab26222020f?flat 2026-08-17 04:51:52,208 - DEBUG - VM uve shows interface as {'l2_active': True, 'ip6_address': '::', 'gateway': '5.71.168.1', 'port_mirror_enabled': False, '__T': 1786942299664284, 'ip6_active': False, 'mac_address': '02:d6:26:eb:69:5b', 'is_health_check_active': True, 'admin_state': True, 'label': 25, 'tx_vlan': 65535, 'ip_address': '5.71.168.3', 'active': True, 'vm_uuid': '36188c05-85c4-46fb-817b-5eddf68ac31c', 'ip4_active': True, 'vhostuser_mode': 0, 'rx_vlan': 65535, 'uuid': 'd626eb69-5b62-406a-916f-fab26222020f', 'fixed_ip4_list': ['5.71.168.3'], 'vn_uuid': '01b287a6-7fd7-4d70-8579-a2c49ca8eaea', 'vm_name': 'ctest-vm2-51671122', 'virtual_network': 'default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520'} 2026-08-17 04:51:52,208 - DEBUG - VM uve shows ip address as ['5.71.168.3', '::'] 2026-08-17 04:51:52,208 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520 2026-08-17 04:51:52,208 - INFO - Verifying through opserver in 10.0.0.177 2026-08-17 04:51:52,209 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520?flat 2026-08-17 04:51:52,231 - DEBUG - expected vm list 36188c05-85c4-46fb-817b-5eddf68ac31c 2026-08-17 04:51:52,231 - DEBUG - Extracted vm list ['36188c05-85c4-46fb-817b-5eddf68ac31c'] 2026-08-17 04:51:52,231 - INFO - VM 36188c05-85c4-46fb-817b-5eddf68ac31c is present in default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520 2026-08-17 04:51:52,231 - DEBUG - Verifying vm in vrouter uve 2026-08-17 04:51:52,231 - DEBUG - Getting info from collector 10.0.0.38.. 2026-08-17 04:51:52,231 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c?flat 2026-08-17 04:51:52,247 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-6167-2'] 2026-08-17 04:51:52,247 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-2:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:51:52,299 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-2?flat 2026-08-17 04:51:52,336 - DEBUG - VM 36188c05-85c4-46fb-817b-5eddf68ac31c is present in vrouter an-jenkins-deploy-platform-ansible-os-6167-2 uve 2026-08-17 04:51:52,337 - DEBUG - Validated that VM ctest-vm2-51671122 is in Vrouter an-jenkins-deploy-platform-ansible-os-6167-2 UVE 2026-08-17 04:51:52,337 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-08-17 04:51:52,347 - DEBUG - Expected tap interface of VM uuid 36188c05-85c4-46fb-817b-5eddf68ac31c is default-domain:ctest-TestDropStats-00253436:d626eb69-5b62-406a-916f-fab26222020f 2026-08-17 04:51:52,347 - DEBUG - Expected VN of VM uuid 36188c05-85c4-46fb-817b-5eddf68ac31c is default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520 2026-08-17 04:51:52,347 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-2:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:51:52,401 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-2?flat 2026-08-17 04:51:52,435 - DEBUG - VM 36188c05-85c4-46fb-817b-5eddf68ac31c is present in vrouter an-jenkins-deploy-platform-ansible-os-6167-2 uve 2026-08-17 04:51:52,435 - INFO - tap interface default-domain:ctest-TestDropStats-00253436:d626eb69-5b62-406a-916f-fab26222020f of vm 36188c05-85c4-46fb-817b-5eddf68ac31c is present in vrouter an-jenkins-deploy-platform-ansible-os-6167-2 uve 2026-08-17 04:51:52,435 - DEBUG - Connected network default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520 of vm 36188c05-85c4-46fb-817b-5eddf68ac31c is present in vrouter an-jenkins-deploy-platform-ansible-os-6167-2 uve 2026-08-17 04:51:52,435 - DEBUG - Verifying the 36188c05-85c4-46fb-817b-5eddf68ac31c virtual network link through opserver 10.0.0.177 2026-08-17 04:51:52,435 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-machines 2026-08-17 04:51:52,448 - DEBUG - VM link and name as {'name': '36188c05-85c4-46fb-817b-5eddf68ac31c', 'href': 'http://10.0.0.177:8081/analytics/uves/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c?flat'} 2026-08-17 04:51:52,448 - DEBUG - Verifying the 36188c05-85c4-46fb-817b-5eddf68ac31c virtual network link through opserver 10.0.0.190 2026-08-17 04:51:52,448 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machines 2026-08-17 04:51:52,500 - DEBUG - VM link and name as {'name': '36188c05-85c4-46fb-817b-5eddf68ac31c', 'href': 'http://10.0.0.190:8081/analytics/uves/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c?flat'} 2026-08-17 04:51:52,500 - DEBUG - Verifying the 36188c05-85c4-46fb-817b-5eddf68ac31c virtual network link through opserver 10.0.0.38 2026-08-17 04:51:52,500 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2026-08-17 04:51:52,513 - DEBUG - VM link and name as {'name': '36188c05-85c4-46fb-817b-5eddf68ac31c', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c?flat'} 2026-08-17 04:51:52,513 - INFO - VM ctest-vm2-51671122 validations in Opserver passed 2026-08-17 04:51:52,541 - INFO - Deleting VM ctest-vm2-51671122 2026-08-17 04:51:52,620 - DEBUG - Verifying in api server 10.0.0.38 2026-08-17 04:51:52,620 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c 2026-08-17 04:51:52,630 - DEBUG - VM ID 36188c05-85c4-46fb-817b-5eddf68ac31c of VM ctest-vm2-51671122 is still found in API Server 2026-08-17 04:51:54,631 - DEBUG - Verifying in api server 10.0.0.38 2026-08-17 04:51:54,631 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c 2026-08-17 04:51:54,641 - DEBUG - VM ID 36188c05-85c4-46fb-817b-5eddf68ac31c of VM ctest-vm2-51671122 is still found in API Server 2026-08-17 04:51:56,642 - DEBUG - Verifying in api server 10.0.0.38 2026-08-17 04:51:56,642 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c 2026-08-17 04:51:56,650 - DEBUG - Response Code: 404 2026-08-17 04:51:56,650 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c 2026-08-17 04:51:56,656 - DEBUG - Response Code: 404 2026-08-17 04:51:56,657 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/36188c05-85c4-46fb-817b-5eddf68ac31c 2026-08-17 04:51:56,662 - DEBUG - Response Code: 404 2026-08-17 04:51:56,662 - INFO - VM ctest-vm2-51671122 is fully removed in API-Server 2026-08-17 04:51:56,831 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-08-17 04:51:56,873 - DEBUG - Validated that vrouter 10.0.0.50 does not have VMs route for VN default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520 2026-08-17 04:51:56,886 - DEBUG - Validated that vrouter 10.0.0.186 does not have VMs route for VN default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520 2026-08-17 04:51:56,886 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520 2026-08-17 04:51:56,886 - INFO - VM ctest-vm2-51671122 is removed in Compute, and routes are removed in all compute nodes 2026-08-17 04:51:57,125 - INFO - Routes for VM ctest-vm2-51671122 is removed in all control-nodes 2026-08-17 04:51:57,125 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-2:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:51:57,178 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-2?flat 2026-08-17 04:51:57,214 - DEBUG - VM 36188c05-85c4-46fb-817b-5eddf68ac31c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6167-2 uve 2026-08-17 04:51:57,214 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:51:57,215 - DEBUG - interface for vm 36188c05-85c4-46fb-817b-5eddf68ac31c deleted from vrouter uve ... 2026-08-17 04:51:57,215 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:00,216 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-2:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:52:00,274 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-2?flat 2026-08-17 04:52:00,310 - DEBUG - VM 36188c05-85c4-46fb-817b-5eddf68ac31c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6167-2 uve 2026-08-17 04:52:00,310 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:52:00,310 - DEBUG - interface for vm 36188c05-85c4-46fb-817b-5eddf68ac31c deleted from vrouter uve ... 2026-08-17 04:52:00,310 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:03,311 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-2:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:52:03,370 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-2?flat 2026-08-17 04:52:03,406 - DEBUG - VM 36188c05-85c4-46fb-817b-5eddf68ac31c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6167-2 uve 2026-08-17 04:52:03,406 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:52:03,406 - DEBUG - interface for vm 36188c05-85c4-46fb-817b-5eddf68ac31c deleted from vrouter uve ... 2026-08-17 04:52:03,407 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:06,407 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-2:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:52:06,462 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-2?flat 2026-08-17 04:52:06,498 - DEBUG - VM 36188c05-85c4-46fb-817b-5eddf68ac31c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6167-2 uve 2026-08-17 04:52:06,499 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:52:06,499 - DEBUG - interface for vm 36188c05-85c4-46fb-817b-5eddf68ac31c deleted from vrouter uve ... 2026-08-17 04:52:06,499 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:09,500 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-2:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:52:09,564 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-2?flat 2026-08-17 04:52:09,599 - DEBUG - VM 36188c05-85c4-46fb-817b-5eddf68ac31c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6167-2 uve 2026-08-17 04:52:09,599 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:52:09,599 - DEBUG - interface for vm 36188c05-85c4-46fb-817b-5eddf68ac31c deleted from vrouter uve ... 2026-08-17 04:52:09,599 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:12,600 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-2:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:52:12,662 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-2?flat 2026-08-17 04:52:12,707 - DEBUG - VM 36188c05-85c4-46fb-817b-5eddf68ac31c is not present in vrouter an-jenkins-deploy-platform-ansible-os-6167-2 uve 2026-08-17 04:52:12,707 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:52:12,707 - DEBUG - interface for vm 36188c05-85c4-46fb-817b-5eddf68ac31c deleted from vrouter uve ... 2026-08-17 04:52:12,707 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:12,707 - DEBUG - Validated that VM 36188c05-85c4-46fb-817b-5eddf68ac31c is removed in Vrouter UVE 2026-08-17 04:52:12,707 - DEBUG - Verifying through opserver in 10.0.0.177 2026-08-17 04:52:12,707 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520?flat 2026-08-17 04:52:12,733 - DEBUG - 36188c05-85c4-46fb-817b-5eddf68ac31c BM not in default-domain:ctest-TestDropStats-00253436:ctest-vn-77719520 uve 2026-08-17 04:52:12,733 - DEBUG - Validated that VM 36188c05-85c4-46fb-817b-5eddf68ac31c is not present in the VN UVE 2026-08-17 04:52:12,733 - DEBUG - Verifying the 36188c05-85c4-46fb-817b-5eddf68ac31c virtual network link through opserver 10.0.0.177 2026-08-17 04:52:12,733 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-machines 2026-08-17 04:52:12,748 - INFO - 36188c05-85c4-46fb-817b-5eddf68ac31c vm uve deleted from opserver 2026-08-17 04:52:12,748 - DEBUG - Verifying the 36188c05-85c4-46fb-817b-5eddf68ac31c virtual network link through opserver 10.0.0.190 2026-08-17 04:52:12,748 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machines 2026-08-17 04:52:12,762 - INFO - 36188c05-85c4-46fb-817b-5eddf68ac31c vm uve deleted from opserver 2026-08-17 04:52:12,762 - DEBUG - Verifying the 36188c05-85c4-46fb-817b-5eddf68ac31c virtual network link through opserver 10.0.0.38 2026-08-17 04:52:12,762 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2026-08-17 04:52:12,775 - INFO - 36188c05-85c4-46fb-817b-5eddf68ac31c vm uve deleted from opserver 2026-08-17 04:52:12,775 - INFO - Validated that VM 36188c05-85c4-46fb-817b-5eddf68ac31c is removed from Opserver 2026-08-17 04:52:12,775 - INFO - Deleting VM ctest-vm1-87328390 2026-08-17 04:52:12,859 - DEBUG - Verifying in api server 10.0.0.38 2026-08-17 04:52:12,859 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:52:12,869 - DEBUG - VM ID d749a7b4-d046-468d-95f3-a1937a699e0c of VM ctest-vm1-87328390 is still found in API Server 2026-08-17 04:52:14,869 - DEBUG - Verifying in api server 10.0.0.38 2026-08-17 04:52:14,870 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:52:14,880 - DEBUG - VM ID d749a7b4-d046-468d-95f3-a1937a699e0c of VM ctest-vm1-87328390 is still found in API Server 2026-08-17 04:52:16,881 - DEBUG - Verifying in api server 10.0.0.38 2026-08-17 04:52:16,881 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:52:16,889 - DEBUG - Response Code: 404 2026-08-17 04:52:16,889 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:52:16,895 - DEBUG - Response Code: 404 2026-08-17 04:52:16,895 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:52:16,903 - DEBUG - Response Code: 404 2026-08-17 04:52:16,903 - INFO - VM ctest-vm1-87328390 is fully removed in API-Server 2026-08-17 04:52:17,061 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-08-17 04:52:17,105 - DEBUG - Validated that vrouter 10.0.0.50 does not have VMs route for VN default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 2026-08-17 04:52:17,125 - DEBUG - Validated that vrouter 10.0.0.186 does not have VMs route for VN default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 2026-08-17 04:52:17,125 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 2026-08-17 04:52:17,125 - INFO - VM ctest-vm1-87328390 is removed in Compute, and routes are removed in all compute nodes 2026-08-17 04:52:17,356 - INFO - Routes for VM ctest-vm1-87328390 is removed in all control-nodes 2026-08-17 04:52:17,356 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-1:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:52:17,404 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-1?flat 2026-08-17 04:52:17,434 - DEBUG - VM d749a7b4-d046-468d-95f3-a1937a699e0c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6167-1 uve 2026-08-17 04:52:17,434 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:52:17,434 - DEBUG - interface for vm d749a7b4-d046-468d-95f3-a1937a699e0c deleted from vrouter uve ... 2026-08-17 04:52:17,434 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:20,435 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-1:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:52:20,482 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-1?flat 2026-08-17 04:52:20,514 - DEBUG - VM d749a7b4-d046-468d-95f3-a1937a699e0c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6167-1 uve 2026-08-17 04:52:20,514 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:52:20,514 - DEBUG - interface for vm d749a7b4-d046-468d-95f3-a1937a699e0c deleted from vrouter uve ... 2026-08-17 04:52:20,514 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:23,515 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-1:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:52:23,563 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-1?flat 2026-08-17 04:52:23,594 - DEBUG - VM d749a7b4-d046-468d-95f3-a1937a699e0c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6167-1 uve 2026-08-17 04:52:23,594 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:52:23,594 - DEBUG - interface for vm d749a7b4-d046-468d-95f3-a1937a699e0c deleted from vrouter uve ... 2026-08-17 04:52:23,594 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:26,595 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-1:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:52:26,653 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-1?flat 2026-08-17 04:52:26,688 - DEBUG - VM d749a7b4-d046-468d-95f3-a1937a699e0c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6167-1 uve 2026-08-17 04:52:26,688 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:52:26,688 - DEBUG - interface for vm d749a7b4-d046-468d-95f3-a1937a699e0c deleted from vrouter uve ... 2026-08-17 04:52:26,688 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:29,689 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-1:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:52:29,739 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-1?flat 2026-08-17 04:52:29,769 - DEBUG - VM d749a7b4-d046-468d-95f3-a1937a699e0c is still present in vrouter an-jenkins-deploy-platform-ansible-os-6167-1 uve 2026-08-17 04:52:29,769 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:52:29,770 - DEBUG - interface for vm d749a7b4-d046-468d-95f3-a1937a699e0c deleted from vrouter uve ... 2026-08-17 04:52:29,770 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:32,771 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6167-1:Compute:contrail-vrouter-agent:0?flat 2026-08-17 04:52:32,821 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6167-1?flat 2026-08-17 04:52:32,852 - DEBUG - VM d749a7b4-d046-468d-95f3-a1937a699e0c is not present in vrouter an-jenkins-deploy-platform-ansible-os-6167-1 uve 2026-08-17 04:52:32,852 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-17 04:52:32,852 - DEBUG - interface for vm d749a7b4-d046-468d-95f3-a1937a699e0c deleted from vrouter uve ... 2026-08-17 04:52:32,852 - DEBUG - Deleted interface not in error interface list ... 2026-08-17 04:52:32,852 - DEBUG - Validated that VM d749a7b4-d046-468d-95f3-a1937a699e0c is removed in Vrouter UVE 2026-08-17 04:52:32,852 - DEBUG - Verifying through opserver in 10.0.0.177 2026-08-17 04:52:32,852 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432?flat 2026-08-17 04:52:32,871 - DEBUG - d749a7b4-d046-468d-95f3-a1937a699e0c BM not in default-domain:ctest-TestDropStats-00253436:ctest-vn-15983432 uve 2026-08-17 04:52:32,871 - DEBUG - Validated that VM d749a7b4-d046-468d-95f3-a1937a699e0c is not present in the VN UVE 2026-08-17 04:52:32,871 - DEBUG - Verifying the d749a7b4-d046-468d-95f3-a1937a699e0c virtual network link through opserver 10.0.0.177 2026-08-17 04:52:32,871 - DEBUG - Requesting: http://10.0.0.177:8081/analytics/uves/virtual-machines 2026-08-17 04:52:32,886 - DEBUG - No links retuned for d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:52:32,886 - INFO - d749a7b4-d046-468d-95f3-a1937a699e0c vm uve deleted from opserver 2026-08-17 04:52:32,886 - DEBUG - Verifying the d749a7b4-d046-468d-95f3-a1937a699e0c virtual network link through opserver 10.0.0.190 2026-08-17 04:52:32,886 - DEBUG - Requesting: http://10.0.0.190:8081/analytics/uves/virtual-machines 2026-08-17 04:52:32,902 - DEBUG - No links retuned for d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:52:32,902 - INFO - d749a7b4-d046-468d-95f3-a1937a699e0c vm uve deleted from opserver 2026-08-17 04:52:32,902 - DEBUG - Verifying the d749a7b4-d046-468d-95f3-a1937a699e0c virtual network link through opserver 10.0.0.38 2026-08-17 04:52:32,902 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2026-08-17 04:52:32,916 - DEBUG - No links retuned for d749a7b4-d046-468d-95f3-a1937a699e0c 2026-08-17 04:52:32,916 - INFO - d749a7b4-d046-468d-95f3-a1937a699e0c vm uve deleted from opserver 2026-08-17 04:52:32,916 - INFO - Validated that VM d749a7b4-d046-468d-95f3-a1937a699e0c is removed from Opserver 2026-08-17 04:52:32,916 - INFO - Deleting VN ctest-vn-77719520 2026-08-17 04:52:33,142 - DEBUG - Response for deleting network () 2026-08-17 04:52:33,142 - INFO - Deleting VN ctest-vn-15983432 2026-08-17 04:52:33,325 - DEBUG - Response for deleting network () 2026-08-17 04:52:34,609 - ERROR - IndexError Python 3.9.25: /usr/bin/python3 Mon Aug 17 04:51:52 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vrouter/test_drop_stats.py in test_flow_action_drop_stats(self=) 36 raise self.skipTest("Skipping test case,this test needs atleast 2 compute nodes") 37 38 assert self.verify_flow_action_drop_stats() 39 return True 40 # end test_drop_stats self = self.verify_flow_action_drop_stats = > /contrail-test/common/vrouter/base_drop_stats.py in verify_flow_action_drop_stats(self=, drop_type='ds_flow_action_drop') 51 fq_name = intf_details[0]['config_name'] 52 53 vif_dict_before = self.get_drop_stats_dict(compute0, fq_name)[1] 54 self.print_drop_stats_dict(vif_dict_before) 55 vif_dict_before undefined self = self.get_drop_stats_dict = .deco_retry....on_drop_stats[dev_reg,sanity] id=0x7f34255025b0>> compute0 = '10.0.0.50' fq_name = 'default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de' /contrail-test/tcutils/util.py in f_retry(*args=(, '10.0.0.50', 'default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de'), **kwargs={}) 82 mtries, mdelay = tries, delay # make mutable 83 84 result = f(*args, **kwargs) # first attempt 85 rv = result 86 final = False result undefined f = args = (, '10.0.0.50', 'default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de') kwargs = {} /contrail-test/common/vrouter/base_drop_stats.py in get_drop_stats_dict(self=, compute='10.0.0.50', fq_name='default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de', module='vif') 29 drop_stats_list = self.agent_inspect_h[compute].get_agent_vrouter_drop_stats() 30 else: 31 drop_stats_list = self.agent_inspect_h[compute].get_agent_vm_interface_drop_stats(fq_name) 32 33 if drop_stats_list is not None: drop_stats_list undefined self = self.agent_inspect_h = {} compute = '10.0.0.50' ].get_agent_vm_interface_drop_stats undefined fq_name = 'default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de' /contrail-test/tcutils/agent/vna_introspect_utils.py in get_agent_vm_interface_drop_stats(self=, fq_name='default-domain:ctest-TestDropStats-00253436:f4e3536b-7583-48bd-91e5-b63a1364f6de') 1039 except IndexError: 1040 return None 1041 return l[0] 1042 # end get_agent_vm_interface_drop_stats 1043 l = [] IndexError: list index out of range __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Sequence index out of range.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('list index out of range',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vrouter/test_drop_stats.py", line 38, in test_flow_action_drop_stats assert self.verify_flow_action_drop_stats() File "/contrail-test/common/vrouter/base_drop_stats.py", line 53, in verify_flow_action_drop_stats vif_dict_before = self.get_drop_stats_dict(compute0, fq_name)[1] File "/contrail-test/tcutils/util.py", line 84, in f_retry result = f(*args, **kwargs) # first attempt File "/contrail-test/common/vrouter/base_drop_stats.py", line 31, in get_drop_stats_dict drop_stats_list = self.agent_inspect_h[compute].get_agent_vm_interface_drop_stats(fq_name) File "/contrail-test/tcutils/agent/vna_introspect_utils.py", line 1041, in get_agent_vm_interface_drop_stats return l[0] IndexError: list index out of range 2026-08-17 04:52:34,610 - DEBUG - Skipping xmpp flap check 2026-08-17 04:52:34,610 - INFO -
2026-08-17 04:52:34,611 - INFO - END TEST : test_flow_action_drop_stats : FAILED[0:01:26]
2026-08-17 04:52:34,611 - INFO - -------------------------------------------------------------------------------- 2026-08-17 04:52:35,504 - INFO - Deleted project: ctest-TestDropStats-00253436, ID : 29c6a20a-8968-46dc-a0fc-797dcbf3d005