2026-04-23 04:43:15,055 - INFO - Domain Default found not creating 2026-04-23 04:43:15,222 - INFO - Project ctest-TestDropStats-22452019 not found, creating it 2026-04-23 04:43:15,792 - INFO - Created Project:ctest-TestDropStats-22452019, ID : 44adc184-7962-4271-8bfa-821b9084d1f8 2026-04-23 04:43:17,317 - INFO - ================================================================================ 2026-04-23 04:43:17,317 - INFO - STARTING TEST : test_flow_action_drop_stats 2026-04-23 04:43:17,317 - INFO - TEST DESCRIPTION : Description: Verify flow action drop stats Steps: 1. Create 2 VNs and launch 1 VM in each VN, on different nodes on multi node setup 2. Add policy to deny pkts between VNs. 3. Ping VM2 from VM1 Pass criteria: 1. Verify flow action count gets incremented, get it from introspect 2. Verify flow action count gets incremented for the vmi of VM1, get it from introspect 2026-04-23 04:43:18,608 - DEBUG - Skipping xmpp flap check 2026-04-23 04:43:18,608 - INFO - Initial checks done. Running the testcase now 2026-04-23 04:43:18,608 - INFO - 2026-04-23 04:43:18,636 - DEBUG - Services list from nova: [, , , ] 2026-04-23 04:43:18,636 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5672-2', 'an-jenkins-deploy-platform-ansible-os-5672-1']} 2026-04-23 04:43:19,340 - DEBUG - Response for create_network : {'network': {'id': '86998074-5267-4ff4-978b-80d49ecbc0dc', 'name': 'ctest-vn-39188504', 'tenant_id': '44adc184796242718bfa821b9084d1f8', 'project_id': '44adc184796242718bfa821b9084d1f8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDropStats-22452019', 'ctest-vn-39188504'], 'port_security_enabled': True, 'description': ''}} 2026-04-23 04:43:19,630 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ab657d7b-cb76-4b37-a989-90f8a6ae7f42', 'name': '', 'tenant_id': '44adc184796242718bfa821b9084d1f8', 'network_id': '86998074-5267-4ff4-978b-80d49ecbc0dc', 'ip_version': 4, 'cidr': '46.44.24.64/26', 'allocation_pools': [{'start': '46.44.24.66', 'end': '46.44.24.126'}], 'gateway_ip': '46.44.24.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '46.44.24.66', 'tags': [], 'project_id': '44adc184796242718bfa821b9084d1f8'}} 2026-04-23 04:43:19,654 - INFO - Created VN ctest-vn-39188504 2026-04-23 04:43:19,668 - DEBUG - VN ctest-vn-39188504 UUID is 86998074-5267-4ff4-978b-80d49ecbc0dc 2026-04-23 04:43:20,114 - DEBUG - Response for create_network : {'network': {'id': 'b446f0c4-b147-48b9-a35a-f25aec24b2ff', 'name': 'ctest-vn-17115358', 'tenant_id': '44adc184796242718bfa821b9084d1f8', 'project_id': '44adc184796242718bfa821b9084d1f8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDropStats-22452019', 'ctest-vn-17115358'], 'port_security_enabled': True, 'description': ''}} 2026-04-23 04:43:20,449 - DEBUG - Response for create_subnet : {'subnet': {'id': '99150647-feb1-4cf7-a5d2-96e932cc1e41', 'name': '', 'tenant_id': '44adc184796242718bfa821b9084d1f8', 'network_id': 'b446f0c4-b147-48b9-a35a-f25aec24b2ff', 'ip_version': 4, 'cidr': '90.220.157.128/26', 'allocation_pools': [{'start': '90.220.157.130', 'end': '90.220.157.190'}], 'gateway_ip': '90.220.157.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '90.220.157.130', 'tags': [], 'project_id': '44adc184796242718bfa821b9084d1f8'}} 2026-04-23 04:43:20,473 - INFO - Created VN ctest-vn-17115358 2026-04-23 04:43:20,489 - DEBUG - VN ctest-vn-17115358 UUID is b446f0c4-b147-48b9-a35a-f25aec24b2ff 2026-04-23 04:43:21,853 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5672-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5672-1) 2026-04-23 04:43:23,215 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5672-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5672-2) 2026-04-23 04:43:23,215 - INFO - Waiting for VM ctest-vm1-63584133 to be up.. 2026-04-23 04:43:23,315 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-04-23 04:43:28,411 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-04-23 04:43:33,493 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-04-23 04:43:38,576 - DEBUG - VM is in ACTIVE state now 2026-04-23 04:43:38,576 - INFO - VM name : ctest-vm1-63584133 2026-04-23 04:43:38,668 - DEBUG - VM ctest-vm1-63584133 ID is c6ffc76b-d1f3-4c28-9955-a99fc9d09803 2026-04-23 04:43:38,693 - DEBUG - VM ctest-vm1-63584133 launched on Node an-jenkins-deploy-platform-ansible-os-5672-1 2026-04-23 04:43:38,780 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803 2026-04-23 04:43:39,080 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803 2026-04-23 04:43:39,119 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f 2026-04-23 04:43:42,307 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-04-23 04:43:42,307 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-63584133 failed! 2026-04-23 04:43:42,323 - DEBUG - Gateway for vn default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 is 46.44.24.65 and allocation pool is NOT set 2026-04-23 04:43:46,401 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-04-23 04:43:46,401 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-63584133 failed! 2026-04-23 04:43:46,415 - DEBUG - Gateway for vn default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 is 46.44.24.65 and allocation pool is NOT set 2026-04-23 04:43:48,493 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.07 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.435 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.435/2.251/4.067/1.816 ms') 2026-04-23 04:43:48,493 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-63584133 passed 2026-04-23 04:43:48,564 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-23 04:43:48,564 - DEBUG - Waiting to SSH to VM ctest-vm1-63584133, IP 46.44.24.67, Port 22 2026-04-23 04:43:48,633 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-23 04:43:48,733 - DEBUG - VM ctest-vm1-63584133 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-23 04:43:53,733 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-23 04:43:53,733 - DEBUG - Waiting to SSH to VM ctest-vm1-63584133, IP 46.44.24.67, Port 22 2026-04-23 04:43:53,906 - DEBUG - VM ctest-vm1-63584133 is ready for SSH connections 2026-04-23 04:43:53,906 - INFO - Waiting for VM ctest-vm2-04011158 to be up.. 2026-04-23 04:43:53,989 - DEBUG - VM is in ACTIVE state now 2026-04-23 04:43:53,989 - INFO - VM name : ctest-vm2-04011158 2026-04-23 04:43:54,086 - DEBUG - VM ctest-vm2-04011158 ID is c2fd4e2d-c822-49a5-8c9d-085145118c14 2026-04-23 04:43:54,086 - DEBUG - VM ctest-vm2-04011158 launched on Node an-jenkins-deploy-platform-ansible-os-5672-2 2026-04-23 04:43:54,189 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14 2026-04-23 04:43:54,203 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/c80e5428-f869-4680-8015-338078efcf68 2026-04-23 04:43:55,375 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.86 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.526 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.526/1.693/2.861/1.167 ms') 2026-04-23 04:43:55,375 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vm2-04011158 passed 2026-04-23 04:43:55,451 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-23 04:43:55,451 - DEBUG - Waiting to SSH to VM ctest-vm2-04011158, IP 90.220.157.131, Port 22 2026-04-23 04:43:55,620 - DEBUG - VM ctest-vm2-04011158 is ready for SSH connections 2026-04-23 04:43:55,714 - DEBUG - VM is in ACTIVE state now 2026-04-23 04:43:55,714 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-23 04:43:55,714 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803 2026-04-23 04:43:55,723 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f 2026-04-23 04:43:55,735 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803 2026-04-23 04:43:55,743 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f 2026-04-23 04:43:55,755 - DEBUG - Requesting: http://10.0.0.249:8082/instance-ip/90d25d6a-ef03-4a29-93e1-52a79511f7a0 2026-04-23 04:43:55,766 - DEBUG - Verifying in api server 10.0.0.249 2026-04-23 04:43:55,766 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803 2026-04-23 04:43:55,775 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f 2026-04-23 04:43:55,785 - DEBUG - Requesting: http://10.0.0.249:8082/instance-ip/90d25d6a-ef03-4a29-93e1-52a79511f7a0 2026-04-23 04:43:55,793 - INFO - VM ctest-vm1-63584133 verfication in all API Servers passed 2026-04-23 04:43:55,815 - DEBUG - VM ctest-vm1-63584133 Tap interface: {'index': '3', 'name': 'tap8c9befd1-df', 'uuid': '8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f', 'vrf_name': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504:ctest-vn-39188504', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '29', 'l2_label': '36', 'vxlan_id': '5', 'vn_name': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504', 'vm_uuid': 'c6ffc76b-d1f3-4c28-9955-a99fc9d09803', 'vm_name': 'ctest-vm1-63584133', 'ip_addr': '46.44.24.67', 'mac_addr': '02:8c:9b:ef:d1:df', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '128', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f', 'sg_uuid_list': ['780fdb6c-7184-4a46-8445-97a3a621daa6'], 'static_route_list': None, 'vm_project_uuid': '44adc184-7962-4271-8bfa-821b9084d1f8', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-04-23 04:43:55,815 - DEBUG - Agent 10.0.0.73 vrf name: default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504:ctest-vn-39188504 2026-04-23 04:43:55,823 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504:ctest-vn-39188504', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504', 'table_label': '-1', 'vxlan_id': '5', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.18:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-04-23 04:43:55,906 - DEBUG - VM ctest-vm1-63584133 : Tap interface tap8c9befd1-df is set to Active 2026-04-23 04:43:55,906 - DEBUG - Tap interface tap8c9befd1-df detail : {'index': '3', 'name': 'tap8c9befd1-df', 'uuid': '8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f', 'vrf_name': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504:ctest-vn-39188504', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '29', 'l2_label': '36', 'vxlan_id': '5', 'vn_name': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504', 'vm_uuid': 'c6ffc76b-d1f3-4c28-9955-a99fc9d09803', 'vm_name': 'ctest-vm1-63584133', 'ip_addr': '46.44.24.67', 'mac_addr': '02:8c:9b:ef:d1:df', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '128', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f', 'sg_uuid_list': ['780fdb6c-7184-4a46-8445-97a3a621daa6'], 'static_route_list': None, 'vm_project_uuid': '44adc184-7962-4271-8bfa-821b9084d1f8', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-04-23 04:43:56,020 - DEBUG - Starting Layer 2 verification in Agent 2026-04-23 04:43:56,038 - DEBUG - Layer 2 path is seen for VM MAC 02:8c:9b:ef:d1:df in agent 10.0.0.73 2026-04-23 04:43:56,038 - DEBUG - Active layer 2 route in agent is present for VMI tap8c9befd1-df 2026-04-23 04:43:56,038 - DEBUG - L2 label(36) matches bw route table and interface table 2026-04-23 04:43:56,047 - DEBUG - VN default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 is found in Agent of node 10.0.0.73 2026-04-23 04:43:56,188 - DEBUG - VRF IDs of VN default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 is consistent in agent 10.0.0.73 2026-04-23 04:43:56,188 - DEBUG - Route for VM IP ['46.44.24.67'] is consistent in agent 10.0.0.73 2026-04-23 04:43:56,188 - DEBUG - VN default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 verification for VM ctest-vm1-63584133 in Agent 10.0.0.73 passed 2026-04-23 04:43:56,302 - DEBUG - Starting all layer 2 verification in agent 10.0.0.73 2026-04-23 04:43:56,315 - DEBUG - Route for VM MAC 02:8c:9b:ef:d1:df is consistent in agent 10.0.0.73 2026-04-23 04:43:56,321 - INFO - VM ctest-vm1-63584133 verifications in Compute nodes passed 2026-04-23 04:43:56,575 - DEBUG - Validated VM route 46.44.24.67 in vrouter of 10.0.0.73 2026-04-23 04:43:56,580 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-04-23 04:43:56,580 - INFO - Validated routes of VM ctest-vm1-63584133 in all vrouters 2026-04-23 04:43:57,132 - DEBUG - Starting all layer2 verification in 10.0.0.249 Control Node 2026-04-23 04:43:57,265 - DEBUG - Layer2 route found for VM MAC 02:8c:9b:ef:d1:df in Control-node 10.0.0.249 2026-04-23 04:43:57,265 - DEBUG - L2 Label for VM ctest-vm1-63584133 same between Control-node 10.0.0.249 and Agent, Expected: 36, Seen: 36 2026-04-23 04:43:57,265 - DEBUG - Starting all layer2 verification in 10.0.0.23 Control Node 2026-04-23 04:43:57,394 - DEBUG - Layer2 route found for VM MAC 02:8c:9b:ef:d1:df in Control-node 10.0.0.23 2026-04-23 04:43:57,394 - DEBUG - L2 Label for VM ctest-vm1-63584133 same between Control-node 10.0.0.23 and Agent, Expected: 36, Seen: 36 2026-04-23 04:43:57,394 - INFO - Verification in Control-nodes for VM ctest-vm1-63584133 passed 2026-04-23 04:43:57,394 - DEBUG - Verifying the vm in opserver 2026-04-23 04:43:57,394 - DEBUG - Verifying in collector 10.0.0.249 ... 2026-04-23 04:43:57,394 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803?flat 2026-04-23 04:43:57,704 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803?flat 2026-04-23 04:43:57,806 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f?flat 2026-04-23 04:43:58,123 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f?flat 2026-04-23 04:43:58,208 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f?flat 2026-04-23 04:43:58,275 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803?flat 2026-04-23 04:43:58,374 - DEBUG - Verifying vm in vn uve 2026-04-23 04:43:58,374 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f?flat 2026-04-23 04:43:58,461 - DEBUG - VM uve shows interface as {'vn_uuid': '86998074-5267-4ff4-978b-80d49ecbc0dc', 'ip6_address': '::', 'admin_state': True, 'ip_address': '46.44.24.67', 'vhostuser_mode': 0, 'mac_address': '02:8c:9b:ef:d1:df', 'gateway': '46.44.24.65', 'ip4_active': False, 'uuid': '8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f', 'vm_name': 'ctest-vm1-63584133', 'rx_vlan': 65535, 'port_mirror_enabled': False, 'active': False, 'tx_vlan': 65535, 'virtual_network': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504', 'label': 685131509, 'l2_active': False, '__T': 1776919411981983, 'fixed_ip4_list': ['46.44.24.67'], 'ip6_active': False, 'is_health_check_active': True, 'vm_uuid': 'c6ffc76b-d1f3-4c28-9955-a99fc9d09803'} 2026-04-23 04:43:58,461 - DEBUG - VM uve shows ip address as ['46.44.24.67', '::'] 2026-04-23 04:43:58,462 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 2026-04-23 04:43:58,462 - INFO - Verifying through opserver in 10.0.0.23 2026-04-23 04:43:58,462 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504?flat 2026-04-23 04:43:58,490 - DEBUG - expected vm list c6ffc76b-d1f3-4c28-9955-a99fc9d09803 2026-04-23 04:43:58,490 - DEBUG - Extracted vm list ['c6ffc76b-d1f3-4c28-9955-a99fc9d09803'] 2026-04-23 04:43:58,490 - INFO - VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is present in default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 2026-04-23 04:43:58,490 - DEBUG - Verifying vm in vrouter uve 2026-04-23 04:43:58,490 - DEBUG - Getting info from collector 10.0.0.249.. 2026-04-23 04:43:58,490 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803?flat 2026-04-23 04:43:58,602 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-5672-1'] 2026-04-23 04:43:58,602 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-1:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:43:58,648 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-1?flat 2026-04-23 04:43:58,976 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-1?flat 2026-04-23 04:43:59,078 - DEBUG - VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is present in vrouter an-jenkins-deploy-platform-ansible-os-5672-1 uve 2026-04-23 04:43:59,078 - DEBUG - Validated that VM ctest-vm1-63584133 is in Vrouter an-jenkins-deploy-platform-ansible-os-5672-1 UVE 2026-04-23 04:43:59,078 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-04-23 04:43:59,088 - DEBUG - Expected tap interface of VM uuid c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f 2026-04-23 04:43:59,088 - DEBUG - Expected VN of VM uuid c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 2026-04-23 04:43:59,088 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-1:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:43:59,126 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-1?flat 2026-04-23 04:43:59,244 - DEBUG - VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is present in vrouter an-jenkins-deploy-platform-ansible-os-5672-1 uve 2026-04-23 04:43:59,244 - INFO - tap interface default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f of vm c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is present in vrouter an-jenkins-deploy-platform-ansible-os-5672-1 uve 2026-04-23 04:43:59,244 - DEBUG - Connected network default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 of vm c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is present in vrouter an-jenkins-deploy-platform-ansible-os-5672-1 uve 2026-04-23 04:43:59,244 - DEBUG - Verifying the c6ffc76b-d1f3-4c28-9955-a99fc9d09803 virtual network link through opserver 10.0.0.23 2026-04-23 04:43:59,244 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2026-04-23 04:43:59,259 - DEBUG - VM link and name as {'name': 'c6ffc76b-d1f3-4c28-9955-a99fc9d09803', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803?flat'} 2026-04-23 04:43:59,259 - DEBUG - Verifying the c6ffc76b-d1f3-4c28-9955-a99fc9d09803 virtual network link through opserver 10.0.0.130 2026-04-23 04:43:59,259 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-machines 2026-04-23 04:43:59,347 - DEBUG - VM link and name as {'name': 'c6ffc76b-d1f3-4c28-9955-a99fc9d09803', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803?flat'} 2026-04-23 04:43:59,347 - DEBUG - Verifying the c6ffc76b-d1f3-4c28-9955-a99fc9d09803 virtual network link through opserver 10.0.0.249 2026-04-23 04:43:59,347 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2026-04-23 04:43:59,366 - DEBUG - VM link and name as {'name': 'c6ffc76b-d1f3-4c28-9955-a99fc9d09803', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803?flat'} 2026-04-23 04:43:59,366 - INFO - VM ctest-vm1-63584133 validations in Opserver passed 2026-04-23 04:43:59,463 - DEBUG - VM is in ACTIVE state now 2026-04-23 04:43:59,463 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-23 04:43:59,463 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14 2026-04-23 04:43:59,472 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/c80e5428-f869-4680-8015-338078efcf68 2026-04-23 04:43:59,485 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14 2026-04-23 04:43:59,497 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/c80e5428-f869-4680-8015-338078efcf68 2026-04-23 04:43:59,508 - DEBUG - Requesting: http://10.0.0.249:8082/instance-ip/cacc4778-a04b-43e0-bdb6-9984a04ae9ff 2026-04-23 04:43:59,524 - DEBUG - Verifying in api server 10.0.0.249 2026-04-23 04:43:59,524 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14 2026-04-23 04:43:59,533 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/c80e5428-f869-4680-8015-338078efcf68 2026-04-23 04:43:59,549 - DEBUG - Requesting: http://10.0.0.249:8082/instance-ip/cacc4778-a04b-43e0-bdb6-9984a04ae9ff 2026-04-23 04:43:59,559 - INFO - VM ctest-vm2-04011158 verfication in all API Servers passed 2026-04-23 04:43:59,587 - DEBUG - VM ctest-vm2-04011158 Tap interface: {'index': '5', 'name': 'tapc80e5428-f8', 'uuid': 'c80e5428-f869-4680-8015-338078efcf68', 'vrf_name': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358:ctest-vn-17115358', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '41', 'vxlan_id': '6', 'vn_name': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358', 'vm_uuid': 'c2fd4e2d-c822-49a5-8c9d-085145118c14', 'vm_name': 'ctest-vm2-04011158', 'ip_addr': '90.220.157.131', 'mac_addr': '02:c8:0e:54:28:f8', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '170', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-22452019:c80e5428-f869-4680-8015-338078efcf68', 'sg_uuid_list': ['780fdb6c-7184-4a46-8445-97a3a621daa6'], 'static_route_list': None, 'vm_project_uuid': '44adc184-7962-4271-8bfa-821b9084d1f8', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-04-23 04:43:59,587 - DEBUG - Agent 10.0.0.131 vrf name: default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358:ctest-vn-17115358 2026-04-23 04:43:59,598 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358:ctest-vn-17115358', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358', 'table_label': '-1', 'vxlan_id': '6', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.192:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-04-23 04:43:59,679 - DEBUG - VM ctest-vm2-04011158 : Tap interface tapc80e5428-f8 is set to Active 2026-04-23 04:43:59,679 - DEBUG - Tap interface tapc80e5428-f8 detail : {'index': '5', 'name': 'tapc80e5428-f8', 'uuid': 'c80e5428-f869-4680-8015-338078efcf68', 'vrf_name': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358:ctest-vn-17115358', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '41', 'vxlan_id': '6', 'vn_name': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358', 'vm_uuid': 'c2fd4e2d-c822-49a5-8c9d-085145118c14', 'vm_name': 'ctest-vm2-04011158', 'ip_addr': '90.220.157.131', 'mac_addr': '02:c8:0e:54:28:f8', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '170', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-22452019:c80e5428-f869-4680-8015-338078efcf68', 'sg_uuid_list': ['780fdb6c-7184-4a46-8445-97a3a621daa6'], 'static_route_list': None, 'vm_project_uuid': '44adc184-7962-4271-8bfa-821b9084d1f8', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-04-23 04:43:59,795 - DEBUG - Starting Layer 2 verification in Agent 2026-04-23 04:43:59,809 - DEBUG - Layer 2 path is seen for VM MAC 02:c8:0e:54:28:f8 in agent 10.0.0.131 2026-04-23 04:43:59,809 - DEBUG - Active layer 2 route in agent is present for VMI tapc80e5428-f8 2026-04-23 04:43:59,809 - DEBUG - L2 label(41) matches bw route table and interface table 2026-04-23 04:43:59,823 - DEBUG - VN default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358 is found in Agent of node 10.0.0.131 2026-04-23 04:43:59,960 - DEBUG - VRF IDs of VN default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358 is consistent in agent 10.0.0.131 2026-04-23 04:43:59,961 - DEBUG - Route for VM IP ['90.220.157.131'] is consistent in agent 10.0.0.131 2026-04-23 04:43:59,961 - DEBUG - VN default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358 verification for VM ctest-vm2-04011158 in Agent 10.0.0.131 passed 2026-04-23 04:44:00,080 - DEBUG - Starting all layer 2 verification in agent 10.0.0.131 2026-04-23 04:44:00,091 - DEBUG - Route for VM MAC 02:c8:0e:54:28:f8 is consistent in agent 10.0.0.131 2026-04-23 04:44:00,092 - INFO - VM ctest-vm2-04011158 verifications in Compute nodes passed 2026-04-23 04:44:00,353 - DEBUG - Validated VM route 90.220.157.131 in vrouter of 10.0.0.131 2026-04-23 04:44:00,364 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-04-23 04:44:00,364 - INFO - Validated routes of VM ctest-vm2-04011158 in all vrouters 2026-04-23 04:44:00,904 - DEBUG - Starting all layer2 verification in 10.0.0.249 Control Node 2026-04-23 04:44:01,034 - DEBUG - Layer2 route found for VM MAC 02:c8:0e:54:28:f8 in Control-node 10.0.0.249 2026-04-23 04:44:01,034 - DEBUG - L2 Label for VM ctest-vm2-04011158 same between Control-node 10.0.0.249 and Agent, Expected: 41, Seen: 41 2026-04-23 04:44:01,034 - DEBUG - Starting all layer2 verification in 10.0.0.130 Control Node 2026-04-23 04:44:01,166 - DEBUG - Layer2 route found for VM MAC 02:c8:0e:54:28:f8 in Control-node 10.0.0.130 2026-04-23 04:44:01,166 - DEBUG - L2 Label for VM ctest-vm2-04011158 same between Control-node 10.0.0.130 and Agent, Expected: 41, Seen: 41 2026-04-23 04:44:01,166 - INFO - Verification in Control-nodes for VM ctest-vm2-04011158 passed 2026-04-23 04:44:01,166 - DEBUG - Verifying the vm in opserver 2026-04-23 04:44:01,166 - DEBUG - Verifying in collector 10.0.0.249 ... 2026-04-23 04:44:01,166 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14?flat 2026-04-23 04:44:01,185 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-22452019:c80e5428-f869-4680-8015-338078efcf68?flat 2026-04-23 04:44:01,207 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-22452019:c80e5428-f869-4680-8015-338078efcf68?flat 2026-04-23 04:44:01,226 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14?flat 2026-04-23 04:44:01,246 - DEBUG - Verifying vm in vn uve 2026-04-23 04:44:01,247 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-22452019:c80e5428-f869-4680-8015-338078efcf68?flat 2026-04-23 04:44:01,267 - DEBUG - VM uve shows interface as {'port_mirror_enabled': False, 'active': True, 'virtual_network': 'default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358', 'fixed_ip4_list': ['90.220.157.131'], 'l2_active': True, 'ip4_active': True, 'label': 25, 'ip_address': '90.220.157.131', 'ip6_active': False, 'is_health_check_active': True, 'vn_uuid': 'b446f0c4-b147-48b9-a35a-f25aec24b2ff', 'admin_state': True, 'ip6_address': '::', 'uuid': 'c80e5428-f869-4680-8015-338078efcf68', 'tx_vlan': 65535, '__T': 1776919420384494, 'rx_vlan': 65535, 'mac_address': '02:c8:0e:54:28:f8', 'vhostuser_mode': 0, 'gateway': '90.220.157.129', 'vm_uuid': 'c2fd4e2d-c822-49a5-8c9d-085145118c14', 'vm_name': 'ctest-vm2-04011158'} 2026-04-23 04:44:01,267 - DEBUG - VM uve shows ip address as ['90.220.157.131', '::'] 2026-04-23 04:44:01,267 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358 2026-04-23 04:44:01,267 - INFO - Verifying through opserver in 10.0.0.23 2026-04-23 04:44:01,267 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358?flat 2026-04-23 04:44:01,293 - DEBUG - expected vm list c2fd4e2d-c822-49a5-8c9d-085145118c14 2026-04-23 04:44:01,293 - DEBUG - Extracted vm list ['c2fd4e2d-c822-49a5-8c9d-085145118c14'] 2026-04-23 04:44:01,293 - INFO - VM c2fd4e2d-c822-49a5-8c9d-085145118c14 is present in default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358 2026-04-23 04:44:01,293 - DEBUG - Verifying vm in vrouter uve 2026-04-23 04:44:01,293 - DEBUG - Getting info from collector 10.0.0.249.. 2026-04-23 04:44:01,293 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14?flat 2026-04-23 04:44:01,313 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-5672-2'] 2026-04-23 04:44:01,313 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-2:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:01,350 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-2?flat 2026-04-23 04:44:01,386 - DEBUG - VM c2fd4e2d-c822-49a5-8c9d-085145118c14 is present in vrouter an-jenkins-deploy-platform-ansible-os-5672-2 uve 2026-04-23 04:44:01,387 - DEBUG - Validated that VM ctest-vm2-04011158 is in Vrouter an-jenkins-deploy-platform-ansible-os-5672-2 UVE 2026-04-23 04:44:01,387 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-04-23 04:44:01,395 - DEBUG - Expected tap interface of VM uuid c2fd4e2d-c822-49a5-8c9d-085145118c14 is default-domain:ctest-TestDropStats-22452019:c80e5428-f869-4680-8015-338078efcf68 2026-04-23 04:44:01,395 - DEBUG - Expected VN of VM uuid c2fd4e2d-c822-49a5-8c9d-085145118c14 is default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358 2026-04-23 04:44:01,395 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-2:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:01,432 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-2?flat 2026-04-23 04:44:01,467 - DEBUG - VM c2fd4e2d-c822-49a5-8c9d-085145118c14 is present in vrouter an-jenkins-deploy-platform-ansible-os-5672-2 uve 2026-04-23 04:44:01,467 - INFO - tap interface default-domain:ctest-TestDropStats-22452019:c80e5428-f869-4680-8015-338078efcf68 of vm c2fd4e2d-c822-49a5-8c9d-085145118c14 is present in vrouter an-jenkins-deploy-platform-ansible-os-5672-2 uve 2026-04-23 04:44:01,467 - DEBUG - Connected network default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358 of vm c2fd4e2d-c822-49a5-8c9d-085145118c14 is present in vrouter an-jenkins-deploy-platform-ansible-os-5672-2 uve 2026-04-23 04:44:01,468 - DEBUG - Verifying the c2fd4e2d-c822-49a5-8c9d-085145118c14 virtual network link through opserver 10.0.0.23 2026-04-23 04:44:01,468 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2026-04-23 04:44:01,482 - DEBUG - VM link and name as {'name': 'c2fd4e2d-c822-49a5-8c9d-085145118c14', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14?flat'} 2026-04-23 04:44:01,482 - DEBUG - Verifying the c2fd4e2d-c822-49a5-8c9d-085145118c14 virtual network link through opserver 10.0.0.130 2026-04-23 04:44:01,482 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-machines 2026-04-23 04:44:01,497 - DEBUG - VM link and name as {'name': 'c2fd4e2d-c822-49a5-8c9d-085145118c14', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14?flat'} 2026-04-23 04:44:01,497 - DEBUG - Verifying the c2fd4e2d-c822-49a5-8c9d-085145118c14 virtual network link through opserver 10.0.0.249 2026-04-23 04:44:01,497 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2026-04-23 04:44:01,518 - DEBUG - VM link and name as {'name': 'c2fd4e2d-c822-49a5-8c9d-085145118c14', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14?flat'} 2026-04-23 04:44:01,518 - INFO - VM ctest-vm2-04011158 validations in Opserver passed 2026-04-23 04:44:01,557 - INFO - Deleting VM ctest-vm2-04011158 2026-04-23 04:44:01,658 - DEBUG - Verifying in api server 10.0.0.249 2026-04-23 04:44:01,659 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14 2026-04-23 04:44:01,668 - DEBUG - VM ID c2fd4e2d-c822-49a5-8c9d-085145118c14 of VM ctest-vm2-04011158 is still found in API Server 2026-04-23 04:44:03,669 - DEBUG - Verifying in api server 10.0.0.249 2026-04-23 04:44:03,669 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14 2026-04-23 04:44:03,679 - DEBUG - Response Code: 404 2026-04-23 04:44:03,680 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14 2026-04-23 04:44:03,686 - DEBUG - Response Code: 404 2026-04-23 04:44:03,687 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c2fd4e2d-c822-49a5-8c9d-085145118c14 2026-04-23 04:44:03,693 - DEBUG - Response Code: 404 2026-04-23 04:44:03,693 - INFO - VM ctest-vm2-04011158 is fully removed in API-Server 2026-04-23 04:44:03,846 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-04-23 04:44:03,904 - DEBUG - Validated that vrouter 10.0.0.73 does not have VMs route for VN default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358 2026-04-23 04:44:03,919 - DEBUG - Validated that vrouter 10.0.0.131 does not have VMs route for VN default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358 2026-04-23 04:44:03,919 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358 2026-04-23 04:44:03,919 - INFO - VM ctest-vm2-04011158 is removed in Compute, and routes are removed in all compute nodes 2026-04-23 04:44:04,165 - INFO - Routes for VM ctest-vm2-04011158 is removed in all control-nodes 2026-04-23 04:44:04,165 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-2:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:04,199 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-2?flat 2026-04-23 04:44:04,232 - DEBUG - VM c2fd4e2d-c822-49a5-8c9d-085145118c14 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5672-2 uve 2026-04-23 04:44:04,232 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-04-23 04:44:04,233 - DEBUG - interface for vm c2fd4e2d-c822-49a5-8c9d-085145118c14 deleted from vrouter uve ... 2026-04-23 04:44:04,233 - DEBUG - Deleted interface not in error interface list ... 2026-04-23 04:44:07,234 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-2:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:07,275 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-2?flat 2026-04-23 04:44:07,309 - DEBUG - VM c2fd4e2d-c822-49a5-8c9d-085145118c14 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5672-2 uve 2026-04-23 04:44:07,309 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-04-23 04:44:07,309 - DEBUG - interface for vm c2fd4e2d-c822-49a5-8c9d-085145118c14 deleted from vrouter uve ... 2026-04-23 04:44:07,309 - DEBUG - Deleted interface not in error interface list ... 2026-04-23 04:44:10,310 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-2:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:10,355 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-2?flat 2026-04-23 04:44:10,387 - DEBUG - VM c2fd4e2d-c822-49a5-8c9d-085145118c14 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5672-2 uve 2026-04-23 04:44:10,387 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-04-23 04:44:10,387 - DEBUG - interface for vm c2fd4e2d-c822-49a5-8c9d-085145118c14 deleted from vrouter uve ... 2026-04-23 04:44:10,387 - DEBUG - Deleted interface not in error interface list ... 2026-04-23 04:44:13,387 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-2:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:13,423 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-2?flat 2026-04-23 04:44:13,453 - DEBUG - VM c2fd4e2d-c822-49a5-8c9d-085145118c14 is not present in vrouter an-jenkins-deploy-platform-ansible-os-5672-2 uve 2026-04-23 04:44:13,453 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-04-23 04:44:13,453 - DEBUG - interface for vm c2fd4e2d-c822-49a5-8c9d-085145118c14 deleted from vrouter uve ... 2026-04-23 04:44:13,453 - DEBUG - Deleted interface not in error interface list ... 2026-04-23 04:44:13,453 - DEBUG - Validated that VM c2fd4e2d-c822-49a5-8c9d-085145118c14 is removed in Vrouter UVE 2026-04-23 04:44:13,453 - DEBUG - Verifying through opserver in 10.0.0.23 2026-04-23 04:44:13,453 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358?flat 2026-04-23 04:44:13,469 - DEBUG - c2fd4e2d-c822-49a5-8c9d-085145118c14 BM not in default-domain:ctest-TestDropStats-22452019:ctest-vn-17115358 uve 2026-04-23 04:44:13,469 - DEBUG - Validated that VM c2fd4e2d-c822-49a5-8c9d-085145118c14 is not present in the VN UVE 2026-04-23 04:44:13,469 - DEBUG - Verifying the c2fd4e2d-c822-49a5-8c9d-085145118c14 virtual network link through opserver 10.0.0.23 2026-04-23 04:44:13,469 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2026-04-23 04:44:13,481 - INFO - c2fd4e2d-c822-49a5-8c9d-085145118c14 vm uve deleted from opserver 2026-04-23 04:44:13,481 - DEBUG - Verifying the c2fd4e2d-c822-49a5-8c9d-085145118c14 virtual network link through opserver 10.0.0.130 2026-04-23 04:44:13,481 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-machines 2026-04-23 04:44:13,493 - INFO - c2fd4e2d-c822-49a5-8c9d-085145118c14 vm uve deleted from opserver 2026-04-23 04:44:13,494 - DEBUG - Verifying the c2fd4e2d-c822-49a5-8c9d-085145118c14 virtual network link through opserver 10.0.0.249 2026-04-23 04:44:13,494 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2026-04-23 04:44:13,508 - INFO - c2fd4e2d-c822-49a5-8c9d-085145118c14 vm uve deleted from opserver 2026-04-23 04:44:13,508 - INFO - Validated that VM c2fd4e2d-c822-49a5-8c9d-085145118c14 is removed from Opserver 2026-04-23 04:44:13,508 - INFO - Deleting VM ctest-vm1-63584133 2026-04-23 04:44:13,582 - DEBUG - Verifying in api server 10.0.0.249 2026-04-23 04:44:13,582 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803 2026-04-23 04:44:13,593 - DEBUG - VM ID c6ffc76b-d1f3-4c28-9955-a99fc9d09803 of VM ctest-vm1-63584133 is still found in API Server 2026-04-23 04:44:15,594 - DEBUG - Verifying in api server 10.0.0.249 2026-04-23 04:44:15,594 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803 2026-04-23 04:44:15,602 - DEBUG - Response Code: 404 2026-04-23 04:44:15,602 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803 2026-04-23 04:44:15,608 - DEBUG - Response Code: 404 2026-04-23 04:44:15,608 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c6ffc76b-d1f3-4c28-9955-a99fc9d09803 2026-04-23 04:44:15,615 - DEBUG - Response Code: 404 2026-04-23 04:44:15,615 - INFO - VM ctest-vm1-63584133 is fully removed in API-Server 2026-04-23 04:44:15,780 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-04-23 04:44:15,838 - DEBUG - Validated that vrouter 10.0.0.73 does not have VMs route for VN default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 2026-04-23 04:44:15,852 - DEBUG - Validated that vrouter 10.0.0.131 does not have VMs route for VN default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 2026-04-23 04:44:15,852 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 2026-04-23 04:44:15,852 - INFO - VM ctest-vm1-63584133 is removed in Compute, and routes are removed in all compute nodes 2026-04-23 04:44:16,089 - INFO - Routes for VM ctest-vm1-63584133 is removed in all control-nodes 2026-04-23 04:44:16,089 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-1:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:16,123 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-1?flat 2026-04-23 04:44:16,158 - DEBUG - VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5672-1 uve 2026-04-23 04:44:16,158 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-04-23 04:44:16,158 - DEBUG - interface for vm c6ffc76b-d1f3-4c28-9955-a99fc9d09803 deleted from vrouter uve ... 2026-04-23 04:44:16,158 - DEBUG - Deleted interface not in error interface list ... 2026-04-23 04:44:19,158 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-1:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:19,196 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-1?flat 2026-04-23 04:44:19,232 - DEBUG - VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5672-1 uve 2026-04-23 04:44:19,232 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-04-23 04:44:19,232 - DEBUG - interface for vm c6ffc76b-d1f3-4c28-9955-a99fc9d09803 deleted from vrouter uve ... 2026-04-23 04:44:19,232 - DEBUG - Deleted interface not in error interface list ... 2026-04-23 04:44:22,233 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-1:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:22,267 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-1?flat 2026-04-23 04:44:22,298 - DEBUG - VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5672-1 uve 2026-04-23 04:44:22,298 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-04-23 04:44:22,298 - DEBUG - interface for vm c6ffc76b-d1f3-4c28-9955-a99fc9d09803 deleted from vrouter uve ... 2026-04-23 04:44:22,298 - DEBUG - Deleted interface not in error interface list ... 2026-04-23 04:44:25,299 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-1:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:25,335 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-1?flat 2026-04-23 04:44:25,366 - DEBUG - VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5672-1 uve 2026-04-23 04:44:25,366 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-04-23 04:44:25,366 - DEBUG - interface for vm c6ffc76b-d1f3-4c28-9955-a99fc9d09803 deleted from vrouter uve ... 2026-04-23 04:44:25,366 - DEBUG - Deleted interface not in error interface list ... 2026-04-23 04:44:28,367 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-1:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:28,416 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-1?flat 2026-04-23 04:44:28,451 - DEBUG - VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5672-1 uve 2026-04-23 04:44:28,451 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-04-23 04:44:28,451 - DEBUG - interface for vm c6ffc76b-d1f3-4c28-9955-a99fc9d09803 deleted from vrouter uve ... 2026-04-23 04:44:28,451 - DEBUG - Deleted interface not in error interface list ... 2026-04-23 04:44:31,453 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-1:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:31,492 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-1?flat 2026-04-23 04:44:31,529 - DEBUG - VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5672-1 uve 2026-04-23 04:44:31,529 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-04-23 04:44:31,529 - DEBUG - interface for vm c6ffc76b-d1f3-4c28-9955-a99fc9d09803 deleted from vrouter uve ... 2026-04-23 04:44:31,529 - DEBUG - Deleted interface not in error interface list ... 2026-04-23 04:44:34,530 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5672-1:Compute:contrail-vrouter-agent:0?flat 2026-04-23 04:44:34,570 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5672-1?flat 2026-04-23 04:44:34,609 - DEBUG - VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is not present in vrouter an-jenkins-deploy-platform-ansible-os-5672-1 uve 2026-04-23 04:44:34,609 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-04-23 04:44:34,609 - DEBUG - interface for vm c6ffc76b-d1f3-4c28-9955-a99fc9d09803 deleted from vrouter uve ... 2026-04-23 04:44:34,609 - DEBUG - Deleted interface not in error interface list ... 2026-04-23 04:44:34,609 - DEBUG - Validated that VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is removed in Vrouter UVE 2026-04-23 04:44:34,609 - DEBUG - Verifying through opserver in 10.0.0.23 2026-04-23 04:44:34,609 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504?flat 2026-04-23 04:44:34,629 - DEBUG - c6ffc76b-d1f3-4c28-9955-a99fc9d09803 BM not in default-domain:ctest-TestDropStats-22452019:ctest-vn-39188504 uve 2026-04-23 04:44:34,629 - DEBUG - Validated that VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is not present in the VN UVE 2026-04-23 04:44:34,629 - DEBUG - Verifying the c6ffc76b-d1f3-4c28-9955-a99fc9d09803 virtual network link through opserver 10.0.0.23 2026-04-23 04:44:34,629 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2026-04-23 04:44:34,644 - INFO - c6ffc76b-d1f3-4c28-9955-a99fc9d09803 vm uve deleted from opserver 2026-04-23 04:44:34,644 - DEBUG - Verifying the c6ffc76b-d1f3-4c28-9955-a99fc9d09803 virtual network link through opserver 10.0.0.130 2026-04-23 04:44:34,644 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-machines 2026-04-23 04:44:34,658 - INFO - c6ffc76b-d1f3-4c28-9955-a99fc9d09803 vm uve deleted from opserver 2026-04-23 04:44:34,658 - DEBUG - Verifying the c6ffc76b-d1f3-4c28-9955-a99fc9d09803 virtual network link through opserver 10.0.0.249 2026-04-23 04:44:34,658 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2026-04-23 04:44:34,670 - INFO - c6ffc76b-d1f3-4c28-9955-a99fc9d09803 vm uve deleted from opserver 2026-04-23 04:44:34,670 - INFO - Validated that VM c6ffc76b-d1f3-4c28-9955-a99fc9d09803 is removed from Opserver 2026-04-23 04:44:34,671 - INFO - Deleting VN ctest-vn-17115358 2026-04-23 04:44:34,866 - DEBUG - Response for deleting network () 2026-04-23 04:44:34,867 - INFO - Deleting VN ctest-vn-39188504 2026-04-23 04:44:35,119 - DEBUG - Response for deleting network () 2026-04-23 04:44:36,385 - ERROR - IndexError Python 3.9.25: /usr/bin/python3 Thu Apr 23 04:44:01 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vrouter/test_drop_stats.py in test_flow_action_drop_stats(self=) 36 raise self.skipTest("Skipping test case,this test needs atleast 2 compute nodes") 37 38 assert self.verify_flow_action_drop_stats() 39 return True 40 # end test_drop_stats self = self.verify_flow_action_drop_stats = > /contrail-test/common/vrouter/base_drop_stats.py in verify_flow_action_drop_stats(self=, drop_type='ds_flow_action_drop') 51 fq_name = intf_details[0]['config_name'] 52 53 vif_dict_before = self.get_drop_stats_dict(compute0, fq_name)[1] 54 self.print_drop_stats_dict(vif_dict_before) 55 vif_dict_before undefined self = self.get_drop_stats_dict = .deco_retry....on_drop_stats[dev_reg,sanity] id=0x7fcc292838b0>> compute0 = '10.0.0.73' fq_name = 'default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f' /contrail-test/tcutils/util.py in f_retry(*args=(, '10.0.0.73', 'default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f'), **kwargs={}) 82 mtries, mdelay = tries, delay # make mutable 83 84 result = f(*args, **kwargs) # first attempt 85 rv = result 86 final = False result undefined f = args = (, '10.0.0.73', 'default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f') kwargs = {} /contrail-test/common/vrouter/base_drop_stats.py in get_drop_stats_dict(self=, compute='10.0.0.73', fq_name='default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f', module='vif') 29 drop_stats_list = self.agent_inspect_h[compute].get_agent_vrouter_drop_stats() 30 else: 31 drop_stats_list = self.agent_inspect_h[compute].get_agent_vm_interface_drop_stats(fq_name) 32 33 if drop_stats_list is not None: drop_stats_list undefined self = self.agent_inspect_h = {} compute = '10.0.0.73' ].get_agent_vm_interface_drop_stats undefined fq_name = 'default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f' /contrail-test/tcutils/agent/vna_introspect_utils.py in get_agent_vm_interface_drop_stats(self=, fq_name='default-domain:ctest-TestDropStats-22452019:8c9befd1-df7c-45c0-9f3b-b973ca0fcb7f') 1039 except IndexError: 1040 return None 1041 return l[0] 1042 # end get_agent_vm_interface_drop_stats 1043 l = [] IndexError: list index out of range __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Sequence index out of range.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('list index out of range',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vrouter/test_drop_stats.py", line 38, in test_flow_action_drop_stats assert self.verify_flow_action_drop_stats() File "/contrail-test/common/vrouter/base_drop_stats.py", line 53, in verify_flow_action_drop_stats vif_dict_before = self.get_drop_stats_dict(compute0, fq_name)[1] File "/contrail-test/tcutils/util.py", line 84, in f_retry result = f(*args, **kwargs) # first attempt File "/contrail-test/common/vrouter/base_drop_stats.py", line 31, in get_drop_stats_dict drop_stats_list = self.agent_inspect_h[compute].get_agent_vm_interface_drop_stats(fq_name) File "/contrail-test/tcutils/agent/vna_introspect_utils.py", line 1041, in get_agent_vm_interface_drop_stats return l[0] IndexError: list index out of range 2026-04-23 04:44:36,385 - DEBUG - Skipping xmpp flap check 2026-04-23 04:44:36,386 - INFO -
2026-04-23 04:44:36,386 - INFO - END TEST : test_flow_action_drop_stats : FAILED[0:01:19]
2026-04-23 04:44:36,386 - INFO - -------------------------------------------------------------------------------- 2026-04-23 04:44:37,137 - INFO - Deleted project: ctest-TestDropStats-22452019, ID : 44adc184-7962-4271-8bfa-821b9084d1f8