2026-06-19 16:10:15,971 - INFO - Domain Default found not creating
2026-06-19 16:10:16,133 - INFO - Project ctest-TestDropStats-86516654 not found, creating it
2026-06-19 16:10:16,659 - INFO - Created Project:ctest-TestDropStats-86516654, ID : bc732062-88c9-46e9-8d3f-33923646a686
2026-06-19 16:10:18,200 - INFO - ================================================================================
2026-06-19 16:10:18,200 - INFO - STARTING TEST : test_flow_action_drop_stats
2026-06-19 16:10:18,201 - INFO - TEST DESCRIPTION :
Description: Verify flow action drop stats
Steps:
1. Create 2 VNs and launch 1 VM in each VN, on different nodes on multi node setup
2. Add policy to deny pkts between VNs.
3. Ping VM2 from VM1
Pass criteria:
1. Verify flow action count gets incremented, get it from introspect
2. Verify flow action count gets incremented for the vmi of VM1, get it from introspect
2026-06-19 16:10:19,461 - DEBUG - Skipping xmpp flap check
2026-06-19 16:10:19,461 - INFO - Initial checks done. Running the testcase now
2026-06-19 16:10:19,461 - INFO -
2026-06-19 16:10:19,484 - DEBUG - Services list from nova: [, , , ]
2026-06-19 16:10:19,484 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5994-1', 'an-jenkins-deploy-platform-ansible-os-5994-2']}
2026-06-19 16:10:20,175 - DEBUG - Response for create_network : {'network': {'id': 'c7c4fa08-7804-4ec9-9ac9-646642b824aa', 'name': 'ctest-vn-93699015', 'tenant_id': 'bc73206288c946e98d3f33923646a686', 'project_id': 'bc73206288c946e98d3f33923646a686', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDropStats-86516654', 'ctest-vn-93699015'], 'port_security_enabled': True, 'description': ''}}
2026-06-19 16:10:20,377 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd03045ba-96f3-4a16-83cb-f256a6c0d380', 'name': '', 'tenant_id': 'bc73206288c946e98d3f33923646a686', 'network_id': 'c7c4fa08-7804-4ec9-9ac9-646642b824aa', 'ip_version': 4, 'cidr': '168.148.10.64/26', 'allocation_pools': [{'start': '168.148.10.66', 'end': '168.148.10.126'}], 'gateway_ip': '168.148.10.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '168.148.10.66', 'tags': [], 'project_id': 'bc73206288c946e98d3f33923646a686'}}
2026-06-19 16:10:20,436 - INFO - Created VN ctest-vn-93699015
2026-06-19 16:10:20,450 - DEBUG - VN ctest-vn-93699015 UUID is c7c4fa08-7804-4ec9-9ac9-646642b824aa
2026-06-19 16:10:20,831 - DEBUG - Response for create_network : {'network': {'id': '74f8fd18-a239-43b0-a14a-75d863936f23', 'name': 'ctest-vn-98336273', 'tenant_id': 'bc73206288c946e98d3f33923646a686', 'project_id': 'bc73206288c946e98d3f33923646a686', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDropStats-86516654', 'ctest-vn-98336273'], 'port_security_enabled': True, 'description': ''}}
2026-06-19 16:10:21,021 - DEBUG - Response for create_subnet : {'subnet': {'id': '0ee225dd-9880-4010-9775-109ec8caac3b', 'name': '', 'tenant_id': 'bc73206288c946e98d3f33923646a686', 'network_id': '74f8fd18-a239-43b0-a14a-75d863936f23', 'ip_version': 4, 'cidr': '220.56.112.128/26', 'allocation_pools': [{'start': '220.56.112.130', 'end': '220.56.112.190'}], 'gateway_ip': '220.56.112.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '220.56.112.130', 'tags': [], 'project_id': 'bc73206288c946e98d3f33923646a686'}}
2026-06-19 16:10:21,039 - INFO - Created VN ctest-vn-98336273
2026-06-19 16:10:21,050 - DEBUG - VN ctest-vn-98336273 UUID is 74f8fd18-a239-43b0-a14a-75d863936f23
2026-06-19 16:10:22,305 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5994-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5994-1)
2026-06-19 16:10:23,424 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5994-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5994-2)
2026-06-19 16:10:23,425 - INFO - Waiting for VM ctest-vm1-50935795 to be up..
2026-06-19 16:10:23,469 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-19 16:10:28,548 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-19 16:10:33,628 - DEBUG - VM is in ACTIVE state now
2026-06-19 16:10:33,628 - INFO - VM name : ctest-vm1-50935795
2026-06-19 16:10:33,713 - DEBUG - VM ctest-vm1-50935795 ID is c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:10:33,733 - DEBUG - VM ctest-vm1-50935795 launched on Node an-jenkins-deploy-platform-ansible-os-5994-1
2026-06-19 16:10:33,800 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:10:34,123 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:10:34,166 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/7afb3b31-8b14-4935-bb79-24af9a3b9dda
2026-06-19 16:10:37,351 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2026-06-19 16:10:37,351 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-50935795 failed!
2026-06-19 16:10:37,365 - DEBUG - Gateway for vn default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015 is 168.148.10.65 and allocation pool is NOT set
2026-06-19 16:10:39,429 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=10.5 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.690 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.690/5.576/10.463/4.886 ms')
2026-06-19 16:10:39,429 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-50935795 passed
2026-06-19 16:10:39,498 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 16:10:39,498 - DEBUG - Waiting to SSH to VM ctest-vm1-50935795, IP 168.148.10.67, Port 22
2026-06-19 16:10:39,663 - DEBUG - VM ctest-vm1-50935795 is ready for SSH connections
2026-06-19 16:10:39,663 - INFO - Waiting for VM ctest-vm2-22427637 to be up..
2026-06-19 16:10:39,728 - DEBUG - VM is in ACTIVE state now
2026-06-19 16:10:39,728 - INFO - VM name : ctest-vm2-22427637
2026-06-19 16:10:39,800 - DEBUG - VM ctest-vm2-22427637 ID is df53c758-65ba-4307-8865-63ee25ce79c4
2026-06-19 16:10:39,800 - DEBUG - VM ctest-vm2-22427637 launched on Node an-jenkins-deploy-platform-ansible-os-5994-2
2026-06-19 16:10:39,869 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4
2026-06-19 16:10:39,879 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/450ec014-2633-48e1-bee8-8ee73a618bb0
2026-06-19 16:10:41,045 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.90 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.719 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.719/2.807/4.896/2.088 ms')
2026-06-19 16:10:41,045 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vm2-22427637 passed
2026-06-19 16:10:41,113 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 16:10:41,113 - DEBUG - Waiting to SSH to VM ctest-vm2-22427637, IP 220.56.112.131, Port 22
2026-06-19 16:10:41,273 - DEBUG - VM ctest-vm2-22427637 is ready for SSH connections
2026-06-19 16:10:41,350 - DEBUG - VM is in ACTIVE state now
2026-06-19 16:10:41,350 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 16:10:41,350 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:10:41,358 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/7afb3b31-8b14-4935-bb79-24af9a3b9dda
2026-06-19 16:10:41,367 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:10:41,375 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/7afb3b31-8b14-4935-bb79-24af9a3b9dda
2026-06-19 16:10:41,384 - DEBUG - Requesting: http://10.0.0.129:8082/instance-ip/57a60c81-1753-4e18-bf1e-05b0479d0064
2026-06-19 16:10:41,394 - DEBUG - Verifying in api server 10.0.0.129
2026-06-19 16:10:41,394 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:10:41,402 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/7afb3b31-8b14-4935-bb79-24af9a3b9dda
2026-06-19 16:10:41,413 - DEBUG - Requesting: http://10.0.0.129:8082/instance-ip/57a60c81-1753-4e18-bf1e-05b0479d0064
2026-06-19 16:10:41,421 - INFO - VM ctest-vm1-50935795 verfication in all API Servers passed
2026-06-19 16:10:41,437 - DEBUG - VM ctest-vm1-50935795 Tap interface: {'index': '3', 'name': 'tap7afb3b31-8b', 'uuid': '7afb3b31-8b14-4935-bb79-24af9a3b9dda', 'vrf_name': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015:ctest-vn-93699015', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '24', 'l2_label': '29', 'vxlan_id': '6', 'vn_name': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015', 'vm_uuid': 'c12082b6-2337-4a5c-9df2-8af665bf0c3b', 'vm_name': 'ctest-vm1-50935795', 'ip_addr': '168.148.10.67', 'mac_addr': '02:7a:fb:3b:31:8b', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '146', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-86516654:7afb3b31-8b14-4935-bb79-24af9a3b9dda', 'sg_uuid_list': ['490a6d12-dc1e-407e-9f23-6153aa5f2123'], 'static_route_list': None, 'vm_project_uuid': 'bc732062-88c9-46e9-8d3f-33923646a686', 'admin_state': 'Enabled', 'flow_key_idx': '24', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2026-06-19 16:10:41,437 - DEBUG - Agent 10.0.0.241 vrf name: default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015:ctest-vn-93699015
2026-06-19 16:10:41,441 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015:ctest-vn-93699015', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015', 'table_label': '-1', 'vxlan_id': '6', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.254:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]}
2026-06-19 16:10:41,519 - DEBUG - VM ctest-vm1-50935795 : Tap interface tap7afb3b31-8b is set to Active
2026-06-19 16:10:41,519 - DEBUG - Tap interface tap7afb3b31-8b detail : {'index': '3', 'name': 'tap7afb3b31-8b', 'uuid': '7afb3b31-8b14-4935-bb79-24af9a3b9dda', 'vrf_name': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015:ctest-vn-93699015', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '24', 'l2_label': '29', 'vxlan_id': '6', 'vn_name': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015', 'vm_uuid': 'c12082b6-2337-4a5c-9df2-8af665bf0c3b', 'vm_name': 'ctest-vm1-50935795', 'ip_addr': '168.148.10.67', 'mac_addr': '02:7a:fb:3b:31:8b', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '146', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-86516654:7afb3b31-8b14-4935-bb79-24af9a3b9dda', 'sg_uuid_list': ['490a6d12-dc1e-407e-9f23-6153aa5f2123'], 'static_route_list': None, 'vm_project_uuid': 'bc732062-88c9-46e9-8d3f-33923646a686', 'admin_state': 'Enabled', 'flow_key_idx': '24', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2026-06-19 16:10:41,633 - DEBUG - Starting Layer 2 verification in Agent
2026-06-19 16:10:41,643 - DEBUG - Layer 2 path is seen for VM MAC 02:7a:fb:3b:31:8b in agent 10.0.0.241
2026-06-19 16:10:41,643 - DEBUG - Active layer 2 route in agent is present for VMI tap7afb3b31-8b
2026-06-19 16:10:41,643 - DEBUG - L2 label(29) matches bw route table and interface table
2026-06-19 16:10:41,648 - DEBUG - VN default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015 is found in Agent of node 10.0.0.241
2026-06-19 16:10:41,777 - DEBUG - VRF IDs of VN default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015 is consistent in agent 10.0.0.241
2026-06-19 16:10:41,777 - DEBUG - Route for VM IP ['168.148.10.67'] is consistent in agent 10.0.0.241
2026-06-19 16:10:41,777 - DEBUG - VN default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015 verification for VM ctest-vm1-50935795 in Agent 10.0.0.241 passed
2026-06-19 16:10:41,894 - DEBUG - Starting all layer 2 verification in agent 10.0.0.241
2026-06-19 16:10:41,903 - DEBUG - Route for VM MAC 02:7a:fb:3b:31:8b is consistent in agent 10.0.0.241
2026-06-19 16:10:41,909 - INFO - VM ctest-vm1-50935795 verifications in Compute nodes passed
2026-06-19 16:10:42,135 - DEBUG - Validated VM route 168.148.10.67 in vrouter of 10.0.0.241
2026-06-19 16:10:42,139 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0
2026-06-19 16:10:42,139 - INFO - Validated routes of VM ctest-vm1-50935795 in all vrouters
2026-06-19 16:10:42,674 - DEBUG - Starting all layer2 verification in 10.0.0.129 Control Node
2026-06-19 16:10:42,797 - DEBUG - Layer2 route found for VM MAC 02:7a:fb:3b:31:8b in Control-node 10.0.0.129
2026-06-19 16:10:42,797 - DEBUG - L2 Label for VM ctest-vm1-50935795 same between Control-node 10.0.0.129 and Agent, Expected: 29, Seen: 29
2026-06-19 16:10:42,797 - DEBUG - Starting all layer2 verification in 10.0.0.19 Control Node
2026-06-19 16:10:42,914 - DEBUG - Layer2 route found for VM MAC 02:7a:fb:3b:31:8b in Control-node 10.0.0.19
2026-06-19 16:10:42,914 - DEBUG - L2 Label for VM ctest-vm1-50935795 same between Control-node 10.0.0.19 and Agent, Expected: 29, Seen: 29
2026-06-19 16:10:42,914 - INFO - Verification in Control-nodes for VM ctest-vm1-50935795 passed
2026-06-19 16:10:42,914 - DEBUG - Verifying the vm in opserver
2026-06-19 16:10:42,914 - DEBUG - Verifying in collector 10.0.0.129 ...
2026-06-19 16:10:42,914 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b?flat
2026-06-19 16:10:43,252 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b?flat
2026-06-19 16:10:43,304 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-86516654:7afb3b31-8b14-4935-bb79-24af9a3b9dda?flat
2026-06-19 16:10:43,627 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-86516654:7afb3b31-8b14-4935-bb79-24af9a3b9dda?flat
2026-06-19 16:10:43,674 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-86516654:7afb3b31-8b14-4935-bb79-24af9a3b9dda?flat
2026-06-19 16:10:43,724 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b?flat
2026-06-19 16:10:43,767 - DEBUG - Verifying vm in vn uve
2026-06-19 16:10:43,767 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-86516654:7afb3b31-8b14-4935-bb79-24af9a3b9dda?flat
2026-06-19 16:10:43,817 - DEBUG - VM uve shows interface as {'fixed_ip4_list': ['168.148.10.67'], '__T': 1781885443120228, 'mac_address': '02:7a:fb:3b:31:8b', 'ip4_active': True, 'vhostuser_mode': 0, 'rx_vlan': 65535, 'uuid': '7afb3b31-8b14-4935-bb79-24af9a3b9dda', 'vn_uuid': 'c7c4fa08-7804-4ec9-9ac9-646642b824aa', 'l2_active': True, 'virtual_network': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015', 'ip6_active': False, 'vm_name': 'ctest-vm1-50935795', 'tx_vlan': 65535, 'is_health_check_active': True, 'admin_state': True, 'port_mirror_enabled': False, 'ip_address': '168.148.10.67', 'label': 24, 'gateway': '168.148.10.65', 'active': True, 'ip6_address': '::', 'vm_uuid': 'c12082b6-2337-4a5c-9df2-8af665bf0c3b'}
2026-06-19 16:10:43,817 - DEBUG - VM uve shows ip address as ['168.148.10.67', '::']
2026-06-19 16:10:43,817 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015
2026-06-19 16:10:43,817 - INFO - Verifying through opserver in 10.0.0.38
2026-06-19 16:10:43,817 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015?flat
2026-06-19 16:10:43,835 - DEBUG - expected vm list c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:10:43,835 - DEBUG - Extracted vm list ['c12082b6-2337-4a5c-9df2-8af665bf0c3b']
2026-06-19 16:10:43,835 - INFO - VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is present in default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015
2026-06-19 16:10:43,835 - DEBUG - Verifying vm in vrouter uve
2026-06-19 16:10:43,835 - DEBUG - Getting info from collector 10.0.0.129..
2026-06-19 16:10:43,835 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b?flat
2026-06-19 16:10:43,880 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-5994-1']
2026-06-19 16:10:43,880 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-1:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:10:43,923 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-1?flat
2026-06-19 16:10:43,951 - DEBUG - VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is present in vrouter an-jenkins-deploy-platform-ansible-os-5994-1 uve
2026-06-19 16:10:43,951 - DEBUG - Validated that VM ctest-vm1-50935795 is in Vrouter an-jenkins-deploy-platform-ansible-os-5994-1 UVE
2026-06-19 16:10:43,951 - DEBUG - Verifying vm tap interface/vn in vrouter uve
2026-06-19 16:10:43,957 - DEBUG - Expected tap interface of VM uuid c12082b6-2337-4a5c-9df2-8af665bf0c3b is default-domain:ctest-TestDropStats-86516654:7afb3b31-8b14-4935-bb79-24af9a3b9dda
2026-06-19 16:10:43,957 - DEBUG - Expected VN of VM uuid c12082b6-2337-4a5c-9df2-8af665bf0c3b is default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015
2026-06-19 16:10:43,957 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-1:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:10:44,000 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-1?flat
2026-06-19 16:10:44,032 - DEBUG - VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is present in vrouter an-jenkins-deploy-platform-ansible-os-5994-1 uve
2026-06-19 16:10:44,032 - INFO - tap interface default-domain:ctest-TestDropStats-86516654:7afb3b31-8b14-4935-bb79-24af9a3b9dda of vm c12082b6-2337-4a5c-9df2-8af665bf0c3b is present in vrouter an-jenkins-deploy-platform-ansible-os-5994-1 uve
2026-06-19 16:10:44,032 - DEBUG - Connected network default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015 of vm c12082b6-2337-4a5c-9df2-8af665bf0c3b is present in vrouter an-jenkins-deploy-platform-ansible-os-5994-1 uve
2026-06-19 16:10:44,032 - DEBUG - Verifying the c12082b6-2337-4a5c-9df2-8af665bf0c3b virtual network link through opserver 10.0.0.38
2026-06-19 16:10:44,032 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines
2026-06-19 16:10:44,045 - DEBUG - VM link and name as {'name': 'c12082b6-2337-4a5c-9df2-8af665bf0c3b', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b?flat'}
2026-06-19 16:10:44,045 - DEBUG - Verifying the c12082b6-2337-4a5c-9df2-8af665bf0c3b virtual network link through opserver 10.0.0.19
2026-06-19 16:10:44,045 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2026-06-19 16:10:44,372 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2026-06-19 16:10:44,419 - DEBUG - VM link and name as {'name': 'c12082b6-2337-4a5c-9df2-8af665bf0c3b', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b?flat'}
2026-06-19 16:10:44,419 - DEBUG - Verifying the c12082b6-2337-4a5c-9df2-8af665bf0c3b virtual network link through opserver 10.0.0.129
2026-06-19 16:10:44,419 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machines
2026-06-19 16:10:44,431 - DEBUG - VM link and name as {'name': 'c12082b6-2337-4a5c-9df2-8af665bf0c3b', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b?flat'}
2026-06-19 16:10:44,431 - INFO - VM ctest-vm1-50935795 validations in Opserver passed
2026-06-19 16:10:44,505 - DEBUG - VM is in ACTIVE state now
2026-06-19 16:10:44,505 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-19 16:10:44,506 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4
2026-06-19 16:10:44,514 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/450ec014-2633-48e1-bee8-8ee73a618bb0
2026-06-19 16:10:44,524 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4
2026-06-19 16:10:44,531 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/450ec014-2633-48e1-bee8-8ee73a618bb0
2026-06-19 16:10:44,541 - DEBUG - Requesting: http://10.0.0.129:8082/instance-ip/b547d4d8-862e-473e-9d98-4a5f5aadeae5
2026-06-19 16:10:44,551 - DEBUG - Verifying in api server 10.0.0.129
2026-06-19 16:10:44,551 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4
2026-06-19 16:10:44,558 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/450ec014-2633-48e1-bee8-8ee73a618bb0
2026-06-19 16:10:44,569 - DEBUG - Requesting: http://10.0.0.129:8082/instance-ip/b547d4d8-862e-473e-9d98-4a5f5aadeae5
2026-06-19 16:10:44,577 - INFO - VM ctest-vm2-22427637 verfication in all API Servers passed
2026-06-19 16:10:44,596 - DEBUG - VM ctest-vm2-22427637 Tap interface: {'index': '3', 'name': 'tap450ec014-26', 'uuid': '450ec014-2633-48e1-bee8-8ee73a618bb0', 'vrf_name': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273:ctest-vn-98336273', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273', 'vm_uuid': 'df53c758-65ba-4307-8865-63ee25ce79c4', 'vm_name': 'ctest-vm2-22427637', 'ip_addr': '220.56.112.131', 'mac_addr': '02:45:0e:c0:14:26', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '108', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-86516654:450ec014-2633-48e1-bee8-8ee73a618bb0', 'sg_uuid_list': ['490a6d12-dc1e-407e-9f23-6153aa5f2123'], 'static_route_list': None, 'vm_project_uuid': 'bc732062-88c9-46e9-8d3f-33923646a686', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2026-06-19 16:10:44,596 - DEBUG - Agent 10.0.0.242 vrf name: default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273:ctest-vn-98336273
2026-06-19 16:10:44,602 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273:ctest-vn-98336273', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273', 'table_label': '-1', 'vxlan_id': '7', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.129:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]}
2026-06-19 16:10:44,677 - DEBUG - VM ctest-vm2-22427637 : Tap interface tap450ec014-26 is set to Active
2026-06-19 16:10:44,677 - DEBUG - Tap interface tap450ec014-26 detail : {'index': '3', 'name': 'tap450ec014-26', 'uuid': '450ec014-2633-48e1-bee8-8ee73a618bb0', 'vrf_name': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273:ctest-vn-98336273', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273', 'vm_uuid': 'df53c758-65ba-4307-8865-63ee25ce79c4', 'vm_name': 'ctest-vm2-22427637', 'ip_addr': '220.56.112.131', 'mac_addr': '02:45:0e:c0:14:26', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '108', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-86516654:450ec014-2633-48e1-bee8-8ee73a618bb0', 'sg_uuid_list': ['490a6d12-dc1e-407e-9f23-6153aa5f2123'], 'static_route_list': None, 'vm_project_uuid': 'bc732062-88c9-46e9-8d3f-33923646a686', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2026-06-19 16:10:44,790 - DEBUG - Starting Layer 2 verification in Agent
2026-06-19 16:10:44,802 - DEBUG - Layer 2 path is seen for VM MAC 02:45:0e:c0:14:26 in agent 10.0.0.242
2026-06-19 16:10:44,802 - DEBUG - Active layer 2 route in agent is present for VMI tap450ec014-26
2026-06-19 16:10:44,802 - DEBUG - L2 label(29) matches bw route table and interface table
2026-06-19 16:10:44,813 - DEBUG - VN default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273 is found in Agent of node 10.0.0.242
2026-06-19 16:10:44,942 - DEBUG - VRF IDs of VN default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273 is consistent in agent 10.0.0.242
2026-06-19 16:10:44,942 - DEBUG - Route for VM IP ['220.56.112.131'] is consistent in agent 10.0.0.242
2026-06-19 16:10:44,942 - DEBUG - VN default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273 verification for VM ctest-vm2-22427637 in Agent 10.0.0.242 passed
2026-06-19 16:10:45,059 - DEBUG - Starting all layer 2 verification in agent 10.0.0.242
2026-06-19 16:10:45,070 - DEBUG - Route for VM MAC 02:45:0e:c0:14:26 is consistent in agent 10.0.0.242
2026-06-19 16:10:45,070 - INFO - VM ctest-vm2-22427637 verifications in Compute nodes passed
2026-06-19 16:10:45,294 - DEBUG - Validated VM route 220.56.112.131 in vrouter of 10.0.0.242
2026-06-19 16:10:45,298 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0
2026-06-19 16:10:45,298 - INFO - Validated routes of VM ctest-vm2-22427637 in all vrouters
2026-06-19 16:10:45,816 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node
2026-06-19 16:10:45,936 - DEBUG - Layer2 route found for VM MAC 02:45:0e:c0:14:26 in Control-node 10.0.0.38
2026-06-19 16:10:45,936 - DEBUG - L2 Label for VM ctest-vm2-22427637 same between Control-node 10.0.0.38 and Agent, Expected: 29, Seen: 29
2026-06-19 16:10:45,936 - DEBUG - Starting all layer2 verification in 10.0.0.129 Control Node
2026-06-19 16:10:46,064 - DEBUG - Layer2 route found for VM MAC 02:45:0e:c0:14:26 in Control-node 10.0.0.129
2026-06-19 16:10:46,064 - DEBUG - L2 Label for VM ctest-vm2-22427637 same between Control-node 10.0.0.129 and Agent, Expected: 29, Seen: 29
2026-06-19 16:10:46,064 - INFO - Verification in Control-nodes for VM ctest-vm2-22427637 passed
2026-06-19 16:10:46,065 - DEBUG - Verifying the vm in opserver
2026-06-19 16:10:46,065 - DEBUG - Verifying in collector 10.0.0.129 ...
2026-06-19 16:10:46,065 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4?flat
2026-06-19 16:10:46,080 - DEBUG - Failed to get VM ctest-vm2-22427637, ID df53c758-65ba-4307-8865-63ee25ce79c4 info from Opserver
2026-06-19 16:10:48,081 - DEBUG - Verifying the vm in opserver
2026-06-19 16:10:48,081 - DEBUG - Verifying in collector 10.0.0.129 ...
2026-06-19 16:10:48,081 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4?flat
2026-06-19 16:10:48,095 - DEBUG - Failed to get VM ctest-vm2-22427637, ID df53c758-65ba-4307-8865-63ee25ce79c4 info from Opserver
2026-06-19 16:10:50,095 - DEBUG - Verifying the vm in opserver
2026-06-19 16:10:50,095 - DEBUG - Verifying in collector 10.0.0.129 ...
2026-06-19 16:10:50,096 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4?flat
2026-06-19 16:10:50,110 - DEBUG - Failed to get VM ctest-vm2-22427637, ID df53c758-65ba-4307-8865-63ee25ce79c4 info from Opserver
2026-06-19 16:10:52,111 - DEBUG - Verifying the vm in opserver
2026-06-19 16:10:52,111 - DEBUG - Verifying in collector 10.0.0.129 ...
2026-06-19 16:10:52,111 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4?flat
2026-06-19 16:10:52,126 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-86516654:450ec014-2633-48e1-bee8-8ee73a618bb0?flat
2026-06-19 16:10:52,145 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-86516654:450ec014-2633-48e1-bee8-8ee73a618bb0?flat
2026-06-19 16:10:52,161 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4?flat
2026-06-19 16:10:52,176 - DEBUG - Verifying vm in vn uve
2026-06-19 16:10:52,177 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-86516654:450ec014-2633-48e1-bee8-8ee73a618bb0?flat
2026-06-19 16:10:52,197 - DEBUG - VM uve shows interface as {'vn_uuid': '74f8fd18-a239-43b0-a14a-75d863936f23', 'ip6_active': False, 'ip6_address': '::', 'tx_vlan': 65535, 'uuid': '450ec014-2633-48e1-bee8-8ee73a618bb0', 'ip_address': '220.56.112.131', '__T': 1781885451702443, 'ip4_active': True, 'admin_state': True, 'vhostuser_mode': 0, 'l2_active': True, 'vm_uuid': 'df53c758-65ba-4307-8865-63ee25ce79c4', 'is_health_check_active': True, 'virtual_network': 'default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273', 'gateway': '220.56.112.129', 'active': True, 'rx_vlan': 65535, 'label': 25, 'port_mirror_enabled': False, 'fixed_ip4_list': ['220.56.112.131'], 'vm_name': 'ctest-vm2-22427637', 'mac_address': '02:45:0e:c0:14:26'}
2026-06-19 16:10:52,197 - DEBUG - VM uve shows ip address as ['220.56.112.131', '::']
2026-06-19 16:10:52,197 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273
2026-06-19 16:10:52,197 - INFO - Verifying through opserver in 10.0.0.38
2026-06-19 16:10:52,197 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273?flat
2026-06-19 16:10:52,219 - DEBUG - expected vm list df53c758-65ba-4307-8865-63ee25ce79c4
2026-06-19 16:10:52,219 - DEBUG - Extracted vm list ['df53c758-65ba-4307-8865-63ee25ce79c4']
2026-06-19 16:10:52,219 - INFO - VM df53c758-65ba-4307-8865-63ee25ce79c4 is present in default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273
2026-06-19 16:10:52,220 - DEBUG - Verifying vm in vrouter uve
2026-06-19 16:10:52,220 - DEBUG - Getting info from collector 10.0.0.129..
2026-06-19 16:10:52,220 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4?flat
2026-06-19 16:10:52,239 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-5994-2']
2026-06-19 16:10:52,239 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-2:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:10:52,296 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-2?flat
2026-06-19 16:10:52,324 - DEBUG - VM df53c758-65ba-4307-8865-63ee25ce79c4 is present in vrouter an-jenkins-deploy-platform-ansible-os-5994-2 uve
2026-06-19 16:10:52,325 - DEBUG - Validated that VM ctest-vm2-22427637 is in Vrouter an-jenkins-deploy-platform-ansible-os-5994-2 UVE
2026-06-19 16:10:52,325 - DEBUG - Verifying vm tap interface/vn in vrouter uve
2026-06-19 16:10:52,333 - DEBUG - Expected tap interface of VM uuid df53c758-65ba-4307-8865-63ee25ce79c4 is default-domain:ctest-TestDropStats-86516654:450ec014-2633-48e1-bee8-8ee73a618bb0
2026-06-19 16:10:52,333 - DEBUG - Expected VN of VM uuid df53c758-65ba-4307-8865-63ee25ce79c4 is default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273
2026-06-19 16:10:52,333 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-2:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:10:52,364 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-2?flat
2026-06-19 16:10:52,392 - DEBUG - VM df53c758-65ba-4307-8865-63ee25ce79c4 is present in vrouter an-jenkins-deploy-platform-ansible-os-5994-2 uve
2026-06-19 16:10:52,392 - INFO - tap interface default-domain:ctest-TestDropStats-86516654:450ec014-2633-48e1-bee8-8ee73a618bb0 of vm df53c758-65ba-4307-8865-63ee25ce79c4 is present in vrouter an-jenkins-deploy-platform-ansible-os-5994-2 uve
2026-06-19 16:10:52,392 - DEBUG - Connected network default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273 of vm df53c758-65ba-4307-8865-63ee25ce79c4 is present in vrouter an-jenkins-deploy-platform-ansible-os-5994-2 uve
2026-06-19 16:10:52,392 - DEBUG - Verifying the df53c758-65ba-4307-8865-63ee25ce79c4 virtual network link through opserver 10.0.0.38
2026-06-19 16:10:52,392 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines
2026-06-19 16:10:52,402 - DEBUG - VM link and name as {'name': 'df53c758-65ba-4307-8865-63ee25ce79c4', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4?flat'}
2026-06-19 16:10:52,402 - DEBUG - Verifying the df53c758-65ba-4307-8865-63ee25ce79c4 virtual network link through opserver 10.0.0.19
2026-06-19 16:10:52,402 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2026-06-19 16:10:52,443 - DEBUG - VM link and name as {'name': 'df53c758-65ba-4307-8865-63ee25ce79c4', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4?flat'}
2026-06-19 16:10:52,443 - DEBUG - Verifying the df53c758-65ba-4307-8865-63ee25ce79c4 virtual network link through opserver 10.0.0.129
2026-06-19 16:10:52,443 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machines
2026-06-19 16:10:52,456 - DEBUG - VM link and name as {'name': 'df53c758-65ba-4307-8865-63ee25ce79c4', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4?flat'}
2026-06-19 16:10:52,456 - INFO - VM ctest-vm2-22427637 validations in Opserver passed
2026-06-19 16:10:52,473 - INFO - ----------------------------------------------------------------------------------------------------
2026-06-19 16:10:52,473 - INFO - ds_discard : 2
2026-06-19 16:10:52,473 - INFO - ds_pull : 0
2026-06-19 16:10:52,473 - INFO - ds_invalid_if : 2
2026-06-19 16:10:52,474 - INFO - ds_invalid_arp : 0
2026-06-19 16:10:52,474 - INFO - ds_trap_no_if : 0
2026-06-19 16:10:52,474 - INFO - ds_nowhere_to_go : 0
2026-06-19 16:10:52,474 - INFO - ds_flow_queue_limit_exceeded : 0
2026-06-19 16:10:52,474 - INFO - ds_flow_no_memory : 0
2026-06-19 16:10:52,474 - INFO - ds_flow_invalid_protocol : 0
2026-06-19 16:10:52,474 - INFO - ds_flow_nat_no_rflow : 0
2026-06-19 16:10:52,474 - INFO - ds_flow_action_drop : 0
2026-06-19 16:10:52,474 - INFO - ds_flow_action_invalid : 0
2026-06-19 16:10:52,474 - INFO - ds_flow_unusable : 0
2026-06-19 16:10:52,474 - INFO - ds_flow_table_full : 0
2026-06-19 16:10:52,474 - INFO - ds_interface_tx_discard : 0
2026-06-19 16:10:52,475 - INFO - ds_interface_drop : 0
2026-06-19 16:10:52,475 - INFO - ds_duplicated : 0
2026-06-19 16:10:52,475 - INFO - ds_push : 0
2026-06-19 16:10:52,475 - INFO - ds_ttl_exceeded : 0
2026-06-19 16:10:52,475 - INFO - ds_invalid_nh : 0
2026-06-19 16:10:52,475 - INFO - ds_invalid_label : 0
2026-06-19 16:10:52,475 - INFO - ds_invalid_protocol : 0
2026-06-19 16:10:52,475 - INFO - ds_interface_rx_discard : 0
2026-06-19 16:10:52,475 - INFO - ds_invalid_mcast_source : 0
2026-06-19 16:10:52,475 - INFO - ds_head_alloc_fail : 0
2026-06-19 16:10:52,475 - INFO - ds_pcow_fail : 0
2026-06-19 16:10:52,476 - INFO - ds_mcast_clone_fail : 0
2026-06-19 16:10:52,476 - INFO - ds_rewrite_fail : 0
2026-06-19 16:10:52,476 - INFO - ds_misc : 0
2026-06-19 16:10:52,476 - INFO - ds_invalid_packet : 0
2026-06-19 16:10:52,476 - INFO - ds_cksum_err : 0
2026-06-19 16:10:52,476 - INFO - ds_no_fmd : 0
2026-06-19 16:10:52,476 - INFO - ds_invalid_vnid : 0
2026-06-19 16:10:52,476 - INFO - ds_frag_err : 0
2026-06-19 16:10:52,476 - INFO - ds_invalid_source : 0
2026-06-19 16:10:52,477 - INFO - ds_mcast_df_bit : 0
2026-06-19 16:10:52,477 - INFO - ds_l2_no_route : 0
2026-06-19 16:10:52,477 - INFO - ds_vlan_fwd_tx : 0
2026-06-19 16:10:52,477 - INFO - ds_vlan_fwd_enq : 0
2026-06-19 16:10:52,477 - INFO - ds_drop_new_flow : 0
2026-06-19 16:10:52,477 - INFO - ds_flow_evict : 0
2026-06-19 16:10:52,477 - INFO - ds_trap_original : 0
2026-06-19 16:10:52,477 - INFO - ds_no_memory : 0
2026-06-19 16:10:52,477 - INFO - ds_fragment_queue_fail : 0
2026-06-19 16:10:52,478 - INFO - ds_no_frag_entry : 0
2026-06-19 16:10:52,478 - INFO - ds_icmp_error : 0
2026-06-19 16:10:52,478 - INFO - ds_clone_fail : 0
2026-06-19 16:10:52,478 - INFO - ds_drop_pkts : 4
2026-06-19 16:10:52,484 - INFO - ----------------------------------------------------------------------------------------------------
2026-06-19 16:10:52,484 - INFO - ds_discard : 5
2026-06-19 16:10:52,484 - INFO - ds_pull : 0
2026-06-19 16:10:52,484 - INFO - ds_invalid_if : 2
2026-06-19 16:10:52,484 - INFO - ds_invalid_arp : 0
2026-06-19 16:10:52,485 - INFO - ds_trap_no_if : 0
2026-06-19 16:10:52,485 - INFO - ds_nowhere_to_go : 0
2026-06-19 16:10:52,485 - INFO - ds_flow_queue_limit_exceeded : 0
2026-06-19 16:10:52,485 - INFO - ds_flow_no_memory : 0
2026-06-19 16:10:52,485 - INFO - ds_flow_invalid_protocol : 0
2026-06-19 16:10:52,485 - INFO - ds_flow_nat_no_rflow : 0
2026-06-19 16:10:52,485 - INFO - ds_flow_action_drop : 16
2026-06-19 16:10:52,485 - INFO - ds_flow_action_invalid : 0
2026-06-19 16:10:52,485 - INFO - ds_flow_unusable : 0
2026-06-19 16:10:52,486 - INFO - ds_flow_table_full : 0
2026-06-19 16:10:52,486 - INFO - ds_interface_tx_discard : 0
2026-06-19 16:10:52,486 - INFO - ds_interface_drop : 0
2026-06-19 16:10:52,486 - INFO - ds_duplicated : 1
2026-06-19 16:10:52,486 - INFO - ds_push : 0
2026-06-19 16:10:52,486 - INFO - ds_ttl_exceeded : 0
2026-06-19 16:10:52,487 - INFO - ds_invalid_nh : 1
2026-06-19 16:10:52,487 - INFO - ds_invalid_label : 0
2026-06-19 16:10:52,487 - INFO - ds_invalid_protocol : 0
2026-06-19 16:10:52,487 - INFO - ds_interface_rx_discard : 0
2026-06-19 16:10:52,487 - INFO - ds_invalid_mcast_source : 0
2026-06-19 16:10:52,488 - INFO - ds_head_alloc_fail : 0
2026-06-19 16:10:52,488 - INFO - ds_pcow_fail : 0
2026-06-19 16:10:52,488 - INFO - ds_mcast_clone_fail : 0
2026-06-19 16:10:52,488 - INFO - ds_rewrite_fail : 0
2026-06-19 16:10:52,488 - INFO - ds_misc : 0
2026-06-19 16:10:52,488 - INFO - ds_invalid_packet : 0
2026-06-19 16:10:52,488 - INFO - ds_cksum_err : 0
2026-06-19 16:10:52,489 - INFO - ds_no_fmd : 0
2026-06-19 16:10:52,489 - INFO - ds_invalid_vnid : 0
2026-06-19 16:10:52,489 - INFO - ds_frag_err : 0
2026-06-19 16:10:52,489 - INFO - ds_invalid_source : 0
2026-06-19 16:10:52,489 - INFO - ds_mcast_df_bit : 0
2026-06-19 16:10:52,489 - INFO - ds_l2_no_route : 8
2026-06-19 16:10:52,489 - INFO - ds_vlan_fwd_tx : 0
2026-06-19 16:10:52,489 - INFO - ds_vlan_fwd_enq : 0
2026-06-19 16:10:52,489 - INFO - ds_drop_new_flow : 0
2026-06-19 16:10:52,489 - INFO - ds_flow_evict : 0
2026-06-19 16:10:52,489 - INFO - ds_trap_original : 0
2026-06-19 16:10:52,489 - INFO - ds_no_memory : 0
2026-06-19 16:10:52,489 - INFO - ds_fragment_queue_fail : 0
2026-06-19 16:10:52,489 - INFO - ds_no_frag_entry : 0
2026-06-19 16:10:52,490 - INFO - ds_icmp_error : 0
2026-06-19 16:10:52,490 - INFO - ds_clone_fail : 0
2026-06-19 16:10:52,490 - INFO - ds_drop_pkts : 33
2026-06-19 16:10:52,490 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 5 -W 1 220.56.112.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-06-19 16:10:52,490 - DEBUG - ping -s 56 -c 5 -W 1 220.56.112.131
2026-06-19 16:10:58,347 - DEBUG - PING 220.56.112.131 (220.56.112.131): 56 data bytes
--- 220.56.112.131 ping statistics ---
5 packets transmitted, 0 packets received, 100% packet loss
2026-06-19 16:10:58,348 - WARNING - Ping to IP 220.56.112.131 from VM ctest-vm1-50935795 failed
2026-06-19 16:11:14,457 - INFO - Vif and vrouter dropstats of type ds_flow_action_drop verifed
2026-06-19 16:11:14,457 - INFO - ----------------------------------------------------------------------------------------------------
2026-06-19 16:11:14,457 - INFO - ds_discard : 3
2026-06-19 16:11:14,457 - INFO - ds_pull : 0
2026-06-19 16:11:14,457 - INFO - ds_invalid_if : 2
2026-06-19 16:11:14,457 - INFO - ds_invalid_arp : 0
2026-06-19 16:11:14,457 - INFO - ds_trap_no_if : 0
2026-06-19 16:11:14,457 - INFO - ds_nowhere_to_go : 0
2026-06-19 16:11:14,457 - INFO - ds_flow_queue_limit_exceeded : 0
2026-06-19 16:11:14,457 - INFO - ds_flow_no_memory : 0
2026-06-19 16:11:14,457 - INFO - ds_flow_invalid_protocol : 0
2026-06-19 16:11:14,457 - INFO - ds_flow_nat_no_rflow : 0
2026-06-19 16:11:14,457 - INFO - ds_flow_action_drop : 5
2026-06-19 16:11:14,457 - INFO - ds_flow_action_invalid : 0
2026-06-19 16:11:14,457 - INFO - ds_flow_unusable : 0
2026-06-19 16:11:14,457 - INFO - ds_flow_table_full : 0
2026-06-19 16:11:14,457 - INFO - ds_interface_tx_discard : 0
2026-06-19 16:11:14,457 - INFO - ds_interface_drop : 0
2026-06-19 16:11:14,458 - INFO - ds_duplicated : 0
2026-06-19 16:11:14,458 - INFO - ds_push : 0
2026-06-19 16:11:14,458 - INFO - ds_ttl_exceeded : 0
2026-06-19 16:11:14,458 - INFO - ds_invalid_nh : 0
2026-06-19 16:11:14,458 - INFO - ds_invalid_label : 0
2026-06-19 16:11:14,458 - INFO - ds_invalid_protocol : 0
2026-06-19 16:11:14,458 - INFO - ds_interface_rx_discard : 0
2026-06-19 16:11:14,458 - INFO - ds_invalid_mcast_source : 0
2026-06-19 16:11:14,458 - INFO - ds_head_alloc_fail : 0
2026-06-19 16:11:14,458 - INFO - ds_pcow_fail : 0
2026-06-19 16:11:14,458 - INFO - ds_mcast_clone_fail : 0
2026-06-19 16:11:14,458 - INFO - ds_rewrite_fail : 0
2026-06-19 16:11:14,458 - INFO - ds_misc : 0
2026-06-19 16:11:14,458 - INFO - ds_invalid_packet : 0
2026-06-19 16:11:14,458 - INFO - ds_cksum_err : 0
2026-06-19 16:11:14,458 - INFO - ds_no_fmd : 0
2026-06-19 16:11:14,458 - INFO - ds_invalid_vnid : 0
2026-06-19 16:11:14,458 - INFO - ds_frag_err : 0
2026-06-19 16:11:14,458 - INFO - ds_invalid_source : 0
2026-06-19 16:11:14,458 - INFO - ds_mcast_df_bit : 0
2026-06-19 16:11:14,458 - INFO - ds_l2_no_route : 0
2026-06-19 16:11:14,458 - INFO - ds_vlan_fwd_tx : 0
2026-06-19 16:11:14,458 - INFO - ds_vlan_fwd_enq : 0
2026-06-19 16:11:14,458 - INFO - ds_drop_new_flow : 0
2026-06-19 16:11:14,458 - INFO - ds_flow_evict : 0
2026-06-19 16:11:14,458 - INFO - ds_trap_original : 0
2026-06-19 16:11:14,458 - INFO - ds_no_memory : 0
2026-06-19 16:11:14,459 - INFO - ds_fragment_queue_fail : 0
2026-06-19 16:11:14,459 - INFO - ds_no_frag_entry : 0
2026-06-19 16:11:14,459 - INFO - ds_icmp_error : 0
2026-06-19 16:11:14,459 - INFO - ds_clone_fail : 0
2026-06-19 16:11:14,459 - INFO - ds_drop_pkts : 10
2026-06-19 16:11:14,459 - INFO - ----------------------------------------------------------------------------------------------------
2026-06-19 16:11:14,459 - INFO - ds_discard : 6
2026-06-19 16:11:14,459 - INFO - ds_pull : 0
2026-06-19 16:11:14,459 - INFO - ds_invalid_if : 2
2026-06-19 16:11:14,459 - INFO - ds_invalid_arp : 0
2026-06-19 16:11:14,459 - INFO - ds_trap_no_if : 0
2026-06-19 16:11:14,459 - INFO - ds_nowhere_to_go : 0
2026-06-19 16:11:14,459 - INFO - ds_flow_queue_limit_exceeded : 0
2026-06-19 16:11:14,459 - INFO - ds_flow_no_memory : 0
2026-06-19 16:11:14,459 - INFO - ds_flow_invalid_protocol : 0
2026-06-19 16:11:14,459 - INFO - ds_flow_nat_no_rflow : 0
2026-06-19 16:11:14,459 - INFO - ds_flow_action_drop : 21
2026-06-19 16:11:14,459 - INFO - ds_flow_action_invalid : 0
2026-06-19 16:11:14,459 - INFO - ds_flow_unusable : 0
2026-06-19 16:11:14,459 - INFO - ds_flow_table_full : 0
2026-06-19 16:11:14,459 - INFO - ds_interface_tx_discard : 0
2026-06-19 16:11:14,459 - INFO - ds_interface_drop : 0
2026-06-19 16:11:14,459 - INFO - ds_duplicated : 1
2026-06-19 16:11:14,459 - INFO - ds_push : 0
2026-06-19 16:11:14,459 - INFO - ds_ttl_exceeded : 0
2026-06-19 16:11:14,459 - INFO - ds_invalid_nh : 1
2026-06-19 16:11:14,459 - INFO - ds_invalid_label : 0
2026-06-19 16:11:14,460 - INFO - ds_invalid_protocol : 0
2026-06-19 16:11:14,460 - INFO - ds_interface_rx_discard : 0
2026-06-19 16:11:14,460 - INFO - ds_invalid_mcast_source : 0
2026-06-19 16:11:14,460 - INFO - ds_head_alloc_fail : 0
2026-06-19 16:11:14,460 - INFO - ds_pcow_fail : 0
2026-06-19 16:11:14,460 - INFO - ds_mcast_clone_fail : 0
2026-06-19 16:11:14,460 - INFO - ds_rewrite_fail : 0
2026-06-19 16:11:14,460 - INFO - ds_misc : 0
2026-06-19 16:11:14,460 - INFO - ds_invalid_packet : 0
2026-06-19 16:11:14,460 - INFO - ds_cksum_err : 0
2026-06-19 16:11:14,460 - INFO - ds_no_fmd : 0
2026-06-19 16:11:14,460 - INFO - ds_invalid_vnid : 0
2026-06-19 16:11:14,460 - INFO - ds_frag_err : 0
2026-06-19 16:11:14,460 - INFO - ds_invalid_source : 0
2026-06-19 16:11:14,460 - INFO - ds_mcast_df_bit : 0
2026-06-19 16:11:14,460 - INFO - ds_l2_no_route : 8
2026-06-19 16:11:14,460 - INFO - ds_vlan_fwd_tx : 0
2026-06-19 16:11:14,460 - INFO - ds_vlan_fwd_enq : 0
2026-06-19 16:11:14,460 - INFO - ds_drop_new_flow : 0
2026-06-19 16:11:14,460 - INFO - ds_flow_evict : 0
2026-06-19 16:11:14,460 - INFO - ds_trap_original : 0
2026-06-19 16:11:14,460 - INFO - ds_no_memory : 0
2026-06-19 16:11:14,460 - INFO - ds_fragment_queue_fail : 0
2026-06-19 16:11:14,460 - INFO - ds_no_frag_entry : 0
2026-06-19 16:11:14,460 - INFO - ds_icmp_error : 0
2026-06-19 16:11:14,460 - INFO - ds_clone_fail : 0
2026-06-19 16:11:14,460 - INFO - ds_drop_pkts : 39
2026-06-19 16:11:14,461 - INFO - Deleting VM ctest-vm2-22427637
2026-06-19 16:11:14,528 - DEBUG - Verifying in api server 10.0.0.129
2026-06-19 16:11:14,528 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4
2026-06-19 16:11:14,536 - DEBUG - VM ID df53c758-65ba-4307-8865-63ee25ce79c4 of VM ctest-vm2-22427637 is still found in API Server
2026-06-19 16:11:16,537 - DEBUG - Verifying in api server 10.0.0.129
2026-06-19 16:11:16,537 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4
2026-06-19 16:11:16,544 - DEBUG - VM ID df53c758-65ba-4307-8865-63ee25ce79c4 of VM ctest-vm2-22427637 is still found in API Server
2026-06-19 16:11:18,545 - DEBUG - Verifying in api server 10.0.0.129
2026-06-19 16:11:18,545 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4
2026-06-19 16:11:18,551 - DEBUG - Response Code: 404
2026-06-19 16:11:18,551 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4
2026-06-19 16:11:18,557 - DEBUG - Response Code: 404
2026-06-19 16:11:18,557 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/df53c758-65ba-4307-8865-63ee25ce79c4
2026-06-19 16:11:18,562 - DEBUG - Response Code: 404
2026-06-19 16:11:18,562 - INFO - VM ctest-vm2-22427637 is fully removed in API-Server
2026-06-19 16:11:18,711 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found
2026-06-19 16:11:18,745 - DEBUG - Validated that vrouter 10.0.0.241 does not have VMs route for VN default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273
2026-06-19 16:11:18,755 - DEBUG - Validated that vrouter 10.0.0.242 does not have VMs route for VN default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273
2026-06-19 16:11:18,755 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273
2026-06-19 16:11:18,755 - INFO - VM ctest-vm2-22427637 is removed in Compute, and routes are removed in all compute nodes
2026-06-19 16:11:18,983 - INFO - Routes for VM ctest-vm2-22427637 is removed in all control-nodes
2026-06-19 16:11:18,983 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-2:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:11:19,012 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-2?flat
2026-06-19 16:11:19,042 - DEBUG - VM df53c758-65ba-4307-8865-63ee25ce79c4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-5994-2 uve
2026-06-19 16:11:19,042 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-06-19 16:11:19,042 - DEBUG - interface for vm df53c758-65ba-4307-8865-63ee25ce79c4 deleted from vrouter uve ...
2026-06-19 16:11:19,043 - DEBUG - Deleted interface not in error interface list ...
2026-06-19 16:11:22,043 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-2:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:11:22,082 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-2?flat
2026-06-19 16:11:22,112 - DEBUG - VM df53c758-65ba-4307-8865-63ee25ce79c4 is not present in vrouter an-jenkins-deploy-platform-ansible-os-5994-2 uve
2026-06-19 16:11:22,112 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-06-19 16:11:22,112 - DEBUG - interface for vm df53c758-65ba-4307-8865-63ee25ce79c4 deleted from vrouter uve ...
2026-06-19 16:11:22,112 - DEBUG - Deleted interface not in error interface list ...
2026-06-19 16:11:22,112 - DEBUG - Validated that VM df53c758-65ba-4307-8865-63ee25ce79c4 is removed in Vrouter UVE
2026-06-19 16:11:22,112 - DEBUG - Verifying through opserver in 10.0.0.38
2026-06-19 16:11:22,112 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273?flat
2026-06-19 16:11:22,128 - DEBUG - df53c758-65ba-4307-8865-63ee25ce79c4 BM not in default-domain:ctest-TestDropStats-86516654:ctest-vn-98336273 uve
2026-06-19 16:11:22,128 - DEBUG - Validated that VM df53c758-65ba-4307-8865-63ee25ce79c4 is not present in the VN UVE
2026-06-19 16:11:22,128 - DEBUG - Verifying the df53c758-65ba-4307-8865-63ee25ce79c4 virtual network link through opserver 10.0.0.38
2026-06-19 16:11:22,128 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines
2026-06-19 16:11:22,138 - INFO - df53c758-65ba-4307-8865-63ee25ce79c4 vm uve deleted from opserver
2026-06-19 16:11:22,138 - DEBUG - Verifying the df53c758-65ba-4307-8865-63ee25ce79c4 virtual network link through opserver 10.0.0.19
2026-06-19 16:11:22,138 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2026-06-19 16:11:22,150 - INFO - df53c758-65ba-4307-8865-63ee25ce79c4 vm uve deleted from opserver
2026-06-19 16:11:22,150 - DEBUG - Verifying the df53c758-65ba-4307-8865-63ee25ce79c4 virtual network link through opserver 10.0.0.129
2026-06-19 16:11:22,150 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machines
2026-06-19 16:11:22,161 - INFO - df53c758-65ba-4307-8865-63ee25ce79c4 vm uve deleted from opserver
2026-06-19 16:11:22,161 - INFO - Validated that VM df53c758-65ba-4307-8865-63ee25ce79c4 is removed from Opserver
2026-06-19 16:11:22,162 - INFO - Deleting VM ctest-vm1-50935795
2026-06-19 16:11:22,219 - DEBUG - Verifying in api server 10.0.0.129
2026-06-19 16:11:22,219 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:11:22,228 - DEBUG - VM ID c12082b6-2337-4a5c-9df2-8af665bf0c3b of VM ctest-vm1-50935795 is still found in API Server
2026-06-19 16:11:24,228 - DEBUG - Verifying in api server 10.0.0.129
2026-06-19 16:11:24,228 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:11:24,236 - DEBUG - VM ID c12082b6-2337-4a5c-9df2-8af665bf0c3b of VM ctest-vm1-50935795 is still found in API Server
2026-06-19 16:11:26,237 - DEBUG - Verifying in api server 10.0.0.129
2026-06-19 16:11:26,237 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:11:26,244 - DEBUG - Response Code: 404
2026-06-19 16:11:26,244 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:11:26,252 - DEBUG - Response Code: 404
2026-06-19 16:11:26,252 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:11:26,258 - DEBUG - Response Code: 404
2026-06-19 16:11:26,259 - INFO - VM ctest-vm1-50935795 is fully removed in API-Server
2026-06-19 16:11:26,411 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found
2026-06-19 16:11:26,443 - DEBUG - Validated that vrouter 10.0.0.241 does not have VMs route for VN default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015
2026-06-19 16:11:26,452 - DEBUG - Validated that vrouter 10.0.0.242 does not have VMs route for VN default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015
2026-06-19 16:11:26,453 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015
2026-06-19 16:11:26,453 - INFO - VM ctest-vm1-50935795 is removed in Compute, and routes are removed in all compute nodes
2026-06-19 16:11:26,679 - INFO - Routes for VM ctest-vm1-50935795 is removed in all control-nodes
2026-06-19 16:11:26,680 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-1:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:11:26,723 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-1?flat
2026-06-19 16:11:26,759 - DEBUG - VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is still present in vrouter an-jenkins-deploy-platform-ansible-os-5994-1 uve
2026-06-19 16:11:26,759 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-06-19 16:11:26,759 - DEBUG - interface for vm c12082b6-2337-4a5c-9df2-8af665bf0c3b deleted from vrouter uve ...
2026-06-19 16:11:26,760 - DEBUG - Deleted interface not in error interface list ...
2026-06-19 16:11:29,760 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-1:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:11:29,805 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-1?flat
2026-06-19 16:11:29,836 - DEBUG - VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is still present in vrouter an-jenkins-deploy-platform-ansible-os-5994-1 uve
2026-06-19 16:11:29,836 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-06-19 16:11:29,836 - DEBUG - interface for vm c12082b6-2337-4a5c-9df2-8af665bf0c3b deleted from vrouter uve ...
2026-06-19 16:11:29,836 - DEBUG - Deleted interface not in error interface list ...
2026-06-19 16:11:32,837 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-1:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:11:32,881 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-1?flat
2026-06-19 16:11:32,921 - DEBUG - VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is still present in vrouter an-jenkins-deploy-platform-ansible-os-5994-1 uve
2026-06-19 16:11:32,921 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-06-19 16:11:32,921 - DEBUG - interface for vm c12082b6-2337-4a5c-9df2-8af665bf0c3b deleted from vrouter uve ...
2026-06-19 16:11:32,921 - DEBUG - Deleted interface not in error interface list ...
2026-06-19 16:11:35,921 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-1:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:11:35,963 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-1?flat
2026-06-19 16:11:35,990 - DEBUG - VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is still present in vrouter an-jenkins-deploy-platform-ansible-os-5994-1 uve
2026-06-19 16:11:35,990 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-06-19 16:11:35,990 - DEBUG - interface for vm c12082b6-2337-4a5c-9df2-8af665bf0c3b deleted from vrouter uve ...
2026-06-19 16:11:35,990 - DEBUG - Deleted interface not in error interface list ...
2026-06-19 16:11:38,990 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-1:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:11:39,033 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-1?flat
2026-06-19 16:11:39,063 - DEBUG - VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is still present in vrouter an-jenkins-deploy-platform-ansible-os-5994-1 uve
2026-06-19 16:11:39,063 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-06-19 16:11:39,063 - DEBUG - interface for vm c12082b6-2337-4a5c-9df2-8af665bf0c3b deleted from vrouter uve ...
2026-06-19 16:11:39,063 - DEBUG - Deleted interface not in error interface list ...
2026-06-19 16:11:42,064 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-1:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:11:42,113 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-1?flat
2026-06-19 16:11:42,146 - DEBUG - VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is still present in vrouter an-jenkins-deploy-platform-ansible-os-5994-1 uve
2026-06-19 16:11:42,146 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-06-19 16:11:42,146 - DEBUG - interface for vm c12082b6-2337-4a5c-9df2-8af665bf0c3b deleted from vrouter uve ...
2026-06-19 16:11:42,146 - DEBUG - Deleted interface not in error interface list ...
2026-06-19 16:11:45,147 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5994-1:Compute:contrail-vrouter-agent:0?flat
2026-06-19 16:11:45,188 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5994-1?flat
2026-06-19 16:11:45,216 - DEBUG - VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is not present in vrouter an-jenkins-deploy-platform-ansible-os-5994-1 uve
2026-06-19 16:11:45,216 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-06-19 16:11:45,216 - DEBUG - interface for vm c12082b6-2337-4a5c-9df2-8af665bf0c3b deleted from vrouter uve ...
2026-06-19 16:11:45,216 - DEBUG - Deleted interface not in error interface list ...
2026-06-19 16:11:45,216 - DEBUG - Validated that VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is removed in Vrouter UVE
2026-06-19 16:11:45,216 - DEBUG - Verifying through opserver in 10.0.0.38
2026-06-19 16:11:45,216 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015?flat
2026-06-19 16:11:45,232 - DEBUG - c12082b6-2337-4a5c-9df2-8af665bf0c3b BM not in default-domain:ctest-TestDropStats-86516654:ctest-vn-93699015 uve
2026-06-19 16:11:45,232 - DEBUG - Validated that VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is not present in the VN UVE
2026-06-19 16:11:45,232 - DEBUG - Verifying the c12082b6-2337-4a5c-9df2-8af665bf0c3b virtual network link through opserver 10.0.0.38
2026-06-19 16:11:45,232 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines
2026-06-19 16:11:45,244 - DEBUG - No links retuned for c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:11:45,244 - INFO - c12082b6-2337-4a5c-9df2-8af665bf0c3b vm uve deleted from opserver
2026-06-19 16:11:45,244 - DEBUG - Verifying the c12082b6-2337-4a5c-9df2-8af665bf0c3b virtual network link through opserver 10.0.0.19
2026-06-19 16:11:45,244 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2026-06-19 16:11:45,280 - DEBUG - No links retuned for c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:11:45,281 - INFO - c12082b6-2337-4a5c-9df2-8af665bf0c3b vm uve deleted from opserver
2026-06-19 16:11:45,281 - DEBUG - Verifying the c12082b6-2337-4a5c-9df2-8af665bf0c3b virtual network link through opserver 10.0.0.129
2026-06-19 16:11:45,281 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machines
2026-06-19 16:11:45,293 - DEBUG - No links retuned for c12082b6-2337-4a5c-9df2-8af665bf0c3b
2026-06-19 16:11:45,293 - INFO - c12082b6-2337-4a5c-9df2-8af665bf0c3b vm uve deleted from opserver
2026-06-19 16:11:45,294 - INFO - Validated that VM c12082b6-2337-4a5c-9df2-8af665bf0c3b is removed from Opserver
2026-06-19 16:11:45,294 - INFO - Deleting VN ctest-vn-98336273
2026-06-19 16:11:45,456 - DEBUG - Response for deleting network ()
2026-06-19 16:11:45,457 - INFO - Deleting VN ctest-vn-93699015
2026-06-19 16:11:45,604 - DEBUG - Response for deleting network ()
2026-06-19 16:11:46,859 - DEBUG - Skipping xmpp flap check
2026-06-19 16:11:46,859 - INFO - END TEST : test_flow_action_drop_stats : PASSED[0:01:28]
2026-06-19 16:11:46,859 - INFO - --------------------------------------------------------------------------------
2026-06-19 16:11:47,598 - INFO - Deleted project: ctest-TestDropStats-86516654, ID : bc732062-88c9-46e9-8d3f-33923646a686