2026-03-09 03:21:09,396 - INFO - Domain Default found not creating 2026-03-09 03:21:09,571 - INFO - Project ctest-TestRoutes-56637830 not found, creating it 2026-03-09 03:21:10,082 - INFO - Created Project:ctest-TestRoutes-56637830, ID : 0826d822-4c84-4782-a7f9-dc007c0eebe6 2026-03-09 03:21:11,584 - INFO - ================================================================================ 2026-03-09 03:21:11,584 - INFO - STARTING TEST : test_rt_table_scenario_1 2026-03-09 03:21:11,584 - INFO - TEST DESCRIPTION : In a VN, launch a VM each on two computes Add a shorter prefix intf static route to VM2 Delete the VMs. The route table on compute1 should be removed 2026-03-09 03:21:12,848 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.25': '0', '10.20.0.254': '0'}, '10.0.0.27': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2026-03-09 03:21:12,848 - INFO - Initial checks done. Running the testcase now 2026-03-09 03:21:12,848 - INFO - 2026-03-09 03:21:13,537 - DEBUG - Response for create_network : {'network': {'id': '69d32741-3700-4bab-923a-8b853a892f8f', 'name': 'ctest-random-95698342', 'tenant_id': '0826d8224c844782a7f9dc007c0eebe6', 'project_id': '0826d8224c844782a7f9dc007c0eebe6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutes-56637830', 'ctest-random-95698342'], 'port_security_enabled': True, 'description': ''}} 2026-03-09 03:21:13,789 - DEBUG - Response for create_subnet : {'subnet': {'id': '27d59654-f31a-4d76-8fd9-4207a37ed44c', 'name': '', 'tenant_id': '0826d8224c844782a7f9dc007c0eebe6', 'network_id': '69d32741-3700-4bab-923a-8b853a892f8f', 'ip_version': 4, 'cidr': '169.228.8.128/26', 'allocation_pools': [{'start': '169.228.8.130', 'end': '169.228.8.190'}], 'gateway_ip': '169.228.8.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '169.228.8.130', 'tags': [], 'project_id': '0826d8224c844782a7f9dc007c0eebe6'}} 2026-03-09 03:21:13,810 - INFO - Created VN ctest-random-95698342 2026-03-09 03:21:13,821 - DEBUG - VN ctest-random-95698342 UUID is 69d32741-3700-4bab-923a-8b853a892f8f 2026-03-09 03:21:13,895 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestRoutes-56637830', 'ctest-vmi-03568159']} 2026-03-09 03:21:14,207 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-03568159', 'id': 'ea200001-59c6-4080-ad0b-063c2932d59d', 'tenant_id': '0826d8224c844782a7f9dc007c0eebe6', 'network_id': '69d32741-3700-4bab-923a-8b853a892f8f', 'mac_address': '02:ea:20:00:01:59', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '169.228.8.131', 'subnet_id': '27d59654-f31a-4d76-8fd9-4207a37ed44c'}], 'security_groups': ['ef072842-7519-491a-8093-8f6a37623754'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '0826d8224c844782a7f9dc007c0eebe6'}} 2026-03-09 03:21:14,207 - DEBUG - Created port ea200001-59c6-4080-ad0b-063c2932d59d 2026-03-09 03:21:14,301 - DEBUG - Services list from nova: [, , , ] 2026-03-09 03:21:14,302 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5454-1', 'an-jenkins-deploy-platform-ansible-os-5454-2']} 2026-03-09 03:21:14,302 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5454-1', 'an-jenkins-deploy-platform-ansible-os-5454-2']} 2026-03-09 03:21:15,398 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5454-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5454-1) 2026-03-09 03:21:15,915 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5454-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5454-2) 2026-03-09 03:21:16,192 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-TestRoutes-56637830', 'ctest-irtb-06886158'](UUID 9d275c88-a8bb-4dda-a674-09731a0d8913), prefixes : ['0.0.0.0/0'] 2026-03-09 03:21:16,192 - DEBUG - Sleeping for 1 seconds.. 2026-03-09 03:21:17,264 - INFO - Added intf route table 9d275c88-a8bb-4dda-a674-09731a0d8913 to port ea200001-59c6-4080-ad0b-063c2932d59d 2026-03-09 03:21:17,347 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-03-09 03:21:22,443 - DEBUG - VM is in ACTIVE state now 2026-03-09 03:21:22,443 - INFO - VM name : ctest-TestRoutes-56637830-50226459 2026-03-09 03:21:22,533 - DEBUG - VM ctest-TestRoutes-56637830-50226459 ID is b90ee302-ddc6-419b-a128-3fa8ab9dc4bd 2026-03-09 03:21:22,623 - DEBUG - VM is in ACTIVE state now 2026-03-09 03:21:22,649 - DEBUG - VM ctest-TestRoutes-56637830-50226459 launched on Node an-jenkins-deploy-platform-ansible-os-5454-1 2026-03-09 03:21:22,732 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd 2026-03-09 03:21:23,032 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd 2026-03-09 03:21:23,071 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd 2026-03-09 03:21:23,078 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/03d3622b-92d9-4b41-b41e-df32f7b04e94 2026-03-09 03:21:23,089 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd 2026-03-09 03:21:23,096 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/03d3622b-92d9-4b41-b41e-df32f7b04e94 2026-03-09 03:21:23,108 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/18d538c7-b3cb-4500-9940-54b8d0cc565a 2026-03-09 03:21:23,121 - DEBUG - Verifying in api server 10.0.0.23 2026-03-09 03:21:23,121 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd 2026-03-09 03:21:23,130 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/03d3622b-92d9-4b41-b41e-df32f7b04e94 2026-03-09 03:21:23,143 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/18d538c7-b3cb-4500-9940-54b8d0cc565a 2026-03-09 03:21:23,154 - INFO - VM ctest-TestRoutes-56637830-50226459 verfication in all API Servers passed 2026-03-09 03:21:23,184 - DEBUG - VM ctest-TestRoutes-56637830-50226459 Tap interface: {'index': '3', 'name': 'tap03d3622b-92', 'uuid': '03d3622b-92d9-4b41-b41e-df32f7b04e94', 'vrf_name': 'default-domain:ctest-TestRoutes-56637830:ctest-random-95698342:ctest-random-95698342', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestRoutes-56637830:ctest-random-95698342', 'vm_uuid': 'b90ee302-ddc6-419b-a128-3fa8ab9dc4bd', 'vm_name': 'ctest-TestRoutes-56637830-50226459', 'ip_addr': '169.228.8.132', 'mac_addr': '02:03:d3:62:2b:92', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '114', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-56637830:03d3622b-92d9-4b41-b41e-df32f7b04e94', 'sg_uuid_list': ['ef072842-7519-491a-8093-8f6a37623754'], 'static_route_list': None, 'vm_project_uuid': '0826d822-4c84-4782-a7f9-dc007c0eebe6', 'admin_state': 'Enabled', 'flow_key_idx': '29', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-03-09 03:21:23,184 - DEBUG - Agent 10.0.0.41 vrf name: default-domain:ctest-TestRoutes-56637830:ctest-random-95698342:ctest-random-95698342 2026-03-09 03:21:23,189 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestRoutes-56637830:ctest-random-95698342:ctest-random-95698342', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestRoutes-56637830:ctest-random-95698342', 'table_label': '-1', 'vxlan_id': '12', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.129:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-03-09 03:21:23,271 - DEBUG - VM ctest-TestRoutes-56637830-50226459 : Tap interface tap03d3622b-92 is set to Active 2026-03-09 03:21:23,272 - DEBUG - Tap interface tap03d3622b-92 detail : {'index': '3', 'name': 'tap03d3622b-92', 'uuid': '03d3622b-92d9-4b41-b41e-df32f7b04e94', 'vrf_name': 'default-domain:ctest-TestRoutes-56637830:ctest-random-95698342:ctest-random-95698342', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestRoutes-56637830:ctest-random-95698342', 'vm_uuid': 'b90ee302-ddc6-419b-a128-3fa8ab9dc4bd', 'vm_name': 'ctest-TestRoutes-56637830-50226459', 'ip_addr': '169.228.8.132', 'mac_addr': '02:03:d3:62:2b:92', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '114', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-56637830:03d3622b-92d9-4b41-b41e-df32f7b04e94', 'sg_uuid_list': ['ef072842-7519-491a-8093-8f6a37623754'], 'static_route_list': None, 'vm_project_uuid': '0826d822-4c84-4782-a7f9-dc007c0eebe6', 'admin_state': 'Enabled', 'flow_key_idx': '29', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-03-09 03:21:23,395 - DEBUG - Starting Layer 2 verification in Agent 2026-03-09 03:21:23,407 - DEBUG - Layer 2 path is seen for VM MAC 02:03:d3:62:2b:92 in agent 10.0.0.41 2026-03-09 03:21:23,408 - DEBUG - Active layer 2 route in agent is present for VMI tap03d3622b-92 2026-03-09 03:21:23,408 - DEBUG - L2 label(29) matches bw route table and interface table 2026-03-09 03:21:23,420 - DEBUG - VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 is found in Agent of node 10.0.0.41 2026-03-09 03:21:23,551 - DEBUG - VRF IDs of VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 is consistent in agent 10.0.0.41 2026-03-09 03:21:23,551 - DEBUG - Route for VM IP ['169.228.8.132'] is consistent in agent 10.0.0.41 2026-03-09 03:21:23,551 - DEBUG - VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 verification for VM ctest-TestRoutes-56637830-50226459 in Agent 10.0.0.41 passed 2026-03-09 03:21:23,660 - DEBUG - Starting all layer 2 verification in agent 10.0.0.41 2026-03-09 03:21:23,676 - DEBUG - Route for VM MAC 02:03:d3:62:2b:92 is consistent in agent 10.0.0.41 2026-03-09 03:21:23,682 - DEBUG - VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 is found in Agent of node 10.0.0.27 2026-03-09 03:21:23,817 - DEBUG - VRF IDs of VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 is consistent in agent 10.0.0.27 2026-03-09 03:21:23,817 - DEBUG - Route for VM IP ['169.228.8.132'] is consistent in agent 10.0.0.27 2026-03-09 03:21:23,817 - DEBUG - VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 verification for VM ctest-TestRoutes-56637830-50226459 in Agent 10.0.0.27 passed 2026-03-09 03:21:23,924 - DEBUG - Starting all layer 2 verification in agent 10.0.0.27 2026-03-09 03:21:23,936 - DEBUG - Route for VM MAC 02:03:d3:62:2b:92 is consistent in agent 10.0.0.27 2026-03-09 03:21:27,121 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2026-03-09 03:21:27,121 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-56637830-50226459 failed! 2026-03-09 03:21:27,135 - DEBUG - Gateway for vn default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 is 169.228.8.129 and allocation pool is NOT set 2026-03-09 03:21:29,206 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.02 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.557 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.557/1.789/3.021/1.232 ms') 2026-03-09 03:21:29,206 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-56637830-50226459 passed 2026-03-09 03:21:29,206 - INFO - VM ctest-TestRoutes-56637830-50226459 verifications in Compute nodes passed 2026-03-09 03:21:29,404 - DEBUG - Validated VM route 169.228.8.132 in vrouter of 10.0.0.41 2026-03-09 03:21:29,408 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-03-09 03:21:29,512 - DEBUG - Validated VM route 169.228.8.132 in vrouter of 10.0.0.27 2026-03-09 03:21:29,517 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: 10.20.0.129, 25; Got 10.20.0.129,25 2026-03-09 03:21:29,517 - DEBUG - Validated VM route 169.228.8.132 in vrouter of 10.0.0.27 2026-03-09 03:21:29,517 - INFO - Validated routes of VM ctest-TestRoutes-56637830-50226459 in all vrouters 2026-03-09 03:21:30,018 - DEBUG - Starting all layer2 verification in 10.0.0.22 Control Node 2026-03-09 03:21:30,141 - DEBUG - Layer2 route found for VM MAC 02:03:d3:62:2b:92 in Control-node 10.0.0.22 2026-03-09 03:21:30,142 - DEBUG - L2 Label for VM ctest-TestRoutes-56637830-50226459 same between Control-node 10.0.0.22 and Agent, Expected: 29, Seen: 29 2026-03-09 03:21:30,142 - DEBUG - Starting all layer2 verification in 10.0.0.249 Control Node 2026-03-09 03:21:30,265 - DEBUG - Layer2 route found for VM MAC 02:03:d3:62:2b:92 in Control-node 10.0.0.249 2026-03-09 03:21:30,265 - DEBUG - L2 Label for VM ctest-TestRoutes-56637830-50226459 same between Control-node 10.0.0.249 and Agent, Expected: 29, Seen: 29 2026-03-09 03:21:30,265 - DEBUG - Starting all layer2 verification in 10.0.0.23 Control Node 2026-03-09 03:21:30,384 - DEBUG - Layer2 route found for VM MAC 02:03:d3:62:2b:92 in Control-node 10.0.0.23 2026-03-09 03:21:30,385 - DEBUG - L2 Label for VM ctest-TestRoutes-56637830-50226459 same between Control-node 10.0.0.23 and Agent, Expected: 29, Seen: 29 2026-03-09 03:21:30,385 - INFO - Verification in Control-nodes for VM ctest-TestRoutes-56637830-50226459 passed 2026-03-09 03:21:30,385 - DEBUG - Verifying the vm in opserver 2026-03-09 03:21:30,385 - DEBUG - Verifying in collector 10.0.0.23 ... 2026-03-09 03:21:30,385 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd?flat 2026-03-09 03:21:30,683 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd?flat 2026-03-09 03:21:30,754 - DEBUG - Failed to get VM ctest-TestRoutes-56637830-50226459, ID b90ee302-ddc6-419b-a128-3fa8ab9dc4bd info from Opserver 2026-03-09 03:21:32,755 - DEBUG - Verifying the vm in opserver 2026-03-09 03:21:32,755 - DEBUG - Verifying in collector 10.0.0.23 ... 2026-03-09 03:21:32,755 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd?flat 2026-03-09 03:21:32,838 - DEBUG - Failed to get VM ctest-TestRoutes-56637830-50226459, ID b90ee302-ddc6-419b-a128-3fa8ab9dc4bd info from Opserver 2026-03-09 03:21:34,838 - DEBUG - Verifying the vm in opserver 2026-03-09 03:21:34,839 - DEBUG - Verifying in collector 10.0.0.23 ... 2026-03-09 03:21:34,839 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd?flat 2026-03-09 03:21:34,908 - DEBUG - Failed to get VM ctest-TestRoutes-56637830-50226459, ID b90ee302-ddc6-419b-a128-3fa8ab9dc4bd info from Opserver 2026-03-09 03:21:36,909 - DEBUG - Verifying the vm in opserver 2026-03-09 03:21:36,909 - DEBUG - Verifying in collector 10.0.0.23 ... 2026-03-09 03:21:36,909 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd?flat 2026-03-09 03:21:36,923 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-56637830:03d3622b-92d9-4b41-b41e-df32f7b04e94?flat 2026-03-09 03:21:37,218 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-56637830:03d3622b-92d9-4b41-b41e-df32f7b04e94?flat 2026-03-09 03:21:37,288 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-56637830:03d3622b-92d9-4b41-b41e-df32f7b04e94?flat 2026-03-09 03:21:37,355 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd?flat 2026-03-09 03:21:37,369 - DEBUG - Verifying vm in vn uve 2026-03-09 03:21:37,370 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-56637830:03d3622b-92d9-4b41-b41e-df32f7b04e94?flat 2026-03-09 03:21:37,436 - DEBUG - VM uve shows interface as {'rx_vlan': 65535, 'vn_uuid': '69d32741-3700-4bab-923a-8b853a892f8f', 'is_health_check_active': True, 'admin_state': True, 'ip4_active': True, 'vm_uuid': 'b90ee302-ddc6-419b-a128-3fa8ab9dc4bd', 'ip6_address': '::', 'vhostuser_mode': 0, 'vm_name': 'ctest-TestRoutes-56637830-50226459', 'fixed_ip4_list': ['169.228.8.132'], 'active': True, 'mac_address': '02:03:d3:62:2b:92', 'l2_active': True, 'virtual_network': 'default-domain:ctest-TestRoutes-56637830:ctest-random-95698342', '__T': 1773026496797160, 'uuid': '03d3622b-92d9-4b41-b41e-df32f7b04e94', 'gateway': '169.228.8.129', 'ip6_active': False, 'ip_address': '169.228.8.132', 'label': 25, 'port_mirror_enabled': False, 'tx_vlan': 65535} 2026-03-09 03:21:37,436 - DEBUG - VM uve shows ip address as ['169.228.8.132', '::'] 2026-03-09 03:21:37,436 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 2026-03-09 03:21:37,436 - INFO - Verifying through opserver in 10.0.0.22 2026-03-09 03:21:37,436 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-56637830:ctest-random-95698342?flat 2026-03-09 03:21:37,460 - DEBUG - expected vm list b90ee302-ddc6-419b-a128-3fa8ab9dc4bd 2026-03-09 03:21:37,460 - DEBUG - Extracted vm list ['b90ee302-ddc6-419b-a128-3fa8ab9dc4bd'] 2026-03-09 03:21:37,460 - INFO - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is present in default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 2026-03-09 03:21:37,460 - DEBUG - Verifying vm in vrouter uve 2026-03-09 03:21:37,460 - DEBUG - Getting info from collector 10.0.0.23.. 2026-03-09 03:21:37,460 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd?flat 2026-03-09 03:21:37,476 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-5454-1'] 2026-03-09 03:21:37,476 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5454-1:Compute:contrail-vrouter-agent:0?flat 2026-03-09 03:21:37,515 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5454-1?flat 2026-03-09 03:21:37,544 - DEBUG - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:21:37,544 - DEBUG - Validated that VM ctest-TestRoutes-56637830-50226459 is in Vrouter an-jenkins-deploy-platform-ansible-os-5454-1 UVE 2026-03-09 03:21:37,544 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-03-09 03:21:37,553 - DEBUG - Expected tap interface of VM uuid b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is default-domain:ctest-TestRoutes-56637830:03d3622b-92d9-4b41-b41e-df32f7b04e94 2026-03-09 03:21:37,553 - DEBUG - Expected VN of VM uuid b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 2026-03-09 03:21:37,554 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5454-1:Compute:contrail-vrouter-agent:0?flat 2026-03-09 03:21:37,598 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5454-1?flat 2026-03-09 03:21:37,632 - DEBUG - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:21:37,633 - INFO - tap interface default-domain:ctest-TestRoutes-56637830:03d3622b-92d9-4b41-b41e-df32f7b04e94 of vm b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:21:37,633 - DEBUG - Connected network default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 of vm b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:21:37,633 - DEBUG - Verifying the b90ee302-ddc6-419b-a128-3fa8ab9dc4bd virtual network link through opserver 10.0.0.22 2026-03-09 03:21:37,633 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2026-03-09 03:21:37,646 - DEBUG - VM link and name as {'name': 'b90ee302-ddc6-419b-a128-3fa8ab9dc4bd', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd?flat'} 2026-03-09 03:21:37,646 - DEBUG - Verifying the b90ee302-ddc6-419b-a128-3fa8ab9dc4bd virtual network link through opserver 10.0.0.249 2026-03-09 03:21:37,646 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2026-03-09 03:21:37,944 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2026-03-09 03:21:38,017 - DEBUG - VM link and name as {'name': 'b90ee302-ddc6-419b-a128-3fa8ab9dc4bd', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd?flat'} 2026-03-09 03:21:38,017 - DEBUG - Verifying the b90ee302-ddc6-419b-a128-3fa8ab9dc4bd virtual network link through opserver 10.0.0.23 2026-03-09 03:21:38,017 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2026-03-09 03:21:38,028 - DEBUG - VM link and name as {'name': 'b90ee302-ddc6-419b-a128-3fa8ab9dc4bd', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd?flat'} 2026-03-09 03:21:38,028 - INFO - VM ctest-TestRoutes-56637830-50226459 validations in Opserver passed 2026-03-09 03:21:38,028 - INFO - Waiting for VM ctest-TestRoutes-56637830-14617139 to be up.. 2026-03-09 03:21:38,142 - DEBUG - VM is in ACTIVE state now 2026-03-09 03:21:38,142 - INFO - VM name : ctest-TestRoutes-56637830-14617139 2026-03-09 03:21:38,223 - DEBUG - VM ctest-TestRoutes-56637830-14617139 ID is 301a8932-ef4a-448a-9d01-5c988bb1e11a 2026-03-09 03:21:38,223 - DEBUG - VM ctest-TestRoutes-56637830-14617139 launched on Node an-jenkins-deploy-platform-ansible-os-5454-2 2026-03-09 03:21:38,312 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/301a8932-ef4a-448a-9d01-5c988bb1e11a 2026-03-09 03:21:38,322 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ea200001-59c6-4080-ad0b-063c2932d59d 2026-03-09 03:21:39,479 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.81 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.358 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.358/1.585/2.812/1.227 ms') 2026-03-09 03:21:39,479 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-56637830-14617139 passed 2026-03-09 03:21:39,548 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-03-09 03:21:39,548 - DEBUG - Waiting to SSH to VM ctest-TestRoutes-56637830-14617139, IP 169.228.8.131, Port 22 2026-03-09 03:21:39,705 - DEBUG - VM ctest-TestRoutes-56637830-14617139 is ready for SSH connections 2026-03-09 03:21:39,706 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:21:40,016 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:21:40,051 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:21:40,090 - DEBUG - Requesting: http://10.0.0.22:8082/project/0826d822-4c84-4782-a7f9-dc007c0eebe6 2026-03-09 03:21:40,181 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/69d32741-3700-4bab-923a-8b853a892f8f 2026-03-09 03:21:40,203 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/69d32741-3700-4bab-923a-8b853a892f8f 2026-03-09 03:21:40,216 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66091608-51da-490e-afb9-be839734cfbd 2026-03-09 03:21:40,226 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66091608-51da-490e-afb9-be839734cfbd 2026-03-09 03:21:40,235 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/4fcab73e-454b-45de-84d6-425c9644d388 2026-03-09 03:21:40,241 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 03:21:40,241 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/69d32741-3700-4bab-923a-8b853a892f8f 2026-03-09 03:21:40,252 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66091608-51da-490e-afb9-be839734cfbd 2026-03-09 03:21:40,269 - INFO - Verified VN network id 12 for VN 69d32741-3700-4bab-923a-8b853a892f8f 2026-03-09 03:21:40,269 - INFO - Verifications in API Server for VN ctest-random-95698342 passed 2026-03-09 03:21:40,269 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/69d32741-3700-4bab-923a-8b853a892f8f 2026-03-09 03:21:40,279 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66091608-51da-490e-afb9-be839734cfbd 2026-03-09 03:21:40,289 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66091608-51da-490e-afb9-be839734cfbd 2026-03-09 03:21:40,300 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/4fcab73e-454b-45de-84d6-425c9644d388 2026-03-09 03:21:40,317 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-56637830:ctest-random-95698342', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-56637830', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7625481755117505451', 'uuid-lslong': '10536887682515677071'}, 'enable': 'true', 'created': '2026-03-09T03:21:13', 'last-modified': '2026-03-09T03:21:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:26.570407'} 2026-03-09 03:21:40,324 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 03:21:40,335 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-56637830:ctest-random-95698342', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-56637830', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7625481755117505451', 'uuid-lslong': '10536887682515677071'}, 'enable': 'true', 'created': '2026-03-09T03:21:13', 'last-modified': '2026-03-09T03:21:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:26.584683'} 2026-03-09 03:21:40,349 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 03:21:40,354 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-56637830:ctest-random-95698342', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-56637830', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7625481755117505451', 'uuid-lslong': '10536887682515677071'}, 'enable': 'true', 'created': '2026-03-09T03:21:13', 'last-modified': '2026-03-09T03:21:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:26.608841'} 2026-03-09 03:21:40,361 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 03:21:40,361 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-random-95698342 passed 2026-03-09 03:21:40,361 - DEBUG - ====Verifying policy data for ctest-random-95698342 in API_Server ====== 2026-03-09 03:21:40,361 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:21:40,367 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:21:40,378 - DEBUG - Requesting: http://10.0.0.22:8082/project/0826d822-4c84-4782-a7f9-dc007c0eebe6 2026-03-09 03:21:40,469 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/69d32741-3700-4bab-923a-8b853a892f8f 2026-03-09 03:21:40,478 - DEBUG - =>VN ctest-random-95698342 has no policy to be verified 2026-03-09 03:21:40,479 - DEBUG - Verifying the vn in opserver 2026-03-09 03:21:40,479 - DEBUG - Verifying the default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 virtual network link through opserver 10.0.0.22 2026-03-09 03:21:40,479 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-09 03:21:40,489 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-56637830:ctest-random-95698342', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-56637830:ctest-random-95698342?flat'} 2026-03-09 03:21:40,490 - DEBUG - Verifying the default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 virtual network link through opserver 10.0.0.249 2026-03-09 03:21:40,490 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-03-09 03:21:40,558 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-56637830:ctest-random-95698342', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-56637830:ctest-random-95698342?flat'} 2026-03-09 03:21:40,558 - DEBUG - Verifying the default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 virtual network link through opserver 10.0.0.23 2026-03-09 03:21:40,558 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-09 03:21:40,572 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-56637830:ctest-random-95698342', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-56637830:ctest-random-95698342?flat'} 2026-03-09 03:21:40,572 - INFO - Validated that VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 is found in opserver 2026-03-09 03:21:40,582 - DEBUG - VRF ids for VN ctest-random-95698342: {'10.0.0.41': '2', '10.0.0.27': '2'} 2026-03-09 03:21:40,583 - INFO - Deleting VM ctest-TestRoutes-56637830-50226459 2026-03-09 03:21:40,656 - DEBUG - Verifying in api server 10.0.0.23 2026-03-09 03:21:40,656 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd 2026-03-09 03:21:40,665 - DEBUG - VM ID b90ee302-ddc6-419b-a128-3fa8ab9dc4bd of VM ctest-TestRoutes-56637830-50226459 is still found in API Server 2026-03-09 03:21:42,666 - DEBUG - Verifying in api server 10.0.0.23 2026-03-09 03:21:42,666 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd 2026-03-09 03:21:42,673 - DEBUG - Response Code: 404 2026-03-09 03:21:42,673 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd 2026-03-09 03:21:42,678 - DEBUG - Response Code: 404 2026-03-09 03:21:42,678 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b90ee302-ddc6-419b-a128-3fa8ab9dc4bd 2026-03-09 03:21:42,684 - DEBUG - Response Code: 404 2026-03-09 03:21:42,684 - INFO - VM ctest-TestRoutes-56637830-50226459 is fully removed in API-Server 2026-03-09 03:21:42,835 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-03-09 03:21:42,874 - DEBUG - Validated that vrouter 10.0.0.41 does not have VMs route for VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 2026-03-09 03:21:42,990 - DEBUG - VM route 169.228.8.132 has been marked for discard in VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 of compute 10.0.0.27 2026-03-09 03:21:42,997 - DEBUG - Validated that vrouter 10.0.0.27 does not have VMs route for VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 2026-03-09 03:21:42,997 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 2026-03-09 03:21:42,997 - INFO - VM ctest-TestRoutes-56637830-50226459 is removed in Compute, and routes are removed in all compute nodes 2026-03-09 03:21:43,263 - INFO - Routes for VM ctest-TestRoutes-56637830-50226459 is removed in all control-nodes 2026-03-09 03:21:43,263 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5454-1:Compute:contrail-vrouter-agent:0?flat 2026-03-09 03:21:43,306 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5454-1?flat 2026-03-09 03:21:43,343 - DEBUG - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is still present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:21:43,343 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-03-09 03:21:43,344 - DEBUG - interface for vm b90ee302-ddc6-419b-a128-3fa8ab9dc4bd deleted from vrouter uve ... 2026-03-09 03:21:43,344 - DEBUG - Deleted interface not in error interface list ... 2026-03-09 03:21:46,344 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5454-1:Compute:contrail-vrouter-agent:0?flat 2026-03-09 03:21:46,385 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5454-1?flat 2026-03-09 03:21:46,420 - DEBUG - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is still present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:21:46,420 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-03-09 03:21:46,420 - DEBUG - interface for vm b90ee302-ddc6-419b-a128-3fa8ab9dc4bd deleted from vrouter uve ... 2026-03-09 03:21:46,420 - DEBUG - Deleted interface not in error interface list ... 2026-03-09 03:21:49,421 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5454-1:Compute:contrail-vrouter-agent:0?flat 2026-03-09 03:21:49,460 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5454-1?flat 2026-03-09 03:21:49,492 - DEBUG - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is still present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:21:49,492 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-03-09 03:21:49,492 - DEBUG - interface for vm b90ee302-ddc6-419b-a128-3fa8ab9dc4bd deleted from vrouter uve ... 2026-03-09 03:21:49,492 - DEBUG - Deleted interface not in error interface list ... 2026-03-09 03:21:52,492 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5454-1:Compute:contrail-vrouter-agent:0?flat 2026-03-09 03:21:52,530 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5454-1?flat 2026-03-09 03:21:52,560 - DEBUG - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is still present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:21:52,560 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-03-09 03:21:52,560 - DEBUG - interface for vm b90ee302-ddc6-419b-a128-3fa8ab9dc4bd deleted from vrouter uve ... 2026-03-09 03:21:52,560 - DEBUG - Deleted interface not in error interface list ... 2026-03-09 03:21:55,560 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5454-1:Compute:contrail-vrouter-agent:0?flat 2026-03-09 03:21:55,597 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5454-1?flat 2026-03-09 03:21:55,625 - DEBUG - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is still present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:21:55,625 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-03-09 03:21:55,625 - DEBUG - interface for vm b90ee302-ddc6-419b-a128-3fa8ab9dc4bd deleted from vrouter uve ... 2026-03-09 03:21:55,625 - DEBUG - Deleted interface not in error interface list ... 2026-03-09 03:21:58,625 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5454-1:Compute:contrail-vrouter-agent:0?flat 2026-03-09 03:21:58,665 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5454-1?flat 2026-03-09 03:21:58,696 - DEBUG - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is still present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:21:58,696 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-03-09 03:21:58,696 - DEBUG - interface for vm b90ee302-ddc6-419b-a128-3fa8ab9dc4bd deleted from vrouter uve ... 2026-03-09 03:21:58,696 - DEBUG - Deleted interface not in error interface list ... 2026-03-09 03:22:01,697 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5454-1:Compute:contrail-vrouter-agent:0?flat 2026-03-09 03:22:01,741 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5454-1?flat 2026-03-09 03:22:01,771 - DEBUG - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is still present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:22:01,771 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-03-09 03:22:01,771 - DEBUG - interface for vm b90ee302-ddc6-419b-a128-3fa8ab9dc4bd deleted from vrouter uve ... 2026-03-09 03:22:01,771 - DEBUG - Deleted interface not in error interface list ... 2026-03-09 03:22:04,772 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5454-1:Compute:contrail-vrouter-agent:0?flat 2026-03-09 03:22:04,811 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5454-1?flat 2026-03-09 03:22:04,847 - DEBUG - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is still present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:22:04,847 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-03-09 03:22:04,847 - DEBUG - interface for vm b90ee302-ddc6-419b-a128-3fa8ab9dc4bd deleted from vrouter uve ... 2026-03-09 03:22:04,847 - DEBUG - Deleted interface not in error interface list ... 2026-03-09 03:22:07,848 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5454-1:Compute:contrail-vrouter-agent:0?flat 2026-03-09 03:22:07,886 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5454-1?flat 2026-03-09 03:22:07,917 - DEBUG - VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is not present in vrouter an-jenkins-deploy-platform-ansible-os-5454-1 uve 2026-03-09 03:22:07,917 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-03-09 03:22:07,917 - DEBUG - interface for vm b90ee302-ddc6-419b-a128-3fa8ab9dc4bd deleted from vrouter uve ... 2026-03-09 03:22:07,917 - DEBUG - Deleted interface not in error interface list ... 2026-03-09 03:22:07,917 - DEBUG - Validated that VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is removed in Vrouter UVE 2026-03-09 03:22:07,917 - DEBUG - Verifying through opserver in 10.0.0.22 2026-03-09 03:22:07,917 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-56637830:ctest-random-95698342?flat 2026-03-09 03:22:07,938 - DEBUG - b90ee302-ddc6-419b-a128-3fa8ab9dc4bd BM not in default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 uve 2026-03-09 03:22:07,938 - DEBUG - Validated that VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is not present in the VN UVE 2026-03-09 03:22:07,938 - DEBUG - Verifying the b90ee302-ddc6-419b-a128-3fa8ab9dc4bd virtual network link through opserver 10.0.0.22 2026-03-09 03:22:07,938 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2026-03-09 03:22:07,950 - INFO - b90ee302-ddc6-419b-a128-3fa8ab9dc4bd vm uve deleted from opserver 2026-03-09 03:22:07,950 - DEBUG - Verifying the b90ee302-ddc6-419b-a128-3fa8ab9dc4bd virtual network link through opserver 10.0.0.249 2026-03-09 03:22:07,950 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2026-03-09 03:22:08,011 - INFO - b90ee302-ddc6-419b-a128-3fa8ab9dc4bd vm uve deleted from opserver 2026-03-09 03:22:08,011 - DEBUG - Verifying the b90ee302-ddc6-419b-a128-3fa8ab9dc4bd virtual network link through opserver 10.0.0.23 2026-03-09 03:22:08,011 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2026-03-09 03:22:08,022 - INFO - b90ee302-ddc6-419b-a128-3fa8ab9dc4bd vm uve deleted from opserver 2026-03-09 03:22:08,023 - INFO - Validated that VM b90ee302-ddc6-419b-a128-3fa8ab9dc4bd is removed from Opserver 2026-03-09 03:22:08,023 - INFO - Validate that Vrouter Route table does get cleared 2026-03-09 03:22:08,096 - INFO - Removed intf route table 9d275c88-a8bb-4dda-a674-09731a0d8913 from port ea200001-59c6-4080-ad0b-063c2932d59d 2026-03-09 03:22:08,128 - INFO - Deleted Interface route table 9d275c88-a8bb-4dda-a674-09731a0d8913 2026-03-09 03:22:08,128 - INFO - Detaching port ea200001-59c6-4080-ad0b-063c2932d59d from VM ctest-TestRoutes-56637830-14617139 2026-03-09 03:22:08,163 - INFO - Deleting VM ctest-TestRoutes-56637830-14617139 2026-03-09 03:22:08,425 - DEBUG - Response for delete_port : () 2026-03-09 03:22:08,425 - INFO - Deleted port ea200001-59c6-4080-ad0b-063c2932d59d 2026-03-09 03:22:08,426 - INFO - Deleting VN ctest-random-95698342 2026-03-09 03:22:08,624 - DEBUG - Response for deleting network () 2026-03-09 03:22:08,624 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66091608-51da-490e-afb9-be839734cfbd 2026-03-09 03:22:08,630 - DEBUG - Response Code: 404 2026-03-09 03:22:08,630 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:22:08,637 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:22:08,648 - DEBUG - Requesting: http://10.0.0.22:8082/project/0826d822-4c84-4782-a7f9-dc007c0eebe6 2026-03-09 03:22:08,734 - INFO - Validated that VN ctest-random-95698342 is not found in API Server 2026-03-09 03:22:08,744 - DEBUG - VN ctest-random-95698342 is not present in Agent 10.0.0.41 2026-03-09 03:22:08,757 - DEBUG - VN ctest-random-95698342 is not present in Agent 10.0.0.27 2026-03-09 03:22:08,757 - INFO - Validated that VN ctest-random-95698342 is not in any agent 2026-03-09 03:22:08,762 - DEBUG - VRF 2 is not seen in agent 10.0.0.41 2026-03-09 03:22:08,767 - DEBUG - Vrouter 10.0.0.41 does not have vrf 2 for VN ctest-random-95698342 2026-03-09 03:22:08,771 - DEBUG - VRF 2 is not seen in agent 10.0.0.27 2026-03-09 03:22:08,776 - DEBUG - Vrouter 10.0.0.27 does not have vrf 2 for VN ctest-random-95698342 2026-03-09 03:22:08,776 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestRoutes-56637830:ctest-random-95698342 2026-03-09 03:22:08,801 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-random-95698342 info 2026-03-09 03:22:10,091 - DEBUG - No XMPP flaps were noticed during the test
2026-03-09 03:22:10,091 - INFO - END TEST : test_rt_table_scenario_1 : PASSED[0:00:59]
2026-03-09 03:22:10,091 - INFO - -------------------------------------------------------------------------------- 2026-03-09 03:22:10,855 - INFO - Deleted project: ctest-TestRoutes-56637830, ID : 0826d822-4c84-4782-a7f9-dc007c0eebe6