2025-08-10 21:55:05,870 - INFO - Domain Default found not creating 2025-08-10 21:55:06,013 - INFO - Project ctest-TestRoutes-46506461 not found, creating it 2025-08-10 21:55:06,486 - INFO - Created Project:ctest-TestRoutes-46506461, ID : 3fc925eb-1f23-4b09-8ec0-e25d2fe79549 2025-08-10 21:55:07,975 - INFO - ================================================================================ 2025-08-10 21:55:07,975 - INFO - STARTING TEST : test_rt_table_scenario_1 2025-08-10 21:55:07,976 - INFO - TEST DESCRIPTION : In a VN, launch a VM each on two computes Add a shorter prefix intf static route to VM2 Delete the VMs. The route table on compute1 should be removed 2025-08-10 21:55:09,223 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.50': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2025-08-10 21:55:09,224 - INFO - Initial checks done. Running the testcase now 2025-08-10 21:55:09,224 - INFO - 2025-08-10 21:55:09,826 - DEBUG - Response for create_network : {'network': {'id': '0d1689ee-d99f-4c0b-b920-4e3a0347955a', 'name': 'ctest-random-29591525', 'tenant_id': '3fc925eb1f234b098ec0e25d2fe79549', 'project_id': '3fc925eb1f234b098ec0e25d2fe79549', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutes-46506461', 'ctest-random-29591525'], 'port_security_enabled': True, 'description': ''}} 2025-08-10 21:55:10,114 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd8ebf6e8-9365-4ec2-883e-03eeb51bd097', 'name': '', 'tenant_id': '3fc925eb1f234b098ec0e25d2fe79549', 'network_id': '0d1689ee-d99f-4c0b-b920-4e3a0347955a', 'ip_version': 4, 'cidr': '25.120.173.192/26', 'allocation_pools': [{'start': '25.120.173.194', 'end': '25.120.173.254'}], 'gateway_ip': '25.120.173.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '25.120.173.194', 'tags': [], 'project_id': '3fc925eb1f234b098ec0e25d2fe79549'}} 2025-08-10 21:55:10,134 - INFO - Created VN ctest-random-29591525 2025-08-10 21:55:10,144 - DEBUG - VN ctest-random-29591525 UUID is 0d1689ee-d99f-4c0b-b920-4e3a0347955a 2025-08-10 21:55:10,216 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestRoutes-46506461', 'ctest-vmi-83371956']} 2025-08-10 21:55:10,568 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-83371956', 'id': 'a0d19a2c-5978-4c5c-8f51-34866224f479', 'tenant_id': '3fc925eb1f234b098ec0e25d2fe79549', 'network_id': '0d1689ee-d99f-4c0b-b920-4e3a0347955a', 'mac_address': '02:a0:d1:9a:2c:59', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '25.120.173.195', 'subnet_id': 'd8ebf6e8-9365-4ec2-883e-03eeb51bd097'}], 'security_groups': ['a4a97ae1-478f-4ac0-ace9-6895f2f8a330'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '3fc925eb1f234b098ec0e25d2fe79549'}} 2025-08-10 21:55:10,568 - DEBUG - Created port a0d19a2c-5978-4c5c-8f51-34866224f479 2025-08-10 21:55:10,662 - DEBUG - Services list from nova: [, , , ] 2025-08-10 21:55:10,662 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3790-1', 'an-jenkins-deploy-platform-ansible-os-3790-2']} 2025-08-10 21:55:10,662 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3790-1', 'an-jenkins-deploy-platform-ansible-os-3790-2']} 2025-08-10 21:55:11,716 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3790-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3790-1) 2025-08-10 21:55:12,153 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3790-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3790-2) 2025-08-10 21:55:12,409 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-TestRoutes-46506461', 'ctest-irtb-06583446'](UUID 814c2eb0-b5c4-450d-85da-f6f63422fdc7), prefixes : ['0.0.0.0/0'] 2025-08-10 21:55:12,410 - DEBUG - Sleeping for 1 seconds.. 2025-08-10 21:55:13,480 - INFO - Added intf route table 814c2eb0-b5c4-450d-85da-f6f63422fdc7 to port a0d19a2c-5978-4c5c-8f51-34866224f479 2025-08-10 21:55:13,554 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-10 21:55:18,630 - DEBUG - VM is in ACTIVE state now 2025-08-10 21:55:18,630 - INFO - VM name : ctest-TestRoutes-46506461-13088563 2025-08-10 21:55:18,700 - DEBUG - VM ctest-TestRoutes-46506461-13088563 ID is d7aaa8bd-b520-46c8-8d24-bb72122fff5d 2025-08-10 21:55:18,770 - DEBUG - VM is in ACTIVE state now 2025-08-10 21:55:18,797 - DEBUG - VM ctest-TestRoutes-46506461-13088563 launched on Node an-jenkins-deploy-platform-ansible-os-3790-1 2025-08-10 21:55:18,868 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d 2025-08-10 21:55:19,159 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d 2025-08-10 21:55:19,191 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d 2025-08-10 21:55:19,201 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/84f9c593-96e4-4c88-b902-b70fe1d612d9 2025-08-10 21:55:19,210 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d 2025-08-10 21:55:19,217 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/84f9c593-96e4-4c88-b902-b70fe1d612d9 2025-08-10 21:55:19,226 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/aa1ca2d1-7f67-49ab-97a6-02a65fdbedb2 2025-08-10 21:55:19,234 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:55:19,234 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d 2025-08-10 21:55:19,240 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/84f9c593-96e4-4c88-b902-b70fe1d612d9 2025-08-10 21:55:19,249 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/aa1ca2d1-7f67-49ab-97a6-02a65fdbedb2 2025-08-10 21:55:19,256 - INFO - VM ctest-TestRoutes-46506461-13088563 verfication in all API Servers passed 2025-08-10 21:55:19,275 - DEBUG - VM ctest-TestRoutes-46506461-13088563 Tap interface: {'index': '3', 'name': 'tap84f9c593-96', 'uuid': '84f9c593-96e4-4c88-b902-b70fe1d612d9', 'vrf_name': 'default-domain:ctest-TestRoutes-46506461:ctest-random-29591525:ctest-random-29591525', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestRoutes-46506461:ctest-random-29591525', 'vm_uuid': 'd7aaa8bd-b520-46c8-8d24-bb72122fff5d', 'vm_name': 'ctest-TestRoutes-46506461-13088563', 'ip_addr': '25.120.173.196', 'mac_addr': '02:84:f9:c5:93:96', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '114', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-46506461:84f9c593-96e4-4c88-b902-b70fe1d612d9', 'sg_uuid_list': ['a4a97ae1-478f-4ac0-ace9-6895f2f8a330'], 'static_route_list': None, 'vm_project_uuid': '3fc925eb-1f23-4b09-8ec0-e25d2fe79549', 'admin_state': 'Enabled', 'flow_key_idx': '29', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-10 21:55:19,276 - DEBUG - Agent 10.0.0.254 vrf name: default-domain:ctest-TestRoutes-46506461:ctest-random-29591525:ctest-random-29591525 2025-08-10 21:55:19,281 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestRoutes-46506461:ctest-random-29591525:ctest-random-29591525', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestRoutes-46506461:ctest-random-29591525', 'table_label': '-1', 'vxlan_id': '11', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.193:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-10 21:55:19,406 - DEBUG - VM ctest-TestRoutes-46506461-13088563 : Tap interface tap84f9c593-96 is set to Active 2025-08-10 21:55:19,406 - DEBUG - Tap interface tap84f9c593-96 detail : {'index': '3', 'name': 'tap84f9c593-96', 'uuid': '84f9c593-96e4-4c88-b902-b70fe1d612d9', 'vrf_name': 'default-domain:ctest-TestRoutes-46506461:ctest-random-29591525:ctest-random-29591525', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestRoutes-46506461:ctest-random-29591525', 'vm_uuid': 'd7aaa8bd-b520-46c8-8d24-bb72122fff5d', 'vm_name': 'ctest-TestRoutes-46506461-13088563', 'ip_addr': '25.120.173.196', 'mac_addr': '02:84:f9:c5:93:96', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '114', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-46506461:84f9c593-96e4-4c88-b902-b70fe1d612d9', 'sg_uuid_list': ['a4a97ae1-478f-4ac0-ace9-6895f2f8a330'], 'static_route_list': None, 'vm_project_uuid': '3fc925eb-1f23-4b09-8ec0-e25d2fe79549', 'admin_state': 'Enabled', 'flow_key_idx': '29', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-10 21:55:19,557 - DEBUG - Starting Layer 2 verification in Agent 2025-08-10 21:55:19,570 - DEBUG - Layer 2 path is seen for VM MAC 02:84:f9:c5:93:96 in agent 10.0.0.254 2025-08-10 21:55:19,571 - DEBUG - Active layer 2 route in agent is present for VMI tap84f9c593-96 2025-08-10 21:55:19,571 - DEBUG - L2 label(29) matches bw route table and interface table 2025-08-10 21:55:19,578 - DEBUG - VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 is found in Agent of node 10.0.0.254 2025-08-10 21:55:19,726 - DEBUG - VRF IDs of VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 is consistent in agent 10.0.0.254 2025-08-10 21:55:19,726 - DEBUG - Route for VM IP ['25.120.173.196'] is consistent in agent 10.0.0.254 2025-08-10 21:55:19,727 - DEBUG - VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 verification for VM ctest-TestRoutes-46506461-13088563 in Agent 10.0.0.254 passed 2025-08-10 21:55:19,878 - DEBUG - Starting all layer 2 verification in agent 10.0.0.254 2025-08-10 21:55:19,891 - DEBUG - Route for VM MAC 02:84:f9:c5:93:96 is consistent in agent 10.0.0.254 2025-08-10 21:55:19,897 - DEBUG - VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 is found in Agent of node 10.0.0.50 2025-08-10 21:55:20,063 - DEBUG - VRF IDs of VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 is consistent in agent 10.0.0.50 2025-08-10 21:55:20,064 - DEBUG - Route for VM IP ['25.120.173.196'] is consistent in agent 10.0.0.50 2025-08-10 21:55:20,064 - DEBUG - VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 verification for VM ctest-TestRoutes-46506461-13088563 in Agent 10.0.0.50 passed 2025-08-10 21:55:20,217 - DEBUG - Starting all layer 2 verification in agent 10.0.0.50 2025-08-10 21:55:20,230 - DEBUG - Route for VM MAC 02:84:f9:c5:93:96 is consistent in agent 10.0.0.50 2025-08-10 21:55:23,460 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-08-10 21:55:23,460 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-46506461-13088563 failed! 2025-08-10 21:55:23,473 - DEBUG - Gateway for vn default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 is 25.120.173.193 and allocation pool is NOT set 2025-08-10 21:55:25,549 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.70 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.654 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.654/2.176/3.699/1.522 ms') 2025-08-10 21:55:25,549 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-46506461-13088563 passed 2025-08-10 21:55:25,549 - INFO - VM ctest-TestRoutes-46506461-13088563 verifications in Compute nodes passed 2025-08-10 21:55:25,802 - DEBUG - Validated VM route 25.120.173.196 in vrouter of 10.0.0.254 2025-08-10 21:55:25,805 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-08-10 21:55:25,917 - DEBUG - Validated VM route 25.120.173.196 in vrouter of 10.0.0.50 2025-08-10 21:55:25,921 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: 10.20.0.193, 25; Got 10.20.0.193,25 2025-08-10 21:55:25,921 - DEBUG - Validated VM route 25.120.173.196 in vrouter of 10.0.0.50 2025-08-10 21:55:25,921 - INFO - Validated routes of VM ctest-TestRoutes-46506461-13088563 in all vrouters 2025-08-10 21:55:26,540 - DEBUG - Starting all layer2 verification in 10.0.0.48 Control Node 2025-08-10 21:55:26,707 - DEBUG - Layer2 route found for VM MAC 02:84:f9:c5:93:96 in Control-node 10.0.0.48 2025-08-10 21:55:26,707 - DEBUG - L2 Label for VM ctest-TestRoutes-46506461-13088563 same between Control-node 10.0.0.48 and Agent, Expected: 29, Seen: 29 2025-08-10 21:55:26,707 - DEBUG - Starting all layer2 verification in 10.0.0.49 Control Node 2025-08-10 21:55:26,870 - DEBUG - Layer2 route found for VM MAC 02:84:f9:c5:93:96 in Control-node 10.0.0.49 2025-08-10 21:55:26,870 - DEBUG - L2 Label for VM ctest-TestRoutes-46506461-13088563 same between Control-node 10.0.0.49 and Agent, Expected: 29, Seen: 29 2025-08-10 21:55:26,870 - INFO - Verification in Control-nodes for VM ctest-TestRoutes-46506461-13088563 passed 2025-08-10 21:55:26,870 - DEBUG - Verifying the vm in opserver 2025-08-10 21:55:26,870 - DEBUG - Verifying in collector 10.0.0.49 ... 2025-08-10 21:55:26,870 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d?flat 2025-08-10 21:55:27,159 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d?flat 2025-08-10 21:55:27,214 - DEBUG - Failed to get VM ctest-TestRoutes-46506461-13088563, ID d7aaa8bd-b520-46c8-8d24-bb72122fff5d info from Opserver 2025-08-10 21:55:29,215 - DEBUG - Verifying the vm in opserver 2025-08-10 21:55:29,215 - DEBUG - Verifying in collector 10.0.0.49 ... 2025-08-10 21:55:29,215 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d?flat 2025-08-10 21:55:29,270 - DEBUG - Failed to get VM ctest-TestRoutes-46506461-13088563, ID d7aaa8bd-b520-46c8-8d24-bb72122fff5d info from Opserver 2025-08-10 21:55:31,271 - DEBUG - Verifying the vm in opserver 2025-08-10 21:55:31,271 - DEBUG - Verifying in collector 10.0.0.49 ... 2025-08-10 21:55:31,271 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d?flat 2025-08-10 21:55:31,328 - DEBUG - Failed to get VM ctest-TestRoutes-46506461-13088563, ID d7aaa8bd-b520-46c8-8d24-bb72122fff5d info from Opserver 2025-08-10 21:55:33,328 - DEBUG - Verifying the vm in opserver 2025-08-10 21:55:33,329 - DEBUG - Verifying in collector 10.0.0.49 ... 2025-08-10 21:55:33,329 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d?flat 2025-08-10 21:55:33,344 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-46506461:84f9c593-96e4-4c88-b902-b70fe1d612d9?flat 2025-08-10 21:55:33,640 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-46506461:84f9c593-96e4-4c88-b902-b70fe1d612d9?flat 2025-08-10 21:55:34,026 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-46506461:84f9c593-96e4-4c88-b902-b70fe1d612d9?flat 2025-08-10 21:55:34,539 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d?flat 2025-08-10 21:55:34,555 - DEBUG - Verifying vm in vn uve 2025-08-10 21:55:34,555 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-46506461:84f9c593-96e4-4c88-b902-b70fe1d612d9?flat 2025-08-10 21:55:34,746 - DEBUG - VM uve shows interface as {'gateway': '25.120.173.193', 'vm_name': 'ctest-TestRoutes-46506461-13088563', 'vn_uuid': '0d1689ee-d99f-4c0b-b920-4e3a0347955a', 'vm_uuid': 'd7aaa8bd-b520-46c8-8d24-bb72122fff5d', 'is_health_check_active': True, '__T': 1754862931476587, 'port_mirror_enabled': False, 'l2_active': True, 'active': True, 'tx_vlan': 65535, 'rx_vlan': 65535, 'fixed_ip4_list': ['25.120.173.196'], 'virtual_network': 'default-domain:ctest-TestRoutes-46506461:ctest-random-29591525', 'admin_state': True, 'uuid': '84f9c593-96e4-4c88-b902-b70fe1d612d9', 'label': 25, 'vhostuser_mode': 0, 'ip6_active': False, 'mac_address': '02:84:f9:c5:93:96', 'ip4_active': True, 'ip_address': '25.120.173.196', 'ip6_address': '::'} 2025-08-10 21:55:34,746 - DEBUG - VM uve shows ip address as ['25.120.173.196', '::'] 2025-08-10 21:55:34,746 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 2025-08-10 21:55:34,746 - INFO - Verifying through opserver in 10.0.0.48 2025-08-10 21:55:34,746 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-46506461:ctest-random-29591525?flat 2025-08-10 21:55:34,777 - DEBUG - expected vm list d7aaa8bd-b520-46c8-8d24-bb72122fff5d 2025-08-10 21:55:34,777 - DEBUG - Extracted vm list ['d7aaa8bd-b520-46c8-8d24-bb72122fff5d'] 2025-08-10 21:55:34,777 - INFO - VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is present in default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 2025-08-10 21:55:34,777 - DEBUG - Verifying vm in vrouter uve 2025-08-10 21:55:34,777 - DEBUG - Getting info from collector 10.0.0.49.. 2025-08-10 21:55:34,777 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d?flat 2025-08-10 21:55:34,791 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3790-1'] 2025-08-10 21:55:34,791 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:55:34,833 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:55:34,866 - DEBUG - VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:55:34,866 - DEBUG - Validated that VM ctest-TestRoutes-46506461-13088563 is in Vrouter an-jenkins-deploy-platform-ansible-os-3790-1 UVE 2025-08-10 21:55:34,866 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-08-10 21:55:34,873 - DEBUG - Expected tap interface of VM uuid d7aaa8bd-b520-46c8-8d24-bb72122fff5d is default-domain:ctest-TestRoutes-46506461:84f9c593-96e4-4c88-b902-b70fe1d612d9 2025-08-10 21:55:34,874 - DEBUG - Expected VN of VM uuid d7aaa8bd-b520-46c8-8d24-bb72122fff5d is default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 2025-08-10 21:55:34,874 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:55:34,934 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:55:34,965 - DEBUG - VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:55:34,965 - INFO - tap interface default-domain:ctest-TestRoutes-46506461:84f9c593-96e4-4c88-b902-b70fe1d612d9 of vm d7aaa8bd-b520-46c8-8d24-bb72122fff5d is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:55:34,965 - DEBUG - Connected network default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 of vm d7aaa8bd-b520-46c8-8d24-bb72122fff5d is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:55:34,965 - DEBUG - Verifying the d7aaa8bd-b520-46c8-8d24-bb72122fff5d virtual network link through opserver 10.0.0.48 2025-08-10 21:55:34,965 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machines 2025-08-10 21:55:34,985 - DEBUG - VM link and name as {'name': 'd7aaa8bd-b520-46c8-8d24-bb72122fff5d', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d?flat'} 2025-08-10 21:55:34,985 - DEBUG - Verifying the d7aaa8bd-b520-46c8-8d24-bb72122fff5d virtual network link through opserver 10.0.0.38 2025-08-10 21:55:34,985 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-10 21:55:35,329 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-10 21:55:35,394 - DEBUG - VM link and name as {'name': 'd7aaa8bd-b520-46c8-8d24-bb72122fff5d', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d?flat'} 2025-08-10 21:55:35,394 - DEBUG - Verifying the d7aaa8bd-b520-46c8-8d24-bb72122fff5d virtual network link through opserver 10.0.0.49 2025-08-10 21:55:35,394 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-08-10 21:55:35,405 - DEBUG - VM link and name as {'name': 'd7aaa8bd-b520-46c8-8d24-bb72122fff5d', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d?flat'} 2025-08-10 21:55:35,405 - INFO - VM ctest-TestRoutes-46506461-13088563 validations in Opserver passed 2025-08-10 21:55:35,405 - INFO - Waiting for VM ctest-TestRoutes-46506461-60778001 to be up.. 2025-08-10 21:55:35,481 - DEBUG - VM is in ACTIVE state now 2025-08-10 21:55:35,482 - INFO - VM name : ctest-TestRoutes-46506461-60778001 2025-08-10 21:55:35,546 - DEBUG - VM ctest-TestRoutes-46506461-60778001 ID is 87894cba-e431-44f7-93a6-675c00515329 2025-08-10 21:55:35,546 - DEBUG - VM ctest-TestRoutes-46506461-60778001 launched on Node an-jenkins-deploy-platform-ansible-os-3790-2 2025-08-10 21:55:35,619 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/87894cba-e431-44f7-93a6-675c00515329 2025-08-10 21:55:35,627 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/a0d19a2c-5978-4c5c-8f51-34866224f479 2025-08-10 21:55:36,814 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.22 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.293 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.293/1.758/3.224/1.465 ms') 2025-08-10 21:55:36,814 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-46506461-60778001 passed 2025-08-10 21:55:36,923 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 21:55:36,923 - DEBUG - Waiting to SSH to VM ctest-TestRoutes-46506461-60778001, IP 25.120.173.195, Port 22 2025-08-10 21:55:37,074 - DEBUG - VM ctest-TestRoutes-46506461-60778001 is ready for SSH connections 2025-08-10 21:55:37,074 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:55:37,363 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:55:37,391 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:55:37,405 - DEBUG - Requesting: http://10.0.0.48:8082/project/3fc925eb-1f23-4b09-8ec0-e25d2fe79549 2025-08-10 21:55:37,494 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0d1689ee-d99f-4c0b-b920-4e3a0347955a 2025-08-10 21:55:37,507 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0d1689ee-d99f-4c0b-b920-4e3a0347955a 2025-08-10 21:55:37,516 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/e7c15f8a-7b37-401f-b85e-c41c30e822dc 2025-08-10 21:55:37,524 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/e7c15f8a-7b37-401f-b85e-c41c30e822dc 2025-08-10 21:55:37,531 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/ea5ec1f6-e834-4926-ac30-ea7409b944fe 2025-08-10 21:55:37,538 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:55:37,538 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0d1689ee-d99f-4c0b-b920-4e3a0347955a 2025-08-10 21:55:37,548 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/e7c15f8a-7b37-401f-b85e-c41c30e822dc 2025-08-10 21:55:37,561 - INFO - Verified VN network id 11 for VN 0d1689ee-d99f-4c0b-b920-4e3a0347955a 2025-08-10 21:55:37,562 - INFO - Verifications in API Server for VN ctest-random-29591525 passed 2025-08-10 21:55:37,562 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0d1689ee-d99f-4c0b-b920-4e3a0347955a 2025-08-10 21:55:37,571 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/e7c15f8a-7b37-401f-b85e-c41c30e822dc 2025-08-10 21:55:37,577 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/e7c15f8a-7b37-401f-b85e-c41c30e822dc 2025-08-10 21:55:37,584 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/ea5ec1f6-e834-4926-ac30-ea7409b944fe 2025-08-10 21:55:37,596 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-46506461:ctest-random-29591525', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-46506461', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '943092830927014923', 'uuid-lslong': '13339748107341501786'}, 'enable': 'true', 'created': '2025-08-10T21:55:09', 'last-modified': '2025-08-10T21:55:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:27.536250'} 2025-08-10 21:55:37,604 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:55:37,609 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-46506461:ctest-random-29591525', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-46506461', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '943092830927014923', 'uuid-lslong': '13339748107341501786'}, 'enable': 'true', 'created': '2025-08-10T21:55:09', 'last-modified': '2025-08-10T21:55:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:27.549086'} 2025-08-10 21:55:37,615 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:55:37,620 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-46506461:ctest-random-29591525', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-46506461', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '943092830927014923', 'uuid-lslong': '13339748107341501786'}, 'enable': 'true', 'created': '2025-08-10T21:55:09', 'last-modified': '2025-08-10T21:55:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:27.560204'} 2025-08-10 21:55:37,628 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:55:37,628 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-random-29591525 passed 2025-08-10 21:55:37,628 - DEBUG - ====Verifying policy data for ctest-random-29591525 in API_Server ====== 2025-08-10 21:55:37,628 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:55:37,634 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:55:37,645 - DEBUG - Requesting: http://10.0.0.48:8082/project/3fc925eb-1f23-4b09-8ec0-e25d2fe79549 2025-08-10 21:55:37,745 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0d1689ee-d99f-4c0b-b920-4e3a0347955a 2025-08-10 21:55:37,761 - DEBUG - =>VN ctest-random-29591525 has no policy to be verified 2025-08-10 21:55:37,761 - DEBUG - Verifying the vn in opserver 2025-08-10 21:55:37,761 - DEBUG - Verifying the default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 virtual network link through opserver 10.0.0.48 2025-08-10 21:55:37,761 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-10 21:55:37,775 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-46506461:ctest-random-29591525', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-46506461:ctest-random-29591525?flat'} 2025-08-10 21:55:37,775 - DEBUG - Verifying the default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 virtual network link through opserver 10.0.0.38 2025-08-10 21:55:37,775 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-10 21:55:37,827 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-46506461:ctest-random-29591525', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-46506461:ctest-random-29591525?flat'} 2025-08-10 21:55:37,827 - DEBUG - Verifying the default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 virtual network link through opserver 10.0.0.49 2025-08-10 21:55:37,827 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-08-10 21:55:37,837 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-46506461:ctest-random-29591525', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-46506461:ctest-random-29591525?flat'} 2025-08-10 21:55:37,837 - INFO - Validated that VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 is found in opserver 2025-08-10 21:55:37,848 - DEBUG - VRF ids for VN ctest-random-29591525: {'10.0.0.254': '2', '10.0.0.50': '2'} 2025-08-10 21:55:37,848 - INFO - Deleting VM ctest-TestRoutes-46506461-13088563 2025-08-10 21:55:37,911 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:55:37,911 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d 2025-08-10 21:55:37,918 - DEBUG - VM ID d7aaa8bd-b520-46c8-8d24-bb72122fff5d of VM ctest-TestRoutes-46506461-13088563 is still found in API Server 2025-08-10 21:55:39,919 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:55:39,919 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d 2025-08-10 21:55:39,926 - DEBUG - Response Code: 404 2025-08-10 21:55:39,926 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d 2025-08-10 21:55:39,932 - DEBUG - Response Code: 404 2025-08-10 21:55:39,933 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/d7aaa8bd-b520-46c8-8d24-bb72122fff5d 2025-08-10 21:55:39,940 - DEBUG - Response Code: 404 2025-08-10 21:55:39,940 - INFO - VM ctest-TestRoutes-46506461-13088563 is fully removed in API-Server 2025-08-10 21:55:40,096 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-08-10 21:55:40,133 - DEBUG - Validated that vrouter 10.0.0.254 does not have VMs route for VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 2025-08-10 21:55:40,256 - DEBUG - VM route 25.120.173.196 has been marked for discard in VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 of compute 10.0.0.50 2025-08-10 21:55:40,258 - DEBUG - Validated that vrouter 10.0.0.50 does not have VMs route for VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 2025-08-10 21:55:40,258 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 2025-08-10 21:55:40,258 - INFO - VM ctest-TestRoutes-46506461-13088563 is removed in Compute, and routes are removed in all compute nodes 2025-08-10 21:55:40,557 - INFO - Routes for VM ctest-TestRoutes-46506461-13088563 is removed in all control-nodes 2025-08-10 21:55:40,558 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:55:40,598 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:55:40,644 - DEBUG - VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:55:40,644 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:55:40,645 - DEBUG - interface for vm d7aaa8bd-b520-46c8-8d24-bb72122fff5d deleted from vrouter uve ... 2025-08-10 21:55:40,645 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:55:43,645 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:55:43,684 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:55:43,719 - DEBUG - VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:55:43,719 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:55:43,719 - DEBUG - interface for vm d7aaa8bd-b520-46c8-8d24-bb72122fff5d deleted from vrouter uve ... 2025-08-10 21:55:43,719 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:55:46,720 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:55:46,760 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:55:46,793 - DEBUG - VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:55:46,793 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:55:46,793 - DEBUG - interface for vm d7aaa8bd-b520-46c8-8d24-bb72122fff5d deleted from vrouter uve ... 2025-08-10 21:55:46,793 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:55:49,793 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:55:49,833 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:55:49,864 - DEBUG - VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:55:49,864 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:55:49,864 - DEBUG - interface for vm d7aaa8bd-b520-46c8-8d24-bb72122fff5d deleted from vrouter uve ... 2025-08-10 21:55:49,864 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:55:52,865 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:55:52,909 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:55:52,945 - DEBUG - VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:55:52,945 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:55:52,946 - DEBUG - interface for vm d7aaa8bd-b520-46c8-8d24-bb72122fff5d deleted from vrouter uve ... 2025-08-10 21:55:52,946 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:55:55,946 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:55:56,025 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:55:56,066 - DEBUG - VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:55:56,066 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:55:56,066 - DEBUG - interface for vm d7aaa8bd-b520-46c8-8d24-bb72122fff5d deleted from vrouter uve ... 2025-08-10 21:55:56,066 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:55:59,067 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:55:59,106 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:55:59,138 - DEBUG - VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:55:59,138 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:55:59,138 - DEBUG - interface for vm d7aaa8bd-b520-46c8-8d24-bb72122fff5d deleted from vrouter uve ... 2025-08-10 21:55:59,138 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:56:02,139 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:56:02,179 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:56:02,213 - DEBUG - VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is not present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:56:02,213 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:56:02,213 - DEBUG - interface for vm d7aaa8bd-b520-46c8-8d24-bb72122fff5d deleted from vrouter uve ... 2025-08-10 21:56:02,213 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:56:02,213 - DEBUG - Validated that VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is removed in Vrouter UVE 2025-08-10 21:56:02,213 - DEBUG - Verifying through opserver in 10.0.0.48 2025-08-10 21:56:02,213 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-46506461:ctest-random-29591525?flat 2025-08-10 21:56:02,239 - DEBUG - d7aaa8bd-b520-46c8-8d24-bb72122fff5d BM not in default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 uve 2025-08-10 21:56:02,239 - DEBUG - Validated that VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is not present in the VN UVE 2025-08-10 21:56:02,239 - DEBUG - Verifying the d7aaa8bd-b520-46c8-8d24-bb72122fff5d virtual network link through opserver 10.0.0.48 2025-08-10 21:56:02,239 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machines 2025-08-10 21:56:02,251 - INFO - d7aaa8bd-b520-46c8-8d24-bb72122fff5d vm uve deleted from opserver 2025-08-10 21:56:02,252 - DEBUG - Verifying the d7aaa8bd-b520-46c8-8d24-bb72122fff5d virtual network link through opserver 10.0.0.38 2025-08-10 21:56:02,252 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-10 21:56:02,310 - INFO - d7aaa8bd-b520-46c8-8d24-bb72122fff5d vm uve deleted from opserver 2025-08-10 21:56:02,310 - DEBUG - Verifying the d7aaa8bd-b520-46c8-8d24-bb72122fff5d virtual network link through opserver 10.0.0.49 2025-08-10 21:56:02,310 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-08-10 21:56:02,322 - INFO - d7aaa8bd-b520-46c8-8d24-bb72122fff5d vm uve deleted from opserver 2025-08-10 21:56:02,322 - INFO - Validated that VM d7aaa8bd-b520-46c8-8d24-bb72122fff5d is removed from Opserver 2025-08-10 21:56:02,323 - INFO - Validate that Vrouter Route table does get cleared 2025-08-10 21:56:02,396 - INFO - Removed intf route table 814c2eb0-b5c4-450d-85da-f6f63422fdc7 from port a0d19a2c-5978-4c5c-8f51-34866224f479 2025-08-10 21:56:02,433 - INFO - Deleted Interface route table 814c2eb0-b5c4-450d-85da-f6f63422fdc7 2025-08-10 21:56:02,433 - INFO - Detaching port a0d19a2c-5978-4c5c-8f51-34866224f479 from VM ctest-TestRoutes-46506461-60778001 2025-08-10 21:56:02,470 - INFO - Deleting VM ctest-TestRoutes-46506461-60778001 2025-08-10 21:56:02,714 - DEBUG - Response for delete_port : () 2025-08-10 21:56:02,714 - INFO - Deleted port a0d19a2c-5978-4c5c-8f51-34866224f479 2025-08-10 21:56:02,714 - INFO - Deleting VN ctest-random-29591525 2025-08-10 21:56:02,858 - DEBUG - Response for deleting network () 2025-08-10 21:56:02,858 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/e7c15f8a-7b37-401f-b85e-c41c30e822dc 2025-08-10 21:56:02,864 - DEBUG - Response Code: 404 2025-08-10 21:56:02,865 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:56:02,870 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:56:02,925 - DEBUG - Requesting: http://10.0.0.48:8082/project/3fc925eb-1f23-4b09-8ec0-e25d2fe79549 2025-08-10 21:56:03,009 - INFO - Validated that VN ctest-random-29591525 is not found in API Server 2025-08-10 21:56:03,021 - DEBUG - VN ctest-random-29591525 is not present in Agent 10.0.0.254 2025-08-10 21:56:03,031 - DEBUG - VN ctest-random-29591525 is not present in Agent 10.0.0.50 2025-08-10 21:56:03,031 - INFO - Validated that VN ctest-random-29591525 is not in any agent 2025-08-10 21:56:03,036 - DEBUG - VRF 2 is not seen in agent 10.0.0.254 2025-08-10 21:56:03,041 - DEBUG - Vrouter 10.0.0.254 does not have vrf 2 for VN ctest-random-29591525 2025-08-10 21:56:03,046 - DEBUG - VRF 2 is not seen in agent 10.0.0.50 2025-08-10 21:56:03,051 - DEBUG - Vrouter 10.0.0.50 does not have vrf 2 for VN ctest-random-29591525 2025-08-10 21:56:03,051 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestRoutes-46506461:ctest-random-29591525 2025-08-10 21:56:03,070 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-random-29591525 info 2025-08-10 21:56:04,323 - DEBUG - No XMPP flaps were noticed during the test
2025-08-10 21:56:04,323 - INFO - END TEST : test_rt_table_scenario_1 : PASSED[0:00:57]
2025-08-10 21:56:04,323 - INFO - -------------------------------------------------------------------------------- 2025-08-10 21:56:05,032 - INFO - Deleted project: ctest-TestRoutes-46506461, ID : 3fc925eb-1f23-4b09-8ec0-e25d2fe79549