2026-01-01 03:21:19,380 - INFO - Domain Default found not creating
2026-01-01 03:21:19,569 - INFO - Project ctest-TestRoutes-76828253 not found, creating it
2026-01-01 03:21:20,192 - INFO - Created Project:ctest-TestRoutes-76828253, ID : 332e1c8c-7896-4201-a3af-0ef800accd27
2026-01-01 03:21:21,861 - INFO - ================================================================================
2026-01-01 03:21:21,861 - INFO - STARTING TEST : test_rt_table_scenario_1
2026-01-01 03:21:21,861 - INFO - TEST DESCRIPTION :
In a VN, launch a VM each on two computes
Add a shorter prefix intf static route to VM2
Delete the VMs.
The route table on compute1 should be removed
2026-01-01 03:21:23,184 - DEBUG - Nothing to compare xmpp stats {'10.0.0.242': {'10.20.0.14': '0', '10.20.0.18': '0'}, '10.0.0.23': {'10.20.0.14': '1', '10.20.0.18': '1'}} with
2026-01-01 03:21:23,184 - INFO - Initial checks done. Running the testcase now
2026-01-01 03:21:23,184 - INFO -
2026-01-01 03:21:23,949 - DEBUG - Response for create_network : {'network': {'id': 'a3c6e4ea-1d18-4170-8def-8d8936054bcb', 'name': 'ctest-random-51867410', 'tenant_id': '332e1c8c78964201a3af0ef800accd27', 'project_id': '332e1c8c78964201a3af0ef800accd27', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutes-76828253', 'ctest-random-51867410'], 'port_security_enabled': True, 'description': ''}}
2026-01-01 03:21:24,310 - DEBUG - Response for create_subnet : {'subnet': {'id': '0052b431-c4df-4552-8ad2-50c662220e9c', 'name': '', 'tenant_id': '332e1c8c78964201a3af0ef800accd27', 'network_id': 'a3c6e4ea-1d18-4170-8def-8d8936054bcb', 'ip_version': 4, 'cidr': '2.32.90.128/26', 'allocation_pools': [{'start': '2.32.90.130', 'end': '2.32.90.190'}], 'gateway_ip': '2.32.90.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2.32.90.130', 'tags': [], 'project_id': '332e1c8c78964201a3af0ef800accd27'}}
2026-01-01 03:21:24,349 - INFO - Created VN ctest-random-51867410
2026-01-01 03:21:24,364 - DEBUG - VN ctest-random-51867410 UUID is a3c6e4ea-1d18-4170-8def-8d8936054bcb
2026-01-01 03:21:24,463 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestRoutes-76828253', 'ctest-vmi-05156904']}
2026-01-01 03:21:24,850 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-05156904', 'id': 'cf4541ed-b07c-4ab9-b416-7269709e8b61', 'tenant_id': '332e1c8c78964201a3af0ef800accd27', 'network_id': 'a3c6e4ea-1d18-4170-8def-8d8936054bcb', 'mac_address': '02:cf:45:41:ed:b0', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '2.32.90.131', 'subnet_id': '0052b431-c4df-4552-8ad2-50c662220e9c'}], 'security_groups': ['df9fd2e5-a627-429e-8b79-1dec4e2625aa'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '332e1c8c78964201a3af0ef800accd27'}}
2026-01-01 03:21:24,850 - DEBUG - Created port cf4541ed-b07c-4ab9-b416-7269709e8b61
2026-01-01 03:21:24,955 - DEBUG - Services list from nova: [, , , ]
2026-01-01 03:21:24,955 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4945-1', 'an-jenkins-deploy-platform-ansible-os-4945-2']}
2026-01-01 03:21:24,955 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4945-1', 'an-jenkins-deploy-platform-ansible-os-4945-2']}
2026-01-01 03:21:26,208 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4945-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4945-1)
2026-01-01 03:21:26,797 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4945-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4945-2)
2026-01-01 03:21:27,062 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-TestRoutes-76828253', 'ctest-irtb-74773689'](UUID a717052d-b076-4b28-ba66-fc877fada885), prefixes : ['0.0.0.0/0']
2026-01-01 03:21:27,062 - DEBUG - Sleeping for 1 seconds..
2026-01-01 03:21:28,130 - INFO - Added intf route table a717052d-b076-4b28-ba66-fc877fada885 to port cf4541ed-b07c-4ab9-b416-7269709e8b61
2026-01-01 03:21:28,219 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-01-01 03:21:33,303 - DEBUG - VM is in ACTIVE state now
2026-01-01 03:21:33,304 - INFO - VM name : ctest-TestRoutes-76828253-65812989
2026-01-01 03:21:33,395 - DEBUG - VM ctest-TestRoutes-76828253-65812989 ID is 3849e9bb-ea24-4c6f-8f14-649a94f96a09
2026-01-01 03:21:33,493 - DEBUG - VM is in ACTIVE state now
2026-01-01 03:21:33,520 - DEBUG - VM ctest-TestRoutes-76828253-65812989 launched on Node an-jenkins-deploy-platform-ansible-os-4945-1
2026-01-01 03:21:33,602 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09
2026-01-01 03:21:33,905 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09
2026-01-01 03:21:33,943 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09
2026-01-01 03:21:33,951 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/40321952-da90-4098-8df8-001b6cb23184
2026-01-01 03:21:33,962 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09
2026-01-01 03:21:33,971 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/40321952-da90-4098-8df8-001b6cb23184
2026-01-01 03:21:33,982 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/76bc2858-879b-4b02-bfac-5f1874b1ac46
2026-01-01 03:21:33,991 - DEBUG - Verifying in api server 10.0.0.27
2026-01-01 03:21:33,991 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09
2026-01-01 03:21:34,007 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/40321952-da90-4098-8df8-001b6cb23184
2026-01-01 03:21:34,017 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/76bc2858-879b-4b02-bfac-5f1874b1ac46
2026-01-01 03:21:34,026 - INFO - VM ctest-TestRoutes-76828253-65812989 verfication in all API Servers passed
2026-01-01 03:21:34,048 - DEBUG - VM ctest-TestRoutes-76828253-65812989 Tap interface: {'index': '3', 'name': 'tap40321952-da', 'uuid': '40321952-da90-4098-8df8-001b6cb23184', 'vrf_name': 'default-domain:ctest-TestRoutes-76828253:ctest-random-51867410:ctest-random-51867410', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestRoutes-76828253:ctest-random-51867410', 'vm_uuid': '3849e9bb-ea24-4c6f-8f14-649a94f96a09', 'vm_name': 'ctest-TestRoutes-76828253-65812989', 'ip_addr': '2.32.90.132', 'mac_addr': '02:40:32:19:52:da', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '114', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-76828253:40321952-da90-4098-8df8-001b6cb23184', 'sg_uuid_list': ['df9fd2e5-a627-429e-8b79-1dec4e2625aa'], 'static_route_list': None, 'vm_project_uuid': '332e1c8c-7896-4201-a3af-0ef800accd27', 'admin_state': 'Enabled', 'flow_key_idx': '29', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2026-01-01 03:21:34,048 - DEBUG - Agent 10.0.0.242 vrf name: default-domain:ctest-TestRoutes-76828253:ctest-random-51867410:ctest-random-51867410
2026-01-01 03:21:34,055 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestRoutes-76828253:ctest-random-51867410:ctest-random-51867410', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestRoutes-76828253:ctest-random-51867410', 'table_label': '-1', 'vxlan_id': '14', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.252:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]}
2026-01-01 03:21:34,143 - DEBUG - VM ctest-TestRoutes-76828253-65812989 : Tap interface tap40321952-da is set to Active
2026-01-01 03:21:34,144 - DEBUG - Tap interface tap40321952-da detail : {'index': '3', 'name': 'tap40321952-da', 'uuid': '40321952-da90-4098-8df8-001b6cb23184', 'vrf_name': 'default-domain:ctest-TestRoutes-76828253:ctest-random-51867410:ctest-random-51867410', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestRoutes-76828253:ctest-random-51867410', 'vm_uuid': '3849e9bb-ea24-4c6f-8f14-649a94f96a09', 'vm_name': 'ctest-TestRoutes-76828253-65812989', 'ip_addr': '2.32.90.132', 'mac_addr': '02:40:32:19:52:da', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '114', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-76828253:40321952-da90-4098-8df8-001b6cb23184', 'sg_uuid_list': ['df9fd2e5-a627-429e-8b79-1dec4e2625aa'], 'static_route_list': None, 'vm_project_uuid': '332e1c8c-7896-4201-a3af-0ef800accd27', 'admin_state': 'Enabled', 'flow_key_idx': '29', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2026-01-01 03:21:34,259 - DEBUG - Starting Layer 2 verification in Agent
2026-01-01 03:21:34,280 - DEBUG - Layer 2 path is seen for VM MAC 02:40:32:19:52:da in agent 10.0.0.242
2026-01-01 03:21:34,281 - DEBUG - Active layer 2 route in agent is present for VMI tap40321952-da
2026-01-01 03:21:34,281 - DEBUG - L2 label(29) matches bw route table and interface table
2026-01-01 03:21:34,288 - DEBUG - VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 is found in Agent of node 10.0.0.242
2026-01-01 03:21:34,437 - DEBUG - VRF IDs of VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 is consistent in agent 10.0.0.242
2026-01-01 03:21:34,437 - DEBUG - Route for VM IP ['2.32.90.132'] is consistent in agent 10.0.0.242
2026-01-01 03:21:34,437 - DEBUG - VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 verification for VM ctest-TestRoutes-76828253-65812989 in Agent 10.0.0.242 passed
2026-01-01 03:21:34,552 - DEBUG - Starting all layer 2 verification in agent 10.0.0.242
2026-01-01 03:21:34,574 - DEBUG - Route for VM MAC 02:40:32:19:52:da is consistent in agent 10.0.0.242
2026-01-01 03:21:34,580 - DEBUG - VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 is found in Agent of node 10.0.0.23
2026-01-01 03:21:34,714 - DEBUG - VRF IDs of VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 is consistent in agent 10.0.0.23
2026-01-01 03:21:34,714 - DEBUG - Route for VM IP ['2.32.90.132'] is consistent in agent 10.0.0.23
2026-01-01 03:21:34,714 - DEBUG - VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 verification for VM ctest-TestRoutes-76828253-65812989 in Agent 10.0.0.23 passed
2026-01-01 03:21:34,830 - DEBUG - Starting all layer 2 verification in agent 10.0.0.23
2026-01-01 03:21:34,843 - DEBUG - Route for VM MAC 02:40:32:19:52:da is consistent in agent 10.0.0.23
2026-01-01 03:21:38,036 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms')
2026-01-01 03:21:38,036 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-76828253-65812989 failed!
2026-01-01 03:21:38,051 - DEBUG - Gateway for vn default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 is 2.32.90.129 and allocation pool is NOT set
2026-01-01 03:21:40,117 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.82 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.990 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.990/2.407/3.824/1.417 ms')
2026-01-01 03:21:40,117 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-76828253-65812989 passed
2026-01-01 03:21:40,117 - INFO - VM ctest-TestRoutes-76828253-65812989 verifications in Compute nodes passed
2026-01-01 03:21:40,306 - DEBUG - Validated VM route 2.32.90.132 in vrouter of 10.0.0.242
2026-01-01 03:21:40,311 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0
2026-01-01 03:21:40,419 - DEBUG - Validated VM route 2.32.90.132 in vrouter of 10.0.0.23
2026-01-01 03:21:40,425 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: 10.20.0.252, 25; Got 10.20.0.252,25
2026-01-01 03:21:40,425 - DEBUG - Validated VM route 2.32.90.132 in vrouter of 10.0.0.23
2026-01-01 03:21:40,425 - INFO - Validated routes of VM ctest-TestRoutes-76828253-65812989 in all vrouters
2026-01-01 03:21:40,952 - DEBUG - Starting all layer2 verification in 10.0.0.249 Control Node
2026-01-01 03:21:41,088 - DEBUG - Layer2 route found for VM MAC 02:40:32:19:52:da in Control-node 10.0.0.249
2026-01-01 03:21:41,089 - DEBUG - L2 Label for VM ctest-TestRoutes-76828253-65812989 same between Control-node 10.0.0.249 and Agent, Expected: 29, Seen: 29
2026-01-01 03:21:41,089 - DEBUG - Starting all layer2 verification in 10.0.0.27 Control Node
2026-01-01 03:21:41,217 - DEBUG - Layer2 route found for VM MAC 02:40:32:19:52:da in Control-node 10.0.0.27
2026-01-01 03:21:41,217 - DEBUG - L2 Label for VM ctest-TestRoutes-76828253-65812989 same between Control-node 10.0.0.27 and Agent, Expected: 29, Seen: 29
2026-01-01 03:21:41,217 - INFO - Verification in Control-nodes for VM ctest-TestRoutes-76828253-65812989 passed
2026-01-01 03:21:41,217 - DEBUG - Verifying the vm in opserver
2026-01-01 03:21:41,217 - DEBUG - Verifying in collector 10.0.0.27 ...
2026-01-01 03:21:41,217 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat
2026-01-01 03:21:41,514 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat
2026-01-01 03:21:41,578 - DEBUG - Failed to get VM ctest-TestRoutes-76828253-65812989, ID 3849e9bb-ea24-4c6f-8f14-649a94f96a09 info from Opserver
2026-01-01 03:21:43,580 - DEBUG - Verifying the vm in opserver
2026-01-01 03:21:43,580 - DEBUG - Verifying in collector 10.0.0.27 ...
2026-01-01 03:21:43,580 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat
2026-01-01 03:21:43,647 - DEBUG - Failed to get VM ctest-TestRoutes-76828253-65812989, ID 3849e9bb-ea24-4c6f-8f14-649a94f96a09 info from Opserver
2026-01-01 03:21:45,648 - DEBUG - Verifying the vm in opserver
2026-01-01 03:21:45,648 - DEBUG - Verifying in collector 10.0.0.27 ...
2026-01-01 03:21:45,648 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat
2026-01-01 03:21:45,723 - DEBUG - Failed to get VM ctest-TestRoutes-76828253-65812989, ID 3849e9bb-ea24-4c6f-8f14-649a94f96a09 info from Opserver
2026-01-01 03:21:47,724 - DEBUG - Verifying the vm in opserver
2026-01-01 03:21:47,724 - DEBUG - Verifying in collector 10.0.0.27 ...
2026-01-01 03:21:47,724 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat
2026-01-01 03:21:47,739 - DEBUG - Failed to get VM ctest-TestRoutes-76828253-65812989, ID 3849e9bb-ea24-4c6f-8f14-649a94f96a09 info from Opserver
2026-01-01 03:21:49,740 - DEBUG - Verifying the vm in opserver
2026-01-01 03:21:49,741 - DEBUG - Verifying in collector 10.0.0.27 ...
2026-01-01 03:21:49,741 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat
2026-01-01 03:21:49,756 - DEBUG - Failed to get VM ctest-TestRoutes-76828253-65812989, ID 3849e9bb-ea24-4c6f-8f14-649a94f96a09 info from Opserver
2026-01-01 03:21:51,758 - DEBUG - Verifying the vm in opserver
2026-01-01 03:21:51,758 - DEBUG - Verifying in collector 10.0.0.27 ...
2026-01-01 03:21:51,758 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat
2026-01-01 03:21:51,774 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-76828253:40321952-da90-4098-8df8-001b6cb23184?flat
2026-01-01 03:21:52,075 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-76828253:40321952-da90-4098-8df8-001b6cb23184?flat
2026-01-01 03:21:52,160 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-76828253:40321952-da90-4098-8df8-001b6cb23184?flat
2026-01-01 03:21:52,241 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat
2026-01-01 03:21:52,257 - DEBUG - Verifying vm in vn uve
2026-01-01 03:21:52,257 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-76828253:40321952-da90-4098-8df8-001b6cb23184?flat
2026-01-01 03:21:52,362 - DEBUG - VM uve shows interface as {'vn_uuid': 'a3c6e4ea-1d18-4170-8def-8d8936054bcb', 'uuid': '40321952-da90-4098-8df8-001b6cb23184', 'vm_name': 'ctest-TestRoutes-76828253-65812989', 'tx_vlan': 65535, 'fixed_ip4_list': ['2.32.90.132'], 'virtual_network': 'default-domain:ctest-TestRoutes-76828253:ctest-random-51867410', 'mac_address': '02:40:32:19:52:da', '__T': 1767237711183620, 'ip4_active': True, 'admin_state': True, 'ip6_address': '::', 'vm_uuid': '3849e9bb-ea24-4c6f-8f14-649a94f96a09', 'is_health_check_active': True, 'vhostuser_mode': 0, 'ip_address': '2.32.90.132', 'label': 25, 'l2_active': True, 'gateway': '2.32.90.129', 'active': True, 'port_mirror_enabled': False, 'rx_vlan': 65535, 'ip6_active': False}
2026-01-01 03:21:52,362 - DEBUG - VM uve shows ip address as ['2.32.90.132', '::']
2026-01-01 03:21:52,362 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestRoutes-76828253:ctest-random-51867410
2026-01-01 03:21:52,362 - INFO - Verifying through opserver in 10.0.0.38
2026-01-01 03:21:52,362 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-76828253:ctest-random-51867410?flat
2026-01-01 03:21:52,402 - DEBUG - expected vm list 3849e9bb-ea24-4c6f-8f14-649a94f96a09
2026-01-01 03:21:52,403 - DEBUG - Extracted vm list ['3849e9bb-ea24-4c6f-8f14-649a94f96a09']
2026-01-01 03:21:52,403 - INFO - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is present in default-domain:ctest-TestRoutes-76828253:ctest-random-51867410
2026-01-01 03:21:52,403 - DEBUG - Verifying vm in vrouter uve
2026-01-01 03:21:52,403 - DEBUG - Getting info from collector 10.0.0.27..
2026-01-01 03:21:52,403 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat
2026-01-01 03:21:52,420 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4945-1']
2026-01-01 03:21:52,420 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4945-1:Compute:contrail-vrouter-agent:0?flat
2026-01-01 03:21:52,458 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4945-1?flat
2026-01-01 03:21:52,491 - DEBUG - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:21:52,491 - DEBUG - Validated that VM ctest-TestRoutes-76828253-65812989 is in Vrouter an-jenkins-deploy-platform-ansible-os-4945-1 UVE
2026-01-01 03:21:52,491 - DEBUG - Verifying vm tap interface/vn in vrouter uve
2026-01-01 03:21:52,499 - DEBUG - Expected tap interface of VM uuid 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is default-domain:ctest-TestRoutes-76828253:40321952-da90-4098-8df8-001b6cb23184
2026-01-01 03:21:52,499 - DEBUG - Expected VN of VM uuid 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is default-domain:ctest-TestRoutes-76828253:ctest-random-51867410
2026-01-01 03:21:52,499 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4945-1:Compute:contrail-vrouter-agent:0?flat
2026-01-01 03:21:52,536 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4945-1?flat
2026-01-01 03:21:52,569 - DEBUG - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:21:52,569 - INFO - tap interface default-domain:ctest-TestRoutes-76828253:40321952-da90-4098-8df8-001b6cb23184 of vm 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:21:52,569 - DEBUG - Connected network default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 of vm 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:21:52,569 - DEBUG - Verifying the 3849e9bb-ea24-4c6f-8f14-649a94f96a09 virtual network link through opserver 10.0.0.38
2026-01-01 03:21:52,569 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines
2026-01-01 03:21:52,583 - DEBUG - VM link and name as {'name': '3849e9bb-ea24-4c6f-8f14-649a94f96a09', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat'}
2026-01-01 03:21:52,583 - DEBUG - Verifying the 3849e9bb-ea24-4c6f-8f14-649a94f96a09 virtual network link through opserver 10.0.0.249
2026-01-01 03:21:52,583 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines
2026-01-01 03:21:52,880 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines
2026-01-01 03:21:52,953 - DEBUG - VM link and name as {'name': '3849e9bb-ea24-4c6f-8f14-649a94f96a09', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat'}
2026-01-01 03:21:52,953 - DEBUG - Verifying the 3849e9bb-ea24-4c6f-8f14-649a94f96a09 virtual network link through opserver 10.0.0.27
2026-01-01 03:21:52,953 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines
2026-01-01 03:21:52,966 - DEBUG - VM link and name as {'name': '3849e9bb-ea24-4c6f-8f14-649a94f96a09', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09?flat'}
2026-01-01 03:21:52,967 - INFO - VM ctest-TestRoutes-76828253-65812989 validations in Opserver passed
2026-01-01 03:21:52,967 - INFO - Waiting for VM ctest-TestRoutes-76828253-75773258 to be up..
2026-01-01 03:21:53,064 - DEBUG - VM is in ACTIVE state now
2026-01-01 03:21:53,065 - INFO - VM name : ctest-TestRoutes-76828253-75773258
2026-01-01 03:21:53,158 - DEBUG - VM ctest-TestRoutes-76828253-75773258 ID is eb791fd3-49f2-4426-a7ba-66467e57320f
2026-01-01 03:21:53,158 - DEBUG - VM ctest-TestRoutes-76828253-75773258 launched on Node an-jenkins-deploy-platform-ansible-os-4945-2
2026-01-01 03:21:53,244 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/eb791fd3-49f2-4426-a7ba-66467e57320f
2026-01-01 03:21:53,255 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/cf4541ed-b07c-4ab9-b416-7269709e8b61
2026-01-01 03:21:54,420 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.35 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.425 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.425/1.888/3.352/1.463 ms')
2026-01-01 03:21:54,420 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-76828253-75773258 passed
2026-01-01 03:21:54,491 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-01 03:21:54,491 - DEBUG - Waiting to SSH to VM ctest-TestRoutes-76828253-75773258, IP 2.32.90.131, Port 22
2026-01-01 03:21:54,659 - DEBUG - VM ctest-TestRoutes-76828253-75773258 is ready for SSH connections
2026-01-01 03:21:54,660 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-01 03:21:54,960 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-01 03:21:55,004 - DEBUG - Requesting: http://10.0.0.38:8082/domain/b5800509-dc40-4626-b491-badce4b95394
2026-01-01 03:21:55,055 - DEBUG - Requesting: http://10.0.0.38:8082/project/332e1c8c-7896-4201-a3af-0ef800accd27
2026-01-01 03:21:55,158 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a3c6e4ea-1d18-4170-8def-8d8936054bcb
2026-01-01 03:21:55,176 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a3c6e4ea-1d18-4170-8def-8d8936054bcb
2026-01-01 03:21:55,187 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79a5af86-db21-4a93-a137-e88e3150137d
2026-01-01 03:21:55,196 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79a5af86-db21-4a93-a137-e88e3150137d
2026-01-01 03:21:55,204 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/add88d54-02e8-4c1d-850d-258c3a85c979
2026-01-01 03:21:55,212 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-01 03:21:55,212 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a3c6e4ea-1d18-4170-8def-8d8936054bcb
2026-01-01 03:21:55,222 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79a5af86-db21-4a93-a137-e88e3150137d
2026-01-01 03:21:55,241 - INFO - Verified VN network id 14 for VN a3c6e4ea-1d18-4170-8def-8d8936054bcb
2026-01-01 03:21:55,241 - INFO - Verifications in API Server for VN ctest-random-51867410 passed
2026-01-01 03:21:55,241 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a3c6e4ea-1d18-4170-8def-8d8936054bcb
2026-01-01 03:21:55,253 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79a5af86-db21-4a93-a137-e88e3150137d
2026-01-01 03:21:55,262 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79a5af86-db21-4a93-a137-e88e3150137d
2026-01-01 03:21:55,270 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/add88d54-02e8-4c1d-850d-258c3a85c979
2026-01-01 03:21:55,282 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-76828253:ctest-random-51867410', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-76828253', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11801371567732572528', 'uuid-lslong': '10227548899238038475'}, 'enable': 'true', 'created': '2026-01-01T03:21:23', 'last-modified': '2026-01-01T03:21:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:31.052312'}
2026-01-01 03:21:55,288 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-01 03:21:55,295 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-76828253:ctest-random-51867410', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-76828253', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11801371567732572528', 'uuid-lslong': '10227548899238038475'}, 'enable': 'true', 'created': '2026-01-01T03:21:23', 'last-modified': '2026-01-01T03:21:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:31.065854'}
2026-01-01 03:21:55,301 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-01 03:21:55,310 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-76828253:ctest-random-51867410', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-76828253', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11801371567732572528', 'uuid-lslong': '10227548899238038475'}, 'enable': 'true', 'created': '2026-01-01T03:21:23', 'last-modified': '2026-01-01T03:21:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:31.076788'}
2026-01-01 03:21:55,317 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-01 03:21:55,317 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-random-51867410 passed
2026-01-01 03:21:55,317 - DEBUG - ====Verifying policy data for ctest-random-51867410 in API_Server ======
2026-01-01 03:21:55,317 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-01 03:21:55,323 - DEBUG - Requesting: http://10.0.0.38:8082/domain/b5800509-dc40-4626-b491-badce4b95394
2026-01-01 03:21:55,336 - DEBUG - Requesting: http://10.0.0.38:8082/project/332e1c8c-7896-4201-a3af-0ef800accd27
2026-01-01 03:21:55,438 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a3c6e4ea-1d18-4170-8def-8d8936054bcb
2026-01-01 03:21:55,450 - DEBUG - =>VN ctest-random-51867410 has no policy to be verified
2026-01-01 03:21:55,450 - DEBUG - Verifying the vn in opserver
2026-01-01 03:21:55,450 - DEBUG - Verifying the default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 virtual network link through opserver 10.0.0.38
2026-01-01 03:21:55,450 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-01 03:21:55,463 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-76828253:ctest-random-51867410', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-76828253:ctest-random-51867410?flat'}
2026-01-01 03:21:55,463 - DEBUG - Verifying the default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 virtual network link through opserver 10.0.0.249
2026-01-01 03:21:55,463 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-01-01 03:21:55,529 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-76828253:ctest-random-51867410', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-76828253:ctest-random-51867410?flat'}
2026-01-01 03:21:55,529 - DEBUG - Verifying the default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 virtual network link through opserver 10.0.0.27
2026-01-01 03:21:55,529 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2026-01-01 03:21:55,546 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-76828253:ctest-random-51867410', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-76828253:ctest-random-51867410?flat'}
2026-01-01 03:21:55,546 - INFO - Validated that VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 is found in opserver
2026-01-01 03:21:55,559 - DEBUG - VRF ids for VN ctest-random-51867410: {'10.0.0.242': '2', '10.0.0.23': '2'}
2026-01-01 03:21:55,560 - INFO - Deleting VM ctest-TestRoutes-76828253-65812989
2026-01-01 03:21:55,649 - DEBUG - Verifying in api server 10.0.0.27
2026-01-01 03:21:55,649 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09
2026-01-01 03:21:55,658 - DEBUG - VM ID 3849e9bb-ea24-4c6f-8f14-649a94f96a09 of VM ctest-TestRoutes-76828253-65812989 is still found in API Server
2026-01-01 03:21:57,658 - DEBUG - Verifying in api server 10.0.0.27
2026-01-01 03:21:57,658 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09
2026-01-01 03:21:57,666 - DEBUG - Response Code: 404
2026-01-01 03:21:57,666 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09
2026-01-01 03:21:57,673 - DEBUG - Response Code: 404
2026-01-01 03:21:57,673 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3849e9bb-ea24-4c6f-8f14-649a94f96a09
2026-01-01 03:21:57,680 - DEBUG - Response Code: 404
2026-01-01 03:21:57,680 - INFO - VM ctest-TestRoutes-76828253-65812989 is fully removed in API-Server
2026-01-01 03:21:57,833 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found
2026-01-01 03:21:57,872 - DEBUG - Validated that vrouter 10.0.0.242 does not have VMs route for VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410
2026-01-01 03:21:57,993 - DEBUG - VM route 2.32.90.132 has been marked for discard in VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 of compute 10.0.0.23
2026-01-01 03:21:57,998 - DEBUG - Validated that vrouter 10.0.0.23 does not have VMs route for VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410
2026-01-01 03:21:57,998 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410
2026-01-01 03:21:57,998 - INFO - VM ctest-TestRoutes-76828253-65812989 is removed in Compute, and routes are removed in all compute nodes
2026-01-01 03:21:58,260 - INFO - Routes for VM ctest-TestRoutes-76828253-65812989 is removed in all control-nodes
2026-01-01 03:21:58,261 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4945-1:Compute:contrail-vrouter-agent:0?flat
2026-01-01 03:21:58,298 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4945-1?flat
2026-01-01 03:21:58,332 - DEBUG - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:21:58,332 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-01-01 03:21:58,332 - DEBUG - interface for vm 3849e9bb-ea24-4c6f-8f14-649a94f96a09 deleted from vrouter uve ...
2026-01-01 03:21:58,333 - DEBUG - Deleted interface not in error interface list ...
2026-01-01 03:22:01,333 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4945-1:Compute:contrail-vrouter-agent:0?flat
2026-01-01 03:22:01,370 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4945-1?flat
2026-01-01 03:22:01,402 - DEBUG - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:22:01,402 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-01-01 03:22:01,402 - DEBUG - interface for vm 3849e9bb-ea24-4c6f-8f14-649a94f96a09 deleted from vrouter uve ...
2026-01-01 03:22:01,402 - DEBUG - Deleted interface not in error interface list ...
2026-01-01 03:22:04,403 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4945-1:Compute:contrail-vrouter-agent:0?flat
2026-01-01 03:22:04,447 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4945-1?flat
2026-01-01 03:22:04,483 - DEBUG - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:22:04,484 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-01-01 03:22:04,484 - DEBUG - interface for vm 3849e9bb-ea24-4c6f-8f14-649a94f96a09 deleted from vrouter uve ...
2026-01-01 03:22:04,484 - DEBUG - Deleted interface not in error interface list ...
2026-01-01 03:22:07,485 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4945-1:Compute:contrail-vrouter-agent:0?flat
2026-01-01 03:22:07,528 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4945-1?flat
2026-01-01 03:22:07,564 - DEBUG - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:22:07,564 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-01-01 03:22:07,564 - DEBUG - interface for vm 3849e9bb-ea24-4c6f-8f14-649a94f96a09 deleted from vrouter uve ...
2026-01-01 03:22:07,564 - DEBUG - Deleted interface not in error interface list ...
2026-01-01 03:22:10,564 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4945-1:Compute:contrail-vrouter-agent:0?flat
2026-01-01 03:22:10,602 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4945-1?flat
2026-01-01 03:22:10,638 - DEBUG - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:22:10,638 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-01-01 03:22:10,638 - DEBUG - interface for vm 3849e9bb-ea24-4c6f-8f14-649a94f96a09 deleted from vrouter uve ...
2026-01-01 03:22:10,638 - DEBUG - Deleted interface not in error interface list ...
2026-01-01 03:22:13,639 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4945-1:Compute:contrail-vrouter-agent:0?flat
2026-01-01 03:22:13,676 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4945-1?flat
2026-01-01 03:22:13,708 - DEBUG - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:22:13,708 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-01-01 03:22:13,708 - DEBUG - interface for vm 3849e9bb-ea24-4c6f-8f14-649a94f96a09 deleted from vrouter uve ...
2026-01-01 03:22:13,708 - DEBUG - Deleted interface not in error interface list ...
2026-01-01 03:22:16,709 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4945-1:Compute:contrail-vrouter-agent:0?flat
2026-01-01 03:22:16,748 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4945-1?flat
2026-01-01 03:22:16,781 - DEBUG - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:22:16,781 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-01-01 03:22:16,781 - DEBUG - interface for vm 3849e9bb-ea24-4c6f-8f14-649a94f96a09 deleted from vrouter uve ...
2026-01-01 03:22:16,781 - DEBUG - Deleted interface not in error interface list ...
2026-01-01 03:22:19,782 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4945-1:Compute:contrail-vrouter-agent:0?flat
2026-01-01 03:22:19,820 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4945-1?flat
2026-01-01 03:22:19,854 - DEBUG - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:22:19,854 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-01-01 03:22:19,854 - DEBUG - interface for vm 3849e9bb-ea24-4c6f-8f14-649a94f96a09 deleted from vrouter uve ...
2026-01-01 03:22:19,854 - DEBUG - Deleted interface not in error interface list ...
2026-01-01 03:22:22,855 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4945-1:Compute:contrail-vrouter-agent:0?flat
2026-01-01 03:22:22,893 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4945-1?flat
2026-01-01 03:22:22,928 - DEBUG - VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4945-1 uve
2026-01-01 03:22:22,928 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2026-01-01 03:22:22,928 - DEBUG - interface for vm 3849e9bb-ea24-4c6f-8f14-649a94f96a09 deleted from vrouter uve ...
2026-01-01 03:22:22,928 - DEBUG - Deleted interface not in error interface list ...
2026-01-01 03:22:22,928 - DEBUG - Validated that VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is removed in Vrouter UVE
2026-01-01 03:22:22,928 - DEBUG - Verifying through opserver in 10.0.0.38
2026-01-01 03:22:22,928 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-76828253:ctest-random-51867410?flat
2026-01-01 03:22:22,964 - DEBUG - 3849e9bb-ea24-4c6f-8f14-649a94f96a09 BM not in default-domain:ctest-TestRoutes-76828253:ctest-random-51867410 uve
2026-01-01 03:22:22,964 - DEBUG - Validated that VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is not present in the VN UVE
2026-01-01 03:22:22,964 - DEBUG - Verifying the 3849e9bb-ea24-4c6f-8f14-649a94f96a09 virtual network link through opserver 10.0.0.38
2026-01-01 03:22:22,964 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines
2026-01-01 03:22:22,978 - INFO - 3849e9bb-ea24-4c6f-8f14-649a94f96a09 vm uve deleted from opserver
2026-01-01 03:22:22,978 - DEBUG - Verifying the 3849e9bb-ea24-4c6f-8f14-649a94f96a09 virtual network link through opserver 10.0.0.249
2026-01-01 03:22:22,978 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines
2026-01-01 03:22:22,997 - INFO - 3849e9bb-ea24-4c6f-8f14-649a94f96a09 vm uve deleted from opserver
2026-01-01 03:22:22,997 - DEBUG - Verifying the 3849e9bb-ea24-4c6f-8f14-649a94f96a09 virtual network link through opserver 10.0.0.27
2026-01-01 03:22:22,997 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines
2026-01-01 03:22:23,013 - INFO - 3849e9bb-ea24-4c6f-8f14-649a94f96a09 vm uve deleted from opserver
2026-01-01 03:22:23,013 - INFO - Validated that VM 3849e9bb-ea24-4c6f-8f14-649a94f96a09 is removed from Opserver
2026-01-01 03:22:23,013 - INFO - Validate that Vrouter Route table does get cleared
2026-01-01 03:22:23,094 - INFO - Removed intf route table a717052d-b076-4b28-ba66-fc877fada885 from port cf4541ed-b07c-4ab9-b416-7269709e8b61
2026-01-01 03:22:23,150 - INFO - Deleted Interface route table a717052d-b076-4b28-ba66-fc877fada885
2026-01-01 03:22:23,150 - INFO - Detaching port cf4541ed-b07c-4ab9-b416-7269709e8b61 from VM ctest-TestRoutes-76828253-75773258
2026-01-01 03:22:23,206 - INFO - Deleting VM ctest-TestRoutes-76828253-75773258
2026-01-01 03:22:23,627 - DEBUG - Response for delete_port : ()
2026-01-01 03:22:23,627 - INFO - Deleted port cf4541ed-b07c-4ab9-b416-7269709e8b61
2026-01-01 03:22:23,627 - INFO - Deleting VN ctest-random-51867410
2026-01-01 03:22:23,833 - DEBUG - Response for deleting network ()
2026-01-01 03:22:23,833 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/79a5af86-db21-4a93-a137-e88e3150137d
2026-01-01 03:22:23,838 - DEBUG - Response Code: 404
2026-01-01 03:22:23,838 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-01 03:22:23,844 - DEBUG - Requesting: http://10.0.0.38:8082/domain/b5800509-dc40-4626-b491-badce4b95394
2026-01-01 03:22:23,862 - DEBUG - Requesting: http://10.0.0.38:8082/project/332e1c8c-7896-4201-a3af-0ef800accd27
2026-01-01 03:22:23,977 - INFO - Validated that VN ctest-random-51867410 is not found in API Server
2026-01-01 03:22:23,993 - DEBUG - VN ctest-random-51867410 is not present in Agent 10.0.0.242
2026-01-01 03:22:24,005 - DEBUG - VN ctest-random-51867410 is not present in Agent 10.0.0.23
2026-01-01 03:22:24,005 - INFO - Validated that VN ctest-random-51867410 is not in any agent
2026-01-01 03:22:24,011 - DEBUG - VRF 2 is not seen in agent 10.0.0.242
2026-01-01 03:22:24,018 - DEBUG - Vrouter 10.0.0.242 does not have vrf 2 for VN ctest-random-51867410
2026-01-01 03:22:24,023 - DEBUG - VRF 2 is not seen in agent 10.0.0.23
2026-01-01 03:22:24,028 - DEBUG - Vrouter 10.0.0.23 does not have vrf 2 for VN ctest-random-51867410
2026-01-01 03:22:24,028 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestRoutes-76828253:ctest-random-51867410
2026-01-01 03:22:24,057 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-random-51867410 info
2026-01-01 03:22:25,345 - DEBUG - No XMPP flaps were noticed during the test
2026-01-01 03:22:25,345 - INFO - END TEST : test_rt_table_scenario_1 : PASSED[0:01:04]
2026-01-01 03:22:25,345 - INFO - --------------------------------------------------------------------------------
2026-01-01 03:22:26,136 - INFO - Deleted project: ctest-TestRoutes-76828253, ID : 332e1c8c-7896-4201-a3af-0ef800accd27