is in ACTIVE state now
2025-10-16 02:40:32,232 - DEBUG - VM ctest-VM31-64953336 launched on Node an-jenkins-deploy-platform-ansible-os-4339-1
2025-10-16 02:40:32,316 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5
2025-10-16 02:40:32,327 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5
2025-10-16 02:40:32,334 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9
2025-10-16 02:40:32,344 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5
2025-10-16 02:40:32,351 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9
2025-10-16 02:40:32,361 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/9a0672e4-b5e4-46f1-9ecd-5138bd0e5e28
2025-10-16 02:40:32,370 - DEBUG - Verifying in api server 10.0.0.23
2025-10-16 02:40:32,370 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5
2025-10-16 02:40:32,376 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9
2025-10-16 02:40:32,386 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/9a0672e4-b5e4-46f1-9ecd-5138bd0e5e28
2025-10-16 02:40:32,394 - INFO - VM ctest-VM31-64953336 verfication in all API Servers passed
2025-10-16 02:40:32,411 - DEBUG - VM ctest-VM31-64953336 Tap interface: {'index': '4', 'name': 'tapb9f9b7fe-8c', 'uuid': 'b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350:ctest-VN3-59930350', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350', 'vm_uuid': '80c2d002-280c-47f8-a60c-e8934e04f9b5', 'vm_name': 'ctest-VM31-64953336', 'ip_addr': '92.178.109.67', 'mac_addr': '02:b9:f9:b7:fe:8c', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '47', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-46678709:b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9', 'sg_uuid_list': ['062f3d04-4cb5-4023-96e3-f98b2fd3fe5c'], 'static_route_list': None, 'vm_project_uuid': 'cb5de812-69f0-4575-9fe8-b92e90450278', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2025-10-16 02:40:32,412 - DEBUG - Agent 10.0.0.38 vrf name: default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350:ctest-VN3-59930350
2025-10-16 02:40:32,417 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350:ctest-VN3-59930350', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.145:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]}
2025-10-16 02:40:32,496 - DEBUG - VM ctest-VM31-64953336 : Tap interface tapb9f9b7fe-8c is set to Active
2025-10-16 02:40:32,496 - DEBUG - Tap interface tapb9f9b7fe-8c detail : {'index': '4', 'name': 'tapb9f9b7fe-8c', 'uuid': 'b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350:ctest-VN3-59930350', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350', 'vm_uuid': '80c2d002-280c-47f8-a60c-e8934e04f9b5', 'vm_name': 'ctest-VM31-64953336', 'ip_addr': '92.178.109.67', 'mac_addr': '02:b9:f9:b7:fe:8c', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '47', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-46678709:b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9', 'sg_uuid_list': ['062f3d04-4cb5-4023-96e3-f98b2fd3fe5c'], 'static_route_list': None, 'vm_project_uuid': 'cb5de812-69f0-4575-9fe8-b92e90450278', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2025-10-16 02:40:32,603 - DEBUG - Starting Layer 2 verification in Agent
2025-10-16 02:40:32,614 - DEBUG - Layer 2 path is seen for VM MAC 02:b9:f9:b7:fe:8c in agent 10.0.0.38
2025-10-16 02:40:32,614 - DEBUG - Active layer 2 route in agent is present for VMI tapb9f9b7fe-8c
2025-10-16 02:40:32,614 - DEBUG - L2 label(36) matches bw route table and interface table
2025-10-16 02:40:32,621 - DEBUG - VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350 is found in Agent of node 10.0.0.38
2025-10-16 02:40:32,747 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350 is consistent in agent 10.0.0.38
2025-10-16 02:40:32,748 - DEBUG - Route for VM IP ['92.178.109.67'] is consistent in agent 10.0.0.38
2025-10-16 02:40:32,748 - DEBUG - VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350 verification for VM ctest-VM31-64953336 in Agent 10.0.0.38 passed
2025-10-16 02:40:32,859 - DEBUG - Starting all layer 2 verification in agent 10.0.0.38
2025-10-16 02:40:32,868 - DEBUG - Route for VM MAC 02:b9:f9:b7:fe:8c is consistent in agent 10.0.0.38
2025-10-16 02:40:34,050 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=5.84 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=3.16 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.164/4.500/5.837/1.336 ms')
2025-10-16 02:40:34,050 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-64953336 passed
2025-10-16 02:40:34,051 - INFO - VM ctest-VM31-64953336 verifications in Compute nodes passed
2025-10-16 02:40:34,250 - DEBUG - Validated VM route 92.178.109.67 in vrouter of 10.0.0.38
2025-10-16 02:40:34,255 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0
2025-10-16 02:40:34,255 - INFO - Validated routes of VM ctest-VM31-64953336 in all vrouters
2025-10-16 02:40:34,771 - DEBUG - Starting all layer2 verification in 10.0.0.23 Control Node
2025-10-16 02:40:34,891 - DEBUG - Layer2 route found for VM MAC 02:b9:f9:b7:fe:8c in Control-node 10.0.0.23
2025-10-16 02:40:34,891 - DEBUG - L2 Label for VM ctest-VM31-64953336 same between Control-node 10.0.0.23 and Agent, Expected: 36, Seen: 36
2025-10-16 02:40:34,891 - DEBUG - Starting all layer2 verification in 10.0.0.19 Control Node
2025-10-16 02:40:35,013 - DEBUG - Layer2 route found for VM MAC 02:b9:f9:b7:fe:8c in Control-node 10.0.0.19
2025-10-16 02:40:35,013 - DEBUG - L2 Label for VM ctest-VM31-64953336 same between Control-node 10.0.0.19 and Agent, Expected: 36, Seen: 36
2025-10-16 02:40:35,013 - INFO - Verification in Control-nodes for VM ctest-VM31-64953336 passed
2025-10-16 02:40:35,013 - DEBUG - Verifying the vm in opserver
2025-10-16 02:40:35,013 - DEBUG - Verifying in collector 10.0.0.23 ...
2025-10-16 02:40:35,013 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5?flat
2025-10-16 02:40:35,027 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-46678709:b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9?flat
2025-10-16 02:40:35,045 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-46678709:b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9?flat
2025-10-16 02:40:35,060 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5?flat
2025-10-16 02:40:35,074 - DEBUG - Verifying vm in vn uve
2025-10-16 02:40:35,074 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-46678709:b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9?flat
2025-10-16 02:40:35,097 - DEBUG - VM uve shows interface as {'mac_address': '02:b9:f9:b7:fe:8c', 'l2_active': True, 'vm_name': 'ctest-VM31-64953336', 'admin_state': True, 'label': 32, 'vn_uuid': 'c14ae4cc-e0c0-4ef8-b118-21b0bc9a3223', 'uuid': 'b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9', 'ip4_active': True, 'port_mirror_enabled': False, 'virtual_network': 'default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350', 'is_health_check_active': True, 'ip_address': '92.178.109.67', 'rx_vlan': 65535, 'tx_vlan': 65535, 'active': True, 'ip6_address': '::', '__T': 1760582406685625, 'ip6_active': False, 'gateway': '92.178.109.65', 'vhostuser_mode': 0, 'vm_uuid': '80c2d002-280c-47f8-a60c-e8934e04f9b5', 'fixed_ip4_list': ['92.178.109.67']}
2025-10-16 02:40:35,097 - DEBUG - VM uve shows ip address as ['92.178.109.67', '::']
2025-10-16 02:40:35,097 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350
2025-10-16 02:40:35,097 - INFO - Verifying through opserver in 10.0.0.19
2025-10-16 02:40:35,097 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350?flat
2025-10-16 02:40:35,116 - DEBUG - expected vm list 80c2d002-280c-47f8-a60c-e8934e04f9b5
2025-10-16 02:40:35,116 - DEBUG - Extracted vm list ['80c2d002-280c-47f8-a60c-e8934e04f9b5']
2025-10-16 02:40:35,116 - INFO - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is present in default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350
2025-10-16 02:40:35,116 - DEBUG - Verifying vm in vrouter uve
2025-10-16 02:40:35,116 - DEBUG - Getting info from collector 10.0.0.23..
2025-10-16 02:40:35,116 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5?flat
2025-10-16 02:40:35,130 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4339-1']
2025-10-16 02:40:35,130 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:40:35,165 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:40:35,194 - DEBUG - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:40:35,194 - DEBUG - Validated that VM ctest-VM31-64953336 is in Vrouter an-jenkins-deploy-platform-ansible-os-4339-1 UVE
2025-10-16 02:40:35,194 - DEBUG - Verifying vm tap interface/vn in vrouter uve
2025-10-16 02:40:35,201 - DEBUG - Expected tap interface of VM uuid 80c2d002-280c-47f8-a60c-e8934e04f9b5 is default-domain:ctest-TestPolicyAcl-46678709:b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9
2025-10-16 02:40:35,201 - DEBUG - Expected VN of VM uuid 80c2d002-280c-47f8-a60c-e8934e04f9b5 is default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350
2025-10-16 02:40:35,201 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:40:35,236 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:40:35,272 - DEBUG - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:40:35,272 - INFO - tap interface default-domain:ctest-TestPolicyAcl-46678709:b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9 of vm 80c2d002-280c-47f8-a60c-e8934e04f9b5 is present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:40:35,272 - DEBUG - Connected network default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350 of vm 80c2d002-280c-47f8-a60c-e8934e04f9b5 is present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:40:35,272 - DEBUG - Verifying the 80c2d002-280c-47f8-a60c-e8934e04f9b5 virtual network link through opserver 10.0.0.19
2025-10-16 02:40:35,272 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2025-10-16 02:40:35,285 - DEBUG - VM link and name as {'name': '80c2d002-280c-47f8-a60c-e8934e04f9b5', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5?flat'}
2025-10-16 02:40:35,285 - DEBUG - Verifying the 80c2d002-280c-47f8-a60c-e8934e04f9b5 virtual network link through opserver 10.0.0.57
2025-10-16 02:40:35,285 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machines
2025-10-16 02:40:35,297 - DEBUG - VM link and name as {'name': '80c2d002-280c-47f8-a60c-e8934e04f9b5', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5?flat'}
2025-10-16 02:40:35,297 - DEBUG - Verifying the 80c2d002-280c-47f8-a60c-e8934e04f9b5 virtual network link through opserver 10.0.0.23
2025-10-16 02:40:35,297 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines
2025-10-16 02:40:35,310 - DEBUG - VM link and name as {'name': '80c2d002-280c-47f8-a60c-e8934e04f9b5', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5?flat'}
2025-10-16 02:40:35,310 - INFO - VM ctest-VM31-64953336 validations in Opserver passed
2025-10-16 02:40:35,310 - INFO - Waiting for VM ctest-VM11-39933899 to be up..
2025-10-16 02:40:35,310 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 02:40:35,310 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/3e0e0cf5-8bab-4ec9-8019-00453230026f
2025-10-16 02:40:35,318 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/06aa9787-bbc0-4494-8fae-435db7147a8c
2025-10-16 02:40:36,497 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.94 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=7.83 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.942/5.883/7.825/1.941 ms')
2025-10-16 02:40:36,497 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-39933899 passed
2025-10-16 02:40:36,562 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 02:40:36,563 - DEBUG - Waiting to SSH to VM ctest-VM11-39933899, IP 145.22.140.195, Port 22
2025-10-16 02:40:36,631 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-16 02:40:36,713 - DEBUG - VM ctest-VM11-39933899 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-16 02:40:41,713 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 02:40:41,714 - DEBUG - Waiting to SSH to VM ctest-VM11-39933899, IP 145.22.140.195, Port 22
2025-10-16 02:40:41,778 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-16 02:40:41,860 - DEBUG - VM ctest-VM11-39933899 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-16 02:40:46,861 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 02:40:46,861 - DEBUG - Waiting to SSH to VM ctest-VM11-39933899, IP 145.22.140.195, Port 22
2025-10-16 02:40:47,016 - DEBUG - VM ctest-VM11-39933899 is ready for SSH connections
2025-10-16 02:40:47,016 - INFO - Waiting for VM ctest-VM21-52518793 to be up..
2025-10-16 02:40:47,017 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 02:40:47,017 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6a4d937f-3543-46eb-96b6-c6ec249c474e
2025-10-16 02:40:47,025 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/2cdb40f9-c047-4eb7-92f8-4287fb5fc02a
2025-10-16 02:40:48,184 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.31 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.14 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.142/3.226/4.310/1.084 ms')
2025-10-16 02:40:48,184 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-52518793 passed
2025-10-16 02:40:48,250 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 02:40:48,250 - DEBUG - Waiting to SSH to VM ctest-VM21-52518793, IP 65.103.208.195, Port 22
2025-10-16 02:40:48,318 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-16 02:40:48,396 - DEBUG - VM ctest-VM21-52518793 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-16 02:40:53,396 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 02:40:53,396 - DEBUG - Waiting to SSH to VM ctest-VM21-52518793, IP 65.103.208.195, Port 22
2025-10-16 02:40:53,563 - DEBUG - VM ctest-VM21-52518793 is ready for SSH connections
2025-10-16 02:40:53,563 - INFO - Waiting for VM ctest-VM31-64953336 to be up..
2025-10-16 02:40:53,563 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 02:40:53,563 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5
2025-10-16 02:40:53,572 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/b9f9b7fe-8cd8-415f-9d6d-93d3844e96e9
2025-10-16 02:40:54,745 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.57 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.512 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.512/2.041/3.570/1.529 ms')
2025-10-16 02:40:54,745 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-64953336 passed
2025-10-16 02:40:54,815 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-16 02:40:54,815 - DEBUG - Waiting to SSH to VM ctest-VM31-64953336, IP 92.178.109.67, Port 22
2025-10-16 02:40:54,984 - DEBUG - VM ctest-VM31-64953336 is ready for SSH connections
2025-10-16 02:40:54,984 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 65.103.208.195, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2025-10-16 02:40:54,984 - DEBUG - ping -s 56 -c 3 -W 1 65.103.208.195
2025-10-16 02:41:12,439 - DEBUG - PING 65.103.208.195 (65.103.208.195) 56(84) bytes of data.
64 bytes from 65.103.208.195: icmp_req=1 ttl=63 time=9.22 ms
64 bytes from 65.103.208.195: icmp_req=2 ttl=63 time=1.32 ms
64 bytes from 65.103.208.195: icmp_req=3 ttl=63 time=3.67 ms
--- 65.103.208.195 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2006ms
rtt min/avg/max/mdev = 1.325/4.740/9.221/3.310 ms
2025-10-16 02:41:12,439 - INFO - Ping to IP 65.103.208.195 from VM ctest-VM11-39933899 passed
2025-10-16 02:41:12,439 - INFO - Test with src as VN and dst as policy PASSED
2025-10-16 02:41:12,440 - INFO - Deleting VM ctest-VM31-64953336
2025-10-16 02:41:12,525 - DEBUG - Verifying in api server 10.0.0.23
2025-10-16 02:41:12,525 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5
2025-10-16 02:41:12,533 - DEBUG - VM ID 80c2d002-280c-47f8-a60c-e8934e04f9b5 of VM ctest-VM31-64953336 is still found in API Server
2025-10-16 02:41:14,533 - DEBUG - Verifying in api server 10.0.0.23
2025-10-16 02:41:14,534 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5
2025-10-16 02:41:14,540 - DEBUG - Response Code: 404
2025-10-16 02:41:14,540 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5
2025-10-16 02:41:14,547 - DEBUG - Response Code: 404
2025-10-16 02:41:14,547 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/80c2d002-280c-47f8-a60c-e8934e04f9b5
2025-10-16 02:41:14,552 - DEBUG - Response Code: 404
2025-10-16 02:41:14,552 - INFO - VM ctest-VM31-64953336 is fully removed in API-Server
2025-10-16 02:41:14,706 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found
2025-10-16 02:41:14,766 - DEBUG - Validated that vrouter 10.0.0.38 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350
2025-10-16 02:41:14,782 - DEBUG - Validated that vrouter 10.0.0.129 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350
2025-10-16 02:41:14,782 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350
2025-10-16 02:41:14,783 - INFO - VM ctest-VM31-64953336 is removed in Compute, and routes are removed in all compute nodes
2025-10-16 02:41:15,013 - INFO - Routes for VM ctest-VM31-64953336 is removed in all control-nodes
2025-10-16 02:41:15,013 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:15,048 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:41:15,079 - DEBUG - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:41:15,079 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:15,079 - DEBUG - interface for vm 80c2d002-280c-47f8-a60c-e8934e04f9b5 deleted from vrouter uve ...
2025-10-16 02:41:15,079 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:18,080 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:18,120 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:41:18,150 - DEBUG - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:41:18,150 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:18,150 - DEBUG - interface for vm 80c2d002-280c-47f8-a60c-e8934e04f9b5 deleted from vrouter uve ...
2025-10-16 02:41:18,150 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:21,151 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:21,181 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:41:21,212 - DEBUG - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:41:21,212 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:21,212 - DEBUG - interface for vm 80c2d002-280c-47f8-a60c-e8934e04f9b5 deleted from vrouter uve ...
2025-10-16 02:41:21,212 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:24,213 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:24,245 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:41:24,276 - DEBUG - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:41:24,276 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:24,276 - DEBUG - interface for vm 80c2d002-280c-47f8-a60c-e8934e04f9b5 deleted from vrouter uve ...
2025-10-16 02:41:24,276 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:27,277 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:27,309 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:41:27,338 - DEBUG - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:41:27,338 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:27,338 - DEBUG - interface for vm 80c2d002-280c-47f8-a60c-e8934e04f9b5 deleted from vrouter uve ...
2025-10-16 02:41:27,338 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:30,339 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:30,374 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:41:30,403 - DEBUG - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:41:30,403 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:30,403 - DEBUG - interface for vm 80c2d002-280c-47f8-a60c-e8934e04f9b5 deleted from vrouter uve ...
2025-10-16 02:41:30,403 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:33,403 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:33,436 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:41:33,467 - DEBUG - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:41:33,467 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:33,467 - DEBUG - interface for vm 80c2d002-280c-47f8-a60c-e8934e04f9b5 deleted from vrouter uve ...
2025-10-16 02:41:33,467 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:36,468 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:36,500 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:41:36,539 - DEBUG - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:41:36,539 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:36,539 - DEBUG - interface for vm 80c2d002-280c-47f8-a60c-e8934e04f9b5 deleted from vrouter uve ...
2025-10-16 02:41:36,539 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:39,539 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:39,578 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:41:39,607 - DEBUG - VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:41:39,607 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:39,607 - DEBUG - interface for vm 80c2d002-280c-47f8-a60c-e8934e04f9b5 deleted from vrouter uve ...
2025-10-16 02:41:39,607 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:39,607 - DEBUG - Validated that VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is removed in Vrouter UVE
2025-10-16 02:41:39,607 - DEBUG - Verifying through opserver in 10.0.0.19
2025-10-16 02:41:39,607 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350?flat
2025-10-16 02:41:39,626 - DEBUG - 80c2d002-280c-47f8-a60c-e8934e04f9b5 BM not in default-domain:ctest-TestPolicyAcl-46678709:ctest-VN3-59930350 uve
2025-10-16 02:41:39,626 - DEBUG - Validated that VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is not present in the VN UVE
2025-10-16 02:41:39,626 - DEBUG - Verifying the 80c2d002-280c-47f8-a60c-e8934e04f9b5 virtual network link through opserver 10.0.0.19
2025-10-16 02:41:39,626 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2025-10-16 02:41:39,638 - INFO - 80c2d002-280c-47f8-a60c-e8934e04f9b5 vm uve deleted from opserver
2025-10-16 02:41:39,638 - DEBUG - Verifying the 80c2d002-280c-47f8-a60c-e8934e04f9b5 virtual network link through opserver 10.0.0.57
2025-10-16 02:41:39,638 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machines
2025-10-16 02:41:39,650 - INFO - 80c2d002-280c-47f8-a60c-e8934e04f9b5 vm uve deleted from opserver
2025-10-16 02:41:39,650 - DEBUG - Verifying the 80c2d002-280c-47f8-a60c-e8934e04f9b5 virtual network link through opserver 10.0.0.23
2025-10-16 02:41:39,650 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines
2025-10-16 02:41:39,662 - INFO - 80c2d002-280c-47f8-a60c-e8934e04f9b5 vm uve deleted from opserver
2025-10-16 02:41:39,662 - INFO - Validated that VM 80c2d002-280c-47f8-a60c-e8934e04f9b5 is removed from Opserver
2025-10-16 02:41:39,662 - INFO - Deleting VM ctest-VM21-52518793
2025-10-16 02:41:39,748 - DEBUG - Verifying in api server 10.0.0.23
2025-10-16 02:41:39,748 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6a4d937f-3543-46eb-96b6-c6ec249c474e
2025-10-16 02:41:39,756 - DEBUG - VM ID 6a4d937f-3543-46eb-96b6-c6ec249c474e of VM ctest-VM21-52518793 is still found in API Server
2025-10-16 02:41:41,757 - DEBUG - Verifying in api server 10.0.0.23
2025-10-16 02:41:41,757 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6a4d937f-3543-46eb-96b6-c6ec249c474e
2025-10-16 02:41:41,768 - DEBUG - Response Code: 404
2025-10-16 02:41:41,769 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6a4d937f-3543-46eb-96b6-c6ec249c474e
2025-10-16 02:41:41,776 - DEBUG - Response Code: 404
2025-10-16 02:41:41,776 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6a4d937f-3543-46eb-96b6-c6ec249c474e
2025-10-16 02:41:41,781 - DEBUG - Response Code: 404
2025-10-16 02:41:41,781 - INFO - VM ctest-VM21-52518793 is fully removed in API-Server
2025-10-16 02:41:41,934 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found
2025-10-16 02:41:41,969 - DEBUG - Validated that vrouter 10.0.0.38 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN2-95936388
2025-10-16 02:41:41,977 - DEBUG - Validated that vrouter 10.0.0.129 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN2-95936388
2025-10-16 02:41:41,977 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN2-95936388
2025-10-16 02:41:41,978 - INFO - VM ctest-VM21-52518793 is removed in Compute, and routes are removed in all compute nodes
2025-10-16 02:41:42,180 - INFO - Routes for VM ctest-VM21-52518793 is removed in all control-nodes
2025-10-16 02:41:42,180 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-2:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:42,222 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-2?flat
2025-10-16 02:41:42,252 - DEBUG - VM 6a4d937f-3543-46eb-96b6-c6ec249c474e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-2 uve
2025-10-16 02:41:42,252 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:42,252 - DEBUG - interface for vm 6a4d937f-3543-46eb-96b6-c6ec249c474e deleted from vrouter uve ...
2025-10-16 02:41:42,252 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:45,253 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-2:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:45,286 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-2?flat
2025-10-16 02:41:45,313 - DEBUG - VM 6a4d937f-3543-46eb-96b6-c6ec249c474e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-2 uve
2025-10-16 02:41:45,313 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:45,313 - DEBUG - interface for vm 6a4d937f-3543-46eb-96b6-c6ec249c474e deleted from vrouter uve ...
2025-10-16 02:41:45,313 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:48,314 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-2:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:48,350 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-2?flat
2025-10-16 02:41:48,381 - DEBUG - VM 6a4d937f-3543-46eb-96b6-c6ec249c474e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-2 uve
2025-10-16 02:41:48,381 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:48,381 - DEBUG - interface for vm 6a4d937f-3543-46eb-96b6-c6ec249c474e deleted from vrouter uve ...
2025-10-16 02:41:48,381 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:51,381 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-2:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:51,414 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-2?flat
2025-10-16 02:41:51,448 - DEBUG - VM 6a4d937f-3543-46eb-96b6-c6ec249c474e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-2 uve
2025-10-16 02:41:51,448 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:51,448 - DEBUG - interface for vm 6a4d937f-3543-46eb-96b6-c6ec249c474e deleted from vrouter uve ...
2025-10-16 02:41:51,448 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:54,449 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-2:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:54,481 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-2?flat
2025-10-16 02:41:54,507 - DEBUG - VM 6a4d937f-3543-46eb-96b6-c6ec249c474e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-2 uve
2025-10-16 02:41:54,507 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:54,507 - DEBUG - interface for vm 6a4d937f-3543-46eb-96b6-c6ec249c474e deleted from vrouter uve ...
2025-10-16 02:41:54,507 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:41:57,508 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-2:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:41:57,540 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-2?flat
2025-10-16 02:41:57,565 - DEBUG - VM 6a4d937f-3543-46eb-96b6-c6ec249c474e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-2 uve
2025-10-16 02:41:57,565 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:41:57,565 - DEBUG - interface for vm 6a4d937f-3543-46eb-96b6-c6ec249c474e deleted from vrouter uve ...
2025-10-16 02:41:57,565 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:42:00,566 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-2:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:42:00,632 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-2?flat
2025-10-16 02:42:00,665 - DEBUG - VM 6a4d937f-3543-46eb-96b6-c6ec249c474e is not present in vrouter an-jenkins-deploy-platform-ansible-os-4339-2 uve
2025-10-16 02:42:00,665 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:42:00,665 - DEBUG - interface for vm 6a4d937f-3543-46eb-96b6-c6ec249c474e deleted from vrouter uve ...
2025-10-16 02:42:00,665 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:42:00,665 - DEBUG - Validated that VM 6a4d937f-3543-46eb-96b6-c6ec249c474e is removed in Vrouter UVE
2025-10-16 02:42:00,665 - DEBUG - Verifying through opserver in 10.0.0.19
2025-10-16 02:42:00,665 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-46678709:ctest-VN2-95936388?flat
2025-10-16 02:42:00,684 - DEBUG - 6a4d937f-3543-46eb-96b6-c6ec249c474e BM not in default-domain:ctest-TestPolicyAcl-46678709:ctest-VN2-95936388 uve
2025-10-16 02:42:00,684 - DEBUG - Validated that VM 6a4d937f-3543-46eb-96b6-c6ec249c474e is not present in the VN UVE
2025-10-16 02:42:00,684 - DEBUG - Verifying the 6a4d937f-3543-46eb-96b6-c6ec249c474e virtual network link through opserver 10.0.0.19
2025-10-16 02:42:00,684 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2025-10-16 02:42:00,696 - INFO - 6a4d937f-3543-46eb-96b6-c6ec249c474e vm uve deleted from opserver
2025-10-16 02:42:00,696 - DEBUG - Verifying the 6a4d937f-3543-46eb-96b6-c6ec249c474e virtual network link through opserver 10.0.0.57
2025-10-16 02:42:00,696 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machines
2025-10-16 02:42:00,711 - INFO - 6a4d937f-3543-46eb-96b6-c6ec249c474e vm uve deleted from opserver
2025-10-16 02:42:00,713 - DEBUG - Verifying the 6a4d937f-3543-46eb-96b6-c6ec249c474e virtual network link through opserver 10.0.0.23
2025-10-16 02:42:00,713 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines
2025-10-16 02:42:00,727 - INFO - 6a4d937f-3543-46eb-96b6-c6ec249c474e vm uve deleted from opserver
2025-10-16 02:42:00,727 - INFO - Validated that VM 6a4d937f-3543-46eb-96b6-c6ec249c474e is removed from Opserver
2025-10-16 02:42:00,727 - INFO - Deleting VM ctest-VM11-39933899
2025-10-16 02:42:00,819 - DEBUG - Verifying in api server 10.0.0.23
2025-10-16 02:42:00,819 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/3e0e0cf5-8bab-4ec9-8019-00453230026f
2025-10-16 02:42:00,826 - DEBUG - VM ID 3e0e0cf5-8bab-4ec9-8019-00453230026f of VM ctest-VM11-39933899 is still found in API Server
2025-10-16 02:42:02,827 - DEBUG - Verifying in api server 10.0.0.23
2025-10-16 02:42:02,827 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/3e0e0cf5-8bab-4ec9-8019-00453230026f
2025-10-16 02:42:02,835 - DEBUG - Response Code: 404
2025-10-16 02:42:02,835 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/3e0e0cf5-8bab-4ec9-8019-00453230026f
2025-10-16 02:42:02,841 - DEBUG - Response Code: 404
2025-10-16 02:42:02,841 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/3e0e0cf5-8bab-4ec9-8019-00453230026f
2025-10-16 02:42:02,847 - DEBUG - Response Code: 404
2025-10-16 02:42:02,847 - INFO - VM ctest-VM11-39933899 is fully removed in API-Server
2025-10-16 02:42:03,008 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found
2025-10-16 02:42:03,053 - DEBUG - Validated that vrouter 10.0.0.38 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN1-12261372
2025-10-16 02:42:03,063 - DEBUG - Validated that vrouter 10.0.0.129 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN1-12261372
2025-10-16 02:42:03,063 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-46678709:ctest-VN1-12261372
2025-10-16 02:42:03,064 - INFO - VM ctest-VM11-39933899 is removed in Compute, and routes are removed in all compute nodes
2025-10-16 02:42:03,258 - INFO - Routes for VM ctest-VM11-39933899 is removed in all control-nodes
2025-10-16 02:42:03,259 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:42:03,294 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:42:03,326 - DEBUG - VM 3e0e0cf5-8bab-4ec9-8019-00453230026f is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:42:03,326 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:42:03,327 - DEBUG - interface for vm 3e0e0cf5-8bab-4ec9-8019-00453230026f deleted from vrouter uve ...
2025-10-16 02:42:03,327 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:42:06,327 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:42:06,362 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:42:06,389 - DEBUG - VM 3e0e0cf5-8bab-4ec9-8019-00453230026f is still present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:42:06,389 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:42:06,389 - DEBUG - interface for vm 3e0e0cf5-8bab-4ec9-8019-00453230026f deleted from vrouter uve ...
2025-10-16 02:42:06,389 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:42:09,391 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4339-1:Compute:contrail-vrouter-agent:0?flat
2025-10-16 02:42:09,424 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4339-1?flat
2025-10-16 02:42:09,453 - DEBUG - VM 3e0e0cf5-8bab-4ec9-8019-00453230026f is not present in vrouter an-jenkins-deploy-platform-ansible-os-4339-1 uve
2025-10-16 02:42:09,453 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-16 02:42:09,454 - DEBUG - interface for vm 3e0e0cf5-8bab-4ec9-8019-00453230026f deleted from vrouter uve ...
2025-10-16 02:42:09,454 - DEBUG - Deleted interface not in error interface list ...
2025-10-16 02:42:09,454 - DEBUG - Validated that VM 3e0e0cf5-8bab-4ec9-8019-00453230026f is removed in Vrouter UVE
2025-10-16 02:42:09,454 - DEBUG - Verifying through opserver in 10.0.0.19
2025-10-16 02:42:09,454 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-46678709:ctest-VN1-12261372?flat
2025-10-16 02:42:09,472 - DEBUG - 3e0e0cf5-8bab-4ec9-8019-00453230026f BM not in default-domain:ctest-TestPolicyAcl-46678709:ctest-VN1-12261372 uve
2025-10-16 02:42:09,472 - DEBUG - Validated that VM 3e0e0cf5-8bab-4ec9-8019-00453230026f is not present in the VN UVE
2025-10-16 02:42:09,472 - DEBUG - Verifying the 3e0e0cf5-8bab-4ec9-8019-00453230026f virtual network link through opserver 10.0.0.19
2025-10-16 02:42:09,472 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2025-10-16 02:42:09,484 - DEBUG - No links retuned for 3e0e0cf5-8bab-4ec9-8019-00453230026f
2025-10-16 02:42:09,484 - INFO - 3e0e0cf5-8bab-4ec9-8019-00453230026f vm uve deleted from opserver
2025-10-16 02:42:09,484 - DEBUG - Verifying the 3e0e0cf5-8bab-4ec9-8019-00453230026f virtual network link through opserver 10.0.0.57
2025-10-16 02:42:09,484 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machines
2025-10-16 02:42:09,499 - DEBUG - No links retuned for 3e0e0cf5-8bab-4ec9-8019-00453230026f
2025-10-16 02:42:09,499 - INFO - 3e0e0cf5-8bab-4ec9-8019-00453230026f vm uve deleted from opserver
2025-10-16 02:42:09,499 - DEBUG - Verifying the 3e0e0cf5-8bab-4ec9-8019-00453230026f virtual network link through opserver 10.0.0.23
2025-10-16 02:42:09,499 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines
2025-10-16 02:42:09,512 - DEBUG - No links retuned for 3e0e0cf5-8bab-4ec9-8019-00453230026f
2025-10-16 02:42:09,512 - INFO - 3e0e0cf5-8bab-4ec9-8019-00453230026f vm uve deleted from opserver
2025-10-16 02:42:09,512 - INFO - Validated that VM 3e0e0cf5-8bab-4ec9-8019-00453230026f is removed from Opserver
2025-10-16 02:42:09,512 - DEBUG - Detaching the Policy for VN :ctest-VN2-95936388
2025-10-16 02:42:09,512 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-10-16 02:42:09,518 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9
2025-10-16 02:42:09,561 - DEBUG - Requesting: http://10.0.0.19:8082/project/cb5de812-69f0-4575-9fe8-b92e90450278
2025-10-16 02:42:09,656 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/6f45c7ef-78a4-4cb8-b2d8-a8d0db4d14f5
2025-10-16 02:42:09,667 - DEBUG - Requesting: http://10.0.0.19:8082/network-policy/58b28795-54e6-4604-8ec8-af795aa1d357
2025-10-16 02:42:09,822 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAcl-46678709', 'ctest-policy21-82699314']] from ctest-VN2-95936388
2025-10-16 02:42:09,822 - DEBUG - Detaching the Policy for VN :ctest-VN1-12261372
2025-10-16 02:42:09,822 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-10-16 02:42:09,830 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9
2025-10-16 02:42:09,863 - DEBUG - Requesting: http://10.0.0.19:8082/project/cb5de812-69f0-4575-9fe8-b92e90450278
2025-10-16 02:42:09,951 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/ca1b770b-45d0-40c1-ab73-b012d1e7228c
2025-10-16 02:42:10,111 - INFO - Detached Policy from ctest-VN1-12261372
2025-10-16 02:42:10,167 - INFO - Deleted policy ctest-policy13-31312596
2025-10-16 02:42:10,203 - INFO - Deleted policy ctest-policy21-82699314
2025-10-16 02:42:10,246 - INFO - Deleted policy ctest-policy12-54199472
2025-10-16 02:42:10,246 - INFO - Deleting VN ctest-VN3-59930350
2025-10-16 02:42:10,432 - DEBUG - Response for deleting network ()
2025-10-16 02:42:10,432 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/e0e2f957-5143-4311-9877-0a0ced6ccb28
2025-10-16 02:42:10,439 - DEBUG - Response Code: 404
2025-10-16 02:42:10,439 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-10-16 02:42:10,449 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9
2025-10-16 02:42:10,505 - DEBUG - Requesting: http://10.0.0.19:8082/project/cb5de812-69f0-4575-9fe8-b92e90450278
2025-10-16 02:42:10,594 - INFO - Validated that VN ctest-VN3-59930350 is not found in API Server
2025-10-16 02:42:10,604 - DEBUG - VN ctest-VN3-59930350 is not present in Agent 10.0.0.38
2025-10-16 02:42:10,613 - DEBUG - VN ctest-VN3-59930350 is not present in Agent 10.0.0.129
2025-10-16 02:42:10,613 - INFO - Validated that VN ctest-VN3-59930350 is not in any agent
2025-10-16 02:42:10,644 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN3-59930350 info
2025-10-16 02:42:10,644 - INFO - Deleting VN ctest-VN2-95936388
2025-10-16 02:42:10,825 - DEBUG - Response for deleting network ()
2025-10-16 02:42:10,825 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9f247272-00db-4d42-ad01-dd13ce4dd043
2025-10-16 02:42:10,831 - DEBUG - Response Code: 404
2025-10-16 02:42:10,831 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-10-16 02:42:10,837 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9
2025-10-16 02:42:10,848 - DEBUG - Requesting: http://10.0.0.19:8082/project/cb5de812-69f0-4575-9fe8-b92e90450278
2025-10-16 02:42:10,935 - INFO - Validated that VN ctest-VN2-95936388 is not found in API Server
2025-10-16 02:42:10,950 - DEBUG - VN ctest-VN2-95936388 is not present in Agent 10.0.0.38
2025-10-16 02:42:10,961 - DEBUG - VN ctest-VN2-95936388 is not present in Agent 10.0.0.129
2025-10-16 02:42:10,961 - INFO - Validated that VN ctest-VN2-95936388 is not in any agent
2025-10-16 02:42:10,992 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN2-95936388 info
2025-10-16 02:42:10,992 - INFO - Deleting VN ctest-VN1-12261372
2025-10-16 02:42:11,164 - DEBUG - Response for deleting network ()
2025-10-16 02:42:11,164 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/e7f96659-6b43-4245-a5ee-5f04a5994d5d
2025-10-16 02:42:11,170 - DEBUG - Response Code: 404
2025-10-16 02:42:11,171 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-10-16 02:42:11,177 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9
2025-10-16 02:42:11,189 - DEBUG - Requesting: http://10.0.0.19:8082/project/cb5de812-69f0-4575-9fe8-b92e90450278
2025-10-16 02:42:11,274 - INFO - Validated that VN ctest-VN1-12261372 is not found in API Server
2025-10-16 02:42:11,287 - DEBUG - VN ctest-VN1-12261372 is not present in Agent 10.0.0.38
2025-10-16 02:42:11,306 - DEBUG - VN ctest-VN1-12261372 is not present in Agent 10.0.0.129
2025-10-16 02:42:11,306 - INFO - Validated that VN ctest-VN1-12261372 is not in any agent
2025-10-16 02:42:11,337 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN1-12261372 info
2025-10-16 02:42:11,434 - INFO - IPAM: ipam3 is not found in API Server
2025-10-16 02:42:11,454 - INFO - IPAM:ipam3 is not found in control node
2025-10-16 02:42:11,594 - INFO - IPAM: ipam2 is not found in API Server
2025-10-16 02:42:11,614 - INFO - IPAM:ipam2 is not found in control node
2025-10-16 02:42:11,750 - INFO - IPAM: ipam1 is not found in API Server
2025-10-16 02:42:11,775 - INFO - IPAM:ipam1 is not found in control node
2025-10-16 02:42:13,058 - DEBUG - No XMPP flaps were noticed during the test
2025-10-16 02:42:13,058 - INFO - END TEST : test_policy_inheritance_src_vn_dst_pol : PASSED[0:02:43]
2025-10-16 02:42:13,059 - INFO - --------------------------------------------------------------------------------
2025-10-16 02:42:13,805 - INFO - Deleted project: ctest-TestPolicyAcl-46678709, ID : cb5de812-69f0-4575-9fe8-b92e90450278