is in ACTIVE state now
2025-10-30 10:33:47,541 - DEBUG - VM ctest-VM31-66076063 launched on Node an-jenkins-deploy-platform-ansible-os-4541-1
2025-10-30 10:33:47,637 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32
2025-10-30 10:33:47,648 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32
2025-10-30 10:33:47,656 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/83f4bd67-07a6-44ed-9a43-ada6a7c08f98
2025-10-30 10:33:47,667 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32
2025-10-30 10:33:47,675 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/83f4bd67-07a6-44ed-9a43-ada6a7c08f98
2025-10-30 10:33:47,686 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/ed544554-bdf6-4dc5-be52-20424748b5a6
2025-10-30 10:33:47,699 - DEBUG - Verifying in api server 10.0.0.19
2025-10-30 10:33:47,699 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32
2025-10-30 10:33:47,707 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/83f4bd67-07a6-44ed-9a43-ada6a7c08f98
2025-10-30 10:33:47,718 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/ed544554-bdf6-4dc5-be52-20424748b5a6
2025-10-30 10:33:47,727 - INFO - VM ctest-VM31-66076063 verfication in all API Servers passed
2025-10-30 10:33:47,757 - DEBUG - VM ctest-VM31-66076063 Tap interface: {'index': '4', 'name': 'tap83f4bd67-07', 'uuid': '83f4bd67-07a6-44ed-9a43-ada6a7c08f98', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790:ctest-VN3-05326790', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '17', 'vn_name': 'default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790', 'vm_uuid': '77d734f1-cb70-4210-8e24-19b2c3816b32', 'vm_name': 'ctest-VM31-66076063', 'ip_addr': '199.250.78.195', 'mac_addr': '02:83:f4:bd:67:07', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '47', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-09205915:83f4bd67-07a6-44ed-9a43-ada6a7c08f98', 'sg_uuid_list': ['fedce1fa-7733-40ea-ae7d-ab69b89c07ae'], 'static_route_list': None, 'vm_project_uuid': '565bcbd8-d14b-41b5-b7b1-d2e36bf19311', 'admin_state': 'Enabled', 'flow_key_idx': '40', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2025-10-30 10:33:47,757 - DEBUG - Agent 10.0.0.41 vrf name: default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790:ctest-VN3-05326790
2025-10-30 10:33:47,764 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790:ctest-VN3-05326790', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790', 'table_label': '-1', 'vxlan_id': '17', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.252:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]}
2025-10-30 10:33:47,844 - DEBUG - VM ctest-VM31-66076063 : Tap interface tap83f4bd67-07 is set to Active
2025-10-30 10:33:47,845 - DEBUG - Tap interface tap83f4bd67-07 detail : {'index': '4', 'name': 'tap83f4bd67-07', 'uuid': '83f4bd67-07a6-44ed-9a43-ada6a7c08f98', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790:ctest-VN3-05326790', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '17', 'vn_name': 'default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790', 'vm_uuid': '77d734f1-cb70-4210-8e24-19b2c3816b32', 'vm_name': 'ctest-VM31-66076063', 'ip_addr': '199.250.78.195', 'mac_addr': '02:83:f4:bd:67:07', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '47', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-09205915:83f4bd67-07a6-44ed-9a43-ada6a7c08f98', 'sg_uuid_list': ['fedce1fa-7733-40ea-ae7d-ab69b89c07ae'], 'static_route_list': None, 'vm_project_uuid': '565bcbd8-d14b-41b5-b7b1-d2e36bf19311', 'admin_state': 'Enabled', 'flow_key_idx': '40', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2025-10-30 10:33:47,961 - DEBUG - Starting Layer 2 verification in Agent
2025-10-30 10:33:47,972 - DEBUG - Layer 2 path is seen for VM MAC 02:83:f4:bd:67:07 in agent 10.0.0.41
2025-10-30 10:33:47,972 - DEBUG - Active layer 2 route in agent is present for VMI tap83f4bd67-07
2025-10-30 10:33:47,973 - DEBUG - L2 label(36) matches bw route table and interface table
2025-10-30 10:33:47,978 - DEBUG - VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790 is found in Agent of node 10.0.0.41
2025-10-30 10:33:48,109 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790 is consistent in agent 10.0.0.41
2025-10-30 10:33:48,110 - DEBUG - Route for VM IP ['199.250.78.195'] is consistent in agent 10.0.0.41
2025-10-30 10:33:48,110 - DEBUG - VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790 verification for VM ctest-VM31-66076063 in Agent 10.0.0.41 passed
2025-10-30 10:33:48,227 - DEBUG - Starting all layer 2 verification in agent 10.0.0.41
2025-10-30 10:33:48,240 - DEBUG - Route for VM MAC 02:83:f4:bd:67:07 is consistent in agent 10.0.0.41
2025-10-30 10:33:49,427 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=8.65 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.11 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.106/5.375/8.645/3.269 ms')
2025-10-30 10:33:49,427 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-66076063 passed
2025-10-30 10:33:49,427 - INFO - VM ctest-VM31-66076063 verifications in Compute nodes passed
2025-10-30 10:33:49,652 - DEBUG - Validated VM route 199.250.78.195 in vrouter of 10.0.0.41
2025-10-30 10:33:49,658 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0
2025-10-30 10:33:49,658 - INFO - Validated routes of VM ctest-VM31-66076063 in all vrouters
2025-10-30 10:33:50,222 - DEBUG - Starting all layer2 verification in 10.0.0.33 Control Node
2025-10-30 10:33:50,360 - DEBUG - Layer2 route found for VM MAC 02:83:f4:bd:67:07 in Control-node 10.0.0.33
2025-10-30 10:33:50,360 - DEBUG - L2 Label for VM ctest-VM31-66076063 same between Control-node 10.0.0.33 and Agent, Expected: 36, Seen: 36
2025-10-30 10:33:50,360 - DEBUG - Starting all layer2 verification in 10.0.0.249 Control Node
2025-10-30 10:33:50,499 - DEBUG - Layer2 route found for VM MAC 02:83:f4:bd:67:07 in Control-node 10.0.0.249
2025-10-30 10:33:50,499 - DEBUG - L2 Label for VM ctest-VM31-66076063 same between Control-node 10.0.0.249 and Agent, Expected: 36, Seen: 36
2025-10-30 10:33:50,499 - INFO - Verification in Control-nodes for VM ctest-VM31-66076063 passed
2025-10-30 10:33:50,500 - DEBUG - Verifying the vm in opserver
2025-10-30 10:33:50,500 - DEBUG - Verifying in collector 10.0.0.19 ...
2025-10-30 10:33:50,500 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32?flat
2025-10-30 10:33:50,517 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-09205915:83f4bd67-07a6-44ed-9a43-ada6a7c08f98?flat
2025-10-30 10:33:50,538 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-09205915:83f4bd67-07a6-44ed-9a43-ada6a7c08f98?flat
2025-10-30 10:33:50,559 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32?flat
2025-10-30 10:33:50,576 - DEBUG - Verifying vm in vn uve
2025-10-30 10:33:50,576 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-09205915:83f4bd67-07a6-44ed-9a43-ada6a7c08f98?flat
2025-10-30 10:33:50,595 - DEBUG - VM uve shows interface as {'active': True, 'ip6_active': False, 'vn_uuid': '5faec4bf-1e91-44f6-8653-734df5a201b2', 'l2_active': True, 'port_mirror_enabled': False, 'uuid': '83f4bd67-07a6-44ed-9a43-ada6a7c08f98', 'vm_name': 'ctest-VM31-66076063', 'ip6_address': '::', 'vhostuser_mode': 0, 'vm_uuid': '77d734f1-cb70-4210-8e24-19b2c3816b32', 'ip_address': '199.250.78.195', 'ip4_active': True, 'gateway': '199.250.78.193', 'fixed_ip4_list': ['199.250.78.195'], 'is_health_check_active': True, 'mac_address': '02:83:f4:bd:67:07', 'label': 32, 'tx_vlan': 65535, 'admin_state': True, '__T': 1761820389565245, 'virtual_network': 'default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790', 'rx_vlan': 65535}
2025-10-30 10:33:50,595 - DEBUG - VM uve shows ip address as ['199.250.78.195', '::']
2025-10-30 10:33:50,595 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790
2025-10-30 10:33:50,595 - INFO - Verifying through opserver in 10.0.0.249
2025-10-30 10:33:50,595 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790?flat
2025-10-30 10:33:50,616 - DEBUG - expected vm list 77d734f1-cb70-4210-8e24-19b2c3816b32
2025-10-30 10:33:50,616 - DEBUG - Extracted vm list ['77d734f1-cb70-4210-8e24-19b2c3816b32']
2025-10-30 10:33:50,616 - INFO - VM 77d734f1-cb70-4210-8e24-19b2c3816b32 is present in default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790
2025-10-30 10:33:50,616 - DEBUG - Verifying vm in vrouter uve
2025-10-30 10:33:50,616 - DEBUG - Getting info from collector 10.0.0.19..
2025-10-30 10:33:50,616 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32?flat
2025-10-30 10:33:50,633 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4541-1']
2025-10-30 10:33:50,633 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-1:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:33:50,680 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-1?flat
2025-10-30 10:33:50,709 - DEBUG - VM 77d734f1-cb70-4210-8e24-19b2c3816b32 is present in vrouter an-jenkins-deploy-platform-ansible-os-4541-1 uve
2025-10-30 10:33:50,709 - DEBUG - Validated that VM ctest-VM31-66076063 is in Vrouter an-jenkins-deploy-platform-ansible-os-4541-1 UVE
2025-10-30 10:33:50,709 - DEBUG - Verifying vm tap interface/vn in vrouter uve
2025-10-30 10:33:50,718 - DEBUG - Expected tap interface of VM uuid 77d734f1-cb70-4210-8e24-19b2c3816b32 is default-domain:ctest-TestPolicyAcl-09205915:83f4bd67-07a6-44ed-9a43-ada6a7c08f98
2025-10-30 10:33:50,718 - DEBUG - Expected VN of VM uuid 77d734f1-cb70-4210-8e24-19b2c3816b32 is default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790
2025-10-30 10:33:50,718 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-1:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:33:50,759 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-1?flat
2025-10-30 10:33:50,789 - DEBUG - VM 77d734f1-cb70-4210-8e24-19b2c3816b32 is present in vrouter an-jenkins-deploy-platform-ansible-os-4541-1 uve
2025-10-30 10:33:50,789 - INFO - tap interface default-domain:ctest-TestPolicyAcl-09205915:83f4bd67-07a6-44ed-9a43-ada6a7c08f98 of vm 77d734f1-cb70-4210-8e24-19b2c3816b32 is present in vrouter an-jenkins-deploy-platform-ansible-os-4541-1 uve
2025-10-30 10:33:50,789 - DEBUG - Connected network default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790 of vm 77d734f1-cb70-4210-8e24-19b2c3816b32 is present in vrouter an-jenkins-deploy-platform-ansible-os-4541-1 uve
2025-10-30 10:33:50,789 - DEBUG - Verifying the 77d734f1-cb70-4210-8e24-19b2c3816b32 virtual network link through opserver 10.0.0.249
2025-10-30 10:33:50,789 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines
2025-10-30 10:33:50,811 - DEBUG - VM link and name as {'name': '77d734f1-cb70-4210-8e24-19b2c3816b32', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32?flat'}
2025-10-30 10:33:50,811 - DEBUG - Verifying the 77d734f1-cb70-4210-8e24-19b2c3816b32 virtual network link through opserver 10.0.0.33
2025-10-30 10:33:50,811 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-machines
2025-10-30 10:33:50,826 - DEBUG - VM link and name as {'name': '77d734f1-cb70-4210-8e24-19b2c3816b32', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32?flat'}
2025-10-30 10:33:50,826 - DEBUG - Verifying the 77d734f1-cb70-4210-8e24-19b2c3816b32 virtual network link through opserver 10.0.0.19
2025-10-30 10:33:50,826 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2025-10-30 10:33:50,841 - DEBUG - VM link and name as {'name': '77d734f1-cb70-4210-8e24-19b2c3816b32', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32?flat'}
2025-10-30 10:33:50,841 - INFO - VM ctest-VM31-66076063 validations in Opserver passed
2025-10-30 10:33:50,841 - INFO - Waiting for VM ctest-VM11-53138827 to be up..
2025-10-30 10:33:50,841 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 10:33:50,841 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/30a6c061-475f-4355-b64c-4cdf068b58ef
2025-10-30 10:33:50,852 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/202a776c-d895-4e28-b93a-f9de63b1a5b7
2025-10-30 10:33:52,037 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.62 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.59 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.586/3.605/3.624/0.019 ms')
2025-10-30 10:33:52,037 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-53138827 passed
2025-10-30 10:33:52,114 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 10:33:52,114 - DEBUG - Waiting to SSH to VM ctest-VM11-53138827, IP 221.13.219.67, Port 22
2025-10-30 10:33:52,181 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 10:33:52,270 - DEBUG - VM ctest-VM11-53138827 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 10:33:57,271 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 10:33:57,271 - DEBUG - Waiting to SSH to VM ctest-VM11-53138827, IP 221.13.219.67, Port 22
2025-10-30 10:33:57,340 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 10:33:57,439 - DEBUG - VM ctest-VM11-53138827 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 10:34:02,440 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 10:34:02,440 - DEBUG - Waiting to SSH to VM ctest-VM11-53138827, IP 221.13.219.67, Port 22
2025-10-30 10:34:02,498 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 10:34:02,587 - DEBUG - VM ctest-VM11-53138827 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 10:34:07,588 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 10:34:07,588 - DEBUG - Waiting to SSH to VM ctest-VM11-53138827, IP 221.13.219.67, Port 22
2025-10-30 10:34:07,760 - DEBUG - VM ctest-VM11-53138827 is ready for SSH connections
2025-10-30 10:34:07,760 - INFO - Waiting for VM ctest-VM21-37142401 to be up..
2025-10-30 10:34:07,760 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 10:34:07,760 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/466b4af0-a5b6-4678-8347-57dc304fcc59
2025-10-30 10:34:07,778 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/2d3e7b13-40b6-4e4d-865e-4044c0ed8505
2025-10-30 10:34:08,951 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.76 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.39 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.387/2.073/2.760/0.686 ms')
2025-10-30 10:34:08,951 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-37142401 passed
2025-10-30 10:34:09,023 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 10:34:09,023 - DEBUG - Waiting to SSH to VM ctest-VM21-37142401, IP 27.178.102.131, Port 22
2025-10-30 10:34:09,193 - DEBUG - VM ctest-VM21-37142401 is ready for SSH connections
2025-10-30 10:34:09,193 - INFO - Waiting for VM ctest-VM31-66076063 to be up..
2025-10-30 10:34:09,193 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 10:34:09,193 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32
2025-10-30 10:34:09,203 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/83f4bd67-07a6-44ed-9a43-ada6a7c08f98
2025-10-30 10:34:10,388 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.40 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.36 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.361/2.882/4.404/1.521 ms')
2025-10-30 10:34:10,388 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-66076063 passed
2025-10-30 10:34:10,463 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 10:34:10,464 - DEBUG - Waiting to SSH to VM ctest-VM31-66076063, IP 199.250.78.195, Port 22
2025-10-30 10:34:10,648 - DEBUG - VM ctest-VM31-66076063 is ready for SSH connections
2025-10-30 10:34:10,648 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 27.178.102.131, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-10-30 10:34:10,649 - DEBUG - ping -s 56 -c 3 -W 1 27.178.102.131
2025-10-30 10:34:38,948 - DEBUG - PING 27.178.102.131 (27.178.102.131) 56(84) bytes of data.
64 bytes from 27.178.102.131: icmp_req=1 ttl=63 time=10.5 ms
64 bytes from 27.178.102.131: icmp_req=2 ttl=63 time=1.64 ms
64 bytes from 27.178.102.131: icmp_req=3 ttl=63 time=1.46 ms
--- 27.178.102.131 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 1.468/4.553/10.549/4.240 ms
2025-10-30 10:34:38,948 - INFO - Ping to IP 27.178.102.131 from VM ctest-VM11-53138827 passed
2025-10-30 10:34:38,949 - INFO - Test with src as VN and dst as policy PASSED
2025-10-30 10:34:38,949 - INFO - Deleting VM ctest-VM31-66076063
2025-10-30 10:34:39,033 - DEBUG - Verifying in api server 10.0.0.19
2025-10-30 10:34:39,034 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32
2025-10-30 10:34:39,045 - DEBUG - VM ID 77d734f1-cb70-4210-8e24-19b2c3816b32 of VM ctest-VM31-66076063 is still found in API Server
2025-10-30 10:34:41,046 - DEBUG - Verifying in api server 10.0.0.19
2025-10-30 10:34:41,046 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32
2025-10-30 10:34:41,054 - DEBUG - Response Code: 404
2025-10-30 10:34:41,054 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32
2025-10-30 10:34:41,060 - DEBUG - Response Code: 404
2025-10-30 10:34:41,061 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/77d734f1-cb70-4210-8e24-19b2c3816b32
2025-10-30 10:34:41,067 - DEBUG - Response Code: 404
2025-10-30 10:34:41,067 - INFO - VM ctest-VM31-66076063 is fully removed in API-Server
2025-10-30 10:34:41,222 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found
2025-10-30 10:34:41,268 - DEBUG - Validated that vrouter 10.0.0.41 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790
2025-10-30 10:34:41,281 - DEBUG - Validated that vrouter 10.0.0.27 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790
2025-10-30 10:34:41,281 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790
2025-10-30 10:34:41,281 - INFO - VM ctest-VM31-66076063 is removed in Compute, and routes are removed in all compute nodes
2025-10-30 10:34:41,527 - INFO - Routes for VM ctest-VM31-66076063 is removed in all control-nodes
2025-10-30 10:34:41,527 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-1:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:34:41,564 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-1?flat
2025-10-30 10:34:41,593 - DEBUG - VM 77d734f1-cb70-4210-8e24-19b2c3816b32 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4541-1 uve
2025-10-30 10:34:41,593 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-30 10:34:41,593 - DEBUG - interface for vm 77d734f1-cb70-4210-8e24-19b2c3816b32 deleted from vrouter uve ...
2025-10-30 10:34:41,593 - DEBUG - Deleted interface not in error interface list ...
2025-10-30 10:34:41,593 - DEBUG - Validated that VM 77d734f1-cb70-4210-8e24-19b2c3816b32 is removed in Vrouter UVE
2025-10-30 10:34:41,593 - DEBUG - Verifying through opserver in 10.0.0.249
2025-10-30 10:34:41,593 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790?flat
2025-10-30 10:34:41,615 - DEBUG - 77d734f1-cb70-4210-8e24-19b2c3816b32 BM not in default-domain:ctest-TestPolicyAcl-09205915:ctest-VN3-05326790 uve
2025-10-30 10:34:41,615 - DEBUG - Validated that VM 77d734f1-cb70-4210-8e24-19b2c3816b32 is not present in the VN UVE
2025-10-30 10:34:41,615 - DEBUG - Verifying the 77d734f1-cb70-4210-8e24-19b2c3816b32 virtual network link through opserver 10.0.0.249
2025-10-30 10:34:41,616 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines
2025-10-30 10:34:41,634 - INFO - 77d734f1-cb70-4210-8e24-19b2c3816b32 vm uve deleted from opserver
2025-10-30 10:34:41,634 - DEBUG - Verifying the 77d734f1-cb70-4210-8e24-19b2c3816b32 virtual network link through opserver 10.0.0.33
2025-10-30 10:34:41,634 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-machines
2025-10-30 10:34:41,650 - INFO - 77d734f1-cb70-4210-8e24-19b2c3816b32 vm uve deleted from opserver
2025-10-30 10:34:41,651 - DEBUG - Verifying the 77d734f1-cb70-4210-8e24-19b2c3816b32 virtual network link through opserver 10.0.0.19
2025-10-30 10:34:41,651 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2025-10-30 10:34:41,664 - INFO - 77d734f1-cb70-4210-8e24-19b2c3816b32 vm uve deleted from opserver
2025-10-30 10:34:41,664 - INFO - Validated that VM 77d734f1-cb70-4210-8e24-19b2c3816b32 is removed from Opserver
2025-10-30 10:34:41,664 - INFO - Deleting VM ctest-VM21-37142401
2025-10-30 10:34:41,746 - DEBUG - Verifying in api server 10.0.0.19
2025-10-30 10:34:41,746 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/466b4af0-a5b6-4678-8347-57dc304fcc59
2025-10-30 10:34:41,759 - DEBUG - VM ID 466b4af0-a5b6-4678-8347-57dc304fcc59 of VM ctest-VM21-37142401 is still found in API Server
2025-10-30 10:34:43,760 - DEBUG - Verifying in api server 10.0.0.19
2025-10-30 10:34:43,760 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/466b4af0-a5b6-4678-8347-57dc304fcc59
2025-10-30 10:34:43,769 - DEBUG - Response Code: 404
2025-10-30 10:34:43,769 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/466b4af0-a5b6-4678-8347-57dc304fcc59
2025-10-30 10:34:43,777 - DEBUG - Response Code: 404
2025-10-30 10:34:43,777 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/466b4af0-a5b6-4678-8347-57dc304fcc59
2025-10-30 10:34:43,785 - DEBUG - Response Code: 404
2025-10-30 10:34:43,786 - INFO - VM ctest-VM21-37142401 is fully removed in API-Server
2025-10-30 10:34:43,940 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found
2025-10-30 10:34:43,981 - DEBUG - Validated that vrouter 10.0.0.41 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN2-12705797
2025-10-30 10:34:43,995 - DEBUG - Validated that vrouter 10.0.0.27 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN2-12705797
2025-10-30 10:34:43,995 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN2-12705797
2025-10-30 10:34:43,995 - INFO - VM ctest-VM21-37142401 is removed in Compute, and routes are removed in all compute nodes
2025-10-30 10:34:44,232 - INFO - Routes for VM ctest-VM21-37142401 is removed in all control-nodes
2025-10-30 10:34:44,232 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-2:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:34:44,276 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-2?flat
2025-10-30 10:34:44,310 - DEBUG - VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4541-2 uve
2025-10-30 10:34:44,310 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-30 10:34:44,310 - DEBUG - interface for vm 466b4af0-a5b6-4678-8347-57dc304fcc59 deleted from vrouter uve ...
2025-10-30 10:34:44,310 - DEBUG - Deleted interface not in error interface list ...
2025-10-30 10:34:47,311 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-2:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:34:47,353 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-2?flat
2025-10-30 10:34:47,384 - DEBUG - VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4541-2 uve
2025-10-30 10:34:47,384 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-30 10:34:47,384 - DEBUG - interface for vm 466b4af0-a5b6-4678-8347-57dc304fcc59 deleted from vrouter uve ...
2025-10-30 10:34:47,384 - DEBUG - Deleted interface not in error interface list ...
2025-10-30 10:34:50,385 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-2:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:34:50,450 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-2?flat
2025-10-30 10:34:50,485 - DEBUG - VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4541-2 uve
2025-10-30 10:34:50,485 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-30 10:34:50,485 - DEBUG - interface for vm 466b4af0-a5b6-4678-8347-57dc304fcc59 deleted from vrouter uve ...
2025-10-30 10:34:50,485 - DEBUG - Deleted interface not in error interface list ...
2025-10-30 10:34:53,486 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-2:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:34:53,528 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-2?flat
2025-10-30 10:34:53,561 - DEBUG - VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4541-2 uve
2025-10-30 10:34:53,561 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-30 10:34:53,561 - DEBUG - interface for vm 466b4af0-a5b6-4678-8347-57dc304fcc59 deleted from vrouter uve ...
2025-10-30 10:34:53,561 - DEBUG - Deleted interface not in error interface list ...
2025-10-30 10:34:56,561 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-2:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:34:56,602 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-2?flat
2025-10-30 10:34:56,645 - DEBUG - VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4541-2 uve
2025-10-30 10:34:56,645 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-30 10:34:56,645 - DEBUG - interface for vm 466b4af0-a5b6-4678-8347-57dc304fcc59 deleted from vrouter uve ...
2025-10-30 10:34:56,645 - DEBUG - Deleted interface not in error interface list ...
2025-10-30 10:34:59,646 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-2:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:34:59,683 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-2?flat
2025-10-30 10:34:59,717 - DEBUG - VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4541-2 uve
2025-10-30 10:34:59,717 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-30 10:34:59,717 - DEBUG - interface for vm 466b4af0-a5b6-4678-8347-57dc304fcc59 deleted from vrouter uve ...
2025-10-30 10:34:59,717 - DEBUG - Deleted interface not in error interface list ...
2025-10-30 10:35:02,719 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-2:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:35:02,755 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-2?flat
2025-10-30 10:35:02,789 - DEBUG - VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4541-2 uve
2025-10-30 10:35:02,789 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-30 10:35:02,789 - DEBUG - interface for vm 466b4af0-a5b6-4678-8347-57dc304fcc59 deleted from vrouter uve ...
2025-10-30 10:35:02,789 - DEBUG - Deleted interface not in error interface list ...
2025-10-30 10:35:05,790 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-2:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:35:05,832 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-2?flat
2025-10-30 10:35:05,869 - DEBUG - VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4541-2 uve
2025-10-30 10:35:05,869 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-30 10:35:05,869 - DEBUG - interface for vm 466b4af0-a5b6-4678-8347-57dc304fcc59 deleted from vrouter uve ...
2025-10-30 10:35:05,869 - DEBUG - Deleted interface not in error interface list ...
2025-10-30 10:35:08,870 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-2:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:35:08,906 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-2?flat
2025-10-30 10:35:08,938 - DEBUG - VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4541-2 uve
2025-10-30 10:35:08,938 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-30 10:35:08,938 - DEBUG - interface for vm 466b4af0-a5b6-4678-8347-57dc304fcc59 deleted from vrouter uve ...
2025-10-30 10:35:08,938 - DEBUG - Deleted interface not in error interface list ...
2025-10-30 10:35:08,938 - DEBUG - Validated that VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is removed in Vrouter UVE
2025-10-30 10:35:08,938 - DEBUG - Verifying through opserver in 10.0.0.249
2025-10-30 10:35:08,938 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-09205915:ctest-VN2-12705797?flat
2025-10-30 10:35:08,957 - DEBUG - 466b4af0-a5b6-4678-8347-57dc304fcc59 BM not in default-domain:ctest-TestPolicyAcl-09205915:ctest-VN2-12705797 uve
2025-10-30 10:35:08,957 - DEBUG - Validated that VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is not present in the VN UVE
2025-10-30 10:35:08,957 - DEBUG - Verifying the 466b4af0-a5b6-4678-8347-57dc304fcc59 virtual network link through opserver 10.0.0.249
2025-10-30 10:35:08,957 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines
2025-10-30 10:35:08,970 - INFO - 466b4af0-a5b6-4678-8347-57dc304fcc59 vm uve deleted from opserver
2025-10-30 10:35:08,970 - DEBUG - Verifying the 466b4af0-a5b6-4678-8347-57dc304fcc59 virtual network link through opserver 10.0.0.33
2025-10-30 10:35:08,970 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-machines
2025-10-30 10:35:08,983 - INFO - 466b4af0-a5b6-4678-8347-57dc304fcc59 vm uve deleted from opserver
2025-10-30 10:35:08,983 - DEBUG - Verifying the 466b4af0-a5b6-4678-8347-57dc304fcc59 virtual network link through opserver 10.0.0.19
2025-10-30 10:35:08,983 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2025-10-30 10:35:09,000 - INFO - 466b4af0-a5b6-4678-8347-57dc304fcc59 vm uve deleted from opserver
2025-10-30 10:35:09,000 - INFO - Validated that VM 466b4af0-a5b6-4678-8347-57dc304fcc59 is removed from Opserver
2025-10-30 10:35:09,000 - INFO - Deleting VM ctest-VM11-53138827
2025-10-30 10:35:09,087 - DEBUG - Verifying in api server 10.0.0.19
2025-10-30 10:35:09,087 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/30a6c061-475f-4355-b64c-4cdf068b58ef
2025-10-30 10:35:09,096 - DEBUG - VM ID 30a6c061-475f-4355-b64c-4cdf068b58ef of VM ctest-VM11-53138827 is still found in API Server
2025-10-30 10:35:11,098 - DEBUG - Verifying in api server 10.0.0.19
2025-10-30 10:35:11,098 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/30a6c061-475f-4355-b64c-4cdf068b58ef
2025-10-30 10:35:11,105 - DEBUG - Response Code: 404
2025-10-30 10:35:11,106 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/30a6c061-475f-4355-b64c-4cdf068b58ef
2025-10-30 10:35:11,112 - DEBUG - Response Code: 404
2025-10-30 10:35:11,112 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/30a6c061-475f-4355-b64c-4cdf068b58ef
2025-10-30 10:35:11,120 - DEBUG - Response Code: 404
2025-10-30 10:35:11,120 - INFO - VM ctest-VM11-53138827 is fully removed in API-Server
2025-10-30 10:35:11,272 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found
2025-10-30 10:35:11,320 - DEBUG - Validated that vrouter 10.0.0.41 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN1-97077062
2025-10-30 10:35:11,330 - DEBUG - Validated that vrouter 10.0.0.27 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN1-97077062
2025-10-30 10:35:11,331 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-09205915:ctest-VN1-97077062
2025-10-30 10:35:11,331 - INFO - VM ctest-VM11-53138827 is removed in Compute, and routes are removed in all compute nodes
2025-10-30 10:35:11,537 - INFO - Routes for VM ctest-VM11-53138827 is removed in all control-nodes
2025-10-30 10:35:11,537 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4541-1:Compute:contrail-vrouter-agent:0?flat
2025-10-30 10:35:11,573 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4541-1?flat
2025-10-30 10:35:11,605 - DEBUG - VM 30a6c061-475f-4355-b64c-4cdf068b58ef is not present in vrouter an-jenkins-deploy-platform-ansible-os-4541-1 uve
2025-10-30 10:35:11,605 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-10-30 10:35:11,605 - DEBUG - interface for vm 30a6c061-475f-4355-b64c-4cdf068b58ef deleted from vrouter uve ...
2025-10-30 10:35:11,605 - DEBUG - Deleted interface not in error interface list ...
2025-10-30 10:35:11,605 - DEBUG - Validated that VM 30a6c061-475f-4355-b64c-4cdf068b58ef is removed in Vrouter UVE
2025-10-30 10:35:11,605 - DEBUG - Verifying through opserver in 10.0.0.249
2025-10-30 10:35:11,605 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-09205915:ctest-VN1-97077062?flat
2025-10-30 10:35:11,625 - DEBUG - 30a6c061-475f-4355-b64c-4cdf068b58ef BM not in default-domain:ctest-TestPolicyAcl-09205915:ctest-VN1-97077062 uve
2025-10-30 10:35:11,625 - DEBUG - Validated that VM 30a6c061-475f-4355-b64c-4cdf068b58ef is not present in the VN UVE
2025-10-30 10:35:11,625 - DEBUG - Verifying the 30a6c061-475f-4355-b64c-4cdf068b58ef virtual network link through opserver 10.0.0.249
2025-10-30 10:35:11,625 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines
2025-10-30 10:35:11,637 - DEBUG - No links retuned for 30a6c061-475f-4355-b64c-4cdf068b58ef
2025-10-30 10:35:11,637 - INFO - 30a6c061-475f-4355-b64c-4cdf068b58ef vm uve deleted from opserver
2025-10-30 10:35:11,637 - DEBUG - Verifying the 30a6c061-475f-4355-b64c-4cdf068b58ef virtual network link through opserver 10.0.0.33
2025-10-30 10:35:11,637 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-machines
2025-10-30 10:35:11,651 - DEBUG - No links retuned for 30a6c061-475f-4355-b64c-4cdf068b58ef
2025-10-30 10:35:11,651 - INFO - 30a6c061-475f-4355-b64c-4cdf068b58ef vm uve deleted from opserver
2025-10-30 10:35:11,651 - DEBUG - Verifying the 30a6c061-475f-4355-b64c-4cdf068b58ef virtual network link through opserver 10.0.0.19
2025-10-30 10:35:11,651 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2025-10-30 10:35:11,664 - DEBUG - No links retuned for 30a6c061-475f-4355-b64c-4cdf068b58ef
2025-10-30 10:35:11,664 - INFO - 30a6c061-475f-4355-b64c-4cdf068b58ef vm uve deleted from opserver
2025-10-30 10:35:11,664 - INFO - Validated that VM 30a6c061-475f-4355-b64c-4cdf068b58ef is removed from Opserver
2025-10-30 10:35:11,664 - DEBUG - Detaching the Policy for VN :ctest-VN2-12705797
2025-10-30 10:35:11,664 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-10-30 10:35:11,671 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a
2025-10-30 10:35:11,687 - DEBUG - Requesting: http://10.0.0.249:8082/project/565bcbd8-d14b-41b5-b7b1-d2e36bf19311
2025-10-30 10:35:11,791 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e25bf350-463a-4322-8725-1508a38a2078
2025-10-30 10:35:11,804 - DEBUG - Requesting: http://10.0.0.249:8082/network-policy/60712af8-b71a-48ef-a02f-f4eac11157e7
2025-10-30 10:35:11,994 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAcl-09205915', 'ctest-policy21-23945352']] from ctest-VN2-12705797
2025-10-30 10:35:11,994 - DEBUG - Detaching the Policy for VN :ctest-VN1-97077062
2025-10-30 10:35:11,994 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-10-30 10:35:12,016 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a
2025-10-30 10:35:12,036 - DEBUG - Requesting: http://10.0.0.249:8082/project/565bcbd8-d14b-41b5-b7b1-d2e36bf19311
2025-10-30 10:35:12,145 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/7efea56b-d0f5-4fd0-8bbf-c3cbad031d0b
2025-10-30 10:35:12,433 - INFO - Detached Policy from ctest-VN1-97077062
2025-10-30 10:35:12,494 - INFO - Deleted policy ctest-policy13-63331717
2025-10-30 10:35:12,544 - INFO - Deleted policy ctest-policy21-23945352
2025-10-30 10:35:12,606 - INFO - Deleted policy ctest-policy12-46191826
2025-10-30 10:35:12,606 - INFO - Deleting VN ctest-VN3-05326790
2025-10-30 10:35:12,773 - DEBUG - Response for deleting network ()
2025-10-30 10:35:12,773 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/fe98688f-1a71-4bef-9172-09f5149674f8
2025-10-30 10:35:12,783 - DEBUG - Response Code: 404
2025-10-30 10:35:12,783 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-10-30 10:35:12,793 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a
2025-10-30 10:35:12,847 - DEBUG - Requesting: http://10.0.0.249:8082/project/565bcbd8-d14b-41b5-b7b1-d2e36bf19311
2025-10-30 10:35:12,937 - INFO - Validated that VN ctest-VN3-05326790 is not found in API Server
2025-10-30 10:35:12,951 - DEBUG - VN ctest-VN3-05326790 is not present in Agent 10.0.0.41
2025-10-30 10:35:12,962 - DEBUG - VN ctest-VN3-05326790 is not present in Agent 10.0.0.27
2025-10-30 10:35:12,962 - INFO - Validated that VN ctest-VN3-05326790 is not in any agent
2025-10-30 10:35:13,000 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN3-05326790 info
2025-10-30 10:35:13,000 - INFO - Deleting VN ctest-VN2-12705797
2025-10-30 10:35:13,167 - DEBUG - Response for deleting network ()
2025-10-30 10:35:13,167 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4f62c7d1-5f92-4e31-8623-b1eb7bdeeb91
2025-10-30 10:35:13,174 - DEBUG - Response Code: 404
2025-10-30 10:35:13,174 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-10-30 10:35:13,182 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a
2025-10-30 10:35:13,200 - DEBUG - Requesting: http://10.0.0.249:8082/project/565bcbd8-d14b-41b5-b7b1-d2e36bf19311
2025-10-30 10:35:13,286 - INFO - Validated that VN ctest-VN2-12705797 is not found in API Server
2025-10-30 10:35:13,299 - DEBUG - VN ctest-VN2-12705797 is not present in Agent 10.0.0.41
2025-10-30 10:35:13,313 - DEBUG - VN ctest-VN2-12705797 is not present in Agent 10.0.0.27
2025-10-30 10:35:13,313 - INFO - Validated that VN ctest-VN2-12705797 is not in any agent
2025-10-30 10:35:13,347 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN2-12705797 info
2025-10-30 10:35:13,347 - INFO - Deleting VN ctest-VN1-97077062
2025-10-30 10:35:13,571 - DEBUG - Response for deleting network ()
2025-10-30 10:35:13,571 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4b5107c0-180c-4833-8362-1130436506e2
2025-10-30 10:35:13,578 - DEBUG - Response Code: 404
2025-10-30 10:35:13,578 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-10-30 10:35:13,585 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a
2025-10-30 10:35:13,599 - DEBUG - Requesting: http://10.0.0.249:8082/project/565bcbd8-d14b-41b5-b7b1-d2e36bf19311
2025-10-30 10:35:13,718 - INFO - Validated that VN ctest-VN1-97077062 is not found in API Server
2025-10-30 10:35:13,731 - DEBUG - VN ctest-VN1-97077062 is not present in Agent 10.0.0.41
2025-10-30 10:35:13,743 - DEBUG - VN ctest-VN1-97077062 is not present in Agent 10.0.0.27
2025-10-30 10:35:13,743 - INFO - Validated that VN ctest-VN1-97077062 is not in any agent
2025-10-30 10:35:13,776 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN1-97077062 info
2025-10-30 10:35:13,877 - INFO - IPAM: ipam3 is not found in API Server
2025-10-30 10:35:13,901 - INFO - IPAM:ipam3 is not found in control node
2025-10-30 10:35:14,045 - INFO - IPAM: ipam2 is not found in API Server
2025-10-30 10:35:14,070 - INFO - IPAM:ipam2 is not found in control node
2025-10-30 10:35:14,237 - INFO - IPAM: ipam1 is not found in API Server
2025-10-30 10:35:14,268 - INFO - IPAM:ipam1 is not found in control node
2025-10-30 10:35:15,560 - DEBUG - No XMPP flaps were noticed during the test
2025-10-30 10:35:15,560 - INFO - END TEST : test_policy_inheritance_src_vn_dst_pol : PASSED[0:02:42]
2025-10-30 10:35:15,560 - INFO - --------------------------------------------------------------------------------
2025-10-30 10:35:16,380 - INFO - Deleted project: ctest-TestPolicyAcl-09205915, ID : 565bcbd8-d14b-41b5-b7b1-d2e36bf19311