is in ACTIVE state now
2025-08-18 03:54:51,150 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:54:51,150 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:54:51,157 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/2d3eceff-77f9-41e5-adb8-01fd88e33f9e
2025-08-18 03:54:51,167 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:54:51,174 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/2d3eceff-77f9-41e5-adb8-01fd88e33f9e
2025-08-18 03:54:51,186 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/99b79495-e8a2-45e8-816f-879a537abc14
2025-08-18 03:54:51,194 - DEBUG - Verifying in api server 10.0.0.19
2025-08-18 03:54:51,194 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:54:51,202 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/2d3eceff-77f9-41e5-adb8-01fd88e33f9e
2025-08-18 03:54:51,213 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/99b79495-e8a2-45e8-816f-879a537abc14
2025-08-18 03:54:51,221 - INFO - VM EVPN_VN1_VM2 verfication in all API Servers passed
2025-08-18 03:54:51,239 - DEBUG - VM EVPN_VN1_VM2 Tap interface: {'index': '3', 'name': 'tap2d3eceff-77', 'uuid': '2d3eceff-77f9-41e5-adb8-01fd88e33f9e', 'vrf_name': 'default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1:EVPN-VN1', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '22', 'l2_label': '26', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1', 'vm_uuid': '628dd597-b2fa-4be2-88d2-c00c2a3a12a7', 'vm_name': 'EVPN_VN1_VM2', 'ip_addr': '11.1.1.4', 'mac_addr': '02:2d:3e:ce:ff:77', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '114', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestEvpnCasesRestart-48963040:2d3eceff-77f9-41e5-adb8-01fd88e33f9e', 'sg_uuid_list': ['5df6679d-0175-4ff1-9858-9e7f3d435138'], 'static_route_list': None, 'vm_project_uuid': 'f48450a6-3468-4cb9-b844-2e77dfad464d', 'admin_state': 'Enabled', 'flow_key_idx': '22', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2025-08-18 03:54:51,239 - DEBUG - Agent 10.0.0.41 vrf name: default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1:EVPN-VN1
2025-08-18 03:54:51,245 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1:EVPN-VN1', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.192:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]}
2025-08-18 03:54:51,321 - DEBUG - VM EVPN_VN1_VM2 : Tap interface tap2d3eceff-77 is set to Active
2025-08-18 03:54:51,321 - DEBUG - Tap interface tap2d3eceff-77 detail : {'index': '3', 'name': 'tap2d3eceff-77', 'uuid': '2d3eceff-77f9-41e5-adb8-01fd88e33f9e', 'vrf_name': 'default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1:EVPN-VN1', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '22', 'l2_label': '26', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1', 'vm_uuid': '628dd597-b2fa-4be2-88d2-c00c2a3a12a7', 'vm_name': 'EVPN_VN1_VM2', 'ip_addr': '11.1.1.4', 'mac_addr': '02:2d:3e:ce:ff:77', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '114', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestEvpnCasesRestart-48963040:2d3eceff-77f9-41e5-adb8-01fd88e33f9e', 'sg_uuid_list': ['5df6679d-0175-4ff1-9858-9e7f3d435138'], 'static_route_list': None, 'vm_project_uuid': 'f48450a6-3468-4cb9-b844-2e77dfad464d', 'admin_state': 'Enabled', 'flow_key_idx': '22', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}
2025-08-18 03:54:51,434 - DEBUG - Starting Layer 2 verification in Agent
2025-08-18 03:54:51,445 - DEBUG - Layer 2 path is seen for VM MAC 02:2d:3e:ce:ff:77 in agent 10.0.0.41
2025-08-18 03:54:51,445 - DEBUG - Active layer 2 route in agent is present for VMI tap2d3eceff-77
2025-08-18 03:54:51,445 - DEBUG - vxlan_id (13) matches bw route table and interface table
2025-08-18 03:54:51,451 - DEBUG - VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1 is found in Agent of node 10.0.0.241
2025-08-18 03:54:51,576 - DEBUG - VRF IDs of VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1 is consistent in agent 10.0.0.241
2025-08-18 03:54:51,576 - DEBUG - Route for VM IP ['11.1.1.4'] is consistent in agent 10.0.0.241
2025-08-18 03:54:51,576 - DEBUG - VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1 verification for VM EVPN_VN1_VM2 in Agent 10.0.0.241 passed
2025-08-18 03:54:51,682 - DEBUG - Starting all layer 2 verification in agent 10.0.0.241
2025-08-18 03:54:51,692 - DEBUG - Route for VM MAC 02:2d:3e:ce:ff:77 is consistent in agent 10.0.0.241
2025-08-18 03:54:51,699 - DEBUG - VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1 is found in Agent of node 10.0.0.41
2025-08-18 03:54:51,832 - DEBUG - VRF IDs of VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1 is consistent in agent 10.0.0.41
2025-08-18 03:54:51,832 - DEBUG - Route for VM IP ['11.1.1.4'] is consistent in agent 10.0.0.41
2025-08-18 03:54:51,832 - DEBUG - VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1 verification for VM EVPN_VN1_VM2 in Agent 10.0.0.41 passed
2025-08-18 03:54:51,942 - DEBUG - Starting all layer 2 verification in agent 10.0.0.41
2025-08-18 03:54:51,957 - DEBUG - Route for VM MAC 02:2d:3e:ce:ff:77 is consistent in agent 10.0.0.41
2025-08-18 03:54:53,131 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=1.37 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.576 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.576/0.974/1.372/0.398 ms')
2025-08-18 03:54:53,131 - INFO - Ping to Metadata IP 169.254.0.3 of VM EVPN_VN1_VM2 passed
2025-08-18 03:54:53,131 - INFO - VM EVPN_VN1_VM2 verifications in Compute nodes passed
2025-08-18 03:54:53,317 - DEBUG - Validated VM route 11.1.1.4 in vrouter of 10.0.0.241
2025-08-18 03:54:53,319 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: 10.20.0.192, 22; Got 10.20.0.192,22
2025-08-18 03:54:53,319 - DEBUG - Validated VM route 11.1.1.4 in vrouter of 10.0.0.241
2025-08-18 03:54:53,432 - DEBUG - Validated VM route 11.1.1.4 in vrouter of 10.0.0.41
2025-08-18 03:54:53,436 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0
2025-08-18 03:54:53,436 - INFO - Validated routes of VM EVPN_VN1_VM2 in all vrouters
2025-08-18 03:54:53,924 - DEBUG - Starting all layer2 verification in 10.0.0.19 Control Node
2025-08-18 03:54:54,047 - DEBUG - Layer2 route found for VM MAC 02:2d:3e:ce:ff:77 in Control-node 10.0.0.19
2025-08-18 03:54:54,047 - DEBUG - L2 Label for VM EVPN_VN1_VM2 same between Control-node 10.0.0.19 and Agent, Expected: 13, Seen: 13
2025-08-18 03:54:54,047 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node
2025-08-18 03:54:54,174 - DEBUG - Layer2 route found for VM MAC 02:2d:3e:ce:ff:77 in Control-node 10.0.0.38
2025-08-18 03:54:54,175 - DEBUG - L2 Label for VM EVPN_VN1_VM2 same between Control-node 10.0.0.38 and Agent, Expected: 13, Seen: 13
2025-08-18 03:54:54,175 - DEBUG - Starting all layer2 verification in 10.0.0.27 Control Node
2025-08-18 03:54:54,302 - DEBUG - Layer2 route found for VM MAC 02:2d:3e:ce:ff:77 in Control-node 10.0.0.27
2025-08-18 03:54:54,302 - DEBUG - L2 Label for VM EVPN_VN1_VM2 same between Control-node 10.0.0.27 and Agent, Expected: 13, Seen: 13
2025-08-18 03:54:54,302 - INFO - Verification in Control-nodes for VM EVPN_VN1_VM2 passed
2025-08-18 03:54:54,302 - DEBUG - Verifying the vm in opserver
2025-08-18 03:54:54,302 - DEBUG - Verifying in collector 10.0.0.19 ...
2025-08-18 03:54:54,302 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7?flat
2025-08-18 03:54:54,317 - DEBUG - Failed to get VM EVPN_VN1_VM2, ID 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 info from Opserver
2025-08-18 03:54:56,318 - DEBUG - Verifying the vm in opserver
2025-08-18 03:54:56,318 - DEBUG - Verifying in collector 10.0.0.19 ...
2025-08-18 03:54:56,318 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7?flat
2025-08-18 03:54:56,335 - DEBUG - Failed to get VM EVPN_VN1_VM2, ID 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 info from Opserver
2025-08-18 03:54:58,335 - DEBUG - Verifying the vm in opserver
2025-08-18 03:54:58,336 - DEBUG - Verifying in collector 10.0.0.19 ...
2025-08-18 03:54:58,336 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7?flat
2025-08-18 03:54:58,353 - DEBUG - Failed to get VM EVPN_VN1_VM2, ID 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 info from Opserver
2025-08-18 03:55:00,354 - DEBUG - Verifying the vm in opserver
2025-08-18 03:55:00,354 - DEBUG - Verifying in collector 10.0.0.19 ...
2025-08-18 03:55:00,355 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7?flat
2025-08-18 03:55:00,373 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestEvpnCasesRestart-48963040:2d3eceff-77f9-41e5-adb8-01fd88e33f9e?flat
2025-08-18 03:55:00,394 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestEvpnCasesRestart-48963040:2d3eceff-77f9-41e5-adb8-01fd88e33f9e?flat
2025-08-18 03:55:00,414 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7?flat
2025-08-18 03:55:00,433 - DEBUG - Verifying vm in vn uve
2025-08-18 03:55:00,433 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestEvpnCasesRestart-48963040:2d3eceff-77f9-41e5-adb8-01fd88e33f9e?flat
2025-08-18 03:55:00,455 - DEBUG - VM uve shows interface as {'__T': 1755489298871751, 'label': 22, 'active': True, 'tx_vlan': 65535, 'ip6_active': False, 'vn_uuid': '0156c628-ce5c-478e-820a-6faa675dae38', 'vm_uuid': '628dd597-b2fa-4be2-88d2-c00c2a3a12a7', 'ip6_address': '::', 'ip4_active': True, 'port_mirror_enabled': False, 'rx_vlan': 65535, 'gateway': '11.1.1.1', 'uuid': '2d3eceff-77f9-41e5-adb8-01fd88e33f9e', 'vm_name': 'EVPN_VN1_VM2', 'admin_state': True, 'ip_address': '11.1.1.4', 'virtual_network': 'default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1', 'l2_active': True, 'mac_address': '02:2d:3e:ce:ff:77', 'fixed_ip4_list': ['11.1.1.4'], 'is_health_check_active': True, 'vhostuser_mode': 0}
2025-08-18 03:55:00,455 - DEBUG - VM uve shows ip address as ['11.1.1.4', '::']
2025-08-18 03:55:00,455 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1
2025-08-18 03:55:00,455 - INFO - Verifying through opserver in 10.0.0.27
2025-08-18 03:55:00,455 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1?flat
2025-08-18 03:55:00,487 - DEBUG - expected vm list 628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:00,488 - DEBUG - Extracted vm list ['628dd597-b2fa-4be2-88d2-c00c2a3a12a7']
2025-08-18 03:55:00,488 - INFO - VM 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 is present in default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1
2025-08-18 03:55:00,488 - DEBUG - Verifying vm in vrouter uve
2025-08-18 03:55:00,488 - DEBUG - Getting info from collector 10.0.0.19..
2025-08-18 03:55:00,488 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7?flat
2025-08-18 03:55:00,505 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3870-2']
2025-08-18 03:55:00,505 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat
2025-08-18 03:55:00,549 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat
2025-08-18 03:55:00,585 - DEBUG - VM 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve
2025-08-18 03:55:00,585 - DEBUG - Validated that VM EVPN_VN1_VM2 is in Vrouter an-jenkins-deploy-platform-ansible-os-3870-2 UVE
2025-08-18 03:55:00,585 - DEBUG - Verifying vm tap interface/vn in vrouter uve
2025-08-18 03:55:00,594 - DEBUG - Expected tap interface of VM uuid 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 is default-domain:ctest-TestEvpnCasesRestart-48963040:2d3eceff-77f9-41e5-adb8-01fd88e33f9e
2025-08-18 03:55:00,594 - DEBUG - Expected VN of VM uuid 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 is default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1
2025-08-18 03:55:00,594 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat
2025-08-18 03:55:00,634 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat
2025-08-18 03:55:00,667 - DEBUG - VM 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve
2025-08-18 03:55:00,667 - INFO - tap interface default-domain:ctest-TestEvpnCasesRestart-48963040:2d3eceff-77f9-41e5-adb8-01fd88e33f9e of vm 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve
2025-08-18 03:55:00,667 - DEBUG - Connected network default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1 of vm 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve
2025-08-18 03:55:00,667 - DEBUG - Verifying the 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 virtual network link through opserver 10.0.0.27
2025-08-18 03:55:00,667 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines
2025-08-18 03:55:00,677 - DEBUG - VM link and name as {'name': '628dd597-b2fa-4be2-88d2-c00c2a3a12a7', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7?flat'}
2025-08-18 03:55:00,677 - DEBUG - Verifying the 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 virtual network link through opserver 10.0.0.38
2025-08-18 03:55:00,677 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines
2025-08-18 03:55:00,688 - DEBUG - VM link and name as {'name': '628dd597-b2fa-4be2-88d2-c00c2a3a12a7', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7?flat'}
2025-08-18 03:55:00,688 - DEBUG - Verifying the 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 virtual network link through opserver 10.0.0.19
2025-08-18 03:55:00,688 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2025-08-18 03:55:00,699 - DEBUG - VM link and name as {'name': '628dd597-b2fa-4be2-88d2-c00c2a3a12a7', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7?flat'}
2025-08-18 03:55:00,699 - INFO - VM EVPN_VN1_VM2 validations in Opserver passed
2025-08-18 03:55:00,767 - DEBUG - Executing command: sudo tcpdump -nni tap2d3eceff-77 -U ether src 02:97:41:50:fe:99 -w /tmp/tap2d3eceff-77_ctest-random-30526995.pcap
2025-08-18 03:55:00,855 - INFO - waiting to get tcpdump started
2025-08-18 03:55:22,014 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=0.881 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.356 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1019ms\r\nrtt min/avg/max/mdev = 0.356/0.618/0.881/0.262 ms')
2025-08-18 03:55:22,015 - INFO - Ping to Metadata IP 169.254.0.3 of VM EVPN_VN1_VM1 passed
2025-08-18 03:55:22,183 - DEBUG - file transfer done ['/tmp/program.py']
2025-08-18 03:55:22,184 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:55:22,184 - DEBUG - Copied file /tmp/tmpn26g1p1j/program.py to 11.1.1.3
2025-08-18 03:55:23,324 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=1.78 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.497 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.497/1.139/1.781/0.642 ms')
2025-08-18 03:55:23,324 - INFO - Ping to Metadata IP 169.254.0.3 of VM EVPN_VN1_VM1 passed
2025-08-18 03:55:23,324 - DEBUG - Running remote_cmd, Cmd : python /tmp/program.py, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2025-08-18 03:55:23,324 - DEBUG - python /tmp/program.py
2025-08-18 03:55:25,117 - DEBUG - WARNING: No route found for IPv6 destination :: (no default route?)
..........
Sent 10 packets.
2025-08-18 03:55:25,117 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tap2d3eceff-77_ctest-random-30526995.pcap ether host 02:2d:3e:ce:ff:77 | grep -c length
2025-08-18 03:55:25,132 - DEBUG - STDOUT: 0
2025-08-18 03:55:25,133 - DEBUG - STDERR: reading from file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-18 03:55:25,133 - WARNING - 0 packets are found in tcpdump output file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap but expected 10
2025-08-18 03:55:27,134 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tap2d3eceff-77_ctest-random-30526995.pcap ether host 02:2d:3e:ce:ff:77 | grep -c length
2025-08-18 03:55:27,150 - DEBUG - STDOUT: 0
2025-08-18 03:55:27,151 - DEBUG - STDERR: reading from file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-18 03:55:27,151 - WARNING - 0 packets are found in tcpdump output file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap but expected 10
2025-08-18 03:55:29,151 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tap2d3eceff-77_ctest-random-30526995.pcap ether host 02:2d:3e:ce:ff:77 | grep -c length
2025-08-18 03:55:29,166 - DEBUG - STDOUT: 0
2025-08-18 03:55:29,166 - DEBUG - STDERR: reading from file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-18 03:55:29,167 - WARNING - 0 packets are found in tcpdump output file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap but expected 10
2025-08-18 03:55:31,167 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tap2d3eceff-77_ctest-random-30526995.pcap ether host 02:2d:3e:ce:ff:77 | grep -c length
2025-08-18 03:55:31,181 - DEBUG - STDOUT: 0
2025-08-18 03:55:31,181 - DEBUG - STDERR: reading from file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-18 03:55:31,181 - WARNING - 0 packets are found in tcpdump output file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap but expected 10
2025-08-18 03:55:33,182 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tap2d3eceff-77_ctest-random-30526995.pcap ether host 02:2d:3e:ce:ff:77 | grep -c length
2025-08-18 03:55:33,199 - DEBUG - STDOUT: 0
2025-08-18 03:55:33,199 - DEBUG - STDERR: reading from file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-18 03:55:33,199 - WARNING - 0 packets are found in tcpdump output file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap but expected 10
2025-08-18 03:55:35,200 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tap2d3eceff-77_ctest-random-30526995.pcap ether host 02:2d:3e:ce:ff:77 | grep -c length
2025-08-18 03:55:35,213 - DEBUG - STDOUT: 0
2025-08-18 03:55:35,213 - DEBUG - STDERR: reading from file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-18 03:55:35,213 - WARNING - 0 packets are found in tcpdump output file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap but expected 10
2025-08-18 03:55:37,214 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tap2d3eceff-77_ctest-random-30526995.pcap ether host 02:2d:3e:ce:ff:77 | grep -c length
2025-08-18 03:55:37,227 - DEBUG - STDOUT: 0
2025-08-18 03:55:37,227 - DEBUG - STDERR: reading from file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-18 03:55:37,228 - WARNING - 0 packets are found in tcpdump output file /tmp/tap2d3eceff-77_ctest-random-30526995.pcap but expected 10
2025-08-18 03:55:37,228 - INFO - Checking the communication between 2 VM after vrouter restart
2025-08-18 03:55:37,228 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:37,237 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/2d3eceff-77f9-41e5-adb8-01fd88e33f9e
2025-08-18 03:55:37,247 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/99b79495-e8a2-45e8-816f-879a537abc14
2025-08-18 03:55:38,377 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=0.871 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.444 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.444/0.657/0.871/0.213 ms')
2025-08-18 03:55:38,377 - INFO - Ping to Metadata IP 169.254.0.3 of VM EVPN_VN1_VM1 passed
2025-08-18 03:55:38,377 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 11.1.1.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2025-08-18 03:55:38,377 - DEBUG - ping -s 56 -c 3 -W 1 11.1.1.4
2025-08-18 03:55:40,872 - DEBUG - PING 11.1.1.4 (11.1.1.4) 56(84) bytes of data.
64 bytes from 11.1.1.4: icmp_req=1 ttl=64 time=10.1 ms
64 bytes from 11.1.1.4: icmp_req=2 ttl=64 time=1.19 ms
64 bytes from 11.1.1.4: icmp_req=3 ttl=64 time=1.17 ms
--- 11.1.1.4 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.172/4.157/10.109/4.208 ms
2025-08-18 03:55:40,872 - INFO - Ping to IP 11.1.1.4 from VM EVPN_VN1_VM1 passed
2025-08-18 03:55:40,873 - INFO - Deleting VM EVPN_VN1_VM2
2025-08-18 03:55:40,944 - DEBUG - Verifying in api server 10.0.0.19
2025-08-18 03:55:40,945 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:40,955 - DEBUG - VM ID 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 of VM EVPN_VN1_VM2 is still found in API Server
2025-08-18 03:55:42,955 - DEBUG - Verifying in api server 10.0.0.19
2025-08-18 03:55:42,955 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:42,962 - DEBUG - Response Code: 404
2025-08-18 03:55:42,962 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:42,967 - DEBUG - Response Code: 404
2025-08-18 03:55:42,967 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:42,973 - DEBUG - Response Code: 404
2025-08-18 03:55:42,973 - INFO - VM EVPN_VN1_VM2 is fully removed in API-Server
2025-08-18 03:55:43,749 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found
2025-08-18 03:55:43,761 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:43,768 - DEBUG - Response Code: 404
2025-08-18 03:55:44,769 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:44,775 - DEBUG - Response Code: 404
2025-08-18 03:55:45,776 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:45,783 - DEBUG - Response Code: 404
2025-08-18 03:55:46,784 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:46,792 - DEBUG - Response Code: 404
2025-08-18 03:55:47,793 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:47,800 - DEBUG - Response Code: 404
2025-08-18 03:55:48,801 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:48,808 - DEBUG - Response Code: 404
2025-08-18 03:55:48,808 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:48,814 - DEBUG - Response Code: 404
2025-08-18 03:55:49,815 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:49,822 - DEBUG - Response Code: 404
2025-08-18 03:55:50,823 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:50,829 - DEBUG - Response Code: 404
2025-08-18 03:55:51,830 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:51,837 - DEBUG - Response Code: 404
2025-08-18 03:55:52,838 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:52,845 - DEBUG - Response Code: 404
2025-08-18 03:55:53,846 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:53,853 - DEBUG - Response Code: 404
2025-08-18 03:55:53,876 - DEBUG - Validated that vrouter 10.0.0.241 does not have VMs route for VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1
2025-08-18 03:55:53,876 - DEBUG - Validated that vrouter 10.0.0.41 does not have VMs route for VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1
2025-08-18 03:55:53,876 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1
2025-08-18 03:55:53,876 - INFO - VM EVPN_VN1_VM2 is removed in Compute, and routes are removed in all compute nodes
2025-08-18 03:55:54,105 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:54,110 - DEBUG - Response Code: 404
2025-08-18 03:55:55,110 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:55,117 - DEBUG - Response Code: 404
2025-08-18 03:55:56,117 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:56,124 - DEBUG - Response Code: 404
2025-08-18 03:55:57,125 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:57,132 - DEBUG - Response Code: 404
2025-08-18 03:55:58,133 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:58,140 - DEBUG - Response Code: 404
2025-08-18 03:55:59,141 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:59,150 - DEBUG - Response Code: 404
2025-08-18 03:55:59,150 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:55:59,156 - DEBUG - Response Code: 404
2025-08-18 03:56:00,157 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:56:00,165 - DEBUG - Response Code: 404
2025-08-18 03:56:01,166 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:56:01,173 - DEBUG - Response Code: 404
2025-08-18 03:56:02,174 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:56:02,180 - DEBUG - Response Code: 404
2025-08-18 03:56:03,181 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:56:03,192 - DEBUG - Response Code: 404
2025-08-18 03:56:04,193 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/628dd597-b2fa-4be2-88d2-c00c2a3a12a7
2025-08-18 03:56:04,199 - DEBUG - Response Code: 404
2025-08-18 03:56:04,199 - INFO - Routes for VM EVPN_VN1_VM2 is removed in all control-nodes
2025-08-18 03:56:04,200 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat
2025-08-18 03:56:04,251 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat
2025-08-18 03:56:04,289 - DEBUG - VM 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 is not present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve
2025-08-18 03:56:04,289 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-08-18 03:56:04,289 - DEBUG - interface for vm 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 deleted from vrouter uve ...
2025-08-18 03:56:04,289 - DEBUG - Deleted interface not in error interface list ...
2025-08-18 03:56:04,289 - DEBUG - Validated that VM 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 is removed in Vrouter UVE
2025-08-18 03:56:04,289 - DEBUG - Verifying through opserver in 10.0.0.27
2025-08-18 03:56:04,289 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1?flat
2025-08-18 03:56:04,316 - DEBUG - 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 BM not in default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1 uve
2025-08-18 03:56:04,317 - DEBUG - Validated that VM 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 is not present in the VN UVE
2025-08-18 03:56:04,317 - DEBUG - Verifying the 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 virtual network link through opserver 10.0.0.27
2025-08-18 03:56:04,317 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines
2025-08-18 03:56:04,330 - INFO - 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 vm uve deleted from opserver
2025-08-18 03:56:04,330 - DEBUG - Verifying the 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 virtual network link through opserver 10.0.0.38
2025-08-18 03:56:04,330 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines
2025-08-18 03:56:04,342 - INFO - 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 vm uve deleted from opserver
2025-08-18 03:56:04,343 - DEBUG - Verifying the 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 virtual network link through opserver 10.0.0.19
2025-08-18 03:56:04,343 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2025-08-18 03:56:04,355 - INFO - 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 vm uve deleted from opserver
2025-08-18 03:56:04,355 - INFO - Validated that VM 628dd597-b2fa-4be2-88d2-c00c2a3a12a7 is removed from Opserver
2025-08-18 03:56:04,355 - INFO - Deleting VM EVPN_VN1_VM1
2025-08-18 03:56:04,422 - DEBUG - Verifying in api server 10.0.0.19
2025-08-18 03:56:04,422 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:04,432 - DEBUG - VM ID 6348c8cb-dc73-4c11-8858-76884993d44a of VM EVPN_VN1_VM1 is still found in API Server
2025-08-18 03:56:06,433 - DEBUG - Verifying in api server 10.0.0.19
2025-08-18 03:56:06,433 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:06,440 - DEBUG - Response Code: 404
2025-08-18 03:56:06,441 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:06,447 - DEBUG - Response Code: 404
2025-08-18 03:56:06,447 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:06,453 - DEBUG - Response Code: 404
2025-08-18 03:56:06,454 - INFO - VM EVPN_VN1_VM1 is fully removed in API-Server
2025-08-18 03:56:06,609 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found
2025-08-18 03:56:06,622 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:06,628 - DEBUG - Response Code: 404
2025-08-18 03:56:07,629 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:07,637 - DEBUG - Response Code: 404
2025-08-18 03:56:08,637 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:08,645 - DEBUG - Response Code: 404
2025-08-18 03:56:09,645 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:09,654 - DEBUG - Response Code: 404
2025-08-18 03:56:10,656 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:10,662 - DEBUG - Response Code: 404
2025-08-18 03:56:11,663 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:11,670 - DEBUG - Response Code: 404
2025-08-18 03:56:11,671 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:11,676 - DEBUG - Response Code: 404
2025-08-18 03:56:12,677 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:12,684 - DEBUG - Response Code: 404
2025-08-18 03:56:13,685 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:13,691 - DEBUG - Response Code: 404
2025-08-18 03:56:14,692 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:14,699 - DEBUG - Response Code: 404
2025-08-18 03:56:15,700 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:15,706 - DEBUG - Response Code: 404
2025-08-18 03:56:16,707 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/6348c8cb-dc73-4c11-8858-76884993d44a
2025-08-18 03:56:16,714 - DEBUG - Response Code: 404
2025-08-18 03:56:16,736 - DEBUG - Validated that vrouter 10.0.0.241 does not have VMs route for VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1
2025-08-18 03:56:16,748 - DEBUG - Validated that vrouter 10.0.0.41 does not have VMs route for VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1
2025-08-18 03:56:16,748 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1
2025-08-18 03:56:16,748 - INFO - VM EVPN_VN1_VM1 is removed in Compute, and routes are removed in all compute nodes
2025-08-18 03:56:16,980 - INFO - Routes for VM EVPN_VN1_VM1 is removed in all control-nodes
2025-08-18 03:56:16,980 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat
2025-08-18 03:56:17,037 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat
2025-08-18 03:56:17,071 - DEBUG - VM 6348c8cb-dc73-4c11-8858-76884993d44a is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve
2025-08-18 03:56:17,071 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-08-18 03:56:17,071 - DEBUG - interface for vm 6348c8cb-dc73-4c11-8858-76884993d44a deleted from vrouter uve ...
2025-08-18 03:56:17,071 - DEBUG - Deleted interface not in error interface list ...
2025-08-18 03:56:20,072 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat
2025-08-18 03:56:20,131 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat
2025-08-18 03:56:20,172 - DEBUG - VM 6348c8cb-dc73-4c11-8858-76884993d44a is not present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve
2025-08-18 03:56:20,173 - DEBUG - Verifying if the vm interface deleted from vroter uve...
2025-08-18 03:56:20,173 - DEBUG - interface for vm 6348c8cb-dc73-4c11-8858-76884993d44a deleted from vrouter uve ...
2025-08-18 03:56:20,173 - DEBUG - Deleted interface not in error interface list ...
2025-08-18 03:56:20,173 - DEBUG - Validated that VM 6348c8cb-dc73-4c11-8858-76884993d44a is removed in Vrouter UVE
2025-08-18 03:56:20,173 - DEBUG - Verifying through opserver in 10.0.0.27
2025-08-18 03:56:20,173 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1?flat
2025-08-18 03:56:20,193 - DEBUG - 6348c8cb-dc73-4c11-8858-76884993d44a BM not in default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1 uve
2025-08-18 03:56:20,193 - DEBUG - Validated that VM 6348c8cb-dc73-4c11-8858-76884993d44a is not present in the VN UVE
2025-08-18 03:56:20,193 - DEBUG - Verifying the 6348c8cb-dc73-4c11-8858-76884993d44a virtual network link through opserver 10.0.0.27
2025-08-18 03:56:20,193 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines
2025-08-18 03:56:20,204 - INFO - 6348c8cb-dc73-4c11-8858-76884993d44a vm uve deleted from opserver
2025-08-18 03:56:20,204 - DEBUG - Verifying the 6348c8cb-dc73-4c11-8858-76884993d44a virtual network link through opserver 10.0.0.38
2025-08-18 03:56:20,204 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines
2025-08-18 03:56:20,215 - INFO - 6348c8cb-dc73-4c11-8858-76884993d44a vm uve deleted from opserver
2025-08-18 03:56:20,215 - DEBUG - Verifying the 6348c8cb-dc73-4c11-8858-76884993d44a virtual network link through opserver 10.0.0.19
2025-08-18 03:56:20,215 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines
2025-08-18 03:56:20,227 - INFO - 6348c8cb-dc73-4c11-8858-76884993d44a vm uve deleted from opserver
2025-08-18 03:56:20,227 - INFO - Validated that VM 6348c8cb-dc73-4c11-8858-76884993d44a is removed from Opserver
2025-08-18 03:56:20,227 - INFO - Deleting VN EVPN-VN1
2025-08-18 03:56:20,411 - DEBUG - Response for deleting network ()
2025-08-18 03:56:20,411 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/145d91a7-5f74-4941-8077-3e5f2f41d8ac
2025-08-18 03:56:20,419 - DEBUG - Response Code: 404
2025-08-18 03:56:20,419 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-18 03:56:20,425 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3
2025-08-18 03:56:20,481 - DEBUG - Requesting: http://10.0.0.27:8082/project/f48450a6-3468-4cb9-b844-2e77dfad464d
2025-08-18 03:56:20,576 - INFO - Validated that VN EVPN-VN1 is not found in API Server
2025-08-18 03:56:20,592 - DEBUG - VN EVPN-VN1 is not present in Agent 10.0.0.241
2025-08-18 03:56:20,602 - DEBUG - VN EVPN-VN1 is not present in Agent 10.0.0.41
2025-08-18 03:56:20,602 - INFO - Validated that VN EVPN-VN1 is not in any agent
2025-08-18 03:56:20,607 - DEBUG - VRF 2 is not seen in agent 10.0.0.241
2025-08-18 03:56:20,613 - DEBUG - Vrouter 10.0.0.241 does not have vrf 2 for VN EVPN-VN1
2025-08-18 03:56:20,618 - DEBUG - VRF 2 is not seen in agent 10.0.0.41
2025-08-18 03:56:20,623 - DEBUG - Vrouter 10.0.0.41 does not have vrf 2 for VN EVPN-VN1
2025-08-18 03:56:20,623 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestEvpnCasesRestart-48963040:EVPN-VN1
2025-08-18 03:56:20,644 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN EVPN-VN1 info
2025-08-18 03:56:22,857 - DEBUG - Skipping xmpp flap check
2025-08-18 03:56:22,857 - INFO - END TEST : test_with_vxlan_encap_agent_restart : PASSED[0:04:25]
2025-08-18 03:56:22,857 - INFO - --------------------------------------------------------------------------------
2025-08-18 03:56:23,578 - INFO - Deleted project: ctest-TestEvpnCasesRestart-48963040, ID : f48450a6-3468-4cb9-b844-2e77dfad464d