2026-06-22 03:55:33,595 - INFO - Domain Default found not creating
2026-06-22 03:55:33,753 - INFO - Project ctest-TestMtuProbe-98970381 not found, creating it
2026-06-22 03:55:34,314 - INFO - Created Project:ctest-TestMtuProbe-98970381, ID : 0356d944-56cc-4463-a1cd-f411f9f2f64a
2026-06-22 03:55:35,813 - INFO - ================================================================================
2026-06-22 03:55:35,813 - INFO - STARTING TEST : test_mtu_probe_intra_node
2026-06-22 03:55:35,814 - INFO - TEST DESCRIPTION :
Description:
check traffic configuring different tcp_mtu_probe vlaues on vm
MTU probing values: 0, 1, 2
0 - Disabled (default)
1 - Disabled by default, Enabled only when ICMP black hole detected
2 - Always enabled, using the initial MSS value of tcp_base_mss
system internally enables bit values for point 1&2
For test purpose,
Idea is to check traffic works fine on configuring values
Vm's across compute node
steps:
1. create 1 VN and launch 2 VMs in same compute node
2. client and server VMs in same compute node
3. configure tcp_mtu_probe to 0, 1, 2
4. send icmp traffic assert if ping fails
5. send tcp traffic assert if tcp traffic fails
Pass criteria:
1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values
2026-06-22 03:55:37,084 - DEBUG - Nothing to compare xmpp stats {'10.0.0.242': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.22': {'10.20.0.193': '0', '10.20.0.129': '0'}} with
2026-06-22 03:55:37,084 - INFO - Initial checks done. Running the testcase now
2026-06-22 03:55:37,084 - INFO -
2026-06-22 03:55:37,753 - DEBUG - Response for create_network : {'network': {'id': 'e7f25f6e-79c4-4308-82e3-f6f8c276a01e', 'name': 'ctest-vn-92284098', 'tenant_id': '0356d94456cc4463a1cdf411f9f2f64a', 'project_id': '0356d94456cc4463a1cdf411f9f2f64a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-98970381', 'ctest-vn-92284098'], 'port_security_enabled': True, 'description': ''}}
2026-06-22 03:55:38,009 - DEBUG - Response for create_subnet : {'subnet': {'id': '405114cb-f875-4a90-b7b2-21c37d40801f', 'name': '', 'tenant_id': '0356d94456cc4463a1cdf411f9f2f64a', 'network_id': 'e7f25f6e-79c4-4308-82e3-f6f8c276a01e', 'ip_version': 4, 'cidr': '55.45.168.64/26', 'allocation_pools': [{'start': '55.45.168.66', 'end': '55.45.168.126'}], 'gateway_ip': '55.45.168.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '55.45.168.66', 'tags': [], 'project_id': '0356d94456cc4463a1cdf411f9f2f64a'}}
2026-06-22 03:55:38,029 - INFO - Created VN ctest-vn-92284098
2026-06-22 03:55:38,041 - DEBUG - VN ctest-vn-92284098 UUID is e7f25f6e-79c4-4308-82e3-f6f8c276a01e
2026-06-22 03:55:38,110 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 03:55:38,431 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 03:55:38,458 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 03:55:38,477 - DEBUG - Requesting: http://10.0.0.19:8082/project/0356d944-56cc-4463-a1cd-f411f9f2f64a
2026-06-22 03:55:38,580 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e7f25f6e-79c4-4308-82e3-f6f8c276a01e
2026-06-22 03:55:38,599 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e7f25f6e-79c4-4308-82e3-f6f8c276a01e
2026-06-22 03:55:38,611 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/2ca0e053-7d9f-4d1c-9b27-d8cce3b31aab
2026-06-22 03:55:38,621 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/2ca0e053-7d9f-4d1c-9b27-d8cce3b31aab
2026-06-22 03:55:38,629 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/727b2f0e-672d-4b91-919f-a656b4a18898
2026-06-22 03:55:38,637 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 03:55:38,637 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e7f25f6e-79c4-4308-82e3-f6f8c276a01e
2026-06-22 03:55:38,647 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/2ca0e053-7d9f-4d1c-9b27-d8cce3b31aab
2026-06-22 03:55:38,664 - INFO - Verified VN network id 12 for VN e7f25f6e-79c4-4308-82e3-f6f8c276a01e
2026-06-22 03:55:38,664 - INFO - Verifications in API Server for VN ctest-vn-92284098 passed
2026-06-22 03:55:38,664 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e7f25f6e-79c4-4308-82e3-f6f8c276a01e
2026-06-22 03:55:38,674 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/2ca0e053-7d9f-4d1c-9b27-d8cce3b31aab
2026-06-22 03:55:38,681 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/2ca0e053-7d9f-4d1c-9b27-d8cce3b31aab
2026-06-22 03:55:38,690 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/727b2f0e-672d-4b91-919f-a656b4a18898
2026-06-22 03:55:38,703 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-98970381', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16713526095219278600', 'uuid-lslong': '9431653592918827038'}, 'enable': 'true', 'created': '2026-06-22T03:55:37', 'last-modified': '2026-06-22T03:55:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.748383'}
2026-06-22 03:55:38,709 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 03:55:38,715 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-98970381', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16713526095219278600', 'uuid-lslong': '9431653592918827038'}, 'enable': 'true', 'created': '2026-06-22T03:55:37', 'last-modified': '2026-06-22T03:55:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.755297'}
2026-06-22 03:55:38,721 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 03:55:38,726 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-98970381', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16713526095219278600', 'uuid-lslong': '9431653592918827038'}, 'enable': 'true', 'created': '2026-06-22T03:55:37', 'last-modified': '2026-06-22T03:55:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.768960'}
2026-06-22 03:55:38,733 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 03:55:38,733 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-92284098 passed
2026-06-22 03:55:38,733 - DEBUG - ====Verifying policy data for ctest-vn-92284098 in API_Server ======
2026-06-22 03:55:38,733 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 03:55:38,739 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 03:55:38,750 - DEBUG - Requesting: http://10.0.0.19:8082/project/0356d944-56cc-4463-a1cd-f411f9f2f64a
2026-06-22 03:55:38,845 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e7f25f6e-79c4-4308-82e3-f6f8c276a01e
2026-06-22 03:55:38,855 - DEBUG - =>VN ctest-vn-92284098 has no policy to be verified
2026-06-22 03:55:38,855 - DEBUG - Verifying the vn in opserver
2026-06-22 03:55:38,856 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 virtual network link through opserver 10.0.0.19
2026-06-22 03:55:38,856 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 03:55:39,181 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 03:55:39,237 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098?flat'}
2026-06-22 03:55:39,237 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 virtual network link through opserver 10.0.0.129
2026-06-22 03:55:39,237 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 03:55:39,559 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 03:55:39,609 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098?flat'}
2026-06-22 03:55:39,609 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 virtual network link through opserver 10.0.0.241
2026-06-22 03:55:39,610 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 03:55:39,929 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 03:55:39,980 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098?flat'}
2026-06-22 03:55:39,980 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 is found in opserver
2026-06-22 03:55:40,000 - DEBUG - Do not have enough data to verify VN in agent
2026-06-22 03:55:40,011 - DEBUG - VRF ids for VN ctest-vn-92284098: {}
2026-06-22 03:55:40,038 - DEBUG - Services list from nova: [, , , ]
2026-06-22 03:55:40,038 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6014-1', 'an-jenkins-deploy-platform-ansible-os-6014-2']}
2026-06-22 03:55:40,038 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6014-1', 'an-jenkins-deploy-platform-ansible-os-6014-2']}
2026-06-22 03:55:41,135 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6014-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6014-1)
2026-06-22 03:55:41,135 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6014-1', 'an-jenkins-deploy-platform-ansible-os-6014-2']}
2026-06-22 03:55:42,332 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6014-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6014-1)
2026-06-22 03:55:42,332 - INFO - Waiting for VM ctest-TestMtuProbe-98970381-82387377 to be up..
2026-06-22 03:55:42,383 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-22 03:55:47,465 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-22 03:55:52,552 - DEBUG - VM is in ACTIVE state now
2026-06-22 03:55:52,552 - INFO - VM name : ctest-TestMtuProbe-98970381-82387377
2026-06-22 03:55:52,639 - DEBUG - VM ctest-TestMtuProbe-98970381-82387377 ID is 5481eed1-86a9-4c22-aa11-d975b9f58db7
2026-06-22 03:55:52,673 - DEBUG - VM ctest-TestMtuProbe-98970381-82387377 launched on Node an-jenkins-deploy-platform-ansible-os-6014-1
2026-06-22 03:55:52,762 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/5481eed1-86a9-4c22-aa11-d975b9f58db7
2026-06-22 03:55:53,101 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/5481eed1-86a9-4c22-aa11-d975b9f58db7
2026-06-22 03:55:53,138 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/2945ccf3-d83c-4998-b892-37cc41034dae
2026-06-22 03:55:56,325 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms')
2026-06-22 03:55:56,326 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-98970381-82387377 failed!
2026-06-22 03:55:56,342 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 is 55.45.168.65 and allocation pool is NOT set
2026-06-22 03:56:00,421 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2026-06-22 03:56:00,421 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-98970381-82387377 failed!
2026-06-22 03:56:00,438 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 is 55.45.168.65 and allocation pool is NOT set
2026-06-22 03:56:04,521 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-06-22 03:56:04,521 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-98970381-82387377 failed!
2026-06-22 03:56:04,536 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 is 55.45.168.65 and allocation pool is NOT set
2026-06-22 03:56:08,613 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2026-06-22 03:56:08,613 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-98970381-82387377 failed!
2026-06-22 03:56:08,628 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 is 55.45.168.65 and allocation pool is NOT set
2026-06-22 03:56:12,715 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2026-06-22 03:56:12,715 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-98970381-82387377 failed!
2026-06-22 03:56:12,730 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 is 55.45.168.65 and allocation pool is NOT set
2026-06-22 03:56:16,803 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms')
2026-06-22 03:56:16,803 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-98970381-82387377 failed!
2026-06-22 03:56:16,825 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 is 55.45.168.65 and allocation pool is NOT set
2026-06-22 03:56:20,905 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2026-06-22 03:56:20,905 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-98970381-82387377 failed!
2026-06-22 03:56:20,922 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 is 55.45.168.65 and allocation pool is NOT set
2026-06-22 03:56:24,996 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2026-06-22 03:56:24,997 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-98970381-82387377 failed!
2026-06-22 03:56:25,012 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-98970381:ctest-vn-92284098 is 55.45.168.65 and allocation pool is NOT set
2026-06-22 03:56:27,077 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=24.5 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.821 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.821/12.675/24.530/11.854 ms')
2026-06-22 03:56:27,077 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-98970381-82387377 passed
2026-06-22 03:56:27,148 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 03:56:27,148 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-98970381-82387377, IP 55.45.168.67, Port 22
2026-06-22 03:56:27,216 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-22 03:56:27,291 - DEBUG - VM ctest-TestMtuProbe-98970381-82387377 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-22 03:56:32,292 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 03:56:32,292 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-98970381-82387377, IP 55.45.168.67, Port 22
2026-06-22 03:56:32,364 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-22 03:56:32,441 - DEBUG - VM ctest-TestMtuProbe-98970381-82387377 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-22 03:56:37,442 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 03:56:37,442 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-98970381-82387377, IP 55.45.168.67, Port 22
2026-06-22 03:56:37,508 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-22 03:56:37,601 - DEBUG - VM ctest-TestMtuProbe-98970381-82387377 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-22 03:56:42,603 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 03:56:42,603 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-98970381-82387377, IP 55.45.168.67, Port 22
2026-06-22 03:56:42,768 - DEBUG - VM ctest-TestMtuProbe-98970381-82387377 is ready for SSH connections
2026-06-22 03:56:42,768 - INFO - Waiting for VM ctest-TestMtuProbe-98970381-08642460 to be up..
2026-06-22 03:56:42,856 - DEBUG - VM is in ACTIVE state now
2026-06-22 03:56:42,856 - INFO - VM name : ctest-TestMtuProbe-98970381-08642460
2026-06-22 03:56:42,952 - DEBUG - VM ctest-TestMtuProbe-98970381-08642460 ID is b480fe0c-8faa-473f-b8a3-a47230fbd7f5
2026-06-22 03:56:42,952 - DEBUG - VM ctest-TestMtuProbe-98970381-08642460 launched on Node an-jenkins-deploy-platform-ansible-os-6014-1
2026-06-22 03:56:43,043 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/b480fe0c-8faa-473f-b8a3-a47230fbd7f5
2026-06-22 03:56:43,053 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/7175c9bc-f46c-488f-a21b-7b4a93de197d
2026-06-22 03:56:44,218 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.50 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.519 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.519/2.011/3.503/1.492 ms')
2026-06-22 03:56:44,218 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestMtuProbe-98970381-08642460 passed
2026-06-22 03:56:44,288 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 03:56:44,288 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-98970381-08642460, IP 55.45.168.68, Port 22
2026-06-22 03:56:44,460 - DEBUG - VM ctest-TestMtuProbe-98970381-08642460 is ready for SSH connections
2026-06-22 03:56:44,460 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:56:44,460 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2026-06-22 03:57:27,728 - DEBUG - None
2026-06-22 03:57:27,728 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:57:27,728 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2026-06-22 03:58:00,889 - DEBUG - None
2026-06-22 03:58:00,889 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2026-06-22 03:58:00,889 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2026-06-22 03:58:00,889 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 03:58:00,889 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 55.45.168.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:00,889 - DEBUG - ping -s 56 -c 3 -W 1 55.45.168.68
2026-06-22 03:58:03,153 - DEBUG - PING 55.45.168.68 (55.45.168.68) 56(84) bytes of data.
64 bytes from 55.45.168.68: icmp_req=1 ttl=64 time=6.98 ms
64 bytes from 55.45.168.68: icmp_req=2 ttl=64 time=0.764 ms
64 bytes from 55.45.168.68: icmp_req=3 ttl=64 time=1.02 ms
--- 55.45.168.68 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.764/2.925/6.983/2.871 ms
2026-06-22 03:58:03,153 - INFO - Ping to IP 55.45.168.68 from VM ctest-TestMtuProbe-98970381-82387377 passed
2026-06-22 03:58:03,153 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 03:58:03,153 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:03,153 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2026-06-22 03:58:03,434 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-06-22 03:58:03,434 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:03,434 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2026-06-22 03:58:03,703 - DEBUG - None
2026-06-22 03:58:03,703 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 55.45.168.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:03,703 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 55.45.168.68 5201 < testfile
2026-06-22 03:58:05,948 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000903174 s, 111 kB/s
2026-06-22 03:58:05,948 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:05,948 - DEBUG - ls -l testfile
2026-06-22 03:58:06,115 - DEBUG - -rw-r--r-- 1 root root 100 Jun 22 03:58 testfile
2026-06-22 03:58:06,115 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-98970381-08642460
2026-06-22 03:58:06,115 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:06,115 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2026-06-22 03:58:06,317 - DEBUG - None
2026-06-22 03:58:06,317 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:06,317 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2026-06-22 03:58:06,517 - DEBUG - None
2026-06-22 03:58:06,517 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2026-06-22 03:58:06,517 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2026-06-22 03:58:06,518 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 03:58:06,518 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 55.45.168.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:06,518 - DEBUG - ping -s 56 -c 3 -W 1 55.45.168.68
2026-06-22 03:58:08,750 - DEBUG - PING 55.45.168.68 (55.45.168.68) 56(84) bytes of data.
64 bytes from 55.45.168.68: icmp_req=1 ttl=64 time=1.86 ms
64 bytes from 55.45.168.68: icmp_req=2 ttl=64 time=0.793 ms
64 bytes from 55.45.168.68: icmp_req=3 ttl=64 time=0.686 ms
--- 55.45.168.68 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 0.686/1.113/1.860/0.530 ms
2026-06-22 03:58:08,750 - INFO - Ping to IP 55.45.168.68 from VM ctest-TestMtuProbe-98970381-82387377 passed
2026-06-22 03:58:08,750 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 03:58:08,750 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:08,750 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2026-06-22 03:58:08,975 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jun 22 03:58 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-06-22 03:58:08,975 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:08,975 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2026-06-22 03:58:09,198 - DEBUG - None
2026-06-22 03:58:09,198 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 55.45.168.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:09,199 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 55.45.168.68 5201 < testfile
2026-06-22 03:58:11,470 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00113057 s, 88.5 kB/s
2026-06-22 03:58:11,470 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:11,470 - DEBUG - ls -l testfile
2026-06-22 03:58:11,631 - DEBUG - -rw-r--r-- 1 root root 100 Jun 22 03:58 testfile
2026-06-22 03:58:11,631 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-98970381-08642460
2026-06-22 03:58:11,631 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:11,631 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2026-06-22 03:58:11,827 - DEBUG - None
2026-06-22 03:58:11,827 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:11,827 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2026-06-22 03:58:12,019 - DEBUG - None
2026-06-22 03:58:12,019 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2026-06-22 03:58:12,019 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2026-06-22 03:58:12,019 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 03:58:12,019 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 55.45.168.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:12,019 - DEBUG - ping -s 56 -c 3 -W 1 55.45.168.68
2026-06-22 03:58:14,228 - DEBUG - PING 55.45.168.68 (55.45.168.68) 56(84) bytes of data.
64 bytes from 55.45.168.68: icmp_req=1 ttl=64 time=2.43 ms
64 bytes from 55.45.168.68: icmp_req=2 ttl=64 time=0.754 ms
64 bytes from 55.45.168.68: icmp_req=3 ttl=64 time=0.727 ms
--- 55.45.168.68 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 0.727/1.305/2.434/0.798 ms
2026-06-22 03:58:14,228 - INFO - Ping to IP 55.45.168.68 from VM ctest-TestMtuProbe-98970381-82387377 passed
2026-06-22 03:58:14,228 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 03:58:14,228 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:14,228 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2026-06-22 03:58:14,460 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jun 22 03:58 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-06-22 03:58:14,460 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:14,460 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2026-06-22 03:58:14,684 - DEBUG - None
2026-06-22 03:58:14,684 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 55.45.168.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:14,684 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 55.45.168.68 5201 < testfile
2026-06-22 03:58:16,915 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000665038 s, 150 kB/s
2026-06-22 03:58:16,915 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 03:58:16,915 - DEBUG - ls -l testfile
2026-06-22 03:58:17,096 - DEBUG - -rw-r--r-- 1 root root 100 Jun 22 03:58 testfile
2026-06-22 03:58:17,097 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-98970381-08642460
2026-06-22 03:58:17,097 - INFO - Deleting VM ctest-TestMtuProbe-98970381-08642460
2026-06-22 03:58:17,176 - INFO - Deleting VM ctest-TestMtuProbe-98970381-82387377
2026-06-22 03:58:17,249 - INFO - Deleting VN ctest-vn-92284098
2026-06-22 03:58:17,290 - DEBUG - VN e7f25f6e-79c4-4308-82e3-f6f8c276a01e still in use: Unable to complete operation on network e7f25f6e-79c4-4308-82e3-f6f8c276a01e. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-8214a7ad-c2d2-41b2-ba46-494598660912']
2026-06-22 03:58:17,291 - WARNING - Deleting VN ctest-vn-92284098 failed..Will retry
2026-06-22 03:58:19,345 - DEBUG - VN e7f25f6e-79c4-4308-82e3-f6f8c276a01e still in use: Unable to complete operation on network e7f25f6e-79c4-4308-82e3-f6f8c276a01e. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-50eec06d-9f1d-40b1-b12b-670489397dae']
2026-06-22 03:58:19,345 - WARNING - Deleting VN ctest-vn-92284098 failed..Will retry
2026-06-22 03:58:21,568 - DEBUG - Response for deleting network ()
2026-06-22 03:58:21,568 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/2ca0e053-7d9f-4d1c-9b27-d8cce3b31aab
2026-06-22 03:58:21,575 - DEBUG - Response Code: 404
2026-06-22 03:58:21,575 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 03:58:21,583 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 03:58:21,639 - DEBUG - Requesting: http://10.0.0.19:8082/project/0356d944-56cc-4463-a1cd-f411f9f2f64a
2026-06-22 03:58:21,735 - INFO - Validated that VN ctest-vn-92284098 is not found in API Server
2026-06-22 03:58:21,750 - DEBUG - VN ctest-vn-92284098 is not present in Agent 10.0.0.242
2026-06-22 03:58:21,762 - DEBUG - VN ctest-vn-92284098 is not present in Agent 10.0.0.22
2026-06-22 03:58:21,762 - INFO - Validated that VN ctest-vn-92284098 is not in any agent
2026-06-22 03:58:21,793 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-92284098 info
2026-06-22 03:58:23,062 - DEBUG - No XMPP flaps were noticed during the test
2026-06-22 03:58:23,062 - INFO - END TEST : test_mtu_probe_intra_node : PASSED[0:02:48]
2026-06-22 03:58:23,062 - INFO - --------------------------------------------------------------------------------
2026-06-22 03:58:23,915 - INFO - Deleted project: ctest-TestMtuProbe-98970381, ID : 0356d944-56cc-4463-a1cd-f411f9f2f64a