2025-08-06 16:21:56,323 - INFO - Domain Default found not creating 2025-08-06 16:21:56,464 - INFO - Project ctest-TestMtuProbe-85082971 not found, creating it 2025-08-06 16:21:57,002 - INFO - Created Project:ctest-TestMtuProbe-85082971, ID : 64893654-7233-4e99-b48b-7f07b7027e3b 2025-08-06 16:21:58,447 - INFO - ================================================================================ 2025-08-06 16:21:58,447 - INFO - STARTING TEST : test_mtu_probe_inter_node 2025-08-06 16:21:58,447 - INFO - TEST DESCRIPTION : Description: check traffic configuring different tcp_mtu_probe vlaues on vm MTU probing values: 0, 1, 2 0 - Disabled (default) 1 - Disabled by default, Enabled only when ICMP black hole detected 2 - Always enabled, using the initial MSS value of tcp_base_mss system internally enables bit values for point 1&2 For test purpose, Idea is to check traffic works fine on configuring values Vm's across compute node steps: 1. create 1 VN and launch 2 VMs across compute node 2. client and server VMs across compute node 3. configure tcp_mtu_probe to 0, 1, 2 4. send icmp traffic assert if ping fails 5. send tcp traffic assert if tcp traffic fails Pass criteria: 1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values 2025-08-06 16:21:59,737 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.57': {'10.20.0.25': '0', '10.20.0.14': '0'}} with 2025-08-06 16:21:59,737 - INFO - Initial checks done. Running the testcase now 2025-08-06 16:21:59,737 - INFO - 2025-08-06 16:21:59,766 - DEBUG - Services list from nova: [, , , ] 2025-08-06 16:21:59,766 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3763-1', 'an-jenkins-deploy-platform-ansible-os-3763-2']} 2025-08-06 16:22:00,416 - DEBUG - Response for create_network : {'network': {'id': '16676512-52e7-4e57-93ab-9ec7472728fd', 'name': 'ctest-vn-13695152', 'tenant_id': '6489365472334e99b48b7f07b7027e3b', 'project_id': '6489365472334e99b48b7f07b7027e3b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-85082971', 'ctest-vn-13695152'], 'port_security_enabled': True, 'description': ''}} 2025-08-06 16:22:00,737 - DEBUG - Response for create_subnet : {'subnet': {'id': '41e77dc2-171a-4509-b9ab-a05846b56b15', 'name': '', 'tenant_id': '6489365472334e99b48b7f07b7027e3b', 'network_id': '16676512-52e7-4e57-93ab-9ec7472728fd', 'ip_version': 4, 'cidr': '19.110.174.0/26', 'allocation_pools': [{'start': '19.110.174.2', 'end': '19.110.174.62'}], 'gateway_ip': '19.110.174.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '19.110.174.2', 'tags': [], 'project_id': '6489365472334e99b48b7f07b7027e3b'}} 2025-08-06 16:22:00,762 - INFO - Created VN ctest-vn-13695152 2025-08-06 16:22:00,776 - DEBUG - VN ctest-vn-13695152 UUID is 16676512-52e7-4e57-93ab-9ec7472728fd 2025-08-06 16:22:00,865 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-06 16:22:01,168 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-06 16:22:01,199 - DEBUG - Requesting: http://10.0.0.254:8082/domain/024378da-7408-4369-ac73-51fa8d4d8d77 2025-08-06 16:22:01,217 - DEBUG - Requesting: http://10.0.0.254:8082/project/64893654-7233-4e99-b48b-7f07b7027e3b 2025-08-06 16:22:01,313 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/16676512-52e7-4e57-93ab-9ec7472728fd 2025-08-06 16:22:01,326 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/16676512-52e7-4e57-93ab-9ec7472728fd 2025-08-06 16:22:01,338 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4c58b33-dc91-4a67-aeb5-e84568e77b45 2025-08-06 16:22:01,349 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4c58b33-dc91-4a67-aeb5-e84568e77b45 2025-08-06 16:22:01,359 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/c422db25-b5f4-4bc8-ba0d-88f1d1928161 2025-08-06 16:22:01,366 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 16:22:01,366 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/16676512-52e7-4e57-93ab-9ec7472728fd 2025-08-06 16:22:01,376 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4c58b33-dc91-4a67-aeb5-e84568e77b45 2025-08-06 16:22:01,395 - INFO - Verified VN network id 9 for VN 16676512-52e7-4e57-93ab-9ec7472728fd 2025-08-06 16:22:01,395 - INFO - Verifications in API Server for VN ctest-vn-13695152 passed 2025-08-06 16:22:01,396 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/16676512-52e7-4e57-93ab-9ec7472728fd 2025-08-06 16:22:01,410 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4c58b33-dc91-4a67-aeb5-e84568e77b45 2025-08-06 16:22:01,420 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4c58b33-dc91-4a67-aeb5-e84568e77b45 2025-08-06 16:22:01,428 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/c422db25-b5f4-4bc8-ba0d-88f1d1928161 2025-08-06 16:22:01,442 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-85082971', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1614370120810319447', 'uuid-lslong': '10640773123322358013'}, 'enable': 'true', 'created': '2025-08-06T16:22:00', 'last-modified': '2025-08-06T16:22:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.762962'} 2025-08-06 16:22:01,449 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 16:22:01,456 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-85082971', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1614370120810319447', 'uuid-lslong': '10640773123322358013'}, 'enable': 'true', 'created': '2025-08-06T16:22:00', 'last-modified': '2025-08-06T16:22:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.775544'} 2025-08-06 16:22:01,464 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 16:22:01,470 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-85082971', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1614370120810319447', 'uuid-lslong': '10640773123322358013'}, 'enable': 'true', 'created': '2025-08-06T16:22:00', 'last-modified': '2025-08-06T16:22:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.790593'} 2025-08-06 16:22:01,476 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 16:22:01,477 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-13695152 passed 2025-08-06 16:22:01,477 - DEBUG - ====Verifying policy data for ctest-vn-13695152 in API_Server ====== 2025-08-06 16:22:01,477 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-06 16:22:01,484 - DEBUG - Requesting: http://10.0.0.254:8082/domain/024378da-7408-4369-ac73-51fa8d4d8d77 2025-08-06 16:22:01,498 - DEBUG - Requesting: http://10.0.0.254:8082/project/64893654-7233-4e99-b48b-7f07b7027e3b 2025-08-06 16:22:01,590 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/16676512-52e7-4e57-93ab-9ec7472728fd 2025-08-06 16:22:01,600 - DEBUG - =>VN ctest-vn-13695152 has no policy to be verified 2025-08-06 16:22:01,600 - DEBUG - Verifying the vn in opserver 2025-08-06 16:22:01,600 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 virtual network link through opserver 10.0.0.254 2025-08-06 16:22:01,601 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-06 16:22:01,893 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-06 16:22:01,953 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152?flat'} 2025-08-06 16:22:01,953 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 virtual network link through opserver 10.0.0.38 2025-08-06 16:22:01,953 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-06 16:22:02,258 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-06 16:22:02,318 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152?flat'} 2025-08-06 16:22:02,318 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 virtual network link through opserver 10.0.0.48 2025-08-06 16:22:02,318 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-06 16:22:02,617 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-06 16:22:02,678 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152?flat'} 2025-08-06 16:22:02,678 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 is found in opserver 2025-08-06 16:22:02,707 - DEBUG - Do not have enough data to verify VN in agent 2025-08-06 16:22:02,725 - DEBUG - VRF ids for VN ctest-vn-13695152: {} 2025-08-06 16:22:02,725 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3763-1', 'an-jenkins-deploy-platform-ansible-os-3763-2']} 2025-08-06 16:22:02,725 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3763-1', 'an-jenkins-deploy-platform-ansible-os-3763-2']} 2025-08-06 16:22:03,913 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3763-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3763-1) 2025-08-06 16:22:03,914 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3763-1', 'an-jenkins-deploy-platform-ansible-os-3763-2']} 2025-08-06 16:22:05,335 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3763-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3763-2) 2025-08-06 16:22:05,335 - INFO - Waiting for VM ctest-TestMtuProbe-85082971-15467268 to be up.. 2025-08-06 16:22:05,417 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 16:22:10,510 - DEBUG - VM is in ACTIVE state now 2025-08-06 16:22:10,510 - INFO - VM name : ctest-TestMtuProbe-85082971-15467268 2025-08-06 16:22:10,602 - DEBUG - VM ctest-TestMtuProbe-85082971-15467268 ID is de66668e-412b-43bc-a45c-9183ac0c12ee 2025-08-06 16:22:10,629 - DEBUG - VM ctest-TestMtuProbe-85082971-15467268 launched on Node an-jenkins-deploy-platform-ansible-os-3763-1 2025-08-06 16:22:10,706 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/de66668e-412b-43bc-a45c-9183ac0c12ee 2025-08-06 16:22:10,998 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/de66668e-412b-43bc-a45c-9183ac0c12ee 2025-08-06 16:22:11,031 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/85df9a99-45b8-4a46-9b94-59ba48cd68ec 2025-08-06 16:22:14,258 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-08-06 16:22:14,259 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15467268 failed! 2025-08-06 16:22:14,276 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 is 19.110.174.1 and allocation pool is NOT set 2025-08-06 16:22:18,354 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-08-06 16:22:18,354 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15467268 failed! 2025-08-06 16:22:18,370 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 is 19.110.174.1 and allocation pool is NOT set 2025-08-06 16:22:22,450 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-06 16:22:22,450 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15467268 failed! 2025-08-06 16:22:22,464 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 is 19.110.174.1 and allocation pool is NOT set 2025-08-06 16:22:26,546 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-08-06 16:22:26,546 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15467268 failed! 2025-08-06 16:22:26,563 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 is 19.110.174.1 and allocation pool is NOT set 2025-08-06 16:22:30,635 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-06 16:22:30,635 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15467268 failed! 2025-08-06 16:22:30,652 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 is 19.110.174.1 and allocation pool is NOT set 2025-08-06 16:22:34,728 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-06 16:22:34,728 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15467268 failed! 2025-08-06 16:22:34,742 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 is 19.110.174.1 and allocation pool is NOT set 2025-08-06 16:22:38,830 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-08-06 16:22:38,831 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15467268 failed! 2025-08-06 16:22:38,845 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 is 19.110.174.1 and allocation pool is NOT set 2025-08-06 16:22:42,925 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-06 16:22:42,926 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15467268 failed! 2025-08-06 16:22:42,942 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 is 19.110.174.1 and allocation pool is NOT set 2025-08-06 16:22:47,021 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-06 16:22:47,021 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15467268 failed! 2025-08-06 16:22:47,038 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 is 19.110.174.1 and allocation pool is NOT set 2025-08-06 16:22:51,117 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-06 16:22:51,117 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15467268 failed! 2025-08-06 16:22:51,135 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-13695152 is 19.110.174.1 and allocation pool is NOT set 2025-08-06 16:22:53,196 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.97 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.683 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.683/3.325/5.968/2.642 ms') 2025-08-06 16:22:53,196 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15467268 passed 2025-08-06 16:22:53,311 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:22:53,311 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-15467268, IP 19.110.174.3, Port 22 2025-08-06 16:22:53,377 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 16:22:53,458 - DEBUG - VM ctest-TestMtuProbe-85082971-15467268 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 16:22:58,458 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:22:58,459 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-15467268, IP 19.110.174.3, Port 22 2025-08-06 16:22:58,525 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 16:22:58,613 - DEBUG - VM ctest-TestMtuProbe-85082971-15467268 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 16:23:03,614 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:23:03,614 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-15467268, IP 19.110.174.3, Port 22 2025-08-06 16:23:03,681 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 16:23:03,811 - DEBUG - VM ctest-TestMtuProbe-85082971-15467268 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 16:23:08,811 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:23:08,811 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-15467268, IP 19.110.174.3, Port 22 2025-08-06 16:23:08,877 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 16:23:08,965 - DEBUG - VM ctest-TestMtuProbe-85082971-15467268 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 16:23:13,966 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:23:13,966 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-15467268, IP 19.110.174.3, Port 22 2025-08-06 16:23:14,123 - DEBUG - VM ctest-TestMtuProbe-85082971-15467268 is ready for SSH connections 2025-08-06 16:23:14,123 - INFO - Waiting for VM ctest-TestMtuProbe-85082971-15504235 to be up.. 2025-08-06 16:23:14,224 - DEBUG - VM is in ACTIVE state now 2025-08-06 16:23:14,224 - INFO - VM name : ctest-TestMtuProbe-85082971-15504235 2025-08-06 16:23:14,316 - DEBUG - VM ctest-TestMtuProbe-85082971-15504235 ID is e8050afe-e35a-426b-aa2c-a1f4057b65eb 2025-08-06 16:23:14,316 - DEBUG - VM ctest-TestMtuProbe-85082971-15504235 launched on Node an-jenkins-deploy-platform-ansible-os-3763-2 2025-08-06 16:23:14,403 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/e8050afe-e35a-426b-aa2c-a1f4057b65eb 2025-08-06 16:23:14,415 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/fab05897-170a-41fc-aa85-580111d24c44 2025-08-06 16:23:15,620 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.11 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.00 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.000/2.054/3.109/1.054 ms') 2025-08-06 16:23:15,620 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-15504235 passed 2025-08-06 16:23:15,747 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:23:15,747 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-15504235, IP 19.110.174.4, Port 22 2025-08-06 16:23:15,923 - DEBUG - VM ctest-TestMtuProbe-85082971-15504235 is ready for SSH connections 2025-08-06 16:23:15,923 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:23:15,923 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:23:37,528 - DEBUG - None 2025-08-06 16:23:37,528 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:23:37,528 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:24:24,073 - DEBUG - None 2025-08-06 16:24:24,074 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:24:24,074 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:24:24,074 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:24:24,074 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 19.110.174.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:24:24,074 - DEBUG - ping -s 56 -c 3 -W 1 19.110.174.4 2025-08-06 16:24:26,603 - DEBUG - PING 19.110.174.4 (19.110.174.4) 56(84) bytes of data. 64 bytes from 19.110.174.4: icmp_req=1 ttl=64 time=12.8 ms 64 bytes from 19.110.174.4: icmp_req=2 ttl=64 time=1.24 ms 64 bytes from 19.110.174.4: icmp_req=3 ttl=64 time=1.16 ms --- 19.110.174.4 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.161/5.096/12.887/5.509 ms 2025-08-06 16:24:26,603 - INFO - Ping to IP 19.110.174.4 from VM ctest-TestMtuProbe-85082971-15467268 passed 2025-08-06 16:24:26,603 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:24:26,603 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:24:26,603 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 16:24:27,295 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 16:24:27,296 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:24:27,296 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 16:24:27,804 - DEBUG - None 2025-08-06 16:24:27,805 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 19.110.174.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:24:27,805 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 19.110.174.4 5201 < testfile 2025-08-06 16:24:30,397 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.000872305 s, 115 kB/s 2025-08-06 16:24:30,397 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:24:30,397 - DEBUG - ls -l testfile 2025-08-06 16:24:30,773 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 16:24 testfile 2025-08-06 16:24:30,773 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-85082971-15504235 2025-08-06 16:24:30,773 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:24:30,773 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:24:31,207 - DEBUG - None 2025-08-06 16:24:31,207 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:24:31,208 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:24:31,726 - DEBUG - None 2025-08-06 16:24:31,726 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:24:31,726 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:24:31,726 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:24:31,726 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 19.110.174.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:24:31,726 - DEBUG - ping -s 56 -c 3 -W 1 19.110.174.4 2025-08-06 16:24:34,289 - DEBUG - PING 19.110.174.4 (19.110.174.4) 56(84) bytes of data. 64 bytes from 19.110.174.4: icmp_req=1 ttl=64 time=3.76 ms 64 bytes from 19.110.174.4: icmp_req=2 ttl=64 time=1.40 ms 64 bytes from 19.110.174.4: icmp_req=3 ttl=64 time=1.02 ms --- 19.110.174.4 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.021/2.062/3.764/1.213 ms 2025-08-06 16:24:34,289 - INFO - Ping to IP 19.110.174.4 from VM ctest-TestMtuProbe-85082971-15467268 passed 2025-08-06 16:24:34,289 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:24:34,289 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:24:34,289 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 16:24:35,031 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 6 16:24 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 16:24:35,031 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:24:35,031 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 16:24:35,594 - DEBUG - None 2025-08-06 16:24:35,594 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 19.110.174.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:24:35,594 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 19.110.174.4 5201 < testfile 2025-08-06 16:24:38,178 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00116002 s, 86.2 kB/s 2025-08-06 16:24:38,178 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:24:38,178 - DEBUG - ls -l testfile 2025-08-06 16:24:38,569 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 16:24 testfile 2025-08-06 16:24:38,569 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-85082971-15504235 2025-08-06 16:24:38,569 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:24:38,569 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:24:39,017 - DEBUG - None 2025-08-06 16:24:39,017 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:24:39,017 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:24:39,497 - DEBUG - None 2025-08-06 16:24:39,497 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:24:39,497 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:24:39,497 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:24:39,497 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 19.110.174.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:24:39,497 - DEBUG - ping -s 56 -c 3 -W 1 19.110.174.4 2025-08-06 16:24:42,038 - DEBUG - PING 19.110.174.4 (19.110.174.4) 56(84) bytes of data. 64 bytes from 19.110.174.4: icmp_req=1 ttl=64 time=3.61 ms 64 bytes from 19.110.174.4: icmp_req=2 ttl=64 time=1.36 ms 64 bytes from 19.110.174.4: icmp_req=3 ttl=64 time=1.33 ms --- 19.110.174.4 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.330/2.103/3.619/1.072 ms 2025-08-06 16:24:42,038 - INFO - Ping to IP 19.110.174.4 from VM ctest-TestMtuProbe-85082971-15467268 passed 2025-08-06 16:24:42,038 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:24:42,038 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:24:42,039 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 16:24:42,733 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 6 16:24 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 16:24:42,733 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:24:42,734 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 16:24:43,239 - DEBUG - None 2025-08-06 16:24:43,239 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 19.110.174.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:24:43,239 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 19.110.174.4 5201 < testfile 2025-08-06 16:24:45,814 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.000996533 s, 100 kB/s 2025-08-06 16:24:45,814 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 16:24:45,814 - DEBUG - ls -l testfile 2025-08-06 16:24:46,198 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 16:24 testfile 2025-08-06 16:24:46,198 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-85082971-15504235 2025-08-06 16:24:46,198 - INFO - Deleting VM ctest-TestMtuProbe-85082971-15504235 2025-08-06 16:24:46,281 - INFO - Deleting VM ctest-TestMtuProbe-85082971-15467268 2025-08-06 16:24:46,365 - INFO - Deleting VN ctest-vn-13695152 2025-08-06 16:24:46,411 - DEBUG - VN 16676512-52e7-4e57-93ab-9ec7472728fd still in use: Unable to complete operation on network 16676512-52e7-4e57-93ab-9ec7472728fd. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-61c9b538-23be-4991-89c0-b380819d611e'] 2025-08-06 16:24:46,411 - WARNING - Deleting VN ctest-vn-13695152 failed..Will retry 2025-08-06 16:24:48,630 - DEBUG - Response for deleting network () 2025-08-06 16:24:48,630 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4c58b33-dc91-4a67-aeb5-e84568e77b45 2025-08-06 16:24:48,643 - DEBUG - Response Code: 404 2025-08-06 16:24:48,643 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-06 16:24:48,653 - DEBUG - Requesting: http://10.0.0.254:8082/domain/024378da-7408-4369-ac73-51fa8d4d8d77 2025-08-06 16:24:48,724 - DEBUG - Requesting: http://10.0.0.254:8082/project/64893654-7233-4e99-b48b-7f07b7027e3b 2025-08-06 16:24:48,821 - INFO - Validated that VN ctest-vn-13695152 is not found in API Server 2025-08-06 16:24:48,838 - DEBUG - VN ctest-vn-13695152 is not present in Agent 10.0.0.49 2025-08-06 16:24:48,850 - DEBUG - VN ctest-vn-13695152 is not present in Agent 10.0.0.57 2025-08-06 16:24:48,851 - INFO - Validated that VN ctest-vn-13695152 is not in any agent 2025-08-06 16:24:48,884 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-13695152 info 2025-08-06 16:24:50,162 - DEBUG - No XMPP flaps were noticed during the test
2025-08-06 16:24:50,162 - INFO - END TEST : test_mtu_probe_inter_node : PASSED[0:02:52]
2025-08-06 16:24:50,162 - INFO - -------------------------------------------------------------------------------- 2025-08-06 16:24:50,166 - INFO - ================================================================================ 2025-08-06 16:24:50,166 - INFO - STARTING TEST : test_mtu_probe_intra_node 2025-08-06 16:24:50,166 - INFO - TEST DESCRIPTION : Description: check traffic configuring different tcp_mtu_probe vlaues on vm MTU probing values: 0, 1, 2 0 - Disabled (default) 1 - Disabled by default, Enabled only when ICMP black hole detected 2 - Always enabled, using the initial MSS value of tcp_base_mss system internally enables bit values for point 1&2 For test purpose, Idea is to check traffic works fine on configuring values Vm's across compute node steps: 1. create 1 VN and launch 2 VMs in same compute node 2. client and server VMs in same compute node 3. configure tcp_mtu_probe to 0, 1, 2 4. send icmp traffic assert if ping fails 5. send tcp traffic assert if tcp traffic fails Pass criteria: 1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values 2025-08-06 16:24:51,464 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.57': {'10.20.0.25': '0', '10.20.0.14': '0'}} with 2025-08-06 16:24:51,464 - INFO - Initial checks done. Running the testcase now 2025-08-06 16:24:51,464 - INFO - 2025-08-06 16:24:51,726 - DEBUG - Response for create_network : {'network': {'id': '086e272d-a08d-4567-b4ad-c985edc7e0a5', 'name': 'ctest-vn-30449579', 'tenant_id': '6489365472334e99b48b7f07b7027e3b', 'project_id': '6489365472334e99b48b7f07b7027e3b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-85082971', 'ctest-vn-30449579'], 'port_security_enabled': True, 'description': ''}} 2025-08-06 16:24:51,979 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f8945057-3e83-4116-86c3-caba41f38eda', 'name': '', 'tenant_id': '6489365472334e99b48b7f07b7027e3b', 'network_id': '086e272d-a08d-4567-b4ad-c985edc7e0a5', 'ip_version': 4, 'cidr': '211.150.136.192/26', 'allocation_pools': [{'start': '211.150.136.194', 'end': '211.150.136.254'}], 'gateway_ip': '211.150.136.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '211.150.136.194', 'tags': [], 'project_id': '6489365472334e99b48b7f07b7027e3b'}} 2025-08-06 16:24:52,003 - INFO - Created VN ctest-vn-30449579 2025-08-06 16:24:52,016 - DEBUG - VN ctest-vn-30449579 UUID is 086e272d-a08d-4567-b4ad-c985edc7e0a5 2025-08-06 16:24:52,090 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-06 16:24:52,097 - DEBUG - Requesting: http://10.0.0.254:8082/domain/024378da-7408-4369-ac73-51fa8d4d8d77 2025-08-06 16:24:52,110 - DEBUG - Requesting: http://10.0.0.254:8082/project/64893654-7233-4e99-b48b-7f07b7027e3b 2025-08-06 16:24:52,218 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/086e272d-a08d-4567-b4ad-c985edc7e0a5 2025-08-06 16:24:52,234 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/086e272d-a08d-4567-b4ad-c985edc7e0a5 2025-08-06 16:24:52,249 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/4071b055-515c-4dec-93e3-cce4f7a2dac4 2025-08-06 16:24:52,257 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/4071b055-515c-4dec-93e3-cce4f7a2dac4 2025-08-06 16:24:52,265 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/8b5e170e-d343-4199-a991-8eff1d244ad4 2025-08-06 16:24:52,272 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 16:24:52,273 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/086e272d-a08d-4567-b4ad-c985edc7e0a5 2025-08-06 16:24:52,284 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/4071b055-515c-4dec-93e3-cce4f7a2dac4 2025-08-06 16:24:52,302 - INFO - Verified VN network id 9 for VN 086e272d-a08d-4567-b4ad-c985edc7e0a5 2025-08-06 16:24:52,302 - INFO - Verifications in API Server for VN ctest-vn-30449579 passed 2025-08-06 16:24:52,302 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/086e272d-a08d-4567-b4ad-c985edc7e0a5 2025-08-06 16:24:52,314 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/4071b055-515c-4dec-93e3-cce4f7a2dac4 2025-08-06 16:24:52,322 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/4071b055-515c-4dec-93e3-cce4f7a2dac4 2025-08-06 16:24:52,330 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/8b5e170e-d343-4199-a991-8eff1d244ad4 2025-08-06 16:24:52,343 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-85082971', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '607466076662220135', 'uuid-lslong': '13019283674855104677'}, 'enable': 'true', 'created': '2025-08-06T16:24:51', 'last-modified': '2025-08-06T16:24:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.430703'} 2025-08-06 16:24:52,349 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 16:24:52,356 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-85082971', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '607466076662220135', 'uuid-lslong': '13019283674855104677'}, 'enable': 'true', 'created': '2025-08-06T16:24:51', 'last-modified': '2025-08-06T16:24:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444707'} 2025-08-06 16:24:52,362 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 16:24:52,371 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-85082971', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '607466076662220135', 'uuid-lslong': '13019283674855104677'}, 'enable': 'true', 'created': '2025-08-06T16:24:51', 'last-modified': '2025-08-06T16:24:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.455626'} 2025-08-06 16:24:52,378 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 16:24:52,378 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-30449579 passed 2025-08-06 16:24:52,379 - DEBUG - ====Verifying policy data for ctest-vn-30449579 in API_Server ====== 2025-08-06 16:24:52,379 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-06 16:24:52,386 - DEBUG - Requesting: http://10.0.0.254:8082/domain/024378da-7408-4369-ac73-51fa8d4d8d77 2025-08-06 16:24:52,399 - DEBUG - Requesting: http://10.0.0.254:8082/project/64893654-7233-4e99-b48b-7f07b7027e3b 2025-08-06 16:24:52,499 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/086e272d-a08d-4567-b4ad-c985edc7e0a5 2025-08-06 16:24:52,510 - DEBUG - =>VN ctest-vn-30449579 has no policy to be verified 2025-08-06 16:24:52,510 - DEBUG - Verifying the vn in opserver 2025-08-06 16:24:52,510 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 virtual network link through opserver 10.0.0.254 2025-08-06 16:24:52,510 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-06 16:24:52,524 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579?flat'} 2025-08-06 16:24:52,524 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 virtual network link through opserver 10.0.0.38 2025-08-06 16:24:52,524 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-06 16:24:52,591 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579?flat'} 2025-08-06 16:24:52,591 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 virtual network link through opserver 10.0.0.48 2025-08-06 16:24:52,591 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-06 16:24:52,649 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579?flat'} 2025-08-06 16:24:52,649 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is found in opserver 2025-08-06 16:24:52,674 - DEBUG - Do not have enough data to verify VN in agent 2025-08-06 16:24:52,687 - DEBUG - VRF ids for VN ctest-vn-30449579: {} 2025-08-06 16:24:52,687 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3763-1', 'an-jenkins-deploy-platform-ansible-os-3763-2']} 2025-08-06 16:24:52,687 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3763-1', 'an-jenkins-deploy-platform-ansible-os-3763-2']} 2025-08-06 16:24:53,863 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3763-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3763-1) 2025-08-06 16:24:53,863 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3763-1', 'an-jenkins-deploy-platform-ansible-os-3763-2']} 2025-08-06 16:24:55,421 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3763-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3763-1) 2025-08-06 16:24:55,421 - INFO - Waiting for VM ctest-TestMtuProbe-85082971-34871289 to be up.. 2025-08-06 16:24:55,507 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 16:25:00,593 - DEBUG - VM is in ACTIVE state now 2025-08-06 16:25:00,593 - INFO - VM name : ctest-TestMtuProbe-85082971-34871289 2025-08-06 16:25:00,680 - DEBUG - VM ctest-TestMtuProbe-85082971-34871289 ID is b22df84c-15cc-486e-8d4c-d4338a7c7a64 2025-08-06 16:25:00,680 - DEBUG - VM ctest-TestMtuProbe-85082971-34871289 launched on Node an-jenkins-deploy-platform-ansible-os-3763-1 2025-08-06 16:25:00,774 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/b22df84c-15cc-486e-8d4c-d4338a7c7a64 2025-08-06 16:25:00,788 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/b872ca6d-6448-4e52-a953-eb49fcc2db03 2025-08-06 16:25:04,048 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-08-06 16:25:04,048 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 failed! 2025-08-06 16:25:04,063 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is 211.150.136.193 and allocation pool is NOT set 2025-08-06 16:25:08,139 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-08-06 16:25:08,139 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 failed! 2025-08-06 16:25:08,154 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is 211.150.136.193 and allocation pool is NOT set 2025-08-06 16:25:12,236 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-06 16:25:12,236 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 failed! 2025-08-06 16:25:12,251 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is 211.150.136.193 and allocation pool is NOT set 2025-08-06 16:25:16,334 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-08-06 16:25:16,334 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 failed! 2025-08-06 16:25:16,351 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is 211.150.136.193 and allocation pool is NOT set 2025-08-06 16:25:20,429 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-06 16:25:20,429 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 failed! 2025-08-06 16:25:20,443 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is 211.150.136.193 and allocation pool is NOT set 2025-08-06 16:25:24,534 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-06 16:25:24,534 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 failed! 2025-08-06 16:25:24,549 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is 211.150.136.193 and allocation pool is NOT set 2025-08-06 16:25:28,625 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-06 16:25:28,625 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 failed! 2025-08-06 16:25:28,640 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is 211.150.136.193 and allocation pool is NOT set 2025-08-06 16:25:32,725 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-06 16:25:32,725 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 failed! 2025-08-06 16:25:32,753 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is 211.150.136.193 and allocation pool is NOT set 2025-08-06 16:25:36,848 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-08-06 16:25:36,848 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 failed! 2025-08-06 16:25:36,869 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is 211.150.136.193 and allocation pool is NOT set 2025-08-06 16:25:40,943 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-08-06 16:25:40,944 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 failed! 2025-08-06 16:25:40,958 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is 211.150.136.193 and allocation pool is NOT set 2025-08-06 16:25:45,045 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-08-06 16:25:45,045 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 failed! 2025-08-06 16:25:45,060 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-85082971:ctest-vn-30449579 is 211.150.136.193 and allocation pool is NOT set 2025-08-06 16:25:47,128 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.93 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=6.87 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 5.930/6.400/6.870/0.470 ms') 2025-08-06 16:25:47,128 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-85082971-34871289 passed 2025-08-06 16:25:47,249 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:25:47,250 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-34871289, IP 211.150.136.195, Port 22 2025-08-06 16:25:47,318 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 16:25:47,408 - DEBUG - VM ctest-TestMtuProbe-85082971-34871289 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 16:25:52,408 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:25:52,409 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-34871289, IP 211.150.136.195, Port 22 2025-08-06 16:25:52,481 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 16:25:52,575 - DEBUG - VM ctest-TestMtuProbe-85082971-34871289 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 16:25:57,577 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:25:57,577 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-34871289, IP 211.150.136.195, Port 22 2025-08-06 16:25:57,636 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 16:25:57,715 - DEBUG - VM ctest-TestMtuProbe-85082971-34871289 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 16:26:02,715 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:26:02,716 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-34871289, IP 211.150.136.195, Port 22 2025-08-06 16:26:02,782 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 16:26:02,874 - DEBUG - VM ctest-TestMtuProbe-85082971-34871289 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 16:26:07,875 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:26:07,876 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-34871289, IP 211.150.136.195, Port 22 2025-08-06 16:26:08,041 - DEBUG - VM ctest-TestMtuProbe-85082971-34871289 is ready for SSH connections 2025-08-06 16:26:08,042 - INFO - Waiting for VM ctest-TestMtuProbe-85082971-39934757 to be up.. 2025-08-06 16:26:08,138 - DEBUG - VM is in ACTIVE state now 2025-08-06 16:26:08,138 - INFO - VM name : ctest-TestMtuProbe-85082971-39934757 2025-08-06 16:26:08,220 - DEBUG - VM ctest-TestMtuProbe-85082971-39934757 ID is 667aa0e7-4c4f-4013-b24f-215607fefccc 2025-08-06 16:26:08,220 - DEBUG - VM ctest-TestMtuProbe-85082971-39934757 launched on Node an-jenkins-deploy-platform-ansible-os-3763-1 2025-08-06 16:26:08,299 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/667aa0e7-4c4f-4013-b24f-215607fefccc 2025-08-06 16:26:08,311 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/78e81108-5df1-4aef-a509-31f7623875fe 2025-08-06 16:26:09,522 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=5.28 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.24 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.239/3.261/5.284/2.022 ms') 2025-08-06 16:26:09,522 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestMtuProbe-85082971-39934757 passed 2025-08-06 16:26:09,636 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:26:09,636 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-85082971-39934757, IP 211.150.136.196, Port 22 2025-08-06 16:26:09,801 - DEBUG - VM ctest-TestMtuProbe-85082971-39934757 is ready for SSH connections 2025-08-06 16:26:09,801 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:26:09,801 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:26:32,541 - DEBUG - None 2025-08-06 16:26:32,541 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:26:32,541 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:27:14,797 - DEBUG - None 2025-08-06 16:27:14,797 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:27:14,797 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:27:14,797 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:27:14,797 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 211.150.136.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:14,798 - DEBUG - ping -s 56 -c 3 -W 1 211.150.136.196 2025-08-06 16:27:17,343 - DEBUG - PING 211.150.136.196 (211.150.136.196) 56(84) bytes of data. 64 bytes from 211.150.136.196: icmp_req=1 ttl=64 time=11.1 ms 64 bytes from 211.150.136.196: icmp_req=2 ttl=64 time=0.949 ms 64 bytes from 211.150.136.196: icmp_req=3 ttl=64 time=1.19 ms --- 211.150.136.196 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 0.949/4.433/11.157/4.755 ms 2025-08-06 16:27:17,343 - INFO - Ping to IP 211.150.136.196 from VM ctest-TestMtuProbe-85082971-34871289 passed 2025-08-06 16:27:17,343 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:27:17,343 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:17,344 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 16:27:17,980 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 16:27:17,980 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:17,980 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 16:27:18,486 - DEBUG - None 2025-08-06 16:27:18,486 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 211.150.136.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:18,486 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 211.150.136.196 5201 < testfile 2025-08-06 16:27:21,110 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.000988869 s, 101 kB/s 2025-08-06 16:27:21,110 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:21,111 - DEBUG - ls -l testfile 2025-08-06 16:27:21,449 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 16:27 testfile 2025-08-06 16:27:21,449 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-85082971-39934757 2025-08-06 16:27:21,449 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:21,449 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:27:21,876 - DEBUG - None 2025-08-06 16:27:21,876 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:21,876 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:27:22,303 - DEBUG - None 2025-08-06 16:27:22,303 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:27:22,303 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:27:22,303 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:27:22,303 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 211.150.136.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:22,304 - DEBUG - ping -s 56 -c 3 -W 1 211.150.136.196 2025-08-06 16:27:24,889 - DEBUG - PING 211.150.136.196 (211.150.136.196) 56(84) bytes of data. 64 bytes from 211.150.136.196: icmp_req=1 ttl=64 time=1.74 ms 64 bytes from 211.150.136.196: icmp_req=2 ttl=64 time=0.813 ms 64 bytes from 211.150.136.196: icmp_req=3 ttl=64 time=0.755 ms --- 211.150.136.196 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.755/1.105/1.748/0.455 ms 2025-08-06 16:27:24,889 - INFO - Ping to IP 211.150.136.196 from VM ctest-TestMtuProbe-85082971-34871289 passed 2025-08-06 16:27:24,889 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:27:24,890 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:24,890 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 16:27:25,484 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 6 16:27 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 16:27:25,484 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:25,484 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 16:27:26,017 - DEBUG - None 2025-08-06 16:27:26,017 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 211.150.136.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:26,017 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 211.150.136.196 5201 < testfile 2025-08-06 16:27:28,608 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00113887 s, 87.8 kB/s 2025-08-06 16:27:28,609 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:28,609 - DEBUG - ls -l testfile 2025-08-06 16:27:28,959 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 16:27 testfile 2025-08-06 16:27:28,959 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-85082971-39934757 2025-08-06 16:27:28,959 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:28,959 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:27:29,424 - DEBUG - None 2025-08-06 16:27:29,424 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:29,424 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 16:27:29,885 - DEBUG - None 2025-08-06 16:27:29,886 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:27:29,886 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 16:27:29,886 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:27:29,886 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 211.150.136.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:29,886 - DEBUG - ping -s 56 -c 3 -W 1 211.150.136.196 2025-08-06 16:27:32,386 - DEBUG - PING 211.150.136.196 (211.150.136.196) 56(84) bytes of data. 64 bytes from 211.150.136.196: icmp_req=1 ttl=64 time=2.36 ms 64 bytes from 211.150.136.196: icmp_req=2 ttl=64 time=0.804 ms 64 bytes from 211.150.136.196: icmp_req=3 ttl=64 time=0.692 ms --- 211.150.136.196 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.692/1.287/2.367/0.765 ms 2025-08-06 16:27:32,386 - INFO - Ping to IP 211.150.136.196 from VM ctest-TestMtuProbe-85082971-34871289 passed 2025-08-06 16:27:32,387 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 16:27:32,387 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:32,387 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 16:27:33,006 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 6 16:27 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 16:27:33,006 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:33,007 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 16:27:33,486 - DEBUG - None 2025-08-06 16:27:33,486 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 211.150.136.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:33,487 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 211.150.136.196 5201 < testfile 2025-08-06 16:27:36,090 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.0012546 s, 79.7 kB/s 2025-08-06 16:27:36,090 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 16:27:36,090 - DEBUG - ls -l testfile 2025-08-06 16:27:36,476 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 16:27 testfile 2025-08-06 16:27:36,476 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-85082971-39934757 2025-08-06 16:27:36,476 - INFO - Deleting VM ctest-TestMtuProbe-85082971-39934757 2025-08-06 16:27:36,569 - INFO - Deleting VM ctest-TestMtuProbe-85082971-34871289 2025-08-06 16:27:36,639 - INFO - Deleting VN ctest-vn-30449579 2025-08-06 16:27:36,728 - DEBUG - VN 086e272d-a08d-4567-b4ad-c985edc7e0a5 still in use: Unable to complete operation on network 086e272d-a08d-4567-b4ad-c985edc7e0a5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-64886540-e47f-475a-9633-05b47945d3c6'] 2025-08-06 16:27:36,728 - WARNING - Deleting VN ctest-vn-30449579 failed..Will retry 2025-08-06 16:27:38,878 - DEBUG - Response for deleting network () 2025-08-06 16:27:38,878 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/4071b055-515c-4dec-93e3-cce4f7a2dac4 2025-08-06 16:27:38,930 - DEBUG - Response Code: 404 2025-08-06 16:27:38,930 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-06 16:27:38,940 - DEBUG - Requesting: http://10.0.0.254:8082/domain/024378da-7408-4369-ac73-51fa8d4d8d77 2025-08-06 16:27:38,954 - DEBUG - Requesting: http://10.0.0.254:8082/project/64893654-7233-4e99-b48b-7f07b7027e3b 2025-08-06 16:27:39,050 - INFO - Validated that VN ctest-vn-30449579 is not found in API Server 2025-08-06 16:27:39,064 - DEBUG - VN ctest-vn-30449579 is not present in Agent 10.0.0.49 2025-08-06 16:27:39,077 - DEBUG - VN ctest-vn-30449579 is not present in Agent 10.0.0.57 2025-08-06 16:27:39,077 - INFO - Validated that VN ctest-vn-30449579 is not in any agent 2025-08-06 16:27:39,114 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-30449579 info 2025-08-06 16:27:40,397 - DEBUG - No XMPP flaps were noticed during the test
2025-08-06 16:27:40,397 - INFO - END TEST : test_mtu_probe_intra_node : PASSED[0:02:50]
2025-08-06 16:27:40,398 - INFO - -------------------------------------------------------------------------------- 2025-08-06 16:27:41,152 - INFO - Deleted project: ctest-TestMtuProbe-85082971, ID : 64893654-7233-4e99-b48b-7f07b7027e3b