2025-08-03 00:24:38,757 - INFO - Domain Default found not creating
2025-08-03 00:24:38,929 - INFO - Project ctest-TestMtuProbe-77386939 not found, creating it
2025-08-03 00:24:39,681 - INFO - Created Project:ctest-TestMtuProbe-77386939, ID : f47b0842-9ed0-4aac-801c-284d30c77a88
2025-08-03 00:24:41,587 - INFO - ================================================================================
2025-08-03 00:24:41,587 - INFO - STARTING TEST : test_mtu_probe_inter_node
2025-08-03 00:24:41,587 - INFO - TEST DESCRIPTION :
Description:
check traffic configuring different tcp_mtu_probe vlaues on vm
MTU probing values: 0, 1, 2
0 - Disabled (default)
1 - Disabled by default, Enabled only when ICMP black hole detected
2 - Always enabled, using the initial MSS value of tcp_base_mss
system internally enables bit values for point 1&2
For test purpose,
Idea is to check traffic works fine on configuring values
Vm's across compute node
steps:
1. create 1 VN and launch 2 VMs across compute node
2. client and server VMs across compute node
3. configure tcp_mtu_probe to 0, 1, 2
4. send icmp traffic assert if ping fails
5. send tcp traffic assert if tcp traffic fails
Pass criteria:
1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values
2025-08-03 00:24:42,973 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with
2025-08-03 00:24:42,973 - INFO - Initial checks done. Running the testcase now
2025-08-03 00:24:42,973 - INFO -
2025-08-03 00:24:43,003 - DEBUG - Services list from nova: [, , , ]
2025-08-03 00:24:43,003 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']}
2025-08-03 00:24:43,834 - DEBUG - Response for create_network : {'network': {'id': '6471652f-e484-4186-91a3-dd3d183b6235', 'name': 'ctest-vn-16170778', 'tenant_id': 'f47b08429ed04aac801c284d30c77a88', 'project_id': 'f47b08429ed04aac801c284d30c77a88', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-77386939', 'ctest-vn-16170778'], 'port_security_enabled': True, 'description': ''}}
2025-08-03 00:24:44,138 - DEBUG - Response for create_subnet : {'subnet': {'id': '2bdb1bc2-f985-4f05-8ec1-3867b033c113', 'name': '', 'tenant_id': 'f47b08429ed04aac801c284d30c77a88', 'network_id': '6471652f-e484-4186-91a3-dd3d183b6235', 'ip_version': 4, 'cidr': '60.109.226.64/26', 'allocation_pools': [{'start': '60.109.226.66', 'end': '60.109.226.126'}], 'gateway_ip': '60.109.226.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '60.109.226.66', 'tags': [], 'project_id': 'f47b08429ed04aac801c284d30c77a88'}}
2025-08-03 00:24:44,166 - INFO - Created VN ctest-vn-16170778
2025-08-03 00:24:44,178 - DEBUG - VN ctest-vn-16170778 UUID is 6471652f-e484-4186-91a3-dd3d183b6235
2025-08-03 00:24:44,279 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-03 00:24:44,614 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-03 00:24:44,646 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028
2025-08-03 00:24:44,669 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88
2025-08-03 00:24:44,801 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6471652f-e484-4186-91a3-dd3d183b6235
2025-08-03 00:24:44,821 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6471652f-e484-4186-91a3-dd3d183b6235
2025-08-03 00:24:44,833 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4
2025-08-03 00:24:44,860 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4
2025-08-03 00:24:44,881 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/37519648-81e6-482c-a74c-113b85d11a02
2025-08-03 00:24:44,892 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-03 00:24:44,892 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6471652f-e484-4186-91a3-dd3d183b6235
2025-08-03 00:24:44,905 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4
2025-08-03 00:24:44,924 - INFO - Verified VN network id 12 for VN 6471652f-e484-4186-91a3-dd3d183b6235
2025-08-03 00:24:44,924 - INFO - Verifications in API Server for VN ctest-vn-16170778 passed
2025-08-03 00:24:44,924 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6471652f-e484-4186-91a3-dd3d183b6235
2025-08-03 00:24:44,945 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4
2025-08-03 00:24:44,955 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4
2025-08-03 00:24:44,964 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/37519648-81e6-482c-a74c-113b85d11a02
2025-08-03 00:24:44,996 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7237677332532838790', 'uuid-lslong': '10494474811172676149'}, 'enable': 'true', 'created': '2025-08-03T00:24:43', 'last-modified': '2025-08-03T00:24:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.908331'}
2025-08-03 00:24:45,003 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-03 00:24:45,012 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7237677332532838790', 'uuid-lslong': '10494474811172676149'}, 'enable': 'true', 'created': '2025-08-03T00:24:43', 'last-modified': '2025-08-03T00:24:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.924321'}
2025-08-03 00:24:45,022 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-03 00:24:45,029 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7237677332532838790', 'uuid-lslong': '10494474811172676149'}, 'enable': 'true', 'created': '2025-08-03T00:24:43', 'last-modified': '2025-08-03T00:24:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.943653'}
2025-08-03 00:24:45,037 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-03 00:24:45,037 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-16170778 passed
2025-08-03 00:24:45,037 - DEBUG - ====Verifying policy data for ctest-vn-16170778 in API_Server ======
2025-08-03 00:24:45,038 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-03 00:24:45,046 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028
2025-08-03 00:24:45,062 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88
2025-08-03 00:24:45,192 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6471652f-e484-4186-91a3-dd3d183b6235
2025-08-03 00:24:45,206 - DEBUG - =>VN ctest-vn-16170778 has no policy to be verified
2025-08-03 00:24:45,206 - DEBUG - Verifying the vn in opserver
2025-08-03 00:24:45,206 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 virtual network link through opserver 10.0.0.38
2025-08-03 00:24:45,206 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-03 00:24:45,574 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-03 00:24:45,689 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778?flat'}
2025-08-03 00:24:45,689 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 virtual network link through opserver 10.0.0.254
2025-08-03 00:24:45,690 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-08-03 00:24:46,041 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-08-03 00:24:46,114 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778?flat'}
2025-08-03 00:24:46,114 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 virtual network link through opserver 10.0.0.50
2025-08-03 00:24:46,114 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-08-03 00:24:46,444 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-08-03 00:24:46,528 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778?flat'}
2025-08-03 00:24:46,528 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is found in opserver
2025-08-03 00:24:46,558 - DEBUG - Do not have enough data to verify VN in agent
2025-08-03 00:24:46,570 - DEBUG - VRF ids for VN ctest-vn-16170778: {}
2025-08-03 00:24:46,570 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']}
2025-08-03 00:24:46,570 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']}
2025-08-03 00:24:48,029 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-2)
2025-08-03 00:24:48,029 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']}
2025-08-03 00:24:49,744 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-1)
2025-08-03 00:24:49,745 - INFO - Waiting for VM ctest-TestMtuProbe-77386939-58669359 to be up..
2025-08-03 00:24:49,862 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-03 00:24:54,981 - DEBUG - VM is in ACTIVE state now
2025-08-03 00:24:54,981 - INFO - VM name : ctest-TestMtuProbe-77386939-58669359
2025-08-03 00:24:55,099 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 ID is 50fa648f-2381-4215-a5b0-edf9bce16ef7
2025-08-03 00:24:55,123 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 launched on Node an-jenkins-deploy-platform-ansible-os-3743-2
2025-08-03 00:24:55,223 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/50fa648f-2381-4215-a5b0-edf9bce16ef7
2025-08-03 00:24:55,518 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/50fa648f-2381-4215-a5b0-edf9bce16ef7
2025-08-03 00:24:55,575 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/31882b29-ed70-4185-aebd-3480ef3a8e40
2025-08-03 00:24:58,859 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2025-08-03 00:24:58,859 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed!
2025-08-03 00:24:58,886 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set
2025-08-03 00:25:02,955 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms')
2025-08-03 00:25:02,955 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed!
2025-08-03 00:25:02,988 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set
2025-08-03 00:25:07,083 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms')
2025-08-03 00:25:07,083 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed!
2025-08-03 00:25:07,104 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set
2025-08-03 00:25:11,177 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-08-03 00:25:11,177 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed!
2025-08-03 00:25:11,212 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set
2025-08-03 00:25:15,309 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms')
2025-08-03 00:25:15,309 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed!
2025-08-03 00:25:15,343 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set
2025-08-03 00:25:19,435 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2025-08-03 00:25:19,435 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed!
2025-08-03 00:25:19,469 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set
2025-08-03 00:25:23,562 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms')
2025-08-03 00:25:23,562 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed!
2025-08-03 00:25:23,594 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set
2025-08-03 00:25:27,691 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms')
2025-08-03 00:25:27,691 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed!
2025-08-03 00:25:27,724 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set
2025-08-03 00:25:31,820 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms')
2025-08-03 00:25:31,820 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed!
2025-08-03 00:25:31,853 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set
2025-08-03 00:25:33,918 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.20 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.533 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.533/3.365/6.198/2.832 ms')
2025-08-03 00:25:33,918 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 passed
2025-08-03 00:25:34,063 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:25:34,063 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-58669359, IP 60.109.226.67, Port 22
2025-08-03 00:25:34,131 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:25:34,262 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:25:39,263 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:25:39,263 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-58669359, IP 60.109.226.67, Port 22
2025-08-03 00:25:39,332 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:25:39,470 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:25:44,470 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:25:44,470 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-58669359, IP 60.109.226.67, Port 22
2025-08-03 00:25:44,540 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:25:44,632 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:25:49,632 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:25:49,633 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-58669359, IP 60.109.226.67, Port 22
2025-08-03 00:25:49,691 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:25:49,818 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:25:54,820 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:25:54,820 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-58669359, IP 60.109.226.67, Port 22
2025-08-03 00:25:54,996 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 is ready for SSH connections
2025-08-03 00:25:54,996 - INFO - Waiting for VM ctest-TestMtuProbe-77386939-77248185 to be up..
2025-08-03 00:25:55,098 - DEBUG - VM is in ACTIVE state now
2025-08-03 00:25:55,098 - INFO - VM name : ctest-TestMtuProbe-77386939-77248185
2025-08-03 00:25:55,200 - DEBUG - VM ctest-TestMtuProbe-77386939-77248185 ID is c96c3730-0dab-4101-ab1b-558635014fa1
2025-08-03 00:25:55,200 - DEBUG - VM ctest-TestMtuProbe-77386939-77248185 launched on Node an-jenkins-deploy-platform-ansible-os-3743-1
2025-08-03 00:25:55,328 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/c96c3730-0dab-4101-ab1b-558635014fa1
2025-08-03 00:25:55,350 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/3a000d2b-cc24-4f4a-b6b9-867a530da530
2025-08-03 00:25:56,574 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.82 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.950 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.950/1.885/2.821/0.935 ms')
2025-08-03 00:25:56,574 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-77248185 passed
2025-08-03 00:25:56,703 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:25:56,704 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-77248185, IP 60.109.226.68, Port 22
2025-08-03 00:25:56,870 - DEBUG - VM ctest-TestMtuProbe-77386939-77248185 is ready for SSH connections
2025-08-03 00:25:56,870 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:25:56,870 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:26:15,512 - DEBUG - None
2025-08-03 00:26:15,512 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:26:15,512 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:26:55,842 - DEBUG - None
2025-08-03 00:26:55,842 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:26:55,843 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:26:55,843 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:26:55,843 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 60.109.226.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:26:55,843 - DEBUG - ping -s 56 -c 3 -W 1 60.109.226.68
2025-08-03 00:26:58,318 - DEBUG - PING 60.109.226.68 (60.109.226.68) 56(84) bytes of data.
64 bytes from 60.109.226.68: icmp_req=1 ttl=64 time=13.4 ms
64 bytes from 60.109.226.68: icmp_req=2 ttl=64 time=1.24 ms
64 bytes from 60.109.226.68: icmp_req=3 ttl=64 time=1.17 ms
--- 60.109.226.68 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.177/5.298/13.470/5.778 ms
2025-08-03 00:26:58,319 - INFO - Ping to IP 60.109.226.68 from VM ctest-TestMtuProbe-77386939-58669359 passed
2025-08-03 00:26:58,319 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:26:58,319 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:26:58,319 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-03 00:26:58,909 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-03 00:26:58,909 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:26:58,909 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-03 00:26:59,366 - DEBUG - None
2025-08-03 00:26:59,367 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 60.109.226.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:26:59,367 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 60.109.226.68 5201 < testfile
2025-08-03 00:27:01,916 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00075422 s, 133 kB/s
2025-08-03 00:27:01,916 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:27:01,916 - DEBUG - ls -l testfile
2025-08-03 00:27:02,257 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:26 testfile
2025-08-03 00:27:02,258 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-77248185
2025-08-03 00:27:02,258 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:27:02,258 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:27:02,664 - DEBUG - None
2025-08-03 00:27:02,664 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:27:02,664 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:27:03,099 - DEBUG - None
2025-08-03 00:27:03,100 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:27:03,100 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:27:03,100 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:27:03,100 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 60.109.226.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:27:03,100 - DEBUG - ping -s 56 -c 3 -W 1 60.109.226.68
2025-08-03 00:27:05,571 - DEBUG - PING 60.109.226.68 (60.109.226.68) 56(84) bytes of data.
64 bytes from 60.109.226.68: icmp_req=1 ttl=64 time=2.92 ms
64 bytes from 60.109.226.68: icmp_req=2 ttl=64 time=1.09 ms
64 bytes from 60.109.226.68: icmp_req=3 ttl=64 time=1.23 ms
--- 60.109.226.68 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 1.096/1.753/2.925/0.830 ms
2025-08-03 00:27:05,571 - INFO - Ping to IP 60.109.226.68 from VM ctest-TestMtuProbe-77386939-58669359 passed
2025-08-03 00:27:05,571 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:27:05,572 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:27:05,572 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-03 00:27:06,168 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 3 00:27 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-03 00:27:06,169 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:27:06,169 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-03 00:27:06,631 - DEBUG - None
2025-08-03 00:27:06,631 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 60.109.226.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:27:06,632 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 60.109.226.68 5201 < testfile
2025-08-03 00:27:09,177 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00100628 s, 99.4 kB/s
2025-08-03 00:27:09,177 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:27:09,178 - DEBUG - ls -l testfile
2025-08-03 00:27:09,540 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:27 testfile
2025-08-03 00:27:09,540 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-77248185
2025-08-03 00:27:09,540 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:27:09,540 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:27:09,977 - DEBUG - None
2025-08-03 00:27:09,977 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:27:09,978 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:27:10,400 - DEBUG - None
2025-08-03 00:27:10,401 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:27:10,401 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:27:10,401 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:27:10,401 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 60.109.226.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:27:10,401 - DEBUG - ping -s 56 -c 3 -W 1 60.109.226.68
2025-08-03 00:27:12,906 - DEBUG - PING 60.109.226.68 (60.109.226.68) 56(84) bytes of data.
64 bytes from 60.109.226.68: icmp_req=1 ttl=64 time=2.44 ms
64 bytes from 60.109.226.68: icmp_req=2 ttl=64 time=1.07 ms
64 bytes from 60.109.226.68: icmp_req=3 ttl=64 time=1.17 ms
--- 60.109.226.68 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.072/1.562/2.442/0.623 ms
2025-08-03 00:27:12,907 - INFO - Ping to IP 60.109.226.68 from VM ctest-TestMtuProbe-77386939-58669359 passed
2025-08-03 00:27:12,907 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:27:12,907 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:27:12,907 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-03 00:27:13,469 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 3 00:27 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-03 00:27:13,470 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:27:13,470 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-03 00:27:13,913 - DEBUG - None
2025-08-03 00:27:13,913 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 60.109.226.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:27:13,913 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 60.109.226.68 5201 < testfile
2025-08-03 00:27:16,463 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000988758 s, 101 kB/s
2025-08-03 00:27:16,463 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:27:16,463 - DEBUG - ls -l testfile
2025-08-03 00:27:16,796 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:27 testfile
2025-08-03 00:27:16,796 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-77248185
2025-08-03 00:27:16,796 - INFO - Deleting VM ctest-TestMtuProbe-77386939-77248185
2025-08-03 00:27:16,889 - INFO - Deleting VM ctest-TestMtuProbe-77386939-58669359
2025-08-03 00:27:16,966 - INFO - Deleting VN ctest-vn-16170778
2025-08-03 00:27:17,025 - DEBUG - VN 6471652f-e484-4186-91a3-dd3d183b6235 still in use: Unable to complete operation on network 6471652f-e484-4186-91a3-dd3d183b6235. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-a174f55b-883f-4abc-bbc9-d81420a91a06']
2025-08-03 00:27:17,026 - WARNING - Deleting VN ctest-vn-16170778 failed..Will retry
2025-08-03 00:27:19,308 - DEBUG - Response for deleting network ()
2025-08-03 00:27:19,308 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4
2025-08-03 00:27:19,316 - DEBUG - Response Code: 404
2025-08-03 00:27:19,316 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-03 00:27:19,323 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028
2025-08-03 00:27:19,382 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88
2025-08-03 00:27:19,494 - INFO - Validated that VN ctest-vn-16170778 is not found in API Server
2025-08-03 00:27:19,506 - DEBUG - VN ctest-vn-16170778 is not present in Agent 10.0.0.48
2025-08-03 00:27:19,519 - DEBUG - VN ctest-vn-16170778 is not present in Agent 10.0.0.49
2025-08-03 00:27:19,519 - INFO - Validated that VN ctest-vn-16170778 is not in any agent
2025-08-03 00:27:19,571 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-16170778 info
2025-08-03 00:27:20,958 - DEBUG - No XMPP flaps were noticed during the test
2025-08-03 00:27:20,958 - INFO - END TEST : test_mtu_probe_inter_node : PASSED[0:02:39]
2025-08-03 00:27:20,958 - INFO - --------------------------------------------------------------------------------
2025-08-03 00:27:20,962 - INFO - ================================================================================
2025-08-03 00:27:20,962 - INFO - STARTING TEST : test_mtu_probe_intra_node
2025-08-03 00:27:20,962 - INFO - TEST DESCRIPTION :
Description:
check traffic configuring different tcp_mtu_probe vlaues on vm
MTU probing values: 0, 1, 2
0 - Disabled (default)
1 - Disabled by default, Enabled only when ICMP black hole detected
2 - Always enabled, using the initial MSS value of tcp_base_mss
system internally enables bit values for point 1&2
For test purpose,
Idea is to check traffic works fine on configuring values
Vm's across compute node
steps:
1. create 1 VN and launch 2 VMs in same compute node
2. client and server VMs in same compute node
3. configure tcp_mtu_probe to 0, 1, 2
4. send icmp traffic assert if ping fails
5. send tcp traffic assert if tcp traffic fails
Pass criteria:
1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values
2025-08-03 00:27:22,351 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with
2025-08-03 00:27:22,351 - INFO - Initial checks done. Running the testcase now
2025-08-03 00:27:22,351 - INFO -
2025-08-03 00:27:22,813 - DEBUG - Response for create_network : {'network': {'id': 'c36e8bb5-5704-4bbf-a172-959d9395ef4d', 'name': 'ctest-vn-57626811', 'tenant_id': 'f47b08429ed04aac801c284d30c77a88', 'project_id': 'f47b08429ed04aac801c284d30c77a88', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-77386939', 'ctest-vn-57626811'], 'port_security_enabled': True, 'description': ''}}
2025-08-03 00:27:23,096 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b0fff920-8095-4f19-b717-6eaefdb1df71', 'name': '', 'tenant_id': 'f47b08429ed04aac801c284d30c77a88', 'network_id': 'c36e8bb5-5704-4bbf-a172-959d9395ef4d', 'ip_version': 4, 'cidr': '25.78.47.128/26', 'allocation_pools': [{'start': '25.78.47.130', 'end': '25.78.47.190'}], 'gateway_ip': '25.78.47.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '25.78.47.130', 'tags': [], 'project_id': 'f47b08429ed04aac801c284d30c77a88'}}
2025-08-03 00:27:23,129 - INFO - Created VN ctest-vn-57626811
2025-08-03 00:27:23,142 - DEBUG - VN ctest-vn-57626811 UUID is c36e8bb5-5704-4bbf-a172-959d9395ef4d
2025-08-03 00:27:23,241 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-03 00:27:23,249 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028
2025-08-03 00:27:23,274 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88
2025-08-03 00:27:23,388 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c36e8bb5-5704-4bbf-a172-959d9395ef4d
2025-08-03 00:27:23,402 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c36e8bb5-5704-4bbf-a172-959d9395ef4d
2025-08-03 00:27:23,414 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25
2025-08-03 00:27:23,427 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25
2025-08-03 00:27:23,436 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/196e7ef3-3714-4ec7-af7c-21bdccfbc83c
2025-08-03 00:27:23,445 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-03 00:27:23,445 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c36e8bb5-5704-4bbf-a172-959d9395ef4d
2025-08-03 00:27:23,457 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25
2025-08-03 00:27:23,476 - INFO - Verified VN network id 12 for VN c36e8bb5-5704-4bbf-a172-959d9395ef4d
2025-08-03 00:27:23,476 - INFO - Verifications in API Server for VN ctest-vn-57626811 passed
2025-08-03 00:27:23,476 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c36e8bb5-5704-4bbf-a172-959d9395ef4d
2025-08-03 00:27:23,488 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25
2025-08-03 00:27:23,497 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25
2025-08-03 00:27:23,507 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/196e7ef3-3714-4ec7-af7c-21bdccfbc83c
2025-08-03 00:27:23,526 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14082346695799360447', 'uuid-lslong': '11633525291469893453'}, 'enable': 'true', 'created': '2025-08-03T00:27:22', 'last-modified': '2025-08-03T00:27:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.506719'}
2025-08-03 00:27:23,532 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-03 00:27:23,547 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14082346695799360447', 'uuid-lslong': '11633525291469893453'}, 'enable': 'true', 'created': '2025-08-03T00:27:22', 'last-modified': '2025-08-03T00:27:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.535216'}
2025-08-03 00:27:23,564 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-03 00:27:23,572 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14082346695799360447', 'uuid-lslong': '11633525291469893453'}, 'enable': 'true', 'created': '2025-08-03T00:27:22', 'last-modified': '2025-08-03T00:27:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.553043'}
2025-08-03 00:27:23,580 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-03 00:27:23,581 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-57626811 passed
2025-08-03 00:27:23,581 - DEBUG - ====Verifying policy data for ctest-vn-57626811 in API_Server ======
2025-08-03 00:27:23,581 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-03 00:27:23,590 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028
2025-08-03 00:27:23,604 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88
2025-08-03 00:27:23,728 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c36e8bb5-5704-4bbf-a172-959d9395ef4d
2025-08-03 00:27:23,752 - DEBUG - =>VN ctest-vn-57626811 has no policy to be verified
2025-08-03 00:27:23,752 - DEBUG - Verifying the vn in opserver
2025-08-03 00:27:23,752 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 virtual network link through opserver 10.0.0.38
2025-08-03 00:27:23,752 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-03 00:27:23,784 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811?flat'}
2025-08-03 00:27:23,784 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 virtual network link through opserver 10.0.0.254
2025-08-03 00:27:23,784 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-08-03 00:27:23,851 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811?flat'}
2025-08-03 00:27:23,851 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 virtual network link through opserver 10.0.0.50
2025-08-03 00:27:23,851 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-08-03 00:27:23,916 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811?flat'}
2025-08-03 00:27:23,916 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is found in opserver
2025-08-03 00:27:23,945 - DEBUG - Do not have enough data to verify VN in agent
2025-08-03 00:27:23,959 - DEBUG - VRF ids for VN ctest-vn-57626811: {}
2025-08-03 00:27:23,959 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']}
2025-08-03 00:27:23,959 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']}
2025-08-03 00:27:25,213 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-2)
2025-08-03 00:27:25,214 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']}
2025-08-03 00:27:26,994 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-2)
2025-08-03 00:27:26,994 - INFO - Waiting for VM ctest-TestMtuProbe-77386939-71811819 to be up..
2025-08-03 00:27:27,096 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-03 00:27:32,249 - DEBUG - VM is in ACTIVE state now
2025-08-03 00:27:32,249 - INFO - VM name : ctest-TestMtuProbe-77386939-71811819
2025-08-03 00:27:32,370 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 ID is 71091d52-5f33-4054-8b67-5df630bc82df
2025-08-03 00:27:32,370 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 launched on Node an-jenkins-deploy-platform-ansible-os-3743-2
2025-08-03 00:27:32,512 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/71091d52-5f33-4054-8b67-5df630bc82df
2025-08-03 00:27:32,537 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/519fb273-4c65-445e-892b-7fa0688e52de
2025-08-03 00:27:35,818 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1033ms')
2025-08-03 00:27:35,818 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed!
2025-08-03 00:27:35,857 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set
2025-08-03 00:27:39,946 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2025-08-03 00:27:39,946 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed!
2025-08-03 00:27:39,979 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set
2025-08-03 00:27:44,074 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms')
2025-08-03 00:27:44,074 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed!
2025-08-03 00:27:44,124 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set
2025-08-03 00:27:48,203 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms')
2025-08-03 00:27:48,203 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed!
2025-08-03 00:27:48,243 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set
2025-08-03 00:27:52,324 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2025-08-03 00:27:52,324 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed!
2025-08-03 00:27:52,347 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set
2025-08-03 00:27:56,420 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-08-03 00:27:56,420 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed!
2025-08-03 00:27:56,441 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set
2025-08-03 00:28:00,527 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms')
2025-08-03 00:28:00,527 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed!
2025-08-03 00:28:00,557 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set
2025-08-03 00:28:04,650 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms')
2025-08-03 00:28:04,650 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed!
2025-08-03 00:28:04,683 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set
2025-08-03 00:28:08,770 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms')
2025-08-03 00:28:08,771 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed!
2025-08-03 00:28:08,788 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set
2025-08-03 00:28:12,870 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=10.6 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1018ms\r\nrtt min/avg/max/mdev = 10.589/10.589/10.589/0.000 ms')
2025-08-03 00:28:12,870 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 passed
2025-08-03 00:28:13,005 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:28:13,005 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-71811819, IP 25.78.47.131, Port 22
2025-08-03 00:28:13,076 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:28:13,210 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:28:18,211 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:28:18,211 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-71811819, IP 25.78.47.131, Port 22
2025-08-03 00:28:18,270 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:28:18,365 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:28:23,366 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:28:23,366 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-71811819, IP 25.78.47.131, Port 22
2025-08-03 00:28:23,432 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:28:23,558 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:28:28,559 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:28:28,559 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-71811819, IP 25.78.47.131, Port 22
2025-08-03 00:28:28,617 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:28:28,725 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:28:33,726 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:28:33,726 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-71811819, IP 25.78.47.131, Port 22
2025-08-03 00:28:33,891 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 is ready for SSH connections
2025-08-03 00:28:33,891 - INFO - Waiting for VM ctest-TestMtuProbe-77386939-83026755 to be up..
2025-08-03 00:28:34,002 - DEBUG - VM is in ACTIVE state now
2025-08-03 00:28:34,002 - INFO - VM name : ctest-TestMtuProbe-77386939-83026755
2025-08-03 00:28:34,131 - DEBUG - VM ctest-TestMtuProbe-77386939-83026755 ID is 553ee3ad-7ecd-42a7-bcf2-02798ba1b4be
2025-08-03 00:28:34,131 - DEBUG - VM ctest-TestMtuProbe-77386939-83026755 launched on Node an-jenkins-deploy-platform-ansible-os-3743-2
2025-08-03 00:28:34,236 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/553ee3ad-7ecd-42a7-bcf2-02798ba1b4be
2025-08-03 00:28:34,254 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/318089f6-cfaf-4201-ba57-4acbafc912c7
2025-08-03 00:28:35,520 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.62 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=5.42 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1004ms\r\nrtt min/avg/max/mdev = 5.424/6.022/6.620/0.598 ms')
2025-08-03 00:28:35,521 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestMtuProbe-77386939-83026755 passed
2025-08-03 00:28:35,677 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:28:35,678 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-83026755, IP 25.78.47.132, Port 22
2025-08-03 00:28:35,761 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:28:35,870 - DEBUG - VM ctest-TestMtuProbe-77386939-83026755 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:28:40,870 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:28:40,871 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-83026755, IP 25.78.47.132, Port 22
2025-08-03 00:28:41,025 - DEBUG - VM ctest-TestMtuProbe-77386939-83026755 is ready for SSH connections
2025-08-03 00:28:41,025 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:28:41,025 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:28:57,861 - DEBUG - None
2025-08-03 00:28:57,861 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:28:57,861 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:29:36,295 - DEBUG - None
2025-08-03 00:29:36,295 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:29:36,295 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:29:36,296 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:29:36,296 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 25.78.47.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:36,296 - DEBUG - ping -s 56 -c 3 -W 1 25.78.47.132
2025-08-03 00:29:38,775 - DEBUG - PING 25.78.47.132 (25.78.47.132) 56(84) bytes of data.
64 bytes from 25.78.47.132: icmp_req=1 ttl=64 time=10.2 ms
64 bytes from 25.78.47.132: icmp_req=2 ttl=64 time=1.19 ms
64 bytes from 25.78.47.132: icmp_req=3 ttl=64 time=0.848 ms
--- 25.78.47.132 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.848/4.080/10.203/4.332 ms
2025-08-03 00:29:38,775 - INFO - Ping to IP 25.78.47.132 from VM ctest-TestMtuProbe-77386939-71811819 passed
2025-08-03 00:29:38,775 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:29:38,776 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:38,776 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-03 00:29:39,345 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-03 00:29:39,346 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:39,346 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-03 00:29:39,791 - DEBUG - None
2025-08-03 00:29:39,791 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 25.78.47.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:39,791 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 25.78.47.132 5201 < testfile
2025-08-03 00:29:42,351 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00112885 s, 88.6 kB/s
2025-08-03 00:29:42,352 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:42,352 - DEBUG - ls -l testfile
2025-08-03 00:29:42,686 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:29 testfile
2025-08-03 00:29:42,686 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-83026755
2025-08-03 00:29:42,686 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:42,686 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:29:43,107 - DEBUG - None
2025-08-03 00:29:43,107 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:43,107 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:29:43,517 - DEBUG - None
2025-08-03 00:29:43,518 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:29:43,518 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:29:43,518 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:29:43,518 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 25.78.47.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:43,518 - DEBUG - ping -s 56 -c 3 -W 1 25.78.47.132
2025-08-03 00:29:45,979 - DEBUG - PING 25.78.47.132 (25.78.47.132) 56(84) bytes of data.
64 bytes from 25.78.47.132: icmp_req=1 ttl=64 time=2.16 ms
64 bytes from 25.78.47.132: icmp_req=2 ttl=64 time=0.686 ms
64 bytes from 25.78.47.132: icmp_req=3 ttl=64 time=0.871 ms
--- 25.78.47.132 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 0.686/1.240/2.163/0.657 ms
2025-08-03 00:29:45,979 - INFO - Ping to IP 25.78.47.132 from VM ctest-TestMtuProbe-77386939-71811819 passed
2025-08-03 00:29:45,980 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:29:45,980 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:45,980 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-03 00:29:46,547 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 3 00:29 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-03 00:29:46,547 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:46,547 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-03 00:29:47,013 - DEBUG - None
2025-08-03 00:29:47,013 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 25.78.47.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:47,013 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 25.78.47.132 5201 < testfile
2025-08-03 00:29:49,565 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00244985 s, 40.8 kB/s
2025-08-03 00:29:49,565 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:49,566 - DEBUG - ls -l testfile
2025-08-03 00:29:49,888 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:29 testfile
2025-08-03 00:29:49,888 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-83026755
2025-08-03 00:29:49,888 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:49,888 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:29:50,299 - DEBUG - None
2025-08-03 00:29:50,299 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:50,299 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-03 00:29:50,716 - DEBUG - None
2025-08-03 00:29:50,716 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:29:50,716 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-03 00:29:50,717 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:29:50,717 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 25.78.47.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:50,717 - DEBUG - ping -s 56 -c 3 -W 1 25.78.47.132
2025-08-03 00:29:53,175 - DEBUG - PING 25.78.47.132 (25.78.47.132) 56(84) bytes of data.
64 bytes from 25.78.47.132: icmp_req=1 ttl=64 time=2.49 ms
64 bytes from 25.78.47.132: icmp_req=2 ttl=64 time=0.810 ms
64 bytes from 25.78.47.132: icmp_req=3 ttl=64 time=0.878 ms
--- 25.78.47.132 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.810/1.393/2.492/0.777 ms
2025-08-03 00:29:53,175 - INFO - Ping to IP 25.78.47.132 from VM ctest-TestMtuProbe-77386939-71811819 passed
2025-08-03 00:29:53,175 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:29:53,176 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:53,176 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-03 00:29:53,711 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 3 00:29 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-03 00:29:53,711 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:53,712 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-03 00:29:54,169 - DEBUG - None
2025-08-03 00:29:54,169 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 25.78.47.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:54,170 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 25.78.47.132 5201 < testfile
2025-08-03 00:29:56,748 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00104908 s, 95.3 kB/s
2025-08-03 00:29:56,748 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-03 00:29:56,748 - DEBUG - ls -l testfile
2025-08-03 00:29:57,079 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:29 testfile
2025-08-03 00:29:57,079 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-83026755
2025-08-03 00:29:57,079 - INFO - Deleting VM ctest-TestMtuProbe-77386939-83026755
2025-08-03 00:29:57,172 - INFO - Deleting VM ctest-TestMtuProbe-77386939-71811819
2025-08-03 00:29:57,252 - INFO - Deleting VN ctest-vn-57626811
2025-08-03 00:29:57,365 - DEBUG - VN c36e8bb5-5704-4bbf-a172-959d9395ef4d still in use: Unable to complete operation on network c36e8bb5-5704-4bbf-a172-959d9395ef4d. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-742b261b-da85-4d37-a849-7435e37ecd73']
2025-08-03 00:29:57,365 - WARNING - Deleting VN ctest-vn-57626811 failed..Will retry
2025-08-03 00:29:59,649 - DEBUG - Response for deleting network ()
2025-08-03 00:29:59,649 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25
2025-08-03 00:29:59,689 - DEBUG - Response Code: 404
2025-08-03 00:29:59,689 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-03 00:29:59,698 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028
2025-08-03 00:29:59,712 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88
2025-08-03 00:29:59,824 - INFO - Validated that VN ctest-vn-57626811 is not found in API Server
2025-08-03 00:29:59,838 - DEBUG - VN ctest-vn-57626811 is not present in Agent 10.0.0.48
2025-08-03 00:29:59,850 - DEBUG - VN ctest-vn-57626811 is not present in Agent 10.0.0.49
2025-08-03 00:29:59,850 - INFO - Validated that VN ctest-vn-57626811 is not in any agent
2025-08-03 00:29:59,906 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-57626811 info
2025-08-03 00:30:01,305 - DEBUG - No XMPP flaps were noticed during the test
2025-08-03 00:30:01,305 - INFO - END TEST : test_mtu_probe_intra_node : PASSED[0:02:41]
2025-08-03 00:30:01,305 - INFO - --------------------------------------------------------------------------------
2025-08-03 00:30:02,152 - INFO - Deleted project: ctest-TestMtuProbe-77386939, ID : f47b0842-9ed0-4aac-801c-284d30c77a88