2025-10-30 00:28:04,308 - INFO - Domain Default found not creating 2025-10-30 00:28:04,484 - INFO - Project ctest-TestMtuProbe-73498179 not found, creating it 2025-10-30 00:28:05,082 - INFO - Created Project:ctest-TestMtuProbe-73498179, ID : 81b32cb2-5f13-44c5-b66e-3bacf8b7eb09 2025-10-30 00:28:06,578 - INFO - ================================================================================ 2025-10-30 00:28:06,578 - INFO - STARTING TEST : test_mtu_probe_intra_node 2025-10-30 00:28:06,578 - INFO - TEST DESCRIPTION : Description: check traffic configuring different tcp_mtu_probe vlaues on vm MTU probing values: 0, 1, 2 0 - Disabled (default) 1 - Disabled by default, Enabled only when ICMP black hole detected 2 - Always enabled, using the initial MSS value of tcp_base_mss system internally enables bit values for point 1&2 For test purpose, Idea is to check traffic works fine on configuring values Vm's across compute node steps: 1. create 1 VN and launch 2 VMs in same compute node 2. client and server VMs in same compute node 3. configure tcp_mtu_probe to 0, 1, 2 4. send icmp traffic assert if ping fails 5. send tcp traffic assert if tcp traffic fails Pass criteria: 1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values 2025-10-30 00:28:07,882 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.254': '0', '10.20.0.5': '0'}, '10.0.0.33': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-10-30 00:28:07,882 - INFO - Initial checks done. Running the testcase now 2025-10-30 00:28:07,882 - INFO - 2025-10-30 00:28:08,551 - DEBUG - Response for create_network : {'network': {'id': '5bde6665-0eb0-4928-b27b-53cdccff088f', 'name': 'ctest-vn-36879895', 'tenant_id': '81b32cb25f1344c5b66e3bacf8b7eb09', 'project_id': '81b32cb25f1344c5b66e3bacf8b7eb09', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-73498179', 'ctest-vn-36879895'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 00:28:08,892 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b1b3e740-f17b-4848-99a9-fc2aa845192c', 'name': '', 'tenant_id': '81b32cb25f1344c5b66e3bacf8b7eb09', 'network_id': '5bde6665-0eb0-4928-b27b-53cdccff088f', 'ip_version': 4, 'cidr': '191.166.220.0/26', 'allocation_pools': [{'start': '191.166.220.2', 'end': '191.166.220.62'}], 'gateway_ip': '191.166.220.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '191.166.220.2', 'tags': [], 'project_id': '81b32cb25f1344c5b66e3bacf8b7eb09'}} 2025-10-30 00:28:08,916 - INFO - Created VN ctest-vn-36879895 2025-10-30 00:28:08,935 - DEBUG - VN ctest-vn-36879895 UUID is 5bde6665-0eb0-4928-b27b-53cdccff088f 2025-10-30 00:28:09,015 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:28:09,311 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:28:09,343 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:28:09,361 - DEBUG - Requesting: http://10.0.0.254:8082/project/81b32cb2-5f13-44c5-b66e-3bacf8b7eb09 2025-10-30 00:28:09,448 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5bde6665-0eb0-4928-b27b-53cdccff088f 2025-10-30 00:28:09,461 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5bde6665-0eb0-4928-b27b-53cdccff088f 2025-10-30 00:28:09,471 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4 2025-10-30 00:28:09,479 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4 2025-10-30 00:28:09,487 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e2edbb52-4034-4ae5-97b7-4e3b8c018964 2025-10-30 00:28:09,493 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:28:09,493 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5bde6665-0eb0-4928-b27b-53cdccff088f 2025-10-30 00:28:09,504 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4 2025-10-30 00:28:09,521 - INFO - Verified VN network id 16 for VN 5bde6665-0eb0-4928-b27b-53cdccff088f 2025-10-30 00:28:09,521 - INFO - Verifications in API Server for VN ctest-vn-36879895 passed 2025-10-30 00:28:09,521 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5bde6665-0eb0-4928-b27b-53cdccff088f 2025-10-30 00:28:09,531 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4 2025-10-30 00:28:09,538 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4 2025-10-30 00:28:09,545 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e2edbb52-4034-4ae5-97b7-4e3b8c018964 2025-10-30 00:28:09,559 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-73498179', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6619841086505371944', 'uuid-lslong': '12860965304259250319'}, 'enable': 'true', 'created': '2025-10-30T00:28:08', 'last-modified': '2025-10-30T00:28:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.738069'} 2025-10-30 00:28:09,564 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:28:09,570 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-73498179', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6619841086505371944', 'uuid-lslong': '12860965304259250319'}, 'enable': 'true', 'created': '2025-10-30T00:28:08', 'last-modified': '2025-10-30T00:28:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.748648'} 2025-10-30 00:28:09,576 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:28:09,581 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-73498179', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6619841086505371944', 'uuid-lslong': '12860965304259250319'}, 'enable': 'true', 'created': '2025-10-30T00:28:08', 'last-modified': '2025-10-30T00:28:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.759608'} 2025-10-30 00:28:09,586 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:28:09,586 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-36879895 passed 2025-10-30 00:28:09,586 - DEBUG - ====Verifying policy data for ctest-vn-36879895 in API_Server ====== 2025-10-30 00:28:09,586 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:28:09,593 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:28:09,604 - DEBUG - Requesting: http://10.0.0.254:8082/project/81b32cb2-5f13-44c5-b66e-3bacf8b7eb09 2025-10-30 00:28:09,697 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5bde6665-0eb0-4928-b27b-53cdccff088f 2025-10-30 00:28:09,707 - DEBUG - =>VN ctest-vn-36879895 has no policy to be verified 2025-10-30 00:28:09,708 - DEBUG - Verifying the vn in opserver 2025-10-30 00:28:09,708 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 virtual network link through opserver 10.0.0.254 2025-10-30 00:28:09,708 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 00:28:10,003 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 00:28:10,066 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895?flat'} 2025-10-30 00:28:10,066 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 virtual network link through opserver 10.0.0.49 2025-10-30 00:28:10,066 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-30 00:28:10,373 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-30 00:28:10,435 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895?flat'} 2025-10-30 00:28:10,435 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 virtual network link through opserver 10.0.0.38 2025-10-30 00:28:10,435 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-30 00:28:10,739 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-30 00:28:10,801 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895?flat'} 2025-10-30 00:28:10,801 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is found in opserver 2025-10-30 00:28:10,827 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 00:28:10,839 - DEBUG - VRF ids for VN ctest-vn-36879895: {} 2025-10-30 00:28:10,866 - DEBUG - Services list from nova: [, , , ] 2025-10-30 00:28:10,866 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4529-1', 'an-jenkins-deploy-platform-ansible-os-4529-2']} 2025-10-30 00:28:10,866 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4529-1', 'an-jenkins-deploy-platform-ansible-os-4529-2']} 2025-10-30 00:28:11,990 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4529-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4529-1) 2025-10-30 00:28:11,990 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4529-1', 'an-jenkins-deploy-platform-ansible-os-4529-2']} 2025-10-30 00:28:13,478 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4529-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4529-1) 2025-10-30 00:28:13,478 - INFO - Waiting for VM ctest-TestMtuProbe-73498179-98281346 to be up.. 2025-10-30 00:28:13,578 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-30 00:28:18,672 - DEBUG - VM is in ACTIVE state now 2025-10-30 00:28:18,672 - INFO - VM name : ctest-TestMtuProbe-73498179-98281346 2025-10-30 00:28:18,757 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 ID is 4baba130-9fa8-49bf-bdc5-a079ede61c32 2025-10-30 00:28:18,782 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 launched on Node an-jenkins-deploy-platform-ansible-os-4529-1 2025-10-30 00:28:18,882 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/4baba130-9fa8-49bf-bdc5-a079ede61c32 2025-10-30 00:28:19,207 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/4baba130-9fa8-49bf-bdc5-a079ede61c32 2025-10-30 00:28:19,245 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/55316e4b-a4b8-472f-8b10-4cb98190ca03 2025-10-30 00:28:22,424 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-10-30 00:28:22,424 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed! 2025-10-30 00:28:22,438 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set 2025-10-30 00:28:26,519 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-10-30 00:28:26,519 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed! 2025-10-30 00:28:26,534 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set 2025-10-30 00:28:30,610 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-10-30 00:28:30,610 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed! 2025-10-30 00:28:30,624 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set 2025-10-30 00:28:34,710 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-10-30 00:28:34,710 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed! 2025-10-30 00:28:34,725 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set 2025-10-30 00:28:38,806 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-30 00:28:38,806 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed! 2025-10-30 00:28:38,819 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set 2025-10-30 00:28:42,903 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-30 00:28:42,903 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed! 2025-10-30 00:28:42,916 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set 2025-10-30 00:28:46,991 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-30 00:28:46,991 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed! 2025-10-30 00:28:47,011 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set 2025-10-30 00:28:51,093 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-30 00:28:51,093 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed! 2025-10-30 00:28:51,106 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set 2025-10-30 00:28:55,195 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-30 00:28:55,195 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed! 2025-10-30 00:28:55,209 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set 2025-10-30 00:28:59,287 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-30 00:28:59,288 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed! 2025-10-30 00:28:59,303 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set 2025-10-30 00:29:03,379 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-30 00:29:03,379 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed! 2025-10-30 00:29:03,394 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set 2025-10-30 00:29:05,459 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.34 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=5.45 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 5.447/6.894/8.341/1.447 ms') 2025-10-30 00:29:05,460 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 passed 2025-10-30 00:29:05,526 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:29:05,526 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22 2025-10-30 00:29:05,594 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 00:29:05,685 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 00:29:10,686 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:29:10,686 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22 2025-10-30 00:29:10,744 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 00:29:10,833 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 00:29:15,834 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:29:15,834 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22 2025-10-30 00:29:15,892 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 00:29:16,012 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 00:29:21,013 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:29:21,013 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22 2025-10-30 00:29:21,078 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 00:29:21,171 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 00:29:26,172 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:29:26,172 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22 2025-10-30 00:29:26,239 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 00:29:26,321 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 00:29:31,322 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:29:31,322 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22 2025-10-30 00:29:31,503 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is ready for SSH connections 2025-10-30 00:29:31,503 - INFO - Waiting for VM ctest-TestMtuProbe-73498179-07648991 to be up.. 2025-10-30 00:29:31,584 - DEBUG - VM is in ACTIVE state now 2025-10-30 00:29:31,584 - INFO - VM name : ctest-TestMtuProbe-73498179-07648991 2025-10-30 00:29:31,666 - DEBUG - VM ctest-TestMtuProbe-73498179-07648991 ID is b5b9a842-9979-4ba1-85c8-ce910b09e38c 2025-10-30 00:29:31,666 - DEBUG - VM ctest-TestMtuProbe-73498179-07648991 launched on Node an-jenkins-deploy-platform-ansible-os-4529-1 2025-10-30 00:29:31,761 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/b5b9a842-9979-4ba1-85c8-ce910b09e38c 2025-10-30 00:29:31,773 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/eff70900-b9a9-4983-89c8-c43b12fabe0f 2025-10-30 00:29:32,943 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.99 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=3.78 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.784/5.389/6.994/1.605 ms') 2025-10-30 00:29:32,943 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestMtuProbe-73498179-07648991 passed 2025-10-30 00:29:33,010 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:29:33,010 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-07648991, IP 191.166.220.4, Port 22 2025-10-30 00:29:33,079 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 00:29:33,178 - DEBUG - VM ctest-TestMtuProbe-73498179-07648991 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 00:29:38,178 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:29:38,179 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-07648991, IP 191.166.220.4, Port 22 2025-10-30 00:29:38,246 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 00:29:38,339 - DEBUG - VM ctest-TestMtuProbe-73498179-07648991 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 00:29:43,339 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:29:43,339 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-07648991, IP 191.166.220.4, Port 22 2025-10-30 00:29:43,511 - DEBUG - VM ctest-TestMtuProbe-73498179-07648991 is ready for SSH connections 2025-10-30 00:29:43,511 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:29:43,511 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-10-30 00:30:22,428 - DEBUG - None 2025-10-30 00:30:22,428 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:30:22,428 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-10-30 00:30:58,564 - DEBUG - None 2025-10-30 00:30:58,564 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-10-30 00:30:58,564 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-10-30 00:30:58,564 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:30:58,564 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 191.166.220.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:30:58,565 - DEBUG - ping -s 56 -c 3 -W 1 191.166.220.4 2025-10-30 00:31:01,027 - DEBUG - PING 191.166.220.4 (191.166.220.4) 56(84) bytes of data. 64 bytes from 191.166.220.4: icmp_req=1 ttl=64 time=8.76 ms 64 bytes from 191.166.220.4: icmp_req=2 ttl=64 time=0.974 ms 64 bytes from 191.166.220.4: icmp_req=3 ttl=64 time=0.745 ms --- 191.166.220.4 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.745/3.495/8.767/3.729 ms 2025-10-30 00:31:01,027 - INFO - Ping to IP 191.166.220.4 from VM ctest-TestMtuProbe-73498179-98281346 passed 2025-10-30 00:31:01,027 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:31:01,027 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:01,027 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-10-30 00:31:01,594 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-10-30 00:31:01,594 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:01,594 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-10-30 00:31:02,025 - DEBUG - None 2025-10-30 00:31:02,025 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 191.166.220.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:02,025 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 191.166.220.4 5201 < testfile 2025-10-30 00:31:04,539 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.000768643 s, 130 kB/s 2025-10-30 00:31:04,539 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:04,539 - DEBUG - ls -l testfile 2025-10-30 00:31:04,877 - DEBUG - -rw-r--r-- 1 root root 100 Oct 30 00:31 testfile 2025-10-30 00:31:04,877 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73498179-07648991 2025-10-30 00:31:04,877 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:04,877 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-10-30 00:31:05,291 - DEBUG - None 2025-10-30 00:31:05,291 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:05,291 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-10-30 00:31:05,692 - DEBUG - None 2025-10-30 00:31:05,693 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-10-30 00:31:05,693 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-10-30 00:31:05,693 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:31:05,693 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 191.166.220.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:05,693 - DEBUG - ping -s 56 -c 3 -W 1 191.166.220.4 2025-10-30 00:31:08,132 - DEBUG - PING 191.166.220.4 (191.166.220.4) 56(84) bytes of data. 64 bytes from 191.166.220.4: icmp_req=1 ttl=64 time=1.71 ms 64 bytes from 191.166.220.4: icmp_req=2 ttl=64 time=0.708 ms 64 bytes from 191.166.220.4: icmp_req=3 ttl=64 time=0.656 ms --- 191.166.220.4 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 0.656/1.026/1.715/0.488 ms 2025-10-30 00:31:08,132 - INFO - Ping to IP 191.166.220.4 from VM ctest-TestMtuProbe-73498179-98281346 passed 2025-10-30 00:31:08,132 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:31:08,132 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:08,133 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-10-30 00:31:08,666 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Oct 30 00:31 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-10-30 00:31:08,666 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:08,666 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-10-30 00:31:09,113 - DEBUG - None 2025-10-30 00:31:09,113 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 191.166.220.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:09,113 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 191.166.220.4 5201 < testfile 2025-10-30 00:31:11,664 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00243207 s, 41.1 kB/s 2025-10-30 00:31:11,664 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:11,664 - DEBUG - ls -l testfile 2025-10-30 00:31:11,980 - DEBUG - -rw-r--r-- 1 root root 100 Oct 30 00:31 testfile 2025-10-30 00:31:11,980 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73498179-07648991 2025-10-30 00:31:11,981 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:11,981 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-10-30 00:31:12,401 - DEBUG - None 2025-10-30 00:31:12,401 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:12,401 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-10-30 00:31:12,835 - DEBUG - None 2025-10-30 00:31:12,835 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-10-30 00:31:12,835 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-10-30 00:31:12,835 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:31:12,836 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 191.166.220.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:12,836 - DEBUG - ping -s 56 -c 3 -W 1 191.166.220.4 2025-10-30 00:31:15,299 - DEBUG - PING 191.166.220.4 (191.166.220.4) 56(84) bytes of data. 64 bytes from 191.166.220.4: icmp_req=1 ttl=64 time=2.47 ms 64 bytes from 191.166.220.4: icmp_req=2 ttl=64 time=0.697 ms 64 bytes from 191.166.220.4: icmp_req=3 ttl=64 time=0.973 ms --- 191.166.220.4 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.697/1.381/2.473/0.780 ms 2025-10-30 00:31:15,299 - INFO - Ping to IP 191.166.220.4 from VM ctest-TestMtuProbe-73498179-98281346 passed 2025-10-30 00:31:15,299 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 00:31:15,299 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:15,299 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-10-30 00:31:15,876 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Oct 30 00:31 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-10-30 00:31:15,876 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:15,876 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-10-30 00:31:16,319 - DEBUG - None 2025-10-30 00:31:16,319 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 191.166.220.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:16,319 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 191.166.220.4 5201 < testfile 2025-10-30 00:31:18,865 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00111625 s, 89.6 kB/s 2025-10-30 00:31:18,865 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 00:31:18,866 - DEBUG - ls -l testfile 2025-10-30 00:31:19,214 - DEBUG - -rw-r--r-- 1 root root 100 Oct 30 00:31 testfile 2025-10-30 00:31:19,214 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73498179-07648991 2025-10-30 00:31:19,214 - INFO - Deleting VM ctest-TestMtuProbe-73498179-07648991 2025-10-30 00:31:19,304 - INFO - Deleting VM ctest-TestMtuProbe-73498179-98281346 2025-10-30 00:31:19,382 - INFO - Deleting VN ctest-vn-36879895 2025-10-30 00:31:19,427 - DEBUG - VN 5bde6665-0eb0-4928-b27b-53cdccff088f still in use: Unable to complete operation on network 5bde6665-0eb0-4928-b27b-53cdccff088f. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-25e77556-4e86-460c-be15-eaa109b0e5a3'] 2025-10-30 00:31:19,427 - WARNING - Deleting VN ctest-vn-36879895 failed..Will retry 2025-10-30 00:31:21,608 - DEBUG - Response for deleting network () 2025-10-30 00:31:21,608 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4 2025-10-30 00:31:21,614 - DEBUG - Response Code: 404 2025-10-30 00:31:21,614 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:31:21,620 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:31:21,673 - DEBUG - Requesting: http://10.0.0.254:8082/project/81b32cb2-5f13-44c5-b66e-3bacf8b7eb09 2025-10-30 00:31:21,765 - INFO - Validated that VN ctest-vn-36879895 is not found in API Server 2025-10-30 00:31:21,775 - DEBUG - VN ctest-vn-36879895 is not present in Agent 10.0.0.65 2025-10-30 00:31:21,799 - DEBUG - VN ctest-vn-36879895 is not present in Agent 10.0.0.33 2025-10-30 00:31:21,799 - INFO - Validated that VN ctest-vn-36879895 is not in any agent 2025-10-30 00:31:21,841 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-36879895 info 2025-10-30 00:31:23,157 - DEBUG - No XMPP flaps were noticed during the test
2025-10-30 00:31:23,157 - INFO - END TEST : test_mtu_probe_intra_node : PASSED[0:03:17]
2025-10-30 00:31:23,157 - INFO - -------------------------------------------------------------------------------- 2025-10-30 00:31:23,877 - INFO - Deleted project: ctest-TestMtuProbe-73498179, ID : 81b32cb2-5f13-44c5-b66e-3bacf8b7eb09