2025-10-30 00:28:04,308 - INFO - Domain Default found not creating
2025-10-30 00:28:04,484 - INFO - Project ctest-TestMtuProbe-73498179 not found, creating it
2025-10-30 00:28:05,082 - INFO - Created Project:ctest-TestMtuProbe-73498179, ID : 81b32cb2-5f13-44c5-b66e-3bacf8b7eb09 
2025-10-30 00:28:06,578 - INFO - ================================================================================
2025-10-30 00:28:06,578 - INFO - STARTING TEST    : test_mtu_probe_intra_node
2025-10-30 00:28:06,578 - INFO - TEST DESCRIPTION :  
        Description: 
            check traffic configuring different tcp_mtu_probe vlaues on vm 
            MTU probing values: 0, 1, 2
            0 - Disabled (default)
            1 - Disabled by default, Enabled only when ICMP black hole detected
            2 - Always enabled, using the initial MSS value of tcp_base_mss
            system internally enables bit values for point 1&2
            For test purpose,
            Idea is to check traffic works fine on configuring values
            Vm's across compute node
        steps:
            1. create 1 VN and launch 2 VMs in same compute node 
            2. client and server VMs in same compute node
            3. configure tcp_mtu_probe to 0, 1, 2
            4. send icmp traffic assert if ping fails 
            5. send tcp traffic assert if tcp traffic fails
        Pass criteria:
            1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values 
        
2025-10-30 00:28:07,882 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.254': '0', '10.20.0.5': '0'}, '10.0.0.33': {'10.20.0.14': '0', '10.20.0.254': '0'}} with
2025-10-30 00:28:07,882 - INFO - Initial checks done. Running the testcase now
2025-10-30 00:28:07,882 - INFO - 
2025-10-30 00:28:08,551 - DEBUG - Response for create_network : {'network': {'id': '5bde6665-0eb0-4928-b27b-53cdccff088f', 'name': 'ctest-vn-36879895', 'tenant_id': '81b32cb25f1344c5b66e3bacf8b7eb09', 'project_id': '81b32cb25f1344c5b66e3bacf8b7eb09', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-73498179', 'ctest-vn-36879895'], 'port_security_enabled': True, 'description': ''}}
2025-10-30 00:28:08,892 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b1b3e740-f17b-4848-99a9-fc2aa845192c', 'name': '', 'tenant_id': '81b32cb25f1344c5b66e3bacf8b7eb09', 'network_id': '5bde6665-0eb0-4928-b27b-53cdccff088f', 'ip_version': 4, 'cidr': '191.166.220.0/26', 'allocation_pools': [{'start': '191.166.220.2', 'end': '191.166.220.62'}], 'gateway_ip': '191.166.220.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '191.166.220.2', 'tags': [], 'project_id': '81b32cb25f1344c5b66e3bacf8b7eb09'}}
2025-10-30 00:28:08,916 - INFO - Created VN ctest-vn-36879895
2025-10-30 00:28:08,935 - DEBUG - VN ctest-vn-36879895 UUID is 5bde6665-0eb0-4928-b27b-53cdccff088f
2025-10-30 00:28:09,015 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-10-30 00:28:09,311 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-10-30 00:28:09,343 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7
2025-10-30 00:28:09,361 - DEBUG - Requesting: http://10.0.0.254:8082/project/81b32cb2-5f13-44c5-b66e-3bacf8b7eb09
2025-10-30 00:28:09,448 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5bde6665-0eb0-4928-b27b-53cdccff088f
2025-10-30 00:28:09,461 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5bde6665-0eb0-4928-b27b-53cdccff088f
2025-10-30 00:28:09,471 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4
2025-10-30 00:28:09,479 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4
2025-10-30 00:28:09,487 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e2edbb52-4034-4ae5-97b7-4e3b8c018964
2025-10-30 00:28:09,493 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-30 00:28:09,493 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5bde6665-0eb0-4928-b27b-53cdccff088f
2025-10-30 00:28:09,504 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4
2025-10-30 00:28:09,521 - INFO - Verified VN network id 16 for VN 5bde6665-0eb0-4928-b27b-53cdccff088f
2025-10-30 00:28:09,521 - INFO - Verifications in API Server for VN ctest-vn-36879895 passed
2025-10-30 00:28:09,521 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5bde6665-0eb0-4928-b27b-53cdccff088f
2025-10-30 00:28:09,531 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4
2025-10-30 00:28:09,538 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4
2025-10-30 00:28:09,545 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e2edbb52-4034-4ae5-97b7-4e3b8c018964
2025-10-30 00:28:09,559 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-73498179', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6619841086505371944', 'uuid-lslong': '12860965304259250319'}, 'enable': 'true', 'created': '2025-10-30T00:28:08', 'last-modified': '2025-10-30T00:28:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.738069'}
2025-10-30 00:28:09,564 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-30 00:28:09,570 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-73498179', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6619841086505371944', 'uuid-lslong': '12860965304259250319'}, 'enable': 'true', 'created': '2025-10-30T00:28:08', 'last-modified': '2025-10-30T00:28:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.748648'}
2025-10-30 00:28:09,576 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-30 00:28:09,581 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-73498179', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6619841086505371944', 'uuid-lslong': '12860965304259250319'}, 'enable': 'true', 'created': '2025-10-30T00:28:08', 'last-modified': '2025-10-30T00:28:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.759608'}
2025-10-30 00:28:09,586 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-30 00:28:09,586 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-36879895 passed
2025-10-30 00:28:09,586 - DEBUG - ====Verifying policy data for ctest-vn-36879895 in API_Server ======
2025-10-30 00:28:09,586 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-10-30 00:28:09,593 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7
2025-10-30 00:28:09,604 - DEBUG - Requesting: http://10.0.0.254:8082/project/81b32cb2-5f13-44c5-b66e-3bacf8b7eb09
2025-10-30 00:28:09,697 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5bde6665-0eb0-4928-b27b-53cdccff088f
2025-10-30 00:28:09,707 - DEBUG - =>VN ctest-vn-36879895 has no policy to be verified
2025-10-30 00:28:09,708 - DEBUG - Verifying the vn in opserver
2025-10-30 00:28:09,708 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 virtual network link  through opserver 10.0.0.254
2025-10-30 00:28:09,708 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-10-30 00:28:10,003 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-10-30 00:28:10,066 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895?flat'}
2025-10-30 00:28:10,066 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 virtual network link  through opserver 10.0.0.49
2025-10-30 00:28:10,066 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks
2025-10-30 00:28:10,373 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks
2025-10-30 00:28:10,435 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895?flat'}
2025-10-30 00:28:10,435 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 virtual network link  through opserver 10.0.0.38
2025-10-30 00:28:10,435 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-10-30 00:28:10,739 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-10-30 00:28:10,801 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895?flat'}
2025-10-30 00:28:10,801 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is found in opserver
2025-10-30 00:28:10,827 - DEBUG - Do not have enough data to verify VN in agent
2025-10-30 00:28:10,839 - DEBUG - VRF ids for VN ctest-vn-36879895: {}
2025-10-30 00:28:10,866 - DEBUG - Services list from nova: [, , , ]
2025-10-30 00:28:10,866 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4529-1', 'an-jenkins-deploy-platform-ansible-os-4529-2']}
2025-10-30 00:28:10,866 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4529-1', 'an-jenkins-deploy-platform-ansible-os-4529-2']}
2025-10-30 00:28:11,990 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4529-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4529-1)
2025-10-30 00:28:11,990 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4529-1', 'an-jenkins-deploy-platform-ansible-os-4529-2']}
2025-10-30 00:28:13,478 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4529-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4529-1)
2025-10-30 00:28:13,478 - INFO - Waiting for VM ctest-TestMtuProbe-73498179-98281346 to be up..
2025-10-30 00:28:13,578 - DEBUG - VM  is still in BUILD state, Expected: ACTIVE
2025-10-30 00:28:18,672 - DEBUG - VM  is in ACTIVE state now
2025-10-30 00:28:18,672 - INFO - VM name : ctest-TestMtuProbe-73498179-98281346
2025-10-30 00:28:18,757 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 ID is 4baba130-9fa8-49bf-bdc5-a079ede61c32
2025-10-30 00:28:18,782 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 launched on Node an-jenkins-deploy-platform-ansible-os-4529-1
2025-10-30 00:28:18,882 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/4baba130-9fa8-49bf-bdc5-a079ede61c32
2025-10-30 00:28:19,207 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/4baba130-9fa8-49bf-bdc5-a079ede61c32
2025-10-30 00:28:19,245 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/55316e4b-a4b8-472f-8b10-4cb98190ca03
2025-10-30 00:28:22,424 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-10-30 00:28:22,424 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed!
2025-10-30 00:28:22,438 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set
2025-10-30 00:28:26,519 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms')
2025-10-30 00:28:26,519 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed!
2025-10-30 00:28:26,534 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set
2025-10-30 00:28:30,610 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms')
2025-10-30 00:28:30,610 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed!
2025-10-30 00:28:30,624 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set
2025-10-30 00:28:34,710 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms')
2025-10-30 00:28:34,710 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed!
2025-10-30 00:28:34,725 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set
2025-10-30 00:28:38,806 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-10-30 00:28:38,806 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed!
2025-10-30 00:28:38,819 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set
2025-10-30 00:28:42,903 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-30 00:28:42,903 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed!
2025-10-30 00:28:42,916 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set
2025-10-30 00:28:46,991 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-10-30 00:28:46,991 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed!
2025-10-30 00:28:47,011 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set
2025-10-30 00:28:51,093 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-30 00:28:51,093 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed!
2025-10-30 00:28:51,106 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set
2025-10-30 00:28:55,195 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2025-10-30 00:28:55,195 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed!
2025-10-30 00:28:55,209 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set
2025-10-30 00:28:59,287 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2025-10-30 00:28:59,288 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed!
2025-10-30 00:28:59,303 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set
2025-10-30 00:29:03,379 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-10-30 00:29:03,379 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 failed!
2025-10-30 00:29:03,394 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73498179:ctest-vn-36879895 is 191.166.220.1 and allocation pool is NOT set
2025-10-30 00:29:05,459 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.34 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=5.45 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 5.447/6.894/8.341/1.447 ms')
2025-10-30 00:29:05,460 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73498179-98281346 passed
2025-10-30 00:29:05,526 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:29:05,526 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22
2025-10-30 00:29:05,594 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 00:29:05,685 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 00:29:10,686 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:29:10,686 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22
2025-10-30 00:29:10,744 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 00:29:10,833 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 00:29:15,834 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:29:15,834 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22
2025-10-30 00:29:15,892 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 00:29:16,012 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 00:29:21,013 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:29:21,013 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22
2025-10-30 00:29:21,078 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 00:29:21,171 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 00:29:26,172 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:29:26,172 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22
2025-10-30 00:29:26,239 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 00:29:26,321 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 00:29:31,322 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:29:31,322 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-98281346, IP 191.166.220.3, Port 22
2025-10-30 00:29:31,503 - DEBUG - VM ctest-TestMtuProbe-73498179-98281346 is ready for SSH connections
2025-10-30 00:29:31,503 - INFO - Waiting for VM ctest-TestMtuProbe-73498179-07648991 to be up..
2025-10-30 00:29:31,584 - DEBUG - VM  is in ACTIVE state now
2025-10-30 00:29:31,584 - INFO - VM name : ctest-TestMtuProbe-73498179-07648991
2025-10-30 00:29:31,666 - DEBUG - VM ctest-TestMtuProbe-73498179-07648991 ID is b5b9a842-9979-4ba1-85c8-ce910b09e38c
2025-10-30 00:29:31,666 - DEBUG - VM ctest-TestMtuProbe-73498179-07648991 launched on Node an-jenkins-deploy-platform-ansible-os-4529-1
2025-10-30 00:29:31,761 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/b5b9a842-9979-4ba1-85c8-ce910b09e38c
2025-10-30 00:29:31,773 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/eff70900-b9a9-4983-89c8-c43b12fabe0f
2025-10-30 00:29:32,943 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.99 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=3.78 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.784/5.389/6.994/1.605 ms')
2025-10-30 00:29:32,943 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestMtuProbe-73498179-07648991 passed
2025-10-30 00:29:33,010 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:29:33,010 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-07648991, IP 191.166.220.4, Port 22
2025-10-30 00:29:33,079 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 00:29:33,178 - DEBUG - VM ctest-TestMtuProbe-73498179-07648991 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 00:29:38,178 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:29:38,179 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-07648991, IP 191.166.220.4, Port 22
2025-10-30 00:29:38,246 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 00:29:38,339 - DEBUG - VM ctest-TestMtuProbe-73498179-07648991 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 00:29:43,339 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:29:43,339 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73498179-07648991, IP 191.166.220.4, Port 22
2025-10-30 00:29:43,511 - DEBUG - VM ctest-TestMtuProbe-73498179-07648991 is ready for SSH connections
2025-10-30 00:29:43,511 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:29:43,511 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-30 00:30:22,428 - DEBUG - None
2025-10-30 00:30:22,428 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:30:22,428 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-30 00:30:58,564 - DEBUG - None
2025-10-30 00:30:58,564 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-30 00:30:58,564 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-30 00:30:58,564 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:30:58,564 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  191.166.220.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:30:58,565 - DEBUG - ping -s 56 -c 3 -W 1  191.166.220.4
2025-10-30 00:31:01,027 - DEBUG - PING 191.166.220.4 (191.166.220.4) 56(84) bytes of data.
64 bytes from 191.166.220.4: icmp_req=1 ttl=64 time=8.76 ms
64 bytes from 191.166.220.4: icmp_req=2 ttl=64 time=0.974 ms
64 bytes from 191.166.220.4: icmp_req=3 ttl=64 time=0.745 ms
--- 191.166.220.4 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.745/3.495/8.767/3.729 ms
2025-10-30 00:31:01,027 - INFO - Ping to IP 191.166.220.4 from VM ctest-TestMtuProbe-73498179-98281346 passed
2025-10-30 00:31:01,027 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:31:01,027 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:01,027 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 
2025-10-30 00:31:01,594 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu  4096 Dec 29  2017 .
drwxr-xr-x  3 root   root    4096 Jan  4  2013 ..
-rw-------  1 ubuntu ubuntu  2689 Dec 29  2017 .bash_history
-rw-r--r--  1 ubuntu ubuntu   220 Apr  3  2012 .bash_logout
-rw-r--r--  1 ubuntu ubuntu  3486 Apr  3  2012 .bashrc
drwx------  2 ubuntu ubuntu  4096 Jan  9  2013 .cache
-rwxrwxr-x  1 ubuntu ubuntu  1431 Feb  5  2015 flow_test_pktgen.sh
drwxr-xr-x  2 ubuntu ubuntu  4096 Jan  9  2013 .fontconfig
drwxrwxr-x  2 ubuntu ubuntu  4096 Jan  9  2013 .fvwm
drwxrwxr-x  3 ubuntu ubuntu  4096 Nov 29  2016 .jenkins
-rw-------  1 ubuntu ubuntu    52 Jul  2  2014 .lesshst
drwx------  4 ubuntu ubuntu  4096 Jan  9  2013 .mozilla
-rwxrwxr-x  1 ubuntu ubuntu  1378 Jun 27  2014 pktgen_new.sh
-rw-r--r--  1 ubuntu ubuntu   675 Apr  3  2012 .profile
drwxr-xr-x  2 ubuntu ubuntu  4096 Jun 27  2014 scr
drwx------  2 ubuntu ubuntu  4096 Feb  3  2015 .ssh
-rw-r--r--  1 ubuntu ubuntu     0 Jan  9  2013 .sudo_as_admin_successful
drwxr-xr-x  2 ubuntu ubuntu  4096 Jun 27  2014 traffic
drwxr-xr-x  4 root   root    4096 Jun 27  2014 traffic-1.0
-rw-rw-r--  1 ubuntu ubuntu 16361 Jan  9  2015 traffic-1.0.tar.gz
-rw-------  1 root   root    4695 Dec 17  2017 .viminfo
-rw-------  1 ubuntu ubuntu   152 Jul  2  2014 .Xauthority
-rw-------  1 ubuntu ubuntu 29828 Jan  9  2013 .xsession-errors
2025-10-30 00:31:01,594 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:01,594 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 
2025-10-30 00:31:02,025 - DEBUG - None
2025-10-30 00:31:02,025 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 191.166.220.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:02,025 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 191.166.220.4 5201 < testfile
2025-10-30 00:31:04,539 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000768643 s, 130 kB/s
2025-10-30 00:31:04,539 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:04,539 - DEBUG - ls -l testfile
2025-10-30 00:31:04,877 - DEBUG - -rw-r--r-- 1 root root 100 Oct 30 00:31 testfile
2025-10-30 00:31:04,877 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73498179-07648991
2025-10-30 00:31:04,877 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:04,877 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-30 00:31:05,291 - DEBUG - None
2025-10-30 00:31:05,291 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:05,291 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-30 00:31:05,692 - DEBUG - None
2025-10-30 00:31:05,693 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-30 00:31:05,693 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-30 00:31:05,693 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:31:05,693 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  191.166.220.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:05,693 - DEBUG - ping -s 56 -c 3 -W 1  191.166.220.4
2025-10-30 00:31:08,132 - DEBUG - PING 191.166.220.4 (191.166.220.4) 56(84) bytes of data.
64 bytes from 191.166.220.4: icmp_req=1 ttl=64 time=1.71 ms
64 bytes from 191.166.220.4: icmp_req=2 ttl=64 time=0.708 ms
64 bytes from 191.166.220.4: icmp_req=3 ttl=64 time=0.656 ms
--- 191.166.220.4 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 0.656/1.026/1.715/0.488 ms
2025-10-30 00:31:08,132 - INFO - Ping to IP 191.166.220.4 from VM ctest-TestMtuProbe-73498179-98281346 passed
2025-10-30 00:31:08,132 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:31:08,132 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:08,133 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 
2025-10-30 00:31:08,666 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu  4096 Oct 30 00:31 .
drwxr-xr-x  3 root   root    4096 Jan  4  2013 ..
-rw-------  1 ubuntu ubuntu  2689 Dec 29  2017 .bash_history
-rw-r--r--  1 ubuntu ubuntu   220 Apr  3  2012 .bash_logout
-rw-r--r--  1 ubuntu ubuntu  3486 Apr  3  2012 .bashrc
drwx------  2 ubuntu ubuntu  4096 Jan  9  2013 .cache
-rwxrwxr-x  1 ubuntu ubuntu  1431 Feb  5  2015 flow_test_pktgen.sh
drwxr-xr-x  2 ubuntu ubuntu  4096 Jan  9  2013 .fontconfig
drwxrwxr-x  2 ubuntu ubuntu  4096 Jan  9  2013 .fvwm
drwxrwxr-x  3 ubuntu ubuntu  4096 Nov 29  2016 .jenkins
-rw-------  1 ubuntu ubuntu    52 Jul  2  2014 .lesshst
drwx------  4 ubuntu ubuntu  4096 Jan  9  2013 .mozilla
-rwxrwxr-x  1 ubuntu ubuntu  1378 Jun 27  2014 pktgen_new.sh
-rw-r--r--  1 ubuntu ubuntu   675 Apr  3  2012 .profile
drwxr-xr-x  2 ubuntu ubuntu  4096 Jun 27  2014 scr
drwx------  2 ubuntu ubuntu  4096 Feb  3  2015 .ssh
-rw-r--r--  1 ubuntu ubuntu     0 Jan  9  2013 .sudo_as_admin_successful
drwxr-xr-x  2 ubuntu ubuntu  4096 Jun 27  2014 traffic
drwxr-xr-x  4 root   root    4096 Jun 27  2014 traffic-1.0
-rw-rw-r--  1 ubuntu ubuntu 16361 Jan  9  2015 traffic-1.0.tar.gz
-rw-------  1 root   root    4695 Dec 17  2017 .viminfo
-rw-------  1 ubuntu ubuntu   152 Jul  2  2014 .Xauthority
-rw-------  1 ubuntu ubuntu 29828 Jan  9  2013 .xsession-errors
2025-10-30 00:31:08,666 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:08,666 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 
2025-10-30 00:31:09,113 - DEBUG - None
2025-10-30 00:31:09,113 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 191.166.220.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:09,113 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 191.166.220.4 5201 < testfile
2025-10-30 00:31:11,664 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00243207 s, 41.1 kB/s
2025-10-30 00:31:11,664 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:11,664 - DEBUG - ls -l testfile
2025-10-30 00:31:11,980 - DEBUG - -rw-r--r-- 1 root root 100 Oct 30 00:31 testfile
2025-10-30 00:31:11,980 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73498179-07648991
2025-10-30 00:31:11,981 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:11,981 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-30 00:31:12,401 - DEBUG - None
2025-10-30 00:31:12,401 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:12,401 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-30 00:31:12,835 - DEBUG - None
2025-10-30 00:31:12,835 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-30 00:31:12,835 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-30 00:31:12,835 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:31:12,836 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  191.166.220.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:12,836 - DEBUG - ping -s 56 -c 3 -W 1  191.166.220.4
2025-10-30 00:31:15,299 - DEBUG - PING 191.166.220.4 (191.166.220.4) 56(84) bytes of data.
64 bytes from 191.166.220.4: icmp_req=1 ttl=64 time=2.47 ms
64 bytes from 191.166.220.4: icmp_req=2 ttl=64 time=0.697 ms
64 bytes from 191.166.220.4: icmp_req=3 ttl=64 time=0.973 ms
--- 191.166.220.4 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.697/1.381/2.473/0.780 ms
2025-10-30 00:31:15,299 - INFO - Ping to IP 191.166.220.4 from VM ctest-TestMtuProbe-73498179-98281346 passed
2025-10-30 00:31:15,299 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 00:31:15,299 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:15,299 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 
2025-10-30 00:31:15,876 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu  4096 Oct 30 00:31 .
drwxr-xr-x  3 root   root    4096 Jan  4  2013 ..
-rw-------  1 ubuntu ubuntu  2689 Dec 29  2017 .bash_history
-rw-r--r--  1 ubuntu ubuntu   220 Apr  3  2012 .bash_logout
-rw-r--r--  1 ubuntu ubuntu  3486 Apr  3  2012 .bashrc
drwx------  2 ubuntu ubuntu  4096 Jan  9  2013 .cache
-rwxrwxr-x  1 ubuntu ubuntu  1431 Feb  5  2015 flow_test_pktgen.sh
drwxr-xr-x  2 ubuntu ubuntu  4096 Jan  9  2013 .fontconfig
drwxrwxr-x  2 ubuntu ubuntu  4096 Jan  9  2013 .fvwm
drwxrwxr-x  3 ubuntu ubuntu  4096 Nov 29  2016 .jenkins
-rw-------  1 ubuntu ubuntu    52 Jul  2  2014 .lesshst
drwx------  4 ubuntu ubuntu  4096 Jan  9  2013 .mozilla
-rwxrwxr-x  1 ubuntu ubuntu  1378 Jun 27  2014 pktgen_new.sh
-rw-r--r--  1 ubuntu ubuntu   675 Apr  3  2012 .profile
drwxr-xr-x  2 ubuntu ubuntu  4096 Jun 27  2014 scr
drwx------  2 ubuntu ubuntu  4096 Feb  3  2015 .ssh
-rw-r--r--  1 ubuntu ubuntu     0 Jan  9  2013 .sudo_as_admin_successful
drwxr-xr-x  2 ubuntu ubuntu  4096 Jun 27  2014 traffic
drwxr-xr-x  4 root   root    4096 Jun 27  2014 traffic-1.0
-rw-rw-r--  1 ubuntu ubuntu 16361 Jan  9  2015 traffic-1.0.tar.gz
-rw-------  1 root   root    4695 Dec 17  2017 .viminfo
-rw-------  1 ubuntu ubuntu   152 Jul  2  2014 .Xauthority
-rw-------  1 ubuntu ubuntu 29828 Jan  9  2013 .xsession-errors
2025-10-30 00:31:15,876 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:15,876 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 
2025-10-30 00:31:16,319 - DEBUG - None
2025-10-30 00:31:16,319 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 191.166.220.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:16,319 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 191.166.220.4 5201 < testfile
2025-10-30 00:31:18,865 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00111625 s, 89.6 kB/s
2025-10-30 00:31:18,865 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 00:31:18,866 - DEBUG - ls -l testfile
2025-10-30 00:31:19,214 - DEBUG - -rw-r--r-- 1 root root 100 Oct 30 00:31 testfile
2025-10-30 00:31:19,214 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73498179-07648991
2025-10-30 00:31:19,214 - INFO - Deleting VM ctest-TestMtuProbe-73498179-07648991
2025-10-30 00:31:19,304 - INFO - Deleting VM ctest-TestMtuProbe-73498179-98281346
2025-10-30 00:31:19,382 - INFO - Deleting VN ctest-vn-36879895 
2025-10-30 00:31:19,427 - DEBUG - VN 5bde6665-0eb0-4928-b27b-53cdccff088f still in use: Unable to complete operation on network 5bde6665-0eb0-4928-b27b-53cdccff088f. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-25e77556-4e86-460c-be15-eaa109b0e5a3']
2025-10-30 00:31:19,427 - WARNING - Deleting VN ctest-vn-36879895 failed..Will retry
2025-10-30 00:31:21,608 - DEBUG - Response for deleting network ()
2025-10-30 00:31:21,608 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f5b2f5f5-dab9-4323-91e0-b4654aacb1d4
2025-10-30 00:31:21,614 - DEBUG - Response Code: 404
2025-10-30 00:31:21,614 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-10-30 00:31:21,620 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7
2025-10-30 00:31:21,673 - DEBUG - Requesting: http://10.0.0.254:8082/project/81b32cb2-5f13-44c5-b66e-3bacf8b7eb09
2025-10-30 00:31:21,765 - INFO - Validated that VN ctest-vn-36879895 is not found in API Server
2025-10-30 00:31:21,775 - DEBUG - VN ctest-vn-36879895 is not present in Agent 10.0.0.65 
2025-10-30 00:31:21,799 - DEBUG - VN ctest-vn-36879895 is not present in Agent 10.0.0.33 
2025-10-30 00:31:21,799 - INFO - Validated that VN ctest-vn-36879895 is not in any agent
2025-10-30 00:31:21,841 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-36879895 info
2025-10-30 00:31:23,157 - DEBUG - No XMPP flaps were noticed during the test
2025-10-30 00:31:23,157 - INFO - END TEST : test_mtu_probe_intra_node : PASSED[0:03:17]
2025-10-30 00:31:23,157 - INFO - --------------------------------------------------------------------------------
2025-10-30 00:31:23,877 - INFO - Deleted project: ctest-TestMtuProbe-73498179, ID : 81b32cb2-5f13-44c5-b66e-3bacf8b7eb09