2025-08-02 23:14:32,112 - INFO - Domain Default found not creating
2025-08-02 23:14:32,291 - INFO - Project ctest-TestDSNAT-49076082 not found, creating it
2025-08-02 23:14:32,966 - INFO - Created Project:ctest-TestDSNAT-49076082, ID : dba5c91a-9203-4094-b232-8f09c2cea164
2025-08-02 23:14:34,484 - INFO - ================================================================================
2025-08-02 23:14:34,484 - INFO - STARTING TEST : test_dsnat_basic
2025-08-02 23:14:34,484 - INFO - TEST DESCRIPTION :
create a VN and enable fabric SNAT
launch two VMs in that VN
verify ping between the VN and ping to the external IP
disable fabric SNAT
verify that the ping the external IP fails
2025-08-02 23:14:35,852 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with
2025-08-02 23:14:35,853 - INFO - Initial checks done. Running the testcase now
2025-08-02 23:14:35,853 - INFO -
2025-08-02 23:14:35,853 - INFO - Create VN, enable FABRIC SNAT and verify its routing instance
2025-08-02 23:14:36,700 - DEBUG - Response for create_network : {'network': {'id': '2dfa39b1-ab72-412f-a4f4-2d195337db32', 'name': 'ctest-dsnat_vn-90624852', 'tenant_id': 'dba5c91a92034094b2328f09c2cea164', 'project_id': 'dba5c91a92034094b2328f09c2cea164', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDSNAT-49076082', 'ctest-dsnat_vn-90624852'], 'port_security_enabled': True, 'description': ''}}
2025-08-02 23:14:37,034 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd953a789-cc18-44ef-a588-f01c077f0321', 'name': '', 'tenant_id': 'dba5c91a92034094b2328f09c2cea164', 'network_id': '2dfa39b1-ab72-412f-a4f4-2d195337db32', 'ip_version': 4, 'cidr': '166.160.147.128/26', 'allocation_pools': [{'start': '166.160.147.130', 'end': '166.160.147.190'}], 'gateway_ip': '166.160.147.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '166.160.147.130', 'tags': [], 'project_id': 'dba5c91a92034094b2328f09c2cea164'}}
2025-08-02 23:14:37,069 - INFO - Created VN ctest-dsnat_vn-90624852
2025-08-02 23:14:37,090 - DEBUG - VN ctest-dsnat_vn-90624852 UUID is 2dfa39b1-ab72-412f-a4f4-2d195337db32
2025-08-02 23:14:37,309 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2dfa39b1-ab72-412f-a4f4-2d195337db32
2025-08-02 23:14:37,619 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2dfa39b1-ab72-412f-a4f4-2d195337db32
2025-08-02 23:14:37,660 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/01279fdb-039e-49b5-9ec3-03fea5cb8bca
2025-08-02 23:14:37,818 - DEBUG - Services list from nova: [, , , ]
2025-08-02 23:14:37,840 - DEBUG - Image by name ubuntu not found
2025-08-02 23:14:37,841 - DEBUG - Installing image ubuntu
2025-08-02 23:14:37,841 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-08-02 23:14:37,841 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//ubuntu.vmdk.gz
2025-08-02 23:14:37,841 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//ubuntu.vmdk.gz
2025-08-02 23:14:37,852 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//ubuntu.vmdk.gz -O /contrail-test/images/ubuntu.vmdk.gz
2025-08-02 23:14:37,882 - DEBUG - Image has been downloaded to /contrail-test/images/ubuntu.vmdk.gz
2025-08-02 23:14:37,882 - DEBUG - Unzip image
2025-08-02 23:14:37,882 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz
2025-08-02 23:14:37,893 - INFO - image /contrail-test/images/ubuntu.vmdk is not found
2025-08-02 23:14:37,894 - INFO - Deleting VN ctest-dsnat_vn-90624852
2025-08-02 23:14:38,154 - DEBUG - Response for deleting network ()
2025-08-02 23:14:39,545 - DEBUG - No XMPP flaps were noticed during the test
2025-08-02 23:14:39,545 - INFO -
2025-08-02 23:14:39,545 - INFO - END TEST : test_dsnat_basic : SKIPPED[0:00:05]
2025-08-02 23:14:39,545 - INFO - --------------------------------------------------------------------------------
2025-08-02 23:14:39,548 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']}
2025-08-02 23:14:39,548 - INFO - ================================================================================
2025-08-02 23:14:39,548 - INFO - STARTING TEST : test_dsnat_bug_1749695
2025-08-02 23:14:39,548 - INFO - TEST DESCRIPTION :
Testcase to verify the bug 1749695
create test VN , associate a policy to allow all traffic between VN and ip fabric
associate the policy to the test VN and fabric VN
set the test VN fabric mode as l3
verify the ping succeeds for intra VN and to the fabric IP
2025-08-02 23:14:40,906 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with
2025-08-02 23:14:40,906 - INFO - Initial checks done. Running the testcase now
2025-08-02 23:14:40,906 - INFO -
2025-08-02 23:14:40,906 - INFO - Create VN, enable FABRIC SNAT and verify its routing instance
2025-08-02 23:14:41,324 - DEBUG - Response for create_network : {'network': {'id': '890659c7-6a50-43fb-8574-a77ae85b6a39', 'name': 'ctest-dsnat_vn-88811629', 'tenant_id': 'dba5c91a92034094b2328f09c2cea164', 'project_id': 'dba5c91a92034094b2328f09c2cea164', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDSNAT-49076082', 'ctest-dsnat_vn-88811629'], 'port_security_enabled': True, 'description': ''}}
2025-08-02 23:14:41,651 - DEBUG - Response for create_subnet : {'subnet': {'id': '625fca13-a1ce-43a1-848e-f50bc74fe523', 'name': '', 'tenant_id': 'dba5c91a92034094b2328f09c2cea164', 'network_id': '890659c7-6a50-43fb-8574-a77ae85b6a39', 'ip_version': 4, 'cidr': '50.179.98.64/26', 'allocation_pools': [{'start': '50.179.98.66', 'end': '50.179.98.126'}], 'gateway_ip': '50.179.98.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '50.179.98.66', 'tags': [], 'project_id': 'dba5c91a92034094b2328f09c2cea164'}}
2025-08-02 23:14:41,691 - INFO - Created VN ctest-dsnat_vn-88811629
2025-08-02 23:14:41,724 - DEBUG - VN ctest-dsnat_vn-88811629 UUID is 890659c7-6a50-43fb-8574-a77ae85b6a39
2025-08-02 23:14:42,081 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/890659c7-6a50-43fb-8574-a77ae85b6a39
2025-08-02 23:14:42,104 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/62c6d6c4-f034-4f71-a725-4cb2684ed366
2025-08-02 23:14:42,295 - DEBUG - Image by name ubuntu-traffic not found
2025-08-02 23:14:42,296 - DEBUG - Installing image ubuntu-traffic
2025-08-02 23:14:42,296 - DEBUG - Image info {'name': 'ubuntu-traffic.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_small', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'ubuntu-traffic-docker', 'vmdk': 'ubuntu-traffic-disk1.vmdk', 'shrinked_vmdk': "'no'"}
2025-08-02 23:14:42,296 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//ubuntu-traffic.vmdk.gz
2025-08-02 23:14:42,297 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//ubuntu-traffic.vmdk.gz
2025-08-02 23:14:42,333 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//ubuntu-traffic.vmdk.gz -O /contrail-test/images/ubuntu-traffic.vmdk.gz
2025-08-02 23:14:47,523 - DEBUG - Image has been downloaded to /contrail-test/images/ubuntu-traffic.vmdk.gz
2025-08-02 23:14:47,524 - DEBUG - Unzip image
2025-08-02 23:14:47,525 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu-traffic.vmdk.gz
2025-08-02 23:15:05,723 - DEBUG - Try to create image in user context
2025-08-02 23:15:15,987 - DEBUG - Image has been created in user context
2025-08-02 23:15:15,987 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/ubuntu-traffic.vmdk
2025-08-02 23:15:16,199 - DEBUG - Downloaded image has been removed
2025-08-02 23:15:16,213 - DEBUG - Uploaded image status = active
2025-08-02 23:15:17,421 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-1)
2025-08-02 23:15:18,826 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-2)
2025-08-02 23:15:18,827 - INFO - Waiting for VM ctest-TestDSNAT-49076082-28752293 to be up..
2025-08-02 23:15:19,032 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:15:24,217 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:15:29,395 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:15:34,572 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:15:39,717 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:15:44,872 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:15:49,982 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:15:55,083 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:16:00,207 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:16:05,307 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:16:10,435 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:16:15,552 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:16:20,666 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:16:25,768 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-02 23:16:30,863 - DEBUG - VM is in ACTIVE state now
2025-08-02 23:16:30,863 - INFO - VM name : ctest-TestDSNAT-49076082-28752293
2025-08-02 23:16:31,009 - DEBUG - VM ctest-TestDSNAT-49076082-28752293 ID is 951d5413-c05f-487d-bf30-f5b21d635205
2025-08-02 23:16:31,055 - DEBUG - VM ctest-TestDSNAT-49076082-28752293 launched on Node an-jenkins-deploy-platform-ansible-os-3743-1
2025-08-02 23:16:31,173 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/951d5413-c05f-487d-bf30-f5b21d635205
2025-08-02 23:16:31,476 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/951d5413-c05f-487d-bf30-f5b21d635205
2025-08-02 23:16:31,513 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/84cb34cc-a069-4f25-b5ef-228f63277e14
2025-08-02 23:16:34,785 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms')
2025-08-02 23:16:34,786 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-49076082-28752293 failed!
2025-08-02 23:16:34,825 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-49076082:ctest-dsnat_vn-88811629 is 50.179.98.65 and allocation pool is NOT set
2025-08-02 23:16:38,920 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms')
2025-08-02 23:16:38,920 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-49076082-28752293 failed!
2025-08-02 23:16:38,954 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-49076082:ctest-dsnat_vn-88811629 is 50.179.98.65 and allocation pool is NOT set
2025-08-02 23:16:43,042 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms')
2025-08-02 23:16:43,042 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-49076082-28752293 failed!
2025-08-02 23:16:43,074 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-49076082:ctest-dsnat_vn-88811629 is 50.179.98.65 and allocation pool is NOT set
2025-08-02 23:16:47,147 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2025-08-02 23:16:47,148 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-49076082-28752293 failed!
2025-08-02 23:16:47,177 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-49076082:ctest-dsnat_vn-88811629 is 50.179.98.65 and allocation pool is NOT set
2025-08-02 23:16:51,276 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2025-08-02 23:16:51,276 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-49076082-28752293 failed!
2025-08-02 23:16:51,298 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-49076082:ctest-dsnat_vn-88811629 is 50.179.98.65 and allocation pool is NOT set
2025-08-02 23:16:55,365 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms')
2025-08-02 23:16:55,365 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-49076082-28752293 failed!
2025-08-02 23:16:55,415 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-49076082:ctest-dsnat_vn-88811629 is 50.179.98.65 and allocation pool is NOT set
2025-08-02 23:16:59,489 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-08-02 23:16:59,489 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-49076082-28752293 failed!
2025-08-02 23:16:59,523 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-49076082:ctest-dsnat_vn-88811629 is 50.179.98.65 and allocation pool is NOT set
2025-08-02 23:17:03,595 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2025-08-02 23:17:03,595 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-49076082-28752293 failed!
2025-08-02 23:17:03,631 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-49076082:ctest-dsnat_vn-88811629 is 50.179.98.65 and allocation pool is NOT set
2025-08-02 23:17:07,719 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=6.90 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1027ms\r\nrtt min/avg/max/mdev = 6.897/6.897/6.897/0.000 ms')
2025-08-02 23:17:07,719 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-49076082-28752293 passed
2025-08-02 23:17:07,873 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-02 23:17:07,873 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-49076082-28752293, IP 50.179.98.67, Port 22
2025-08-02 23:17:07,946 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-02 23:17:08,057 - DEBUG - VM ctest-TestDSNAT-49076082-28752293 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-02 23:17:13,058 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-02 23:17:13,058 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-49076082-28752293, IP 50.179.98.67, Port 22
2025-08-02 23:17:13,116 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-02 23:17:13,230 - DEBUG - VM ctest-TestDSNAT-49076082-28752293 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-02 23:17:18,231 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-02 23:17:18,232 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-49076082-28752293, IP 50.179.98.67, Port 22
2025-08-02 23:17:18,299 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-02 23:17:18,423 - DEBUG - VM ctest-TestDSNAT-49076082-28752293 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-02 23:17:23,423 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-02 23:17:23,424 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-49076082-28752293, IP 50.179.98.67, Port 22
2025-08-02 23:17:23,481 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-02 23:17:23,611 - DEBUG - VM ctest-TestDSNAT-49076082-28752293 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-02 23:17:28,612 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-02 23:17:28,612 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-49076082-28752293, IP 50.179.98.67, Port 22
2025-08-02 23:17:28,786 - DEBUG - VM ctest-TestDSNAT-49076082-28752293 is ready for SSH connections
2025-08-02 23:17:28,787 - INFO - Waiting for VM ctest-TestDSNAT-49076082-02560784 to be up..
2025-08-02 23:17:28,900 - DEBUG - VM is in ACTIVE state now
2025-08-02 23:17:28,900 - INFO - VM name : ctest-TestDSNAT-49076082-02560784
2025-08-02 23:17:29,004 - DEBUG - VM ctest-TestDSNAT-49076082-02560784 ID is 4e0c018d-40a5-4d64-8a6f-db0c3ef2354e
2025-08-02 23:17:29,004 - DEBUG - VM ctest-TestDSNAT-49076082-02560784 launched on Node an-jenkins-deploy-platform-ansible-os-3743-2
2025-08-02 23:17:29,126 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/4e0c018d-40a5-4d64-8a6f-db0c3ef2354e
2025-08-02 23:17:29,149 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/97ed267f-3b5d-475b-96ce-8cc0232b66c7
2025-08-02 23:17:30,399 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=1.87 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.398 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.398/1.132/1.867/0.734 ms')
2025-08-02 23:17:30,400 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-49076082-02560784 passed
2025-08-02 23:17:30,551 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-02 23:17:30,551 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-49076082-02560784, IP 50.179.98.68, Port 22
2025-08-02 23:17:30,720 - DEBUG - VM ctest-TestDSNAT-49076082-02560784 is ready for SSH connections
2025-08-02 23:17:30,905 - DEBUG - Fetched VN: default-domain:default-project:ip-fabric(9df43027-c8a6-44db-9402-68e772079a83) with subnets None
2025-08-02 23:17:30,962 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDSNAT-49076082:ctest-dsnat_vn-88811629, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:default-project:ip-fabric, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2025-08-02 23:17:31,449 - INFO - Attaching policy ctest-test-dsnat-06116611 to vn ctest-dsnat_vn-88811629
2025-08-02 23:17:32,046 - INFO - Attaching policy ctest-test-dsnat-06116611 to vn ip-fabric
2025-08-02 23:17:32,373 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.17, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-02 23:17:32,373 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.17
2025-08-02 23:17:50,179 - DEBUG - PING 10.20.0.17 (10.20.0.17) 56(84) bytes of data.
64 bytes from 10.20.0.17: icmp_req=1 ttl=62 time=3.14 ms
64 bytes from 10.20.0.17: icmp_req=2 ttl=62 time=0.732 ms
64 bytes from 10.20.0.17: icmp_req=3 ttl=62 time=0.736 ms
--- 10.20.0.17 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.732/1.537/3.144/1.136 ms
2025-08-02 23:17:50,180 - INFO - Ping to IP 10.20.0.17 from VM ctest-TestDSNAT-49076082-28752293 passed
2025-08-02 23:17:50,320 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.17, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-02 23:17:50,320 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.17
2025-08-02 23:17:53,865 - DEBUG - PING 10.20.0.17 (10.20.0.17) 56(84) bytes of data.
--- 10.20.0.17 ping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 2001ms
2025-08-02 23:17:53,866 - WARNING - Ping to IP 10.20.0.17 from VM ctest-TestDSNAT-49076082-28752293 failed
2025-08-02 23:17:54,866 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.17, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-02 23:17:54,867 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.17
2025-08-02 23:17:58,373 - DEBUG - PING 10.20.0.17 (10.20.0.17) 56(84) bytes of data.
--- 10.20.0.17 ping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 2017ms
2025-08-02 23:17:58,373 - WARNING - Ping to IP 10.20.0.17 from VM ctest-TestDSNAT-49076082-28752293 failed
2025-08-02 23:17:59,374 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.17, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-02 23:17:59,374 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.17
2025-08-02 23:18:02,852 - DEBUG - PING 10.20.0.17 (10.20.0.17) 56(84) bytes of data.
--- 10.20.0.17 ping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 2016ms
2025-08-02 23:18:02,852 - WARNING - Ping to IP 10.20.0.17 from VM ctest-TestDSNAT-49076082-28752293 failed
2025-08-02 23:18:03,853 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.17, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-02 23:18:03,854 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.17
2025-08-02 23:18:07,353 - DEBUG - PING 10.20.0.17 (10.20.0.17) 56(84) bytes of data.
--- 10.20.0.17 ping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 2015ms
2025-08-02 23:18:07,353 - WARNING - Ping to IP 10.20.0.17 from VM ctest-TestDSNAT-49076082-28752293 failed
2025-08-02 23:18:08,354 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.17, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-02 23:18:08,354 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.17
2025-08-02 23:18:11,827 - DEBUG - PING 10.20.0.17 (10.20.0.17) 56(84) bytes of data.
--- 10.20.0.17 ping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 2016ms
2025-08-02 23:18:11,827 - WARNING - Ping to IP 10.20.0.17 from VM ctest-TestDSNAT-49076082-28752293 failed
2025-08-02 23:18:12,828 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.17, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-02 23:18:12,828 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.17
2025-08-02 23:18:15,295 - DEBUG - PING 10.20.0.17 (10.20.0.17) 56(84) bytes of data.
64 bytes from 10.20.0.17: icmp_req=1 ttl=62 time=1.93 ms
64 bytes from 10.20.0.17: icmp_req=2 ttl=62 time=0.693 ms
64 bytes from 10.20.0.17: icmp_req=3 ttl=62 time=1.06 ms
--- 10.20.0.17 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 0.693/1.229/1.933/0.519 ms
2025-08-02 23:18:15,295 - INFO - Ping to IP 10.20.0.17 from VM ctest-TestDSNAT-49076082-28752293 passed
2025-08-02 23:18:15,295 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-02 23:18:15,295 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 50.179.98.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-02 23:18:15,295 - DEBUG - ping -s 56 -c 3 -W 1 50.179.98.68
2025-08-02 23:18:17,777 - DEBUG - PING 50.179.98.68 (50.179.98.68) 56(84) bytes of data.
64 bytes from 50.179.98.68: icmp_req=1 ttl=63 time=11.3 ms
64 bytes from 50.179.98.68: icmp_req=2 ttl=63 time=1.57 ms
64 bytes from 50.179.98.68: icmp_req=3 ttl=63 time=1.14 ms
--- 50.179.98.68 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 1.147/4.706/11.399/4.736 ms
2025-08-02 23:18:17,777 - INFO - Ping to IP 50.179.98.68 from VM ctest-TestDSNAT-49076082-28752293 passed
2025-08-02 23:18:17,777 - INFO - Dettaching policy ctest-test-dsnat-06116611 from vn ip-fabric
2025-08-02 23:18:18,037 - INFO - Dettaching policy ctest-test-dsnat-06116611 from vn ctest-dsnat_vn-88811629
2025-08-02 23:18:18,296 - INFO - Deleted policy ctest-test-dsnat-06116611
2025-08-02 23:18:18,296 - INFO - Deleting VM ctest-TestDSNAT-49076082-02560784
2025-08-02 23:18:18,387 - INFO - Deleting VM ctest-TestDSNAT-49076082-28752293
2025-08-02 23:18:18,461 - INFO - Deleting VN ctest-dsnat_vn-88811629
2025-08-02 23:18:18,556 - DEBUG - VN 890659c7-6a50-43fb-8574-a77ae85b6a39 still in use: Unable to complete operation on network 890659c7-6a50-43fb-8574-a77ae85b6a39. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-eb643ff3-0d5b-44a9-8228-fd918bb85366']
2025-08-02 23:18:18,556 - WARNING - Deleting VN ctest-dsnat_vn-88811629 failed..Will retry
2025-08-02 23:18:20,847 - DEBUG - Response for deleting network ()
2025-08-02 23:18:22,234 - DEBUG - No XMPP flaps were noticed during the test
2025-08-02 23:18:22,234 - INFO - END TEST : test_dsnat_bug_1749695 : PASSED[0:03:43]
2025-08-02 23:18:22,234 - INFO - --------------------------------------------------------------------------------
2025-08-02 23:18:23,171 - INFO - Deleted project: ctest-TestDSNAT-49076082, ID : dba5c91a-9203-4094-b232-8f09c2cea164
2025-08-03 00:48:50,995 - INFO - Domain Default found not creating
2025-08-03 00:48:51,168 - INFO - Project ctest-TestDSNAT-91891612 not found, creating it
2025-08-03 00:48:51,767 - INFO - Created Project:ctest-TestDSNAT-91891612, ID : 7f3cd9cb-2b22-4fd5-976c-febfc10341e9
2025-08-03 00:48:53,314 - DEBUG - Services list from nova: [, , , ]
2025-08-03 00:48:53,314 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']}
2025-08-03 00:48:53,314 - INFO - ================================================================================
2025-08-03 00:48:53,314 - INFO - STARTING TEST : test_dsnat_tcp_basic
2025-08-03 00:48:53,314 - INFO - TEST DESCRIPTION :
Configure TCP port translation pool
send TCP traffic from the VM to the fabric IP
Verify the Port address translation happened and the
port being used in the range of configured
2025-08-03 00:48:54,685 - DEBUG - Skipping xmpp flap check
2025-08-03 00:48:54,686 - INFO - Initial checks done. Running the testcase now
2025-08-03 00:48:54,686 - INFO -
2025-08-03 00:48:55,173 - INFO - Create VN, enable FABRIC SNAT and verify its routing instance
2025-08-03 00:48:55,639 - DEBUG - Response for create_network : {'network': {'id': 'dc4fc652-5802-4d82-9e0a-4533af0b45b6', 'name': 'ctest-dsnat_vn-43301258', 'tenant_id': '7f3cd9cb2b224fd5976cfebfc10341e9', 'project_id': '7f3cd9cb2b224fd5976cfebfc10341e9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDSNAT-91891612', 'ctest-dsnat_vn-43301258'], 'port_security_enabled': True, 'description': ''}}
2025-08-03 00:48:56,002 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a6e7efe3-0167-4dc6-9ec0-d1ee2fa1f29c', 'name': '', 'tenant_id': '7f3cd9cb2b224fd5976cfebfc10341e9', 'network_id': 'dc4fc652-5802-4d82-9e0a-4533af0b45b6', 'ip_version': 4, 'cidr': '27.18.205.192/26', 'allocation_pools': [{'start': '27.18.205.194', 'end': '27.18.205.254'}], 'gateway_ip': '27.18.205.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '27.18.205.194', 'tags': [], 'project_id': '7f3cd9cb2b224fd5976cfebfc10341e9'}}
2025-08-03 00:48:56,037 - INFO - Created VN ctest-dsnat_vn-43301258
2025-08-03 00:48:56,051 - DEBUG - VN ctest-dsnat_vn-43301258 UUID is dc4fc652-5802-4d82-9e0a-4533af0b45b6
2025-08-03 00:48:56,306 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/dc4fc652-5802-4d82-9e0a-4533af0b45b6
2025-08-03 00:48:56,611 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/dc4fc652-5802-4d82-9e0a-4533af0b45b6
2025-08-03 00:48:56,660 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/532d30cf-5014-4699-89df-debea288d161
2025-08-03 00:48:57,914 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-1)
2025-08-03 00:48:59,359 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-2)
2025-08-03 00:48:59,360 - INFO - Waiting for VM ctest-dsnat-vm1-33148125 to be up..
2025-08-03 00:48:59,476 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-03 00:49:04,805 - DEBUG - VM is in ACTIVE state now
2025-08-03 00:49:04,805 - INFO - VM name : ctest-dsnat-vm1-33148125
2025-08-03 00:49:04,944 - DEBUG - VM ctest-dsnat-vm1-33148125 ID is 852d11bb-cd1b-4b02-916b-268481164dd1
2025-08-03 00:49:04,976 - DEBUG - VM ctest-dsnat-vm1-33148125 launched on Node an-jenkins-deploy-platform-ansible-os-3743-1
2025-08-03 00:49:05,080 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/852d11bb-cd1b-4b02-916b-268481164dd1
2025-08-03 00:49:05,385 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/852d11bb-cd1b-4b02-916b-268481164dd1
2025-08-03 00:49:05,437 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/0136b236-c672-478e-aae5-bd9653f3ddec
2025-08-03 00:49:08,681 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms')
2025-08-03 00:49:08,681 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-dsnat-vm1-33148125 failed!
2025-08-03 00:49:08,714 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-91891612:ctest-dsnat_vn-43301258 is 27.18.205.193 and allocation pool is NOT set
2025-08-03 00:49:12,810 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2025-08-03 00:49:12,810 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-dsnat-vm1-33148125 failed!
2025-08-03 00:49:12,844 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-91891612:ctest-dsnat_vn-43301258 is 27.18.205.193 and allocation pool is NOT set
2025-08-03 00:49:16,940 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms')
2025-08-03 00:49:16,940 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-dsnat-vm1-33148125 failed!
2025-08-03 00:49:16,972 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-91891612:ctest-dsnat_vn-43301258 is 27.18.205.193 and allocation pool is NOT set
2025-08-03 00:49:21,057 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2025-08-03 00:49:21,057 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-dsnat-vm1-33148125 failed!
2025-08-03 00:49:21,091 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-91891612:ctest-dsnat_vn-43301258 is 27.18.205.193 and allocation pool is NOT set
2025-08-03 00:49:25,162 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2025-08-03 00:49:25,162 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-dsnat-vm1-33148125 failed!
2025-08-03 00:49:25,198 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-91891612:ctest-dsnat_vn-43301258 is 27.18.205.193 and allocation pool is NOT set
2025-08-03 00:49:29,284 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms')
2025-08-03 00:49:29,284 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-dsnat-vm1-33148125 failed!
2025-08-03 00:49:29,319 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-91891612:ctest-dsnat_vn-43301258 is 27.18.205.193 and allocation pool is NOT set
2025-08-03 00:49:33,416 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms')
2025-08-03 00:49:33,416 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-dsnat-vm1-33148125 failed!
2025-08-03 00:49:33,437 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-91891612:ctest-dsnat_vn-43301258 is 27.18.205.193 and allocation pool is NOT set
2025-08-03 00:49:37,514 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=6.36 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1010ms\r\nrtt min/avg/max/mdev = 6.363/6.363/6.363/0.000 ms')
2025-08-03 00:49:37,514 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-dsnat-vm1-33148125 passed
2025-08-03 00:49:37,619 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:49:37,619 - DEBUG - Waiting to SSH to VM ctest-dsnat-vm1-33148125, IP 27.18.205.195, Port 22
2025-08-03 00:49:37,686 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:49:37,811 - DEBUG - VM ctest-dsnat-vm1-33148125 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:49:42,812 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:49:42,812 - DEBUG - Waiting to SSH to VM ctest-dsnat-vm1-33148125, IP 27.18.205.195, Port 22
2025-08-03 00:49:42,867 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:49:43,002 - DEBUG - VM ctest-dsnat-vm1-33148125 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:49:48,003 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:49:48,003 - DEBUG - Waiting to SSH to VM ctest-dsnat-vm1-33148125, IP 27.18.205.195, Port 22
2025-08-03 00:49:48,068 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:49:48,192 - DEBUG - VM ctest-dsnat-vm1-33148125 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:49:53,192 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:49:53,192 - DEBUG - Waiting to SSH to VM ctest-dsnat-vm1-33148125, IP 27.18.205.195, Port 22
2025-08-03 00:49:53,251 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-03 00:49:53,356 - DEBUG - VM ctest-dsnat-vm1-33148125 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-03 00:49:58,357 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:49:58,357 - DEBUG - Waiting to SSH to VM ctest-dsnat-vm1-33148125, IP 27.18.205.195, Port 22
2025-08-03 00:49:58,515 - DEBUG - VM ctest-dsnat-vm1-33148125 is ready for SSH connections
2025-08-03 00:49:58,515 - INFO - Waiting for VM ctest-dsnat-vm2-11088239 to be up..
2025-08-03 00:49:58,624 - DEBUG - VM is in ACTIVE state now
2025-08-03 00:49:58,624 - INFO - VM name : ctest-dsnat-vm2-11088239
2025-08-03 00:49:58,725 - DEBUG - VM ctest-dsnat-vm2-11088239 ID is 9d2a6618-9ffc-44c1-b797-3d1e1856edd5
2025-08-03 00:49:58,725 - DEBUG - VM ctest-dsnat-vm2-11088239 launched on Node an-jenkins-deploy-platform-ansible-os-3743-2
2025-08-03 00:49:58,839 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/9d2a6618-9ffc-44c1-b797-3d1e1856edd5
2025-08-03 00:49:58,859 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/86ebe868-ef1c-4b58-85b3-f736d99b6aed
2025-08-03 00:50:00,073 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.43 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.60 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.601/4.014/5.428/1.413 ms')
2025-08-03 00:50:00,074 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-dsnat-vm2-11088239 passed
2025-08-03 00:50:00,177 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-03 00:50:00,178 - DEBUG - Waiting to SSH to VM ctest-dsnat-vm2-11088239, IP 27.18.205.196, Port 22
2025-08-03 00:50:00,344 - DEBUG - VM ctest-dsnat-vm2-11088239 is ready for SSH connections
2025-08-03 00:50:00,459 - DEBUG - command output is cat: /tmp/iperf_server_ctest-random-71885283.pid: No such file or directory
kill: usage: kill [-s sigspec | -n signum | -sigspec] pid | jobspec ... or kill -l [sigspec]
2025-08-03 00:50:00,570 - DEBUG - command output is
2025-08-03 00:50:00,570 - INFO - Starting Iperf3 on ctest-dsnat-vm1-33148125, args: --port 6201 --length 1048576 --time 10
2025-08-03 00:50:00,570 - DEBUG - Iperf3 cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result
2025-08-03 00:50:00,570 - INFO - Excecuting cmds, ['iperf3 -s --port 6201 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result'], on server 10.0.0.49
2025-08-03 00:50:00,672 - DEBUG - command output is ['']
2025-08-03 00:50:00,672 - DEBUG - Running remote_cmd, Cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:50:00,672 - DEBUG - nohup iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result & echo $! > /tmp/iperf_client_ctest-random-71885283.pid
2025-08-03 00:50:17,953 - DEBUG - None
2025-08-03 00:50:21,251 - DEBUG - Returns multiple flows, [], matching flow data as list of tuples
2025-08-03 00:50:21,320 - DEBUG - command output is /bin/bash: line 1: kill: (60292) - No such process
2025-08-03 00:50:21,436 - DEBUG - command output is
2025-08-03 00:50:21,436 - INFO - Nat port being used for the flow is []
2025-08-03 00:50:26,504 - DEBUG - command output is /bin/bash: line 1: kill: (60292) - No such process
2025-08-03 00:50:26,623 - DEBUG - command output is
2025-08-03 00:50:26,623 - INFO - Starting Iperf3 on ctest-dsnat-vm1-33148125, args: --port 6201 --length 1048576 --time 10
2025-08-03 00:50:26,623 - DEBUG - Iperf3 cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result
2025-08-03 00:50:26,623 - INFO - Excecuting cmds, ['iperf3 -s --port 6201 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result'], on server 10.0.0.49
2025-08-03 00:50:26,720 - DEBUG - command output is ['']
2025-08-03 00:50:26,720 - DEBUG - Running remote_cmd, Cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:50:26,720 - DEBUG - nohup iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result & echo $! > /tmp/iperf_client_ctest-random-71885283.pid
2025-08-03 00:50:27,176 - DEBUG - None
2025-08-03 00:50:30,468 - DEBUG - Returns multiple flows, [], matching flow data as list of tuples
2025-08-03 00:50:30,537 - DEBUG - command output is /bin/bash: line 1: kill: (60413) - No such process
2025-08-03 00:50:30,650 - DEBUG - command output is
2025-08-03 00:50:30,650 - INFO - Nat port being used for the flow is []
2025-08-03 00:50:35,719 - DEBUG - command output is /bin/bash: line 1: kill: (60413) - No such process
2025-08-03 00:50:35,834 - DEBUG - command output is
2025-08-03 00:50:35,834 - INFO - Starting Iperf3 on ctest-dsnat-vm1-33148125, args: --port 6201 --length 1048576 --time 10
2025-08-03 00:50:35,834 - DEBUG - Iperf3 cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result
2025-08-03 00:50:35,834 - INFO - Excecuting cmds, ['iperf3 -s --port 6201 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result'], on server 10.0.0.49
2025-08-03 00:50:35,936 - DEBUG - command output is ['']
2025-08-03 00:50:35,936 - DEBUG - Running remote_cmd, Cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:50:35,936 - DEBUG - nohup iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result & echo $! > /tmp/iperf_client_ctest-random-71885283.pid
2025-08-03 00:50:36,353 - DEBUG - None
2025-08-03 00:50:39,648 - DEBUG - Returns multiple flows, [], matching flow data as list of tuples
2025-08-03 00:50:39,716 - DEBUG - command output is /bin/bash: line 1: kill: (60462) - No such process
2025-08-03 00:50:39,820 - DEBUG - command output is
2025-08-03 00:50:39,820 - INFO - Nat port being used for the flow is []
2025-08-03 00:50:44,888 - DEBUG - command output is /bin/bash: line 1: kill: (60462) - No such process
2025-08-03 00:50:45,002 - DEBUG - command output is
2025-08-03 00:50:45,002 - INFO - Starting Iperf3 on ctest-dsnat-vm1-33148125, args: --port 6201 --length 1048576 --time 10
2025-08-03 00:50:45,002 - DEBUG - Iperf3 cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result
2025-08-03 00:50:45,002 - INFO - Excecuting cmds, ['iperf3 -s --port 6201 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result'], on server 10.0.0.49
2025-08-03 00:50:45,100 - DEBUG - command output is ['']
2025-08-03 00:50:45,101 - DEBUG - Running remote_cmd, Cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:50:45,101 - DEBUG - nohup iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result & echo $! > /tmp/iperf_client_ctest-random-71885283.pid
2025-08-03 00:50:45,525 - DEBUG - None
2025-08-03 00:50:48,871 - DEBUG - Returns multiple flows, [], matching flow data as list of tuples
2025-08-03 00:50:48,944 - DEBUG - command output is /bin/bash: line 1: kill: (60545) - No such process
2025-08-03 00:50:49,058 - DEBUG - command output is
2025-08-03 00:50:49,059 - INFO - Nat port being used for the flow is []
2025-08-03 00:50:54,128 - DEBUG - command output is /bin/bash: line 1: kill: (60545) - No such process
2025-08-03 00:50:54,246 - DEBUG - command output is
2025-08-03 00:50:54,246 - INFO - Starting Iperf3 on ctest-dsnat-vm1-33148125, args: --port 6201 --length 1048576 --time 10
2025-08-03 00:50:54,246 - DEBUG - Iperf3 cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result
2025-08-03 00:50:54,246 - INFO - Excecuting cmds, ['iperf3 -s --port 6201 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result'], on server 10.0.0.49
2025-08-03 00:50:54,343 - DEBUG - command output is ['']
2025-08-03 00:50:54,343 - DEBUG - Running remote_cmd, Cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:50:54,343 - DEBUG - nohup iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result & echo $! > /tmp/iperf_client_ctest-random-71885283.pid
2025-08-03 00:50:54,793 - DEBUG - None
2025-08-03 00:50:58,111 - DEBUG - Returns multiple flows, [], matching flow data as list of tuples
2025-08-03 00:50:58,179 - DEBUG - command output is /bin/bash: line 1: kill: (60691) - No such process
2025-08-03 00:50:58,283 - DEBUG - command output is
2025-08-03 00:50:58,283 - INFO - Nat port being used for the flow is []
2025-08-03 00:51:03,352 - DEBUG - command output is /bin/bash: line 1: kill: (60691) - No such process
2025-08-03 00:51:03,456 - DEBUG - command output is
2025-08-03 00:51:03,456 - INFO - Starting Iperf3 on ctest-dsnat-vm1-33148125, args: --port 6201 --length 1048576 --time 10
2025-08-03 00:51:03,456 - DEBUG - Iperf3 cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result
2025-08-03 00:51:03,456 - INFO - Excecuting cmds, ['iperf3 -s --port 6201 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result'], on server 10.0.0.49
2025-08-03 00:51:03,564 - DEBUG - command output is ['']
2025-08-03 00:51:03,564 - DEBUG - Running remote_cmd, Cmd : iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2025-08-03 00:51:03,564 - DEBUG - nohup iperf3 -c 10.20.0.193 --port 6201 --length 1048576 --time 10 1>/tmp/iper3_ctest-random-71885283.log 2>/tmp/iper3_ctest-random-71885283.result & echo $! > /tmp/iperf_client_ctest-random-71885283.pid
2025-08-03 00:51:04,017 - DEBUG - None
2025-08-03 00:51:07,309 - DEBUG - Returns multiple flows, [], matching flow data as list of tuples
2025-08-03 00:51:07,375 - DEBUG - command output is /bin/bash: line 1: kill: (60740) - No such process
2025-08-03 00:51:07,490 - DEBUG - command output is
2025-08-03 00:51:07,490 - INFO - Nat port being used for the flow is []
2025-08-03 00:51:07,588 - DEBUG - command output is /bin/bash: line 1: kill: (60740) - No such process
2025-08-03 00:51:07,702 - DEBUG - command output is
2025-08-03 00:51:07,702 - INFO - Deleting VM ctest-dsnat-vm2-11088239
2025-08-03 00:51:07,781 - INFO - Deleting VM ctest-dsnat-vm1-33148125
2025-08-03 00:51:07,850 - INFO - Deleting VN ctest-dsnat_vn-43301258
2025-08-03 00:51:07,918 - DEBUG - VN dc4fc652-5802-4d82-9e0a-4533af0b45b6 still in use: Unable to complete operation on network dc4fc652-5802-4d82-9e0a-4533af0b45b6. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-76f69612-8982-46a4-91b9-af040b0838fb']
2025-08-03 00:51:07,918 - WARNING - Deleting VN ctest-dsnat_vn-43301258 failed..Will retry
2025-08-03 00:51:10,206 - DEBUG - Response for deleting network ()
2025-08-03 00:51:11,549 - ERROR - AssertionError
Python 3.6.8: /usr/bin/python3
Sun Aug 3 00:51:07 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/serial_scripts/dsnat/test_dsnat.py in test_dsnat_tcp_basic(self=)
108 self.iperf = None
109
110 assert self.verify_flow_with_port(vm1_fixture, vm2_fixture, port_range, **traffic)
111
112 @preposttest_wrapper
self =
self.verify_flow_with_port = .deco_retry.....test_dsnat_tcp_basic[sanity] id=0x7f17ae217710>>
vm1_fixture =
vm2_fixture =
port_range = [65000, 65001, 65002, 65003, 65004, 65005, 65006, 65007, 65008, 65009]
traffic = {'port': 6201, 'udp': False}
AssertionError:
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ()
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/dsnat/test_dsnat.py", line 110, in test_dsnat_tcp_basic
assert self.verify_flow_with_port(vm1_fixture, vm2_fixture, port_range, **traffic)
AssertionError
2025-08-03 00:51:11,550 - DEBUG - Skipping xmpp flap check
2025-08-03 00:51:11,550 - INFO -
2025-08-03 00:51:11,550 - INFO - END TEST : test_dsnat_tcp_basic : FAILED[0:02:18]
2025-08-03 00:51:11,550 - INFO - --------------------------------------------------------------------------------
2025-08-03 00:51:12,447 - INFO - Deleted project: ctest-TestDSNAT-91891612, ID : 7f3cd9cb-2b22-4fd5-976c-febfc10341e9