2026-03-16 02:16:07,203 - INFO - Domain Default found not creating
2026-03-16 02:16:07,371 - INFO - Project ctest-TestRoutersBasic-65498968 not found, creating it
2026-03-16 02:16:08,029 - INFO - Created Project:ctest-TestRoutersBasic-65498968, ID : bde3da21-c6e1-4873-984c-8d674fa2ff6d
2026-03-16 02:16:09,682 - INFO - ================================================================================
2026-03-16 02:16:09,682 - INFO - STARTING TEST : test_basic_snat_behavior_without_external_connectivity
2026-03-16 02:16:09,682 - INFO - TEST DESCRIPTION : Create an external network, a router
set router-gateway to external network
launch a private network and attach it to router
validate left vm pinging right vm through Snat
2026-03-16 02:16:10,974 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.193': '0', '10.20.0.129': '0'}, '10.0.0.240': {'10.20.0.193': '0', '10.20.0.129': '0'}} with
2026-03-16 02:16:10,975 - INFO - Initial checks done. Running the testcase now
2026-03-16 02:16:10,975 - INFO -
2026-03-16 02:16:11,733 - INFO - Default SG to be edited for allow all on project: ctest-TestRoutersBasic-65498968
2026-03-16 02:16:11,794 - INFO - Adding rules to the default security group in Project ctest-TestRoutersBasic-65498968
2026-03-16 02:16:12,121 - DEBUG - Reading firewall policy {'fq_name': ['default-domain', 'ctest-TestRoutersBasic-65498968', 'default']}
2026-03-16 02:16:12,573 - DEBUG - Response for create_network : {'network': {'id': '6a9af9af-ede3-4463-9394-0a5154848903', 'name': 'ctest-vn-78512236', 'tenant_id': 'bde3da21c6e14873984c8d674fa2ff6d', 'project_id': 'bde3da21c6e14873984c8d674fa2ff6d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutersBasic-65498968', 'ctest-vn-78512236'], 'port_security_enabled': True, 'description': ''}}
2026-03-16 02:16:12,841 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e78dca16-2695-4c5d-a96c-94beb9f03cf4', 'name': '', 'tenant_id': 'bde3da21c6e14873984c8d674fa2ff6d', 'network_id': '6a9af9af-ede3-4463-9394-0a5154848903', 'ip_version': 4, 'cidr': '68.170.224.192/26', 'allocation_pools': [{'start': '68.170.224.194', 'end': '68.170.224.254'}], 'gateway_ip': '68.170.224.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '68.170.224.194', 'tags': [], 'project_id': 'bde3da21c6e14873984c8d674fa2ff6d'}}
2026-03-16 02:16:12,865 - INFO - Created VN ctest-vn-78512236
2026-03-16 02:16:12,879 - DEBUG - VN ctest-vn-78512236 UUID is 6a9af9af-ede3-4463-9394-0a5154848903
2026-03-16 02:16:13,536 - DEBUG - Response for create_network : {'network': {'id': '41f34446-70d4-420f-94c4-3da57117440e', 'name': 'ctest-ext_vn-95879601', 'tenant_id': 'bde3da21c6e14873984c8d674fa2ff6d', 'project_id': 'bde3da21c6e14873984c8d674fa2ff6d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': True, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutersBasic-65498968', 'ctest-ext_vn-95879601'], 'port_security_enabled': True, 'description': ''}}
2026-03-16 02:16:13,809 - DEBUG - Response for create_subnet : {'subnet': {'id': '8fcd83c1-a20c-464d-811b-3c80873765a5', 'name': '', 'tenant_id': 'bde3da21c6e14873984c8d674fa2ff6d', 'network_id': '41f34446-70d4-420f-94c4-3da57117440e', 'ip_version': 4, 'cidr': '134.201.58.192/26', 'allocation_pools': [{'start': '134.201.58.194', 'end': '134.201.58.254'}], 'gateway_ip': '134.201.58.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '134.201.58.194', 'tags': [], 'project_id': 'bde3da21c6e14873984c8d674fa2ff6d'}}
2026-03-16 02:16:13,837 - INFO - Created VN ctest-ext_vn-95879601
2026-03-16 02:16:13,852 - DEBUG - VN ctest-ext_vn-95879601 UUID is 41f34446-70d4-420f-94c4-3da57117440e
2026-03-16 02:16:14,027 - DEBUG - Services list from nova: [, , , ]
2026-03-16 02:16:15,144 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5469-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5469-1)
2026-03-16 02:16:16,562 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5469-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5469-2)
2026-03-16 02:16:16,675 - INFO - Setting gateway for router 71a90841-ec40-4b8a-a237-d9817b5d246e to network 41f34446-70d4-420f-94c4-3da57117440e
2026-03-16 02:16:16,764 - INFO - Adding interface with subnet_id e78dca16-2695-4c5d-a96c-94beb9f03cf4, port_id None to router 71a90841-ec40-4b8a-a237-d9817b5d246e
2026-03-16 02:16:17,269 - INFO - Waiting for VM ctest-TestRoutersBasic-65498968-24028934 to be up..
2026-03-16 02:16:17,504 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-16 02:16:22,599 - DEBUG - VM is in ACTIVE state now
2026-03-16 02:16:22,599 - INFO - VM name : ctest-TestRoutersBasic-65498968-24028934
2026-03-16 02:16:22,680 - DEBUG - VM ctest-TestRoutersBasic-65498968-24028934 ID is 63399756-184b-4aed-ae75-582f7a169800
2026-03-16 02:16:22,703 - DEBUG - VM ctest-TestRoutersBasic-65498968-24028934 launched on Node an-jenkins-deploy-platform-ansible-os-5469-1
2026-03-16 02:16:22,789 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/63399756-184b-4aed-ae75-582f7a169800
2026-03-16 02:16:23,088 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/63399756-184b-4aed-ae75-582f7a169800
2026-03-16 02:16:23,125 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/55e5e5b2-62b6-409d-9a59-6140f48e599f
2026-03-16 02:16:26,312 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms')
2026-03-16 02:16:26,312 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutersBasic-65498968-24028934 failed!
2026-03-16 02:16:26,329 - DEBUG - Gateway for vn default-domain:ctest-TestRoutersBasic-65498968:ctest-vn-78512236 is 68.170.224.193 and allocation pool is NOT set
2026-03-16 02:16:28,392 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.90 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.440 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.440/1.669/2.898/1.229 ms')
2026-03-16 02:16:28,392 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutersBasic-65498968-24028934 passed
2026-03-16 02:16:28,462 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 02:16:28,462 - DEBUG - Waiting to SSH to VM ctest-TestRoutersBasic-65498968-24028934, IP 68.170.224.195, Port 22
2026-03-16 02:16:28,631 - DEBUG - VM ctest-TestRoutersBasic-65498968-24028934 is ready for SSH connections
2026-03-16 02:16:28,631 - INFO - Waiting for VM ctest-TestRoutersBasic-65498968-54682998 to be up..
2026-03-16 02:16:28,716 - DEBUG - VM is in ACTIVE state now
2026-03-16 02:16:28,716 - INFO - VM name : ctest-TestRoutersBasic-65498968-54682998
2026-03-16 02:16:28,794 - DEBUG - VM ctest-TestRoutersBasic-65498968-54682998 ID is e1a15687-13fc-4088-9b1d-928130064313
2026-03-16 02:16:28,794 - DEBUG - VM ctest-TestRoutersBasic-65498968-54682998 launched on Node an-jenkins-deploy-platform-ansible-os-5469-2
2026-03-16 02:16:28,877 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e1a15687-13fc-4088-9b1d-928130064313
2026-03-16 02:16:28,891 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/08194f27-8ba1-416e-af74-c48f499480e7
2026-03-16 02:16:30,061 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.15 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.09 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.086/2.620/3.154/0.534 ms')
2026-03-16 02:16:30,062 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutersBasic-65498968-54682998 passed
2026-03-16 02:16:30,137 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 02:16:30,137 - DEBUG - Waiting to SSH to VM ctest-TestRoutersBasic-65498968-54682998, IP 134.201.58.195, Port 22
2026-03-16 02:16:30,194 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-16 02:16:30,280 - DEBUG - VM ctest-TestRoutersBasic-65498968-54682998 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-16 02:16:35,281 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 02:16:35,281 - DEBUG - Waiting to SSH to VM ctest-TestRoutersBasic-65498968-54682998, IP 134.201.58.195, Port 22
2026-03-16 02:16:35,448 - DEBUG - VM ctest-TestRoutersBasic-65498968-54682998 is ready for SSH connections
2026-03-16 02:16:35,449 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 02:16:35,449 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 134.201.58.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-03-16 02:16:35,449 - DEBUG - ping -s 56 -c 3 -W 1 134.201.58.195
2026-03-16 02:16:39,147 - DEBUG - PING 134.201.58.195 (134.201.58.195): 56 data bytes
64 bytes from 134.201.58.195: seq=0 ttl=62 time=8.414 ms
64 bytes from 134.201.58.195: seq=1 ttl=62 time=1.387 ms
64 bytes from 134.201.58.195: seq=2 ttl=62 time=1.402 ms
--- 134.201.58.195 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.387/3.734/8.414 ms
2026-03-16 02:16:39,147 - INFO - Ping to IP 134.201.58.195 from VM ctest-TestRoutersBasic-65498968-24028934 passed
2026-03-16 02:16:39,148 - INFO - Deleting interface with subnet_id e78dca16-2695-4c5d-a96c-94beb9f03cf4, port_id None from router 71a90841-ec40-4b8a-a237-d9817b5d246e
2026-03-16 02:16:39,545 - INFO - Deleting VM ctest-TestRoutersBasic-65498968-54682998
2026-03-16 02:16:39,642 - INFO - Deleting VM ctest-TestRoutersBasic-65498968-24028934
2026-03-16 02:16:39,722 - INFO - Deleting VN ctest-ext_vn-95879601
2026-03-16 02:16:39,828 - DEBUG - VN 41f34446-70d4-420f-94c4-3da57117440e still in use: Unable to complete operation on network 41f34446-70d4-420f-94c4-3da57117440e. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-074a28f1-283c-4c44-9a6b-cb90a78304fc']
2026-03-16 02:16:39,828 - WARNING - Deleting VN ctest-ext_vn-95879601 failed..Will retry
2026-03-16 02:16:41,988 - DEBUG - Response for deleting network ()
2026-03-16 02:16:41,988 - INFO - Deleting VN ctest-vn-78512236
2026-03-16 02:16:42,197 - DEBUG - Response for deleting network ()
2026-03-16 02:16:43,489 - DEBUG - No XMPP flaps were noticed during the test
2026-03-16 02:16:43,489 - INFO - END TEST : test_basic_snat_behavior_without_external_connectivity : PASSED[0:00:34]
2026-03-16 02:16:43,489 - INFO - --------------------------------------------------------------------------------
2026-03-16 02:16:44,256 - INFO - Deleted project: ctest-TestRoutersBasic-65498968, ID : bde3da21-c6e1-4873-984c-8d674fa2ff6d