2026-01-08 02:15:59,572 - INFO - Domain Default found not creating
2026-01-08 02:15:59,732 - INFO - Project ctest-TestRoutersBasic-26648880 not found, creating it
2026-01-08 02:16:00,333 - INFO - Created Project:ctest-TestRoutersBasic-26648880, ID : 67688cd5-dade-454e-a6a2-dadd9a9f4ed4
2026-01-08 02:16:01,796 - INFO - ================================================================================
2026-01-08 02:16:01,796 - INFO - STARTING TEST : test_basic_snat_behavior_without_external_connectivity
2026-01-08 02:16:01,796 - INFO - TEST DESCRIPTION : Create an external network, a router
set router-gateway to external network
launch a private network and attach it to router
validate left vm pinging right vm through Snat
2026-01-08 02:16:03,065 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.56': {'10.20.0.25': '0', '10.20.0.193': '0'}} with
2026-01-08 02:16:03,065 - INFO - Initial checks done. Running the testcase now
2026-01-08 02:16:03,065 - INFO -
2026-01-08 02:16:03,816 - INFO - Default SG to be edited for allow all on project: ctest-TestRoutersBasic-26648880
2026-01-08 02:16:03,880 - INFO - Adding rules to the default security group in Project ctest-TestRoutersBasic-26648880
2026-01-08 02:16:04,199 - DEBUG - Reading firewall policy {'fq_name': ['default-domain', 'ctest-TestRoutersBasic-26648880', 'default']}
2026-01-08 02:16:04,623 - DEBUG - Response for create_network : {'network': {'id': '62ac31ad-a3b6-4afb-818d-d16b04116891', 'name': 'ctest-vn-13099304', 'tenant_id': '67688cd5dade454ea6a2dadd9a9f4ed4', 'project_id': '67688cd5dade454ea6a2dadd9a9f4ed4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutersBasic-26648880', 'ctest-vn-13099304'], 'port_security_enabled': True, 'description': ''}}
2026-01-08 02:16:04,966 - DEBUG - Response for create_subnet : {'subnet': {'id': '057ed167-32c0-46fa-8b49-965e931ebb8a', 'name': '', 'tenant_id': '67688cd5dade454ea6a2dadd9a9f4ed4', 'network_id': '62ac31ad-a3b6-4afb-818d-d16b04116891', 'ip_version': 4, 'cidr': '158.253.180.192/26', 'allocation_pools': [{'start': '158.253.180.194', 'end': '158.253.180.254'}], 'gateway_ip': '158.253.180.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '158.253.180.194', 'tags': [], 'project_id': '67688cd5dade454ea6a2dadd9a9f4ed4'}}
2026-01-08 02:16:04,989 - INFO - Created VN ctest-vn-13099304
2026-01-08 02:16:05,002 - DEBUG - VN ctest-vn-13099304 UUID is 62ac31ad-a3b6-4afb-818d-d16b04116891
2026-01-08 02:16:05,425 - DEBUG - Response for create_network : {'network': {'id': 'd3900323-8ca5-4bac-b5b7-6cfb173ec7f5', 'name': 'ctest-ext_vn-08800332', 'tenant_id': '67688cd5dade454ea6a2dadd9a9f4ed4', 'project_id': '67688cd5dade454ea6a2dadd9a9f4ed4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': True, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutersBasic-26648880', 'ctest-ext_vn-08800332'], 'port_security_enabled': True, 'description': ''}}
2026-01-08 02:16:05,682 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c7a496e3-6012-4dd0-8ae9-3115f4297f45', 'name': '', 'tenant_id': '67688cd5dade454ea6a2dadd9a9f4ed4', 'network_id': 'd3900323-8ca5-4bac-b5b7-6cfb173ec7f5', 'ip_version': 4, 'cidr': '145.111.105.128/26', 'allocation_pools': [{'start': '145.111.105.130', 'end': '145.111.105.190'}], 'gateway_ip': '145.111.105.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '145.111.105.130', 'tags': [], 'project_id': '67688cd5dade454ea6a2dadd9a9f4ed4'}}
2026-01-08 02:16:05,702 - INFO - Created VN ctest-ext_vn-08800332
2026-01-08 02:16:05,713 - DEBUG - VN ctest-ext_vn-08800332 UUID is d3900323-8ca5-4bac-b5b7-6cfb173ec7f5
2026-01-08 02:16:05,846 - DEBUG - Services list from nova: [, , , ]
2026-01-08 02:16:06,892 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4976-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4976-2)
2026-01-08 02:16:08,235 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4976-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4976-1)
2026-01-08 02:16:08,337 - INFO - Setting gateway for router 2cadc1ff-566c-4806-acbe-f0b1b6885c62 to network d3900323-8ca5-4bac-b5b7-6cfb173ec7f5
2026-01-08 02:16:08,430 - INFO - Adding interface with subnet_id 057ed167-32c0-46fa-8b49-965e931ebb8a, port_id None to router 2cadc1ff-566c-4806-acbe-f0b1b6885c62
2026-01-08 02:16:08,907 - INFO - Waiting for VM ctest-TestRoutersBasic-26648880-91080696 to be up..
2026-01-08 02:16:09,125 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-01-08 02:16:14,219 - DEBUG - VM is in ACTIVE state now
2026-01-08 02:16:14,219 - INFO - VM name : ctest-TestRoutersBasic-26648880-91080696
2026-01-08 02:16:14,312 - DEBUG - VM ctest-TestRoutersBasic-26648880-91080696 ID is b35a1d76-e6a6-46d2-90fb-33b33244f0d3
2026-01-08 02:16:14,341 - DEBUG - VM ctest-TestRoutersBasic-26648880-91080696 launched on Node an-jenkins-deploy-platform-ansible-os-4976-2
2026-01-08 02:16:14,434 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/b35a1d76-e6a6-46d2-90fb-33b33244f0d3
2026-01-08 02:16:14,748 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/b35a1d76-e6a6-46d2-90fb-33b33244f0d3
2026-01-08 02:16:14,791 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/d6bfa48f-ec12-45f5-905d-d29a2fb72203
2026-01-08 02:16:17,993 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms')
2026-01-08 02:16:17,993 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutersBasic-26648880-91080696 failed!
2026-01-08 02:16:18,008 - DEBUG - Gateway for vn default-domain:ctest-TestRoutersBasic-26648880:ctest-vn-13099304 is 158.253.180.193 and allocation pool is NOT set
2026-01-08 02:16:20,076 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.54 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.477 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.477/2.007/3.537/1.530 ms')
2026-01-08 02:16:20,077 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutersBasic-26648880-91080696 passed
2026-01-08 02:16:20,144 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 02:16:20,144 - DEBUG - Waiting to SSH to VM ctest-TestRoutersBasic-26648880-91080696, IP 158.253.180.195, Port 22
2026-01-08 02:16:20,313 - DEBUG - VM ctest-TestRoutersBasic-26648880-91080696 is ready for SSH connections
2026-01-08 02:16:20,313 - INFO - Waiting for VM ctest-TestRoutersBasic-26648880-24070750 to be up..
2026-01-08 02:16:20,442 - DEBUG - VM is in ACTIVE state now
2026-01-08 02:16:20,442 - INFO - VM name : ctest-TestRoutersBasic-26648880-24070750
2026-01-08 02:16:20,524 - DEBUG - VM ctest-TestRoutersBasic-26648880-24070750 ID is 5e37ae77-23b3-405b-82e0-0a90d561684c
2026-01-08 02:16:20,524 - DEBUG - VM ctest-TestRoutersBasic-26648880-24070750 launched on Node an-jenkins-deploy-platform-ansible-os-4976-1
2026-01-08 02:16:20,616 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/5e37ae77-23b3-405b-82e0-0a90d561684c
2026-01-08 02:16:20,626 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/edcd502b-5287-4ded-bf3e-e4c5c9918925
2026-01-08 02:16:21,786 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=12.9 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.78 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.779/7.318/12.857/5.539 ms')
2026-01-08 02:16:21,786 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutersBasic-26648880-24070750 passed
2026-01-08 02:16:21,855 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 02:16:21,855 - DEBUG - Waiting to SSH to VM ctest-TestRoutersBasic-26648880-24070750, IP 145.111.105.131, Port 22
2026-01-08 02:16:21,923 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-01-08 02:16:22,001 - DEBUG - VM ctest-TestRoutersBasic-26648880-24070750 is NOT ready for SSH connections, VM status: ACTIVE
2026-01-08 02:16:27,002 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 02:16:27,002 - DEBUG - Waiting to SSH to VM ctest-TestRoutersBasic-26648880-24070750, IP 145.111.105.131, Port 22
2026-01-08 02:16:27,165 - DEBUG - VM ctest-TestRoutersBasic-26648880-24070750 is ready for SSH connections
2026-01-08 02:16:27,165 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 02:16:27,165 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 145.111.105.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2026-01-08 02:16:27,165 - DEBUG - ping -s 56 -c 3 -W 1 145.111.105.131
2026-01-08 02:16:30,851 - DEBUG - PING 145.111.105.131 (145.111.105.131): 56 data bytes
64 bytes from 145.111.105.131: seq=0 ttl=62 time=9.386 ms
64 bytes from 145.111.105.131: seq=1 ttl=62 time=1.537 ms
64 bytes from 145.111.105.131: seq=2 ttl=62 time=3.360 ms
--- 145.111.105.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.537/4.761/9.386 ms
2026-01-08 02:16:30,851 - INFO - Ping to IP 145.111.105.131 from VM ctest-TestRoutersBasic-26648880-91080696 passed
2026-01-08 02:16:30,851 - INFO - Deleting interface with subnet_id 057ed167-32c0-46fa-8b49-965e931ebb8a, port_id None from router 2cadc1ff-566c-4806-acbe-f0b1b6885c62
2026-01-08 02:16:31,193 - INFO - Deleting VM ctest-TestRoutersBasic-26648880-24070750
2026-01-08 02:16:31,337 - INFO - Deleting VM ctest-TestRoutersBasic-26648880-91080696
2026-01-08 02:16:31,523 - INFO - Deleting VN ctest-ext_vn-08800332
2026-01-08 02:16:31,649 - DEBUG - VN d3900323-8ca5-4bac-b5b7-6cfb173ec7f5 still in use: Unable to complete operation on network d3900323-8ca5-4bac-b5b7-6cfb173ec7f5. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-010d8520-ec33-4ae8-bd44-314c9f23206f']
2026-01-08 02:16:31,649 - WARNING - Deleting VN ctest-ext_vn-08800332 failed..Will retry
2026-01-08 02:16:33,810 - DEBUG - Response for deleting network ()
2026-01-08 02:16:33,810 - INFO - Deleting VN ctest-vn-13099304
2026-01-08 02:16:33,985 - DEBUG - Response for deleting network ()
2026-01-08 02:16:35,271 - DEBUG - No XMPP flaps were noticed during the test
2026-01-08 02:16:35,272 - INFO - END TEST : test_basic_snat_behavior_without_external_connectivity : PASSED[0:00:34]
2026-01-08 02:16:35,272 - INFO - --------------------------------------------------------------------------------
2026-01-08 02:16:36,005 - INFO - Deleted project: ctest-TestRoutersBasic-26648880, ID : 67688cd5-dade-454e-a6a2-dadd9a9f4ed4