2026-03-19 02:23:55,182 - INFO - Domain Default found not creating
2026-03-19 02:23:55,364 - INFO - Project ctest-TestRoutersBasic-23409994 not found, creating it
2026-03-19 02:23:55,836 - INFO - Created Project:ctest-TestRoutersBasic-23409994, ID : 9260db73-b9c0-49f6-a211-ae06fe59354c
2026-03-19 02:23:57,432 - INFO - ================================================================================
2026-03-19 02:23:57,432 - INFO - STARTING TEST : test_basic_snat_behavior_without_external_connectivity
2026-03-19 02:23:57,432 - INFO - TEST DESCRIPTION : Create an external network, a router
set router-gateway to external network
launch a private network and attach it to router
validate left vm pinging right vm through Snat
2026-03-19 02:23:57,690 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.14': '0'}} with
2026-03-19 02:23:57,690 - INFO - Initial checks done. Running the testcase now
2026-03-19 02:23:57,690 - INFO -
2026-03-19 02:23:58,484 - INFO - Default SG to be edited for allow all on project: ctest-TestRoutersBasic-23409994
2026-03-19 02:23:58,577 - INFO - Adding rules to the default security group in Project ctest-TestRoutersBasic-23409994
2026-03-19 02:23:58,897 - DEBUG - Reading firewall policy {'fq_name': ['default-domain', 'ctest-TestRoutersBasic-23409994', 'default']}
2026-03-19 02:23:59,182 - DEBUG - Response for create_network : {'network': {'id': '1e1afdb5-da03-467c-8b9c-7c53f2d4917e', 'name': 'ctest-vn-03365359', 'tenant_id': '9260db73b9c049f6a211ae06fe59354c', 'project_id': '9260db73b9c049f6a211ae06fe59354c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutersBasic-23409994', 'ctest-vn-03365359'], 'port_security_enabled': True, 'description': ''}}
2026-03-19 02:23:59,368 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e54c507a-d73d-4ffd-8a97-5154e02414f7', 'name': '', 'tenant_id': '9260db73b9c049f6a211ae06fe59354c', 'network_id': '1e1afdb5-da03-467c-8b9c-7c53f2d4917e', 'ip_version': 4, 'cidr': '66.184.31.128/26', 'allocation_pools': [{'start': '66.184.31.130', 'end': '66.184.31.190'}], 'gateway_ip': '66.184.31.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '66.184.31.130', 'tags': [], 'project_id': '9260db73b9c049f6a211ae06fe59354c'}}
2026-03-19 02:23:59,385 - INFO - Created VN ctest-vn-03365359
2026-03-19 02:23:59,437 - DEBUG - VN ctest-vn-03365359 UUID is 1e1afdb5-da03-467c-8b9c-7c53f2d4917e
2026-03-19 02:23:59,729 - DEBUG - Response for create_network : {'network': {'id': '0eb5c3f1-c8ec-45d2-b918-17b184c8b558', 'name': 'ctest-ext_vn-81646140', 'tenant_id': '9260db73b9c049f6a211ae06fe59354c', 'project_id': '9260db73b9c049f6a211ae06fe59354c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': True, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutersBasic-23409994', 'ctest-ext_vn-81646140'], 'port_security_enabled': True, 'description': ''}}
2026-03-19 02:23:59,936 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e7d9c3b0-fad5-4dfa-9b4b-a362f5bf3de9', 'name': '', 'tenant_id': '9260db73b9c049f6a211ae06fe59354c', 'network_id': '0eb5c3f1-c8ec-45d2-b918-17b184c8b558', 'ip_version': 4, 'cidr': '99.212.112.192/26', 'allocation_pools': [{'start': '99.212.112.194', 'end': '99.212.112.254'}], 'gateway_ip': '99.212.112.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '99.212.112.194', 'tags': [], 'project_id': '9260db73b9c049f6a211ae06fe59354c'}}
2026-03-19 02:23:59,954 - INFO - Created VN ctest-ext_vn-81646140
2026-03-19 02:24:00,021 - DEBUG - VN ctest-ext_vn-81646140 UUID is 0eb5c3f1-c8ec-45d2-b918-17b184c8b558
2026-03-19 02:24:00,208 - DEBUG - Services list from nova: [, , ]
2026-03-19 02:24:01,383 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-5494-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-5494-1)
2026-03-19 02:24:02,722 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-5494-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-5494-1)
2026-03-19 02:24:02,809 - INFO - Setting gateway for router 431a1f24-503f-4356-a3b5-fac31bce17e5 to network 0eb5c3f1-c8ec-45d2-b918-17b184c8b558
2026-03-19 02:24:02,893 - INFO - Adding interface with subnet_id e54c507a-d73d-4ffd-8a97-5154e02414f7, port_id None to router 431a1f24-503f-4356-a3b5-fac31bce17e5
2026-03-19 02:24:03,306 - INFO - Waiting for VM ctest-TestRoutersBasic-23409994-94180413 to be up..
2026-03-19 02:24:03,446 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-19 02:24:08,557 - DEBUG - VM is in ACTIVE state now
2026-03-19 02:24:08,557 - INFO - VM name : ctest-TestRoutersBasic-23409994-94180413
2026-03-19 02:24:08,651 - DEBUG - VM ctest-TestRoutersBasic-23409994-94180413 ID is 630eead1-bcf8-45db-829b-c70024297069
2026-03-19 02:24:08,676 - DEBUG - VM ctest-TestRoutersBasic-23409994-94180413 launched on Node cn-jenkins-deploy-platform-ansible-os-5494-1
2026-03-19 02:24:08,758 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine/630eead1-bcf8-45db-829b-c70024297069
2026-03-19 02:24:09,099 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine/630eead1-bcf8-45db-829b-c70024297069
2026-03-19 02:24:09,133 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine-interface/9c337bcc-6b16-4c3a-8a2f-e5f13d7f8254
2026-03-19 02:24:12,387 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2026-03-19 02:24:12,387 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutersBasic-23409994-94180413 failed!
2026-03-19 02:24:12,445 - DEBUG - Gateway for vn default-domain:ctest-TestRoutersBasic-23409994:ctest-vn-03365359 is 66.184.31.129 and allocation pool is NOT set
2026-03-19 02:24:14,510 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.76 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.37 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.370/3.063/4.757/1.693 ms')
2026-03-19 02:24:14,510 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutersBasic-23409994-94180413 passed
2026-03-19 02:24:14,657 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 02:24:14,657 - DEBUG - Waiting to SSH to VM ctest-TestRoutersBasic-23409994-94180413, IP 66.184.31.131, Port 22
2026-03-19 02:24:14,812 - DEBUG - VM ctest-TestRoutersBasic-23409994-94180413 is ready for SSH connections
2026-03-19 02:24:14,812 - INFO - Waiting for VM ctest-TestRoutersBasic-23409994-79317196 to be up..
2026-03-19 02:24:14,898 - DEBUG - VM is in ACTIVE state now
2026-03-19 02:24:14,898 - INFO - VM name : ctest-TestRoutersBasic-23409994-79317196
2026-03-19 02:24:14,971 - DEBUG - VM ctest-TestRoutersBasic-23409994-79317196 ID is 5a18e2a8-0b07-4f97-aee4-92fb9df2e025
2026-03-19 02:24:14,971 - DEBUG - VM ctest-TestRoutersBasic-23409994-79317196 launched on Node cn-jenkins-deploy-platform-ansible-os-5494-1
2026-03-19 02:24:15,047 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine/5a18e2a8-0b07-4f97-aee4-92fb9df2e025
2026-03-19 02:24:15,056 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine-interface/e5df76d6-02da-4c0f-9047-5f38061827ab
2026-03-19 02:24:16,291 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.99 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.57 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 2.571/3.778/4.985/1.207 ms')
2026-03-19 02:24:16,291 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestRoutersBasic-23409994-79317196 passed
2026-03-19 02:24:16,445 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 02:24:16,445 - DEBUG - Waiting to SSH to VM ctest-TestRoutersBasic-23409994-79317196, IP 99.212.112.195, Port 22
2026-03-19 02:24:16,511 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 02:24:16,589 - DEBUG - VM ctest-TestRoutersBasic-23409994-79317196 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 02:24:21,589 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 02:24:21,589 - DEBUG - Waiting to SSH to VM ctest-TestRoutersBasic-23409994-79317196, IP 99.212.112.195, Port 22
2026-03-19 02:24:21,745 - DEBUG - VM ctest-TestRoutersBasic-23409994-79317196 is ready for SSH connections
2026-03-19 02:24:21,745 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 02:24:21,745 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 99.212.112.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-03-19 02:24:21,745 - DEBUG - ping -s 56 -c 3 -W 1 99.212.112.195
2026-03-19 02:24:25,504 - DEBUG - PING 99.212.112.195 (99.212.112.195): 56 data bytes
64 bytes from 99.212.112.195: seq=0 ttl=62 time=6.948 ms
64 bytes from 99.212.112.195: seq=1 ttl=62 time=0.855 ms
64 bytes from 99.212.112.195: seq=2 ttl=62 time=1.263 ms
--- 99.212.112.195 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.855/3.022/6.948 ms
2026-03-19 02:24:25,504 - INFO - Ping to IP 99.212.112.195 from VM ctest-TestRoutersBasic-23409994-94180413 passed
2026-03-19 02:24:25,504 - INFO - Deleting interface with subnet_id e54c507a-d73d-4ffd-8a97-5154e02414f7, port_id None from router 431a1f24-503f-4356-a3b5-fac31bce17e5
2026-03-19 02:24:25,712 - INFO - Deleting VM ctest-TestRoutersBasic-23409994-79317196
2026-03-19 02:24:25,786 - INFO - Deleting VM ctest-TestRoutersBasic-23409994-94180413
2026-03-19 02:24:25,880 - INFO - Deleting VN ctest-ext_vn-81646140
2026-03-19 02:24:25,959 - DEBUG - VN 0eb5c3f1-c8ec-45d2-b918-17b184c8b558 still in use: Unable to complete operation on network 0eb5c3f1-c8ec-45d2-b918-17b184c8b558. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-3dcb8f13-d630-401f-a5a2-07af31b1bb36']
2026-03-19 02:24:25,960 - WARNING - Deleting VN ctest-ext_vn-81646140 failed..Will retry
2026-03-19 02:24:28,052 - DEBUG - Response for deleting network ()
2026-03-19 02:24:28,053 - INFO - Deleting VN ctest-vn-03365359
2026-03-19 02:24:28,150 - DEBUG - Response for deleting network ()
2026-03-19 02:24:28,407 - DEBUG - No XMPP flaps were noticed during the test
2026-03-19 02:24:28,407 - INFO - END TEST : test_basic_snat_behavior_without_external_connectivity : PASSED[0:00:31]
2026-03-19 02:24:28,407 - INFO - --------------------------------------------------------------------------------
2026-03-19 02:24:29,125 - INFO - Deleted project: ctest-TestRoutersBasic-23409994, ID : 9260db73-b9c0-49f6-a211-ae06fe59354c