2026-05-25 02:26:13,737 - INFO - Domain Default found not creating 2026-05-25 02:26:13,947 - INFO - Project ctest-TestRouters-36433628 not found, creating it 2026-05-25 02:26:14,565 - INFO - Created Project:ctest-TestRouters-36433628, ID : 97e8f48f-d285-4f6c-8e10-837c18237c6a 2026-05-25 02:26:16,374 - INFO - ================================================================================ 2026-05-25 02:26:16,374 - INFO - STARTING TEST : test_basic_router_behavior 2026-05-25 02:26:16,374 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs Create a router Create 2 VNs, and a VM in each Add router port from each VN Ping between VMs 2026-05-25 02:26:17,685 - DEBUG - Nothing to compare xmpp stats {'10.0.0.133': {'10.20.0.252': '0', '10.20.0.249': '0'}, '10.0.0.240': {'10.20.0.241': '0', '10.20.0.249': '0'}} with 2026-05-25 02:26:17,685 - INFO - Initial checks done. Running the testcase now 2026-05-25 02:26:17,686 - INFO - 2026-05-25 02:26:18,453 - DEBUG - Response for create_network : {'network': {'id': '2dab3a5e-6a99-451f-9634-ba64799dd70d', 'name': 'ctest-vn1-05086201', 'tenant_id': '97e8f48fd2854f6c8e10837c18237c6a', 'project_id': '97e8f48fd2854f6c8e10837c18237c6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-36433628', 'ctest-vn1-05086201'], 'port_security_enabled': True, 'description': ''}} 2026-05-25 02:26:18,729 - DEBUG - Response for create_subnet : {'subnet': {'id': '79ce5713-6286-428a-95d4-ae38c9e9873d', 'name': '', 'tenant_id': '97e8f48fd2854f6c8e10837c18237c6a', 'network_id': '2dab3a5e-6a99-451f-9634-ba64799dd70d', 'ip_version': 4, 'cidr': '111.68.56.192/26', 'allocation_pools': [{'start': '111.68.56.194', 'end': '111.68.56.254'}], 'gateway_ip': '111.68.56.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '111.68.56.194', 'tags': [], 'project_id': '97e8f48fd2854f6c8e10837c18237c6a'}} 2026-05-25 02:26:18,756 - INFO - Created VN ctest-vn1-05086201 2026-05-25 02:26:18,768 - DEBUG - VN ctest-vn1-05086201 UUID is 2dab3a5e-6a99-451f-9634-ba64799dd70d 2026-05-25 02:26:19,165 - DEBUG - Response for create_network : {'network': {'id': '468b2bb8-57c6-4d92-9720-c80d3402dc57', 'name': 'ctest-vn2-94703437', 'tenant_id': '97e8f48fd2854f6c8e10837c18237c6a', 'project_id': '97e8f48fd2854f6c8e10837c18237c6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-36433628', 'ctest-vn2-94703437'], 'port_security_enabled': True, 'description': ''}} 2026-05-25 02:26:19,417 - DEBUG - Response for create_subnet : {'subnet': {'id': '367bf199-db7e-4e21-949f-376860379417', 'name': '', 'tenant_id': '97e8f48fd2854f6c8e10837c18237c6a', 'network_id': '468b2bb8-57c6-4d92-9720-c80d3402dc57', 'ip_version': 4, 'cidr': '179.184.83.192/26', 'allocation_pools': [{'start': '179.184.83.194', 'end': '179.184.83.254'}], 'gateway_ip': '179.184.83.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '179.184.83.194', 'tags': [], 'project_id': '97e8f48fd2854f6c8e10837c18237c6a'}} 2026-05-25 02:26:19,442 - INFO - Created VN ctest-vn2-94703437 2026-05-25 02:26:19,454 - DEBUG - VN ctest-vn2-94703437 UUID is 468b2bb8-57c6-4d92-9720-c80d3402dc57 2026-05-25 02:26:19,608 - DEBUG - Services list from nova: [, , , ] 2026-05-25 02:26:20,816 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5822-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5822-2) 2026-05-25 02:26:22,323 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5822-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5822-1) 2026-05-25 02:26:22,456 - INFO - Adding interface with subnet_id 79ce5713-6286-428a-95d4-ae38c9e9873d, port_id None to router 4b8baf2c-e7ef-4d6b-876e-9c2d6d9edcce 2026-05-25 02:26:22,923 - INFO - Waiting for VM ctest-vn1-vm1-63988089 to be up.. 2026-05-25 02:26:23,093 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-05-25 02:26:28,232 - DEBUG - VM is in ACTIVE state now 2026-05-25 02:26:28,232 - INFO - VM name : ctest-vn1-vm1-63988089 2026-05-25 02:26:28,331 - DEBUG - VM ctest-vn1-vm1-63988089 ID is bf706bc4-cfa7-4f52-b22e-7170f30fb67e 2026-05-25 02:26:28,374 - DEBUG - VM ctest-vn1-vm1-63988089 launched on Node an-jenkins-deploy-platform-ansible-os-5822-2 2026-05-25 02:26:28,472 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/bf706bc4-cfa7-4f52-b22e-7170f30fb67e 2026-05-25 02:26:28,783 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/bf706bc4-cfa7-4f52-b22e-7170f30fb67e 2026-05-25 02:26:28,829 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/adbf1450-dd61-46fa-8ca7-37036d4f1913 2026-05-25 02:26:32,026 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2026-05-25 02:26:32,027 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-63988089 failed! 2026-05-25 02:26:32,045 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-36433628:ctest-vn1-05086201 is 111.68.56.193 and allocation pool is NOT set 2026-05-25 02:26:36,120 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=6.79 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1006ms\r\nrtt min/avg/max/mdev = 6.792/6.792/6.792/0.000 ms') 2026-05-25 02:26:36,120 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-63988089 passed 2026-05-25 02:26:36,202 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-25 02:26:36,202 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-63988089, IP 111.68.56.195, Port 22 2026-05-25 02:26:36,381 - DEBUG - VM ctest-vn1-vm1-63988089 is ready for SSH connections 2026-05-25 02:26:36,381 - INFO - Waiting for VM ctest-vn2-vm1-02992853 to be up.. 2026-05-25 02:26:36,488 - DEBUG - VM is in ACTIVE state now 2026-05-25 02:26:36,488 - INFO - VM name : ctest-vn2-vm1-02992853 2026-05-25 02:26:36,590 - DEBUG - VM ctest-vn2-vm1-02992853 ID is 081c9bc6-84b6-4c49-86e1-b6e589e2caba 2026-05-25 02:26:36,590 - DEBUG - VM ctest-vn2-vm1-02992853 launched on Node an-jenkins-deploy-platform-ansible-os-5822-1 2026-05-25 02:26:36,690 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/081c9bc6-84b6-4c49-86e1-b6e589e2caba 2026-05-25 02:26:36,704 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/30a683e4-523a-483c-9c77-88592ee6c100 2026-05-25 02:26:37,903 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.79 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.944 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.944/2.365/3.787/1.421 ms') 2026-05-25 02:26:37,903 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-02992853 passed 2026-05-25 02:26:37,983 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-25 02:26:37,983 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-02992853, IP 179.184.83.195, Port 22 2026-05-25 02:26:38,063 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-25 02:26:38,171 - DEBUG - VM ctest-vn2-vm1-02992853 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-25 02:26:43,172 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-25 02:26:43,172 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-02992853, IP 179.184.83.195, Port 22 2026-05-25 02:26:43,356 - DEBUG - VM ctest-vn2-vm1-02992853 is ready for SSH connections 2026-05-25 02:26:43,357 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-25 02:26:43,357 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 179.184.83.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.240, gateway password: c0ntrail123 2026-05-25 02:26:43,357 - DEBUG - ping -s 56 -c 3 -W 1 179.184.83.195 2026-05-25 02:26:47,420 - DEBUG - PING 179.184.83.195 (179.184.83.195): 56 data bytes --- 179.184.83.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2026-05-25 02:26:47,420 - WARNING - Ping to IP 179.184.83.195 from VM ctest-vn1-vm1-63988089 failed 2026-05-25 02:26:47,420 - INFO - Adding interface with subnet_id 367bf199-db7e-4e21-949f-376860379417, port_id None to router 4b8baf2c-e7ef-4d6b-876e-9c2d6d9edcce 2026-05-25 02:26:47,932 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-25 02:26:47,932 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 179.184.83.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.240, gateway password: c0ntrail123 2026-05-25 02:26:47,932 - DEBUG - ping -s 56 -c 3 -W 1 179.184.83.195 2026-05-25 02:26:50,190 - DEBUG - PING 179.184.83.195 (179.184.83.195): 56 data bytes 64 bytes from 179.184.83.195: seq=0 ttl=63 time=5.283 ms 64 bytes from 179.184.83.195: seq=1 ttl=63 time=1.629 ms 64 bytes from 179.184.83.195: seq=2 ttl=63 time=1.513 ms --- 179.184.83.195 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.513/2.808/5.283 ms 2026-05-25 02:26:50,190 - INFO - Ping to IP 179.184.83.195 from VM ctest-vn1-vm1-63988089 passed 2026-05-25 02:26:50,190 - INFO - Deleting interface with subnet_id 79ce5713-6286-428a-95d4-ae38c9e9873d, port_id None from router 4b8baf2c-e7ef-4d6b-876e-9c2d6d9edcce 2026-05-25 02:26:50,422 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-25 02:26:50,422 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 179.184.83.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.240, gateway password: c0ntrail123 2026-05-25 02:26:50,422 - DEBUG - ping -s 56 -c 3 -W 1 179.184.83.195 2026-05-25 02:26:53,720 - DEBUG - PING 179.184.83.195 (179.184.83.195): 56 data bytes --- 179.184.83.195 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2026-05-25 02:26:53,720 - WARNING - Ping to IP 179.184.83.195 from VM ctest-vn1-vm1-63988089 failed 2026-05-25 02:26:53,720 - INFO - Adding interface with subnet_id 79ce5713-6286-428a-95d4-ae38c9e9873d, port_id None to router 4b8baf2c-e7ef-4d6b-876e-9c2d6d9edcce 2026-05-25 02:26:54,138 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-25 02:26:54,139 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 179.184.83.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.240, gateway password: c0ntrail123 2026-05-25 02:26:54,139 - DEBUG - ping -s 56 -c 3 -W 1 179.184.83.195 2026-05-25 02:26:57,361 - DEBUG - PING 179.184.83.195 (179.184.83.195): 56 data bytes 64 bytes from 179.184.83.195: seq=1 ttl=63 time=5.492 ms 64 bytes from 179.184.83.195: seq=2 ttl=63 time=1.751 ms --- 179.184.83.195 ping statistics --- 3 packets transmitted, 2 packets received, 33% packet loss round-trip min/avg/max = 1.751/3.621/5.492 ms 2026-05-25 02:26:57,362 - WARNING - Ping to IP 179.184.83.195 from VM ctest-vn1-vm1-63988089 failed 2026-05-25 02:26:58,362 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 179.184.83.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.240, gateway password: c0ntrail123 2026-05-25 02:26:58,362 - DEBUG - ping -s 56 -c 3 -W 1 179.184.83.195 2026-05-25 02:27:00,587 - DEBUG - PING 179.184.83.195 (179.184.83.195): 56 data bytes 64 bytes from 179.184.83.195: seq=0 ttl=63 time=3.230 ms 64 bytes from 179.184.83.195: seq=1 ttl=63 time=1.549 ms 64 bytes from 179.184.83.195: seq=2 ttl=63 time=1.835 ms --- 179.184.83.195 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.549/2.204/3.230 ms 2026-05-25 02:27:00,587 - INFO - Ping to IP 179.184.83.195 from VM ctest-vn1-vm1-63988089 passed 2026-05-25 02:27:00,587 - INFO - Deleting interface with subnet_id 367bf199-db7e-4e21-949f-376860379417, port_id None from router 4b8baf2c-e7ef-4d6b-876e-9c2d6d9edcce 2026-05-25 02:27:00,870 - INFO - Deleting interface with subnet_id 79ce5713-6286-428a-95d4-ae38c9e9873d, port_id None from router 4b8baf2c-e7ef-4d6b-876e-9c2d6d9edcce 2026-05-25 02:27:01,258 - INFO - Deleting VM ctest-vn2-vm1-02992853 2026-05-25 02:27:01,387 - INFO - Deleting VM ctest-vn1-vm1-63988089 2026-05-25 02:27:01,494 - INFO - Deleting VN ctest-vn2-94703437 2026-05-25 02:27:01,559 - DEBUG - VN 468b2bb8-57c6-4d92-9720-c80d3402dc57 still in use: Unable to complete operation on network 468b2bb8-57c6-4d92-9720-c80d3402dc57. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-10af7632-bacb-427c-9cfb-6932bb2a8702'] 2026-05-25 02:27:01,559 - WARNING - Deleting VN ctest-vn2-94703437 failed..Will retry 2026-05-25 02:27:03,730 - DEBUG - Response for deleting network () 2026-05-25 02:27:03,731 - INFO - Deleting VN ctest-vn1-05086201 2026-05-25 02:27:03,931 - DEBUG - Response for deleting network () 2026-05-25 02:27:05,211 - DEBUG - No XMPP flaps were noticed during the test 2026-05-25 02:27:05,211 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:49] 2026-05-25 02:27:05,211 - INFO - -------------------------------------------------------------------------------- 2026-05-25 02:27:05,973 - INFO - Deleted project: ctest-TestRouters-36433628, ID : 97e8f48f-d285-4f6c-8e10-837c18237c6a