2025-10-15 12:43:27,695 - INFO - Domain Default found not creating
2025-10-15 12:43:27,825 - INFO - Project ctest-TestRouters-78027140 not found, creating it
2025-10-15 12:43:28,312 - INFO - Created Project:ctest-TestRouters-78027140, ID : ee405c7a-c0fa-4d4c-a21e-49444c971f40 
2025-10-15 12:43:29,791 - INFO - ================================================================================
2025-10-15 12:43:29,791 - INFO - STARTING TEST    : test_basic_router_behavior
2025-10-15 12:43:29,791 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
        Create a router
        Create 2 VNs, and a VM in each
        Add router port from each VN
        Ping between VMs
        
2025-10-15 12:43:30,045 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.145': '0'}} with
2025-10-15 12:43:30,045 - INFO - Initial checks done. Running the testcase now
2025-10-15 12:43:30,045 - INFO - 
2025-10-15 12:43:30,601 - DEBUG - Response for create_network : {'network': {'id': 'bb0abfd4-bc32-4a70-886a-7e3c60147682', 'name': 'ctest-vn1-05894096', 'tenant_id': 'ee405c7ac0fa4d4ca21e49444c971f40', 'project_id': 'ee405c7ac0fa4d4ca21e49444c971f40', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-78027140', 'ctest-vn1-05894096'], 'port_security_enabled': True, 'description': ''}}
2025-10-15 12:43:30,787 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bc315829-2fcd-4c37-b8df-13d3f4665e90', 'name': '', 'tenant_id': 'ee405c7ac0fa4d4ca21e49444c971f40', 'network_id': 'bb0abfd4-bc32-4a70-886a-7e3c60147682', 'ip_version': 4, 'cidr': '38.108.102.128/26', 'allocation_pools': [{'start': '38.108.102.130', 'end': '38.108.102.190'}], 'gateway_ip': '38.108.102.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '38.108.102.130', 'tags': [], 'project_id': 'ee405c7ac0fa4d4ca21e49444c971f40'}}
2025-10-15 12:43:30,803 - INFO - Created VN ctest-vn1-05894096
2025-10-15 12:43:30,855 - DEBUG - VN ctest-vn1-05894096 UUID is bb0abfd4-bc32-4a70-886a-7e3c60147682
2025-10-15 12:43:31,158 - DEBUG - Response for create_network : {'network': {'id': 'aa9d6601-4a41-4dad-b8de-1f4ae676cde7', 'name': 'ctest-vn2-47046313', 'tenant_id': 'ee405c7ac0fa4d4ca21e49444c971f40', 'project_id': 'ee405c7ac0fa4d4ca21e49444c971f40', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-78027140', 'ctest-vn2-47046313'], 'port_security_enabled': True, 'description': ''}}
2025-10-15 12:43:31,381 - DEBUG - Response for create_subnet : {'subnet': {'id': '25b0a64f-f8ab-40f8-a085-0bd29fcad2c1', 'name': '', 'tenant_id': 'ee405c7ac0fa4d4ca21e49444c971f40', 'network_id': 'aa9d6601-4a41-4dad-b8de-1f4ae676cde7', 'ip_version': 4, 'cidr': '182.247.151.192/26', 'allocation_pools': [{'start': '182.247.151.194', 'end': '182.247.151.254'}], 'gateway_ip': '182.247.151.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '182.247.151.194', 'tags': [], 'project_id': 'ee405c7ac0fa4d4ca21e49444c971f40'}}
2025-10-15 12:43:31,397 - INFO - Created VN ctest-vn2-47046313
2025-10-15 12:43:31,454 - DEBUG - VN ctest-vn2-47046313 UUID is aa9d6601-4a41-4dad-b8de-1f4ae676cde7
2025-10-15 12:43:31,696 - DEBUG - Services list from nova: [, , ]
2025-10-15 12:43:32,655 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4324-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4324-1)
2025-10-15 12:43:33,875 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4324-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4324-1)
2025-10-15 12:43:33,936 - INFO - Adding interface with subnet_id bc315829-2fcd-4c37-b8df-13d3f4665e90, port_id None to router 9c3dfdbd-475c-41dd-a8af-fa78670f6a3d
2025-10-15 12:43:34,180 - INFO - Waiting for VM ctest-vn1-vm1-01631799 to be up..
2025-10-15 12:43:34,283 - DEBUG - VM  is still in BUILD state, Expected: ACTIVE
2025-10-15 12:43:39,351 - DEBUG - VM  is in ACTIVE state now
2025-10-15 12:43:39,351 - INFO - VM name : ctest-vn1-vm1-01631799
2025-10-15 12:43:39,421 - DEBUG - VM ctest-vn1-vm1-01631799 ID is 1741239a-a980-418c-a3df-49a34d6ad394
2025-10-15 12:43:39,439 - DEBUG - VM ctest-vn1-vm1-01631799 launched on Node cn-jenkins-deploy-platform-ansible-os-4324-1
2025-10-15 12:43:39,509 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/1741239a-a980-418c-a3df-49a34d6ad394
2025-10-15 12:43:39,803 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/1741239a-a980-418c-a3df-49a34d6ad394
2025-10-15 12:43:39,833 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/d290c1d9-c0d4-4a90-b0cb-4d7349e9ff45
2025-10-15 12:43:43,080 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-15 12:43:43,080 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-01631799 failed!
2025-10-15 12:43:43,135 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-78027140:ctest-vn1-05894096 is 38.108.102.129 and allocation pool is NOT set
2025-10-15 12:43:45,191 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.35 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.47 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.473/2.413/3.353/0.940 ms')
2025-10-15 12:43:45,191 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-01631799 passed
2025-10-15 12:43:45,343 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-15 12:43:45,343 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-01631799, IP 38.108.102.131, Port 22
2025-10-15 12:43:45,509 - DEBUG - VM ctest-vn1-vm1-01631799 is ready for SSH connections
2025-10-15 12:43:45,509 - INFO - Waiting for VM ctest-vn2-vm1-80651873 to be up..
2025-10-15 12:43:45,577 - DEBUG - VM  is in ACTIVE state now
2025-10-15 12:43:45,578 - INFO - VM name : ctest-vn2-vm1-80651873
2025-10-15 12:43:45,646 - DEBUG - VM ctest-vn2-vm1-80651873 ID is 95de15e5-28ea-4994-836a-761ad74e0b8a
2025-10-15 12:43:45,646 - DEBUG - VM ctest-vn2-vm1-80651873 launched on Node cn-jenkins-deploy-platform-ansible-os-4324-1
2025-10-15 12:43:45,712 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/95de15e5-28ea-4994-836a-761ad74e0b8a
2025-10-15 12:43:45,727 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/eadbbc3f-d335-4f04-b9b1-f6b070825f45
2025-10-15 12:43:46,952 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.82 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.422 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.422/1.621/2.821/1.199 ms')
2025-10-15 12:43:46,952 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn2-vm1-80651873 passed
2025-10-15 12:43:47,098 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-15 12:43:47,099 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-80651873, IP 182.247.151.195, Port 22
2025-10-15 12:43:47,258 - DEBUG - VM ctest-vn2-vm1-80651873 is ready for SSH connections
2025-10-15 12:43:47,258 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-15 12:43:47,258 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  182.247.151.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2025-10-15 12:43:47,258 - DEBUG - ping -s 56 -c 3 -W 1  182.247.151.195
2025-10-15 12:43:51,952 - DEBUG - PING 182.247.151.195 (182.247.151.195): 56 data bytes
--- 182.247.151.195 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2025-10-15 12:43:51,953 - WARNING - Ping to IP 182.247.151.195 from VM ctest-vn1-vm1-01631799 failed
2025-10-15 12:43:51,953 - INFO - Adding interface with subnet_id 25b0a64f-f8ab-40f8-a085-0bd29fcad2c1, port_id None to router 9c3dfdbd-475c-41dd-a8af-fa78670f6a3d
2025-10-15 12:43:52,180 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-15 12:43:52,180 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  182.247.151.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2025-10-15 12:43:52,181 - DEBUG - ping -s 56 -c 3 -W 1  182.247.151.195
2025-10-15 12:43:54,379 - DEBUG - PING 182.247.151.195 (182.247.151.195): 56 data bytes
64 bytes from 182.247.151.195: seq=0 ttl=63 time=2.610 ms
64 bytes from 182.247.151.195: seq=1 ttl=63 time=0.803 ms
64 bytes from 182.247.151.195: seq=2 ttl=63 time=0.913 ms
--- 182.247.151.195 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.803/1.442/2.610 ms
2025-10-15 12:43:54,379 - INFO - Ping to IP 182.247.151.195 from VM ctest-vn1-vm1-01631799 passed
2025-10-15 12:43:54,380 - INFO - Deleting interface with subnet_id bc315829-2fcd-4c37-b8df-13d3f4665e90, port_id None from router 9c3dfdbd-475c-41dd-a8af-fa78670f6a3d
2025-10-15 12:43:54,494 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-15 12:43:54,494 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  182.247.151.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2025-10-15 12:43:54,494 - DEBUG - ping -s 56 -c 3 -W 1  182.247.151.195
2025-10-15 12:43:57,687 - DEBUG - PING 182.247.151.195 (182.247.151.195): 56 data bytes
--- 182.247.151.195 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2025-10-15 12:43:57,687 - WARNING - Ping to IP 182.247.151.195 from VM ctest-vn1-vm1-01631799 failed
2025-10-15 12:43:57,687 - INFO - Adding interface with subnet_id bc315829-2fcd-4c37-b8df-13d3f4665e90, port_id None to router 9c3dfdbd-475c-41dd-a8af-fa78670f6a3d
2025-10-15 12:43:57,875 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-15 12:43:57,875 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  182.247.151.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2025-10-15 12:43:57,875 - DEBUG - ping -s 56 -c 3 -W 1  182.247.151.195
2025-10-15 12:44:01,083 - DEBUG - PING 182.247.151.195 (182.247.151.195): 56 data bytes
64 bytes from 182.247.151.195: seq=1 ttl=63 time=1.553 ms
64 bytes from 182.247.151.195: seq=2 ttl=63 time=1.038 ms
--- 182.247.151.195 ping statistics ---
3 packets transmitted, 2 packets received, 33% packet loss
round-trip min/avg/max = 1.038/1.295/1.553 ms
2025-10-15 12:44:01,083 - WARNING - Ping to IP 182.247.151.195 from VM ctest-vn1-vm1-01631799 failed
2025-10-15 12:44:02,083 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  182.247.151.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123
2025-10-15 12:44:02,083 - DEBUG - ping -s 56 -c 3 -W 1  182.247.151.195
2025-10-15 12:44:04,282 - DEBUG - PING 182.247.151.195 (182.247.151.195): 56 data bytes
64 bytes from 182.247.151.195: seq=0 ttl=63 time=1.334 ms
64 bytes from 182.247.151.195: seq=1 ttl=63 time=1.020 ms
64 bytes from 182.247.151.195: seq=2 ttl=63 time=0.725 ms
--- 182.247.151.195 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.725/1.026/1.334 ms
2025-10-15 12:44:04,282 - INFO - Ping to IP 182.247.151.195 from VM ctest-vn1-vm1-01631799 passed
2025-10-15 12:44:04,282 - INFO - Deleting interface with subnet_id 25b0a64f-f8ab-40f8-a085-0bd29fcad2c1, port_id None from router 9c3dfdbd-475c-41dd-a8af-fa78670f6a3d
2025-10-15 12:44:04,386 - INFO - Deleting interface with subnet_id bc315829-2fcd-4c37-b8df-13d3f4665e90, port_id None from router 9c3dfdbd-475c-41dd-a8af-fa78670f6a3d
2025-10-15 12:44:04,536 - INFO - Deleting VM ctest-vn2-vm1-80651873
2025-10-15 12:44:04,604 - INFO - Deleting VM ctest-vn1-vm1-01631799
2025-10-15 12:44:04,670 - INFO - Deleting VN ctest-vn2-47046313 
2025-10-15 12:44:04,706 - DEBUG - VN aa9d6601-4a41-4dad-b8de-1f4ae676cde7 still in use: Unable to complete operation on network aa9d6601-4a41-4dad-b8de-1f4ae676cde7. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-59a89150-f31d-4b51-9c3d-d8b45b166c08']
2025-10-15 12:44:04,706 - WARNING - Deleting VN ctest-vn2-47046313 failed..Will retry
2025-10-15 12:44:06,793 - DEBUG - Response for deleting network ()
2025-10-15 12:44:06,793 - INFO - Deleting VN ctest-vn1-05894096 
2025-10-15 12:44:06,913 - DEBUG - Response for deleting network ()
2025-10-15 12:44:07,167 - DEBUG - No XMPP flaps were noticed during the test
2025-10-15 12:44:07,167 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:38]
2025-10-15 12:44:07,167 - INFO - --------------------------------------------------------------------------------
2025-10-15 12:44:07,811 - INFO - Deleted project: ctest-TestRouters-78027140, ID : ee405c7a-c0fa-4d4c-a21e-49444c971f40