2025-10-29 11:44:11,772 - INFO - Domain Default found not creating
2025-10-29 11:44:11,953 - INFO - Project ctest-TestRouters-71550868 not found, creating it
2025-10-29 11:44:12,595 - INFO - Created Project:ctest-TestRouters-71550868, ID : 5349b72a-4623-45ce-820e-276354860d63 
2025-10-29 11:44:14,174 - INFO - ================================================================================
2025-10-29 11:44:14,174 - INFO - STARTING TEST    : test_basic_router_behavior
2025-10-29 11:44:14,175 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
        Create a router
        Create 2 VNs, and a VM in each
        Add router port from each VN
        Ping between VMs
        
2025-10-29 11:44:15,491 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.17': '0', '10.20.0.254': '0'}, '10.0.0.50': {'10.20.0.254': '0', '10.20.0.14': '0'}} with
2025-10-29 11:44:15,491 - INFO - Initial checks done. Running the testcase now
2025-10-29 11:44:15,491 - INFO - 
2025-10-29 11:44:16,244 - DEBUG - Response for create_network : {'network': {'id': 'a349bd03-42f4-4ed5-a6ae-a8d0ca3830c4', 'name': 'ctest-vn1-46255319', 'tenant_id': '5349b72a462345ce820e276354860d63', 'project_id': '5349b72a462345ce820e276354860d63', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-71550868', 'ctest-vn1-46255319'], 'port_security_enabled': True, 'description': ''}}
2025-10-29 11:44:16,558 - DEBUG - Response for create_subnet : {'subnet': {'id': '79ec9bb4-9e10-4acf-8ccb-8ce0d255e485', 'name': '', 'tenant_id': '5349b72a462345ce820e276354860d63', 'network_id': 'a349bd03-42f4-4ed5-a6ae-a8d0ca3830c4', 'ip_version': 4, 'cidr': '99.87.77.128/26', 'allocation_pools': [{'start': '99.87.77.130', 'end': '99.87.77.190'}], 'gateway_ip': '99.87.77.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '99.87.77.130', 'tags': [], 'project_id': '5349b72a462345ce820e276354860d63'}}
2025-10-29 11:44:16,591 - INFO - Created VN ctest-vn1-46255319
2025-10-29 11:44:16,605 - DEBUG - VN ctest-vn1-46255319 UUID is a349bd03-42f4-4ed5-a6ae-a8d0ca3830c4
2025-10-29 11:44:17,132 - DEBUG - Response for create_network : {'network': {'id': '6fbeb8f9-b816-4843-b4ea-342b6c3b390f', 'name': 'ctest-vn2-72500490', 'tenant_id': '5349b72a462345ce820e276354860d63', 'project_id': '5349b72a462345ce820e276354860d63', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-71550868', 'ctest-vn2-72500490'], 'port_security_enabled': True, 'description': ''}}
2025-10-29 11:44:17,415 - DEBUG - Response for create_subnet : {'subnet': {'id': '38652d25-2d58-4c7e-b1b0-e5fae6df33e5', 'name': '', 'tenant_id': '5349b72a462345ce820e276354860d63', 'network_id': '6fbeb8f9-b816-4843-b4ea-342b6c3b390f', 'ip_version': 4, 'cidr': '93.28.252.128/26', 'allocation_pools': [{'start': '93.28.252.130', 'end': '93.28.252.190'}], 'gateway_ip': '93.28.252.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '93.28.252.130', 'tags': [], 'project_id': '5349b72a462345ce820e276354860d63'}}
2025-10-29 11:44:17,440 - INFO - Created VN ctest-vn2-72500490
2025-10-29 11:44:17,454 - DEBUG - VN ctest-vn2-72500490 UUID is 6fbeb8f9-b816-4843-b4ea-342b6c3b390f
2025-10-29 11:44:17,722 - DEBUG - Services list from nova: [, , , ]
2025-10-29 11:44:18,994 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4521-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4521-2)
2025-10-29 11:44:20,446 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4521-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4521-1)
2025-10-29 11:44:20,563 - INFO - Adding interface with subnet_id 79ec9bb4-9e10-4acf-8ccb-8ce0d255e485, port_id None to router 8364e83d-b5c4-4701-bc59-0db8251affd2
2025-10-29 11:44:20,956 - INFO - Waiting for VM ctest-vn1-vm1-71423851 to be up..
2025-10-29 11:44:21,137 - DEBUG - VM  is still in BUILD state, Expected: ACTIVE
2025-10-29 11:44:26,229 - DEBUG - VM  is in ACTIVE state now
2025-10-29 11:44:26,230 - INFO - VM name : ctest-vn1-vm1-71423851
2025-10-29 11:44:26,317 - DEBUG - VM ctest-vn1-vm1-71423851 ID is 44e7f370-4caa-4b85-9cdd-d93e6d8d6986
2025-10-29 11:44:26,344 - DEBUG - VM ctest-vn1-vm1-71423851 launched on Node an-jenkins-deploy-platform-ansible-os-4521-2
2025-10-29 11:44:26,430 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/44e7f370-4caa-4b85-9cdd-d93e6d8d6986
2025-10-29 11:44:26,740 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/44e7f370-4caa-4b85-9cdd-d93e6d8d6986
2025-10-29 11:44:26,775 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/62059f25-1451-4c0c-a6a5-23fb33b36a78
2025-10-29 11:44:30,005 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-29 11:44:30,005 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-71423851 failed!
2025-10-29 11:44:30,024 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-71550868:ctest-vn1-46255319 is 99.87.77.129 and allocation pool is NOT set
2025-10-29 11:44:34,104 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2025-10-29 11:44:34,104 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-71423851 failed!
2025-10-29 11:44:34,120 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-71550868:ctest-vn1-46255319 is 99.87.77.129 and allocation pool is NOT set
2025-10-29 11:44:36,189 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.35 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.905 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.905/2.628/4.351/1.723 ms')
2025-10-29 11:44:36,189 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-71423851 passed
2025-10-29 11:44:36,261 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 11:44:36,261 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-71423851, IP 99.87.77.131, Port 22
2025-10-29 11:44:36,329 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-29 11:44:36,426 - DEBUG - VM ctest-vn1-vm1-71423851 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-29 11:44:41,427 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 11:44:41,427 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-71423851, IP 99.87.77.131, Port 22
2025-10-29 11:44:41,601 - DEBUG - VM ctest-vn1-vm1-71423851 is ready for SSH connections
2025-10-29 11:44:41,602 - INFO - Waiting for VM ctest-vn2-vm1-57375031 to be up..
2025-10-29 11:44:41,706 - DEBUG - VM  is in ACTIVE state now
2025-10-29 11:44:41,706 - INFO - VM name : ctest-vn2-vm1-57375031
2025-10-29 11:44:41,799 - DEBUG - VM ctest-vn2-vm1-57375031 ID is dd8f433f-0929-4ad4-b73f-f148b5ef0ac6
2025-10-29 11:44:41,799 - DEBUG - VM ctest-vn2-vm1-57375031 launched on Node an-jenkins-deploy-platform-ansible-os-4521-1
2025-10-29 11:44:41,888 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/dd8f433f-0929-4ad4-b73f-f148b5ef0ac6
2025-10-29 11:44:41,899 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/3aeef462-bcbf-41e3-a8b7-d3e40e6b8e70
2025-10-29 11:44:43,072 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.03 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.736 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.736/1.881/3.027/1.145 ms')
2025-10-29 11:44:43,072 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-57375031 passed
2025-10-29 11:44:43,147 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 11:44:43,147 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-57375031, IP 93.28.252.131, Port 22
2025-10-29 11:44:43,329 - DEBUG - VM ctest-vn2-vm1-57375031 is ready for SSH connections
2025-10-29 11:44:43,329 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 11:44:43,329 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  93.28.252.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-10-29 11:44:43,329 - DEBUG - ping -s 56 -c 3 -W 1  93.28.252.131
2025-10-29 11:44:47,350 - DEBUG - PING 93.28.252.131 (93.28.252.131): 56 data bytes
--- 93.28.252.131 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2025-10-29 11:44:47,350 - WARNING - Ping to IP 93.28.252.131 from VM ctest-vn1-vm1-71423851 failed
2025-10-29 11:44:47,350 - INFO - Adding interface with subnet_id 38652d25-2d58-4c7e-b1b0-e5fae6df33e5, port_id None to router 8364e83d-b5c4-4701-bc59-0db8251affd2
2025-10-29 11:44:47,802 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 11:44:47,802 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  93.28.252.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-10-29 11:44:47,802 - DEBUG - ping -s 56 -c 3 -W 1  93.28.252.131
2025-10-29 11:44:51,017 - DEBUG - PING 93.28.252.131 (93.28.252.131): 56 data bytes
64 bytes from 93.28.252.131: seq=1 ttl=63 time=6.369 ms
64 bytes from 93.28.252.131: seq=2 ttl=63 time=1.447 ms
--- 93.28.252.131 ping statistics ---
3 packets transmitted, 2 packets received, 33% packet loss
round-trip min/avg/max = 1.447/3.908/6.369 ms
2025-10-29 11:44:51,017 - WARNING - Ping to IP 93.28.252.131 from VM ctest-vn1-vm1-71423851 failed
2025-10-29 11:44:52,018 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  93.28.252.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-10-29 11:44:52,018 - DEBUG - ping -s 56 -c 3 -W 1  93.28.252.131
2025-10-29 11:44:54,237 - DEBUG - PING 93.28.252.131 (93.28.252.131): 56 data bytes
64 bytes from 93.28.252.131: seq=0 ttl=63 time=2.452 ms
64 bytes from 93.28.252.131: seq=1 ttl=63 time=1.466 ms
64 bytes from 93.28.252.131: seq=2 ttl=63 time=1.444 ms
--- 93.28.252.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.444/1.787/2.452 ms
2025-10-29 11:44:54,237 - INFO - Ping to IP 93.28.252.131 from VM ctest-vn1-vm1-71423851 passed
2025-10-29 11:44:54,237 - INFO - Deleting interface with subnet_id 79ec9bb4-9e10-4acf-8ccb-8ce0d255e485, port_id None from router 8364e83d-b5c4-4701-bc59-0db8251affd2
2025-10-29 11:44:54,484 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 11:44:54,484 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  93.28.252.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-10-29 11:44:54,484 - DEBUG - ping -s 56 -c 3 -W 1  93.28.252.131
2025-10-29 11:44:57,691 - DEBUG - PING 93.28.252.131 (93.28.252.131): 56 data bytes
--- 93.28.252.131 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2025-10-29 11:44:57,691 - WARNING - Ping to IP 93.28.252.131 from VM ctest-vn1-vm1-71423851 failed
2025-10-29 11:44:57,691 - INFO - Adding interface with subnet_id 79ec9bb4-9e10-4acf-8ccb-8ce0d255e485, port_id None to router 8364e83d-b5c4-4701-bc59-0db8251affd2
2025-10-29 11:44:58,129 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 11:44:58,129 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  93.28.252.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-10-29 11:44:58,130 - DEBUG - ping -s 56 -c 3 -W 1  93.28.252.131
2025-10-29 11:45:00,357 - DEBUG - PING 93.28.252.131 (93.28.252.131): 56 data bytes
64 bytes from 93.28.252.131: seq=0 ttl=63 time=3.332 ms
64 bytes from 93.28.252.131: seq=1 ttl=63 time=2.860 ms
64 bytes from 93.28.252.131: seq=2 ttl=63 time=1.559 ms
--- 93.28.252.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.559/2.583/3.332 ms
2025-10-29 11:45:00,358 - INFO - Ping to IP 93.28.252.131 from VM ctest-vn1-vm1-71423851 passed
2025-10-29 11:45:00,358 - INFO - Deleting interface with subnet_id 38652d25-2d58-4c7e-b1b0-e5fae6df33e5, port_id None from router 8364e83d-b5c4-4701-bc59-0db8251affd2
2025-10-29 11:45:00,612 - INFO - Deleting interface with subnet_id 79ec9bb4-9e10-4acf-8ccb-8ce0d255e485, port_id None from router 8364e83d-b5c4-4701-bc59-0db8251affd2
2025-10-29 11:45:00,959 - INFO - Deleting VM ctest-vn2-vm1-57375031
2025-10-29 11:45:01,067 - INFO - Deleting VM ctest-vn1-vm1-71423851
2025-10-29 11:45:01,151 - INFO - Deleting VN ctest-vn2-72500490 
2025-10-29 11:45:01,208 - DEBUG - VN 6fbeb8f9-b816-4843-b4ea-342b6c3b390f still in use: Unable to complete operation on network 6fbeb8f9-b816-4843-b4ea-342b6c3b390f. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-9781ccef-1870-45b0-a4a5-79e14d0d4b4d']
2025-10-29 11:45:01,208 - WARNING - Deleting VN ctest-vn2-72500490 failed..Will retry
2025-10-29 11:45:03,389 - DEBUG - Response for deleting network ()
2025-10-29 11:45:03,389 - INFO - Deleting VN ctest-vn1-46255319 
2025-10-29 11:45:03,636 - DEBUG - Response for deleting network ()
2025-10-29 11:45:04,937 - DEBUG - No XMPP flaps were noticed during the test
2025-10-29 11:45:04,937 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:50]
2025-10-29 11:45:04,938 - INFO - --------------------------------------------------------------------------------
2025-10-29 11:45:05,773 - INFO - Deleted project: ctest-TestRouters-71550868, ID : 5349b72a-4623-45ce-820e-276354860d63