2025-10-31 05:39:44,932 - INFO - Domain Default found not creating
2025-10-31 05:39:45,099 - INFO - Project ctest-TestRouters-84984079 not found, creating it
2025-10-31 05:39:45,591 - INFO - Created Project:ctest-TestRouters-84984079, ID : b5eddf95-4229-466c-94fa-2928a4f85174 
2025-10-31 05:39:47,140 - INFO - ================================================================================
2025-10-31 05:39:47,140 - INFO - STARTING TEST    : test_basic_router_behavior
2025-10-31 05:39:47,140 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
        Create a router
        Create 2 VNs, and a VM in each
        Add router port from each VN
        Ping between VMs
        
2025-10-31 05:39:47,395 - DEBUG - Nothing to compare xmpp stats {'10.0.0.137': {'10.20.0.14': '0'}} with
2025-10-31 05:39:47,395 - INFO - Initial checks done. Running the testcase now
2025-10-31 05:39:47,395 - INFO - 
2025-10-31 05:39:48,239 - DEBUG - Response for create_network : {'network': {'id': '96fecccc-df60-496d-ad76-caf409dbae0c', 'name': 'ctest-vn1-09003462', 'tenant_id': 'b5eddf954229466c94fa2928a4f85174', 'project_id': 'b5eddf954229466c94fa2928a4f85174', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-84984079', 'ctest-vn1-09003462'], 'port_security_enabled': True, 'description': ''}}
2025-10-31 05:39:48,424 - DEBUG - Response for create_subnet : {'subnet': {'id': '084be6b3-ac80-4f1a-a988-15979022be3e', 'name': '', 'tenant_id': 'b5eddf954229466c94fa2928a4f85174', 'network_id': '96fecccc-df60-496d-ad76-caf409dbae0c', 'ip_version': 4, 'cidr': '27.134.219.0/26', 'allocation_pools': [{'start': '27.134.219.2', 'end': '27.134.219.62'}], 'gateway_ip': '27.134.219.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '27.134.219.2', 'tags': [], 'project_id': 'b5eddf954229466c94fa2928a4f85174'}}
2025-10-31 05:39:48,446 - INFO - Created VN ctest-vn1-09003462
2025-10-31 05:39:48,505 - DEBUG - VN ctest-vn1-09003462 UUID is 96fecccc-df60-496d-ad76-caf409dbae0c
2025-10-31 05:39:48,823 - DEBUG - Response for create_network : {'network': {'id': '43f0d895-5caf-4db0-9d3c-efa6df58ce50', 'name': 'ctest-vn2-68855172', 'tenant_id': 'b5eddf954229466c94fa2928a4f85174', 'project_id': 'b5eddf954229466c94fa2928a4f85174', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-84984079', 'ctest-vn2-68855172'], 'port_security_enabled': True, 'description': ''}}
2025-10-31 05:39:49,009 - DEBUG - Response for create_subnet : {'subnet': {'id': '4d4ccc50-5ec2-4d0f-a372-ff75260ca4ef', 'name': '', 'tenant_id': 'b5eddf954229466c94fa2928a4f85174', 'network_id': '43f0d895-5caf-4db0-9d3c-efa6df58ce50', 'ip_version': 4, 'cidr': '24.240.99.128/26', 'allocation_pools': [{'start': '24.240.99.130', 'end': '24.240.99.190'}], 'gateway_ip': '24.240.99.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '24.240.99.130', 'tags': [], 'project_id': 'b5eddf954229466c94fa2928a4f85174'}}
2025-10-31 05:39:49,028 - INFO - Created VN ctest-vn2-68855172
2025-10-31 05:39:49,085 - DEBUG - VN ctest-vn2-68855172 UUID is 43f0d895-5caf-4db0-9d3c-efa6df58ce50
2025-10-31 05:39:49,303 - DEBUG - Services list from nova: [, , ]
2025-10-31 05:39:50,475 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4571-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4571-1)
2025-10-31 05:39:51,907 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4571-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4571-1)
2025-10-31 05:39:51,984 - INFO - Adding interface with subnet_id 084be6b3-ac80-4f1a-a988-15979022be3e, port_id None to router e3abe8a8-7bd9-476f-b3bc-aea527352df1
2025-10-31 05:39:52,345 - INFO - Waiting for VM ctest-vn1-vm1-78892960 to be up..
2025-10-31 05:39:52,448 - DEBUG - VM  is still in BUILD state, Expected: ACTIVE
2025-10-31 05:39:57,538 - DEBUG - VM  is in ACTIVE state now
2025-10-31 05:39:57,538 - INFO - VM name : ctest-vn1-vm1-78892960
2025-10-31 05:39:57,618 - DEBUG - VM ctest-vn1-vm1-78892960 ID is 98e6e181-360f-405d-b30e-9534c6b42b67
2025-10-31 05:39:57,639 - DEBUG - VM ctest-vn1-vm1-78892960 launched on Node cn-jenkins-deploy-platform-ansible-os-4571-1
2025-10-31 05:39:57,716 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/98e6e181-360f-405d-b30e-9534c6b42b67
2025-10-31 05:39:58,050 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/98e6e181-360f-405d-b30e-9534c6b42b67
2025-10-31 05:39:58,079 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/633a3f53-485e-4a60-927f-788a66a6cd93
2025-10-31 05:40:01,325 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2025-10-31 05:40:01,325 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-78892960 failed!
2025-10-31 05:40:01,381 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-84984079:ctest-vn1-09003462 is 27.134.219.1 and allocation pool is NOT set
2025-10-31 05:40:03,440 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.67 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.62 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.615/3.141/4.667/1.526 ms')
2025-10-31 05:40:03,440 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-78892960 passed
2025-10-31 05:40:03,589 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 05:40:03,589 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-78892960, IP 27.134.219.3, Port 22
2025-10-31 05:40:03,745 - DEBUG - VM ctest-vn1-vm1-78892960 is ready for SSH connections
2025-10-31 05:40:03,745 - INFO - Waiting for VM ctest-vn2-vm1-63706055 to be up..
2025-10-31 05:40:03,821 - DEBUG - VM  is in ACTIVE state now
2025-10-31 05:40:03,821 - INFO - VM name : ctest-vn2-vm1-63706055
2025-10-31 05:40:03,893 - DEBUG - VM ctest-vn2-vm1-63706055 ID is 1be833a6-0739-423c-99df-e688068cabfa
2025-10-31 05:40:03,893 - DEBUG - VM ctest-vn2-vm1-63706055 launched on Node cn-jenkins-deploy-platform-ansible-os-4571-1
2025-10-31 05:40:03,971 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/1be833a6-0739-423c-99df-e688068cabfa
2025-10-31 05:40:03,980 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/e84337c8-70b8-4622-ba2f-45cc62f42712
2025-10-31 05:40:05,218 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=5.15 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.992 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.992/3.068/5.145/2.076 ms')
2025-10-31 05:40:05,218 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn2-vm1-63706055 passed
2025-10-31 05:40:05,373 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 05:40:05,373 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-63706055, IP 24.240.99.131, Port 22
2025-10-31 05:40:05,533 - DEBUG - VM ctest-vn2-vm1-63706055 is ready for SSH connections
2025-10-31 05:40:05,533 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 05:40:05,533 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  24.240.99.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.137, gateway password: c0ntrail123
2025-10-31 05:40:05,534 - DEBUG - ping -s 56 -c 3 -W 1  24.240.99.131
2025-10-31 05:40:10,601 - DEBUG - PING 24.240.99.131 (24.240.99.131): 56 data bytes
--- 24.240.99.131 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2025-10-31 05:40:10,601 - WARNING - Ping to IP 24.240.99.131 from VM ctest-vn1-vm1-78892960 failed
2025-10-31 05:40:10,601 - INFO - Adding interface with subnet_id 4d4ccc50-5ec2-4d0f-a372-ff75260ca4ef, port_id None to router e3abe8a8-7bd9-476f-b3bc-aea527352df1
2025-10-31 05:40:10,836 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 05:40:10,836 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  24.240.99.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.137, gateway password: c0ntrail123
2025-10-31 05:40:10,837 - DEBUG - ping -s 56 -c 3 -W 1  24.240.99.131
2025-10-31 05:40:14,054 - DEBUG - PING 24.240.99.131 (24.240.99.131): 56 data bytes
64 bytes from 24.240.99.131: seq=1 ttl=63 time=3.032 ms
64 bytes from 24.240.99.131: seq=2 ttl=63 time=1.039 ms
--- 24.240.99.131 ping statistics ---
3 packets transmitted, 2 packets received, 33% packet loss
round-trip min/avg/max = 1.039/2.035/3.032 ms
2025-10-31 05:40:14,055 - WARNING - Ping to IP 24.240.99.131 from VM ctest-vn1-vm1-78892960 failed
2025-10-31 05:40:15,055 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  24.240.99.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.137, gateway password: c0ntrail123
2025-10-31 05:40:15,055 - DEBUG - ping -s 56 -c 3 -W 1  24.240.99.131
2025-10-31 05:40:17,279 - DEBUG - PING 24.240.99.131 (24.240.99.131): 56 data bytes
64 bytes from 24.240.99.131: seq=0 ttl=63 time=1.633 ms
64 bytes from 24.240.99.131: seq=1 ttl=63 time=0.734 ms
64 bytes from 24.240.99.131: seq=2 ttl=63 time=0.740 ms
--- 24.240.99.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.734/1.035/1.633 ms
2025-10-31 05:40:17,279 - INFO - Ping to IP 24.240.99.131 from VM ctest-vn1-vm1-78892960 passed
2025-10-31 05:40:17,279 - INFO - Deleting interface with subnet_id 084be6b3-ac80-4f1a-a988-15979022be3e, port_id None from router e3abe8a8-7bd9-476f-b3bc-aea527352df1
2025-10-31 05:40:17,391 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 05:40:17,391 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  24.240.99.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.137, gateway password: c0ntrail123
2025-10-31 05:40:17,391 - DEBUG - ping -s 56 -c 3 -W 1  24.240.99.131
2025-10-31 05:40:20,614 - DEBUG - PING 24.240.99.131 (24.240.99.131): 56 data bytes
--- 24.240.99.131 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2025-10-31 05:40:20,614 - WARNING - Ping to IP 24.240.99.131 from VM ctest-vn1-vm1-78892960 failed
2025-10-31 05:40:20,614 - INFO - Adding interface with subnet_id 084be6b3-ac80-4f1a-a988-15979022be3e, port_id None to router e3abe8a8-7bd9-476f-b3bc-aea527352df1
2025-10-31 05:40:20,825 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 05:40:20,825 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  24.240.99.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.137, gateway password: c0ntrail123
2025-10-31 05:40:20,826 - DEBUG - ping -s 56 -c 3 -W 1  24.240.99.131
2025-10-31 05:40:23,049 - DEBUG - PING 24.240.99.131 (24.240.99.131): 56 data bytes
64 bytes from 24.240.99.131: seq=0 ttl=63 time=1.513 ms
64 bytes from 24.240.99.131: seq=1 ttl=63 time=0.953 ms
64 bytes from 24.240.99.131: seq=2 ttl=63 time=0.858 ms
--- 24.240.99.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.858/1.108/1.513 ms
2025-10-31 05:40:23,049 - INFO - Ping to IP 24.240.99.131 from VM ctest-vn1-vm1-78892960 passed
2025-10-31 05:40:23,049 - INFO - Deleting interface with subnet_id 4d4ccc50-5ec2-4d0f-a372-ff75260ca4ef, port_id None from router e3abe8a8-7bd9-476f-b3bc-aea527352df1
2025-10-31 05:40:23,175 - INFO - Deleting interface with subnet_id 084be6b3-ac80-4f1a-a988-15979022be3e, port_id None from router e3abe8a8-7bd9-476f-b3bc-aea527352df1
2025-10-31 05:40:23,350 - INFO - Deleting VM ctest-vn2-vm1-63706055
2025-10-31 05:40:23,420 - INFO - Deleting VM ctest-vn1-vm1-78892960
2025-10-31 05:40:23,501 - INFO - Deleting VN ctest-vn2-68855172 
2025-10-31 05:40:23,536 - DEBUG - VN 43f0d895-5caf-4db0-9d3c-efa6df58ce50 still in use: Unable to complete operation on network 43f0d895-5caf-4db0-9d3c-efa6df58ce50. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-260093d5-5c52-40a0-84e0-bb544643c85d']
2025-10-31 05:40:23,537 - WARNING - Deleting VN ctest-vn2-68855172 failed..Will retry
2025-10-31 05:40:25,627 - DEBUG - Response for deleting network ()
2025-10-31 05:40:25,627 - INFO - Deleting VN ctest-vn1-09003462 
2025-10-31 05:40:25,719 - DEBUG - Response for deleting network ()
2025-10-31 05:40:25,979 - DEBUG - No XMPP flaps were noticed during the test
2025-10-31 05:40:25,979 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:38]
2025-10-31 05:40:25,979 - INFO - --------------------------------------------------------------------------------
2025-10-31 05:40:26,709 - INFO - Deleted project: ctest-TestRouters-84984079, ID : b5eddf95-4229-466c-94fa-2928a4f85174