2025-10-31 14:45:50,709 - INFO - Domain Default found not creating
2025-10-31 14:45:50,854 - INFO - Project ctest-TestRouters-62674075 not found, creating it
2025-10-31 14:45:51,304 - INFO - Created Project:ctest-TestRouters-62674075, ID : 086bee96-fbd9-4e11-b66f-7d709252490f 
2025-10-31 14:45:52,965 - INFO - ================================================================================
2025-10-31 14:45:52,966 - INFO - STARTING TEST    : test_basic_router_behavior
2025-10-31 14:45:52,966 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
        Create a router
        Create 2 VNs, and a VM in each
        Add router port from each VN
        Ping between VMs
        
2025-10-31 14:45:53,222 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.254': '0'}} with
2025-10-31 14:45:53,222 - INFO - Initial checks done. Running the testcase now
2025-10-31 14:45:53,222 - INFO - 
2025-10-31 14:45:53,826 - DEBUG - Response for create_network : {'network': {'id': '92141be9-b7fb-48aa-be2c-6a57797d0c80', 'name': 'ctest-vn1-76754171', 'tenant_id': '086bee96fbd94e11b66f7d709252490f', 'project_id': '086bee96fbd94e11b66f7d709252490f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-62674075', 'ctest-vn1-76754171'], 'port_security_enabled': True, 'description': ''}}
2025-10-31 14:45:53,982 - DEBUG - Response for create_subnet : {'subnet': {'id': '6d269be6-3f8e-4e47-9b0a-228f78a0f09c', 'name': '', 'tenant_id': '086bee96fbd94e11b66f7d709252490f', 'network_id': '92141be9-b7fb-48aa-be2c-6a57797d0c80', 'ip_version': 4, 'cidr': '29.24.104.64/26', 'allocation_pools': [{'start': '29.24.104.66', 'end': '29.24.104.126'}], 'gateway_ip': '29.24.104.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '29.24.104.66', 'tags': [], 'project_id': '086bee96fbd94e11b66f7d709252490f'}}
2025-10-31 14:45:54,001 - INFO - Created VN ctest-vn1-76754171
2025-10-31 14:45:54,052 - DEBUG - VN ctest-vn1-76754171 UUID is 92141be9-b7fb-48aa-be2c-6a57797d0c80
2025-10-31 14:45:54,387 - DEBUG - Response for create_network : {'network': {'id': '1b8a8093-0ecf-4a54-8156-7bd717dac165', 'name': 'ctest-vn2-97503339', 'tenant_id': '086bee96fbd94e11b66f7d709252490f', 'project_id': '086bee96fbd94e11b66f7d709252490f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-62674075', 'ctest-vn2-97503339'], 'port_security_enabled': True, 'description': ''}}
2025-10-31 14:45:54,573 - DEBUG - Response for create_subnet : {'subnet': {'id': '2005b3a7-b746-466b-b9be-9dba09dee866', 'name': '', 'tenant_id': '086bee96fbd94e11b66f7d709252490f', 'network_id': '1b8a8093-0ecf-4a54-8156-7bd717dac165', 'ip_version': 4, 'cidr': '73.71.31.128/26', 'allocation_pools': [{'start': '73.71.31.130', 'end': '73.71.31.190'}], 'gateway_ip': '73.71.31.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '73.71.31.130', 'tags': [], 'project_id': '086bee96fbd94e11b66f7d709252490f'}}
2025-10-31 14:45:54,592 - INFO - Created VN ctest-vn2-97503339
2025-10-31 14:45:54,648 - DEBUG - VN ctest-vn2-97503339 UUID is 1b8a8093-0ecf-4a54-8156-7bd717dac165
2025-10-31 14:45:54,851 - DEBUG - Services list from nova: [, , ]
2025-10-31 14:45:55,967 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4578-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4578-1)
2025-10-31 14:45:57,306 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4578-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4578-1)
2025-10-31 14:45:57,397 - INFO - Adding interface with subnet_id 6d269be6-3f8e-4e47-9b0a-228f78a0f09c, port_id None to router ce60e936-7604-422f-be8e-9864771c84ea
2025-10-31 14:45:57,745 - INFO - Waiting for VM ctest-vn1-vm1-25191741 to be up..
2025-10-31 14:45:57,919 - DEBUG - VM  is still in BUILD state, Expected: ACTIVE
2025-10-31 14:46:02,991 - DEBUG - VM  is in ACTIVE state now
2025-10-31 14:46:02,992 - INFO - VM name : ctest-vn1-vm1-25191741
2025-10-31 14:46:03,068 - DEBUG - VM ctest-vn1-vm1-25191741 ID is c38f8bf3-4a0e-4639-b784-03395cdb7b53
2025-10-31 14:46:03,092 - DEBUG - VM ctest-vn1-vm1-25191741 launched on Node cn-jenkins-deploy-platform-ansible-os-4578-1
2025-10-31 14:46:03,181 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/c38f8bf3-4a0e-4639-b784-03395cdb7b53
2025-10-31 14:46:03,522 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/c38f8bf3-4a0e-4639-b784-03395cdb7b53
2025-10-31 14:46:03,555 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/d7d4140d-ae74-4c96-b1f7-fa0d2806b1d9
2025-10-31 14:46:06,804 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2025-10-31 14:46:06,804 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-25191741 failed!
2025-10-31 14:46:06,856 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-62674075:ctest-vn1-76754171 is 29.24.104.65 and allocation pool is NOT set
2025-10-31 14:46:08,922 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.70 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.51 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.508/4.106/6.704/2.598 ms')
2025-10-31 14:46:08,922 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-25191741 passed
2025-10-31 14:46:09,072 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 14:46:09,072 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-25191741, IP 29.24.104.67, Port 22
2025-10-31 14:46:09,239 - DEBUG - VM ctest-vn1-vm1-25191741 is ready for SSH connections
2025-10-31 14:46:09,239 - INFO - Waiting for VM ctest-vn2-vm1-46489438 to be up..
2025-10-31 14:46:09,325 - DEBUG - VM  is in ACTIVE state now
2025-10-31 14:46:09,325 - INFO - VM name : ctest-vn2-vm1-46489438
2025-10-31 14:46:09,404 - DEBUG - VM ctest-vn2-vm1-46489438 ID is 7827dcbc-cf0d-4bc2-91cd-f7c1f3a04974
2025-10-31 14:46:09,404 - DEBUG - VM ctest-vn2-vm1-46489438 launched on Node cn-jenkins-deploy-platform-ansible-os-4578-1
2025-10-31 14:46:09,473 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/7827dcbc-cf0d-4bc2-91cd-f7c1f3a04974
2025-10-31 14:46:09,481 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/0ab410a5-bea5-43bd-86e1-ed52cc1760b1
2025-10-31 14:46:10,717 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.28 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.390 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.390/1.835/3.281/1.445 ms')
2025-10-31 14:46:10,717 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn2-vm1-46489438 passed
2025-10-31 14:46:10,868 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 14:46:10,868 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-46489438, IP 73.71.31.131, Port 22
2025-10-31 14:46:11,034 - DEBUG - VM ctest-vn2-vm1-46489438 is ready for SSH connections
2025-10-31 14:46:11,034 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 14:46:11,034 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  73.71.31.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-31 14:46:11,034 - DEBUG - ping -s 56 -c 3 -W 1  73.71.31.131
2025-10-31 14:46:16,092 - DEBUG - PING 73.71.31.131 (73.71.31.131): 56 data bytes
--- 73.71.31.131 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2025-10-31 14:46:16,092 - WARNING - Ping to IP 73.71.31.131 from VM ctest-vn1-vm1-25191741 failed
2025-10-31 14:46:16,092 - INFO - Adding interface with subnet_id 2005b3a7-b746-466b-b9be-9dba09dee866, port_id None to router ce60e936-7604-422f-be8e-9864771c84ea
2025-10-31 14:46:16,354 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 14:46:16,355 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  73.71.31.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-31 14:46:16,355 - DEBUG - ping -s 56 -c 3 -W 1  73.71.31.131
2025-10-31 14:46:19,584 - DEBUG - PING 73.71.31.131 (73.71.31.131): 56 data bytes
64 bytes from 73.71.31.131: seq=1 ttl=63 time=2.765 ms
64 bytes from 73.71.31.131: seq=2 ttl=63 time=1.190 ms
--- 73.71.31.131 ping statistics ---
3 packets transmitted, 2 packets received, 33% packet loss
round-trip min/avg/max = 1.190/1.977/2.765 ms
2025-10-31 14:46:19,585 - WARNING - Ping to IP 73.71.31.131 from VM ctest-vn1-vm1-25191741 failed
2025-10-31 14:46:20,585 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  73.71.31.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-31 14:46:20,586 - DEBUG - ping -s 56 -c 3 -W 1  73.71.31.131
2025-10-31 14:46:22,803 - DEBUG - PING 73.71.31.131 (73.71.31.131): 56 data bytes
64 bytes from 73.71.31.131: seq=0 ttl=63 time=1.459 ms
64 bytes from 73.71.31.131: seq=1 ttl=63 time=0.900 ms
64 bytes from 73.71.31.131: seq=2 ttl=63 time=0.781 ms
--- 73.71.31.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.781/1.046/1.459 ms
2025-10-31 14:46:22,803 - INFO - Ping to IP 73.71.31.131 from VM ctest-vn1-vm1-25191741 passed
2025-10-31 14:46:22,804 - INFO - Deleting interface with subnet_id 6d269be6-3f8e-4e47-9b0a-228f78a0f09c, port_id None from router ce60e936-7604-422f-be8e-9864771c84ea
2025-10-31 14:46:22,918 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 14:46:22,918 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  73.71.31.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-31 14:46:22,918 - DEBUG - ping -s 56 -c 3 -W 1  73.71.31.131
2025-10-31 14:46:26,137 - DEBUG - PING 73.71.31.131 (73.71.31.131): 56 data bytes
--- 73.71.31.131 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2025-10-31 14:46:26,137 - WARNING - Ping to IP 73.71.31.131 from VM ctest-vn1-vm1-25191741 failed
2025-10-31 14:46:26,137 - INFO - Adding interface with subnet_id 6d269be6-3f8e-4e47-9b0a-228f78a0f09c, port_id None to router ce60e936-7604-422f-be8e-9864771c84ea
2025-10-31 14:46:26,341 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 14:46:26,341 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  73.71.31.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-31 14:46:26,341 - DEBUG - ping -s 56 -c 3 -W 1  73.71.31.131
2025-10-31 14:46:28,559 - DEBUG - PING 73.71.31.131 (73.71.31.131): 56 data bytes
64 bytes from 73.71.31.131: seq=0 ttl=63 time=1.569 ms
64 bytes from 73.71.31.131: seq=1 ttl=63 time=0.780 ms
64 bytes from 73.71.31.131: seq=2 ttl=63 time=0.782 ms
--- 73.71.31.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.780/1.043/1.569 ms
2025-10-31 14:46:28,559 - INFO - Ping to IP 73.71.31.131 from VM ctest-vn1-vm1-25191741 passed
2025-10-31 14:46:28,559 - INFO - Deleting interface with subnet_id 2005b3a7-b746-466b-b9be-9dba09dee866, port_id None from router ce60e936-7604-422f-be8e-9864771c84ea
2025-10-31 14:46:28,693 - INFO - Deleting interface with subnet_id 6d269be6-3f8e-4e47-9b0a-228f78a0f09c, port_id None from router ce60e936-7604-422f-be8e-9864771c84ea
2025-10-31 14:46:28,891 - INFO - Deleting VM ctest-vn2-vm1-46489438
2025-10-31 14:46:28,977 - INFO - Deleting VM ctest-vn1-vm1-25191741
2025-10-31 14:46:29,056 - INFO - Deleting VN ctest-vn2-97503339 
2025-10-31 14:46:29,091 - DEBUG - VN 1b8a8093-0ecf-4a54-8156-7bd717dac165 still in use: Unable to complete operation on network 1b8a8093-0ecf-4a54-8156-7bd717dac165. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-2b2cccdb-1f40-438f-8d4c-3d0b1f8a7399']
2025-10-31 14:46:29,091 - WARNING - Deleting VN ctest-vn2-97503339 failed..Will retry
2025-10-31 14:46:31,193 - DEBUG - Response for deleting network ()
2025-10-31 14:46:31,193 - INFO - Deleting VN ctest-vn1-76754171 
2025-10-31 14:46:31,308 - DEBUG - Response for deleting network ()
2025-10-31 14:46:31,566 - DEBUG - No XMPP flaps were noticed during the test
2025-10-31 14:46:31,566 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:39]
2025-10-31 14:46:31,566 - INFO - --------------------------------------------------------------------------------
2025-10-31 14:46:32,314 - INFO - Deleted project: ctest-TestRouters-62674075, ID : 086bee96-fbd9-4e11-b66f-7d709252490f