2025-10-30 14:40:35,062 - INFO - Domain Default found not creating
2025-10-30 14:40:35,218 - INFO - Project ctest-TestRouters-72366399 not found, creating it
2025-10-30 14:40:35,737 - INFO - Created Project:ctest-TestRouters-72366399, ID : 3ce30f82-b6c2-4a5a-93ef-e4b3cca2ddf1 
2025-10-30 14:40:37,193 - INFO - ================================================================================
2025-10-30 14:40:37,193 - INFO - STARTING TEST    : test_basic_router_behavior
2025-10-30 14:40:37,193 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
        Create a router
        Create 2 VNs, and a VM in each
        Add router port from each VN
        Ping between VMs
        
2025-10-30 14:40:37,451 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.254': '0'}} with
2025-10-30 14:40:37,451 - INFO - Initial checks done. Running the testcase now
2025-10-30 14:40:37,451 - INFO - 
2025-10-30 14:40:38,011 - DEBUG - Response for create_network : {'network': {'id': '8aa83b19-00e8-40f0-90e8-6036bacf3b1a', 'name': 'ctest-vn1-31549451', 'tenant_id': '3ce30f82b6c24a5a93efe4b3cca2ddf1', 'project_id': '3ce30f82b6c24a5a93efe4b3cca2ddf1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-72366399', 'ctest-vn1-31549451'], 'port_security_enabled': True, 'description': ''}}
2025-10-30 14:40:38,168 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a87031fb-34cc-455c-97a9-c06af8d0df19', 'name': '', 'tenant_id': '3ce30f82b6c24a5a93efe4b3cca2ddf1', 'network_id': '8aa83b19-00e8-40f0-90e8-6036bacf3b1a', 'ip_version': 4, 'cidr': '44.191.151.64/26', 'allocation_pools': [{'start': '44.191.151.66', 'end': '44.191.151.126'}], 'gateway_ip': '44.191.151.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '44.191.151.66', 'tags': [], 'project_id': '3ce30f82b6c24a5a93efe4b3cca2ddf1'}}
2025-10-30 14:40:38,185 - INFO - Created VN ctest-vn1-31549451
2025-10-30 14:40:38,240 - DEBUG - VN ctest-vn1-31549451 UUID is 8aa83b19-00e8-40f0-90e8-6036bacf3b1a
2025-10-30 14:40:38,598 - DEBUG - Response for create_network : {'network': {'id': 'db87b823-bd11-4ab2-8a76-345a4cb10b89', 'name': 'ctest-vn2-68639025', 'tenant_id': '3ce30f82b6c24a5a93efe4b3cca2ddf1', 'project_id': '3ce30f82b6c24a5a93efe4b3cca2ddf1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-72366399', 'ctest-vn2-68639025'], 'port_security_enabled': True, 'description': ''}}
2025-10-30 14:40:38,829 - DEBUG - Response for create_subnet : {'subnet': {'id': '5340a986-1d8e-4a4f-92ff-52cc2b9ee116', 'name': '', 'tenant_id': '3ce30f82b6c24a5a93efe4b3cca2ddf1', 'network_id': 'db87b823-bd11-4ab2-8a76-345a4cb10b89', 'ip_version': 4, 'cidr': '41.5.214.64/26', 'allocation_pools': [{'start': '41.5.214.66', 'end': '41.5.214.126'}], 'gateway_ip': '41.5.214.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '41.5.214.66', 'tags': [], 'project_id': '3ce30f82b6c24a5a93efe4b3cca2ddf1'}}
2025-10-30 14:40:38,852 - INFO - Created VN ctest-vn2-68639025
2025-10-30 14:40:38,908 - DEBUG - VN ctest-vn2-68639025 UUID is db87b823-bd11-4ab2-8a76-345a4cb10b89
2025-10-30 14:40:39,122 - DEBUG - Services list from nova: [, , ]
2025-10-30 14:40:40,134 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4545-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4545-1)
2025-10-30 14:40:41,367 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4545-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4545-1)
2025-10-30 14:40:41,440 - INFO - Adding interface with subnet_id a87031fb-34cc-455c-97a9-c06af8d0df19, port_id None to router 2d3ef96e-e10f-449e-ad55-c73abba76f5d
2025-10-30 14:40:41,746 - INFO - Waiting for VM ctest-vn1-vm1-50823450 to be up..
2025-10-30 14:40:41,836 - DEBUG - VM  is still in BUILD state, Expected: ACTIVE
2025-10-30 14:40:46,918 - DEBUG - VM  is in ACTIVE state now
2025-10-30 14:40:46,918 - INFO - VM name : ctest-vn1-vm1-50823450
2025-10-30 14:40:46,994 - DEBUG - VM ctest-vn1-vm1-50823450 ID is a7137e7b-85eb-4035-95ba-09adf7919363
2025-10-30 14:40:47,032 - DEBUG - VM ctest-vn1-vm1-50823450 launched on Node cn-jenkins-deploy-platform-ansible-os-4545-1
2025-10-30 14:40:47,120 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/a7137e7b-85eb-4035-95ba-09adf7919363
2025-10-30 14:40:47,429 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/a7137e7b-85eb-4035-95ba-09adf7919363
2025-10-30 14:40:47,461 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/453b82f7-ae2e-42fc-bb21-5782aedda6e6
2025-10-30 14:40:50,708 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1001ms')
2025-10-30 14:40:50,708 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-50823450 failed!
2025-10-30 14:40:50,764 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-72366399:ctest-vn1-31549451 is 44.191.151.65 and allocation pool is NOT set
2025-10-30 14:40:52,824 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.16 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.585 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.585/1.870/3.155/1.285 ms')
2025-10-30 14:40:52,825 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-50823450 passed
2025-10-30 14:40:52,972 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 14:40:52,972 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-50823450, IP 44.191.151.67, Port 22
2025-10-30 14:40:53,127 - DEBUG - VM ctest-vn1-vm1-50823450 is ready for SSH connections
2025-10-30 14:40:53,127 - INFO - Waiting for VM ctest-vn2-vm1-05496843 to be up..
2025-10-30 14:40:53,203 - DEBUG - VM  is in ACTIVE state now
2025-10-30 14:40:53,203 - INFO - VM name : ctest-vn2-vm1-05496843
2025-10-30 14:40:53,273 - DEBUG - VM ctest-vn2-vm1-05496843 ID is a40d1ce6-0a2a-4195-8366-bbf6f1aeea2f
2025-10-30 14:40:53,273 - DEBUG - VM ctest-vn2-vm1-05496843 launched on Node cn-jenkins-deploy-platform-ansible-os-4545-1
2025-10-30 14:40:53,343 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/a40d1ce6-0a2a-4195-8366-bbf6f1aeea2f
2025-10-30 14:40:53,353 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/ed5288b9-bfac-449c-bdb3-5fd4b9476a3f
2025-10-30 14:40:54,602 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.10 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.529 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.529/1.814/3.100/1.285 ms')
2025-10-30 14:40:54,602 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn2-vm1-05496843 passed
2025-10-30 14:40:54,756 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 14:40:54,756 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-05496843, IP 41.5.214.67, Port 22
2025-10-30 14:40:54,915 - DEBUG - VM ctest-vn2-vm1-05496843 is ready for SSH connections
2025-10-30 14:40:54,915 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 14:40:54,915 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  41.5.214.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.254, gateway password: c0ntrail123
2025-10-30 14:40:54,916 - DEBUG - ping -s 56 -c 3 -W 1  41.5.214.67
2025-10-30 14:40:59,878 - DEBUG - PING 41.5.214.67 (41.5.214.67): 56 data bytes
--- 41.5.214.67 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2025-10-30 14:40:59,879 - WARNING - Ping to IP 41.5.214.67 from VM ctest-vn1-vm1-50823450 failed
2025-10-30 14:40:59,879 - INFO - Adding interface with subnet_id 5340a986-1d8e-4a4f-92ff-52cc2b9ee116, port_id None to router 2d3ef96e-e10f-449e-ad55-c73abba76f5d
2025-10-30 14:41:00,120 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 14:41:00,120 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  41.5.214.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.254, gateway password: c0ntrail123
2025-10-30 14:41:00,120 - DEBUG - ping -s 56 -c 3 -W 1  41.5.214.67
2025-10-30 14:41:03,332 - DEBUG - PING 41.5.214.67 (41.5.214.67): 56 data bytes
64 bytes from 41.5.214.67: seq=1 ttl=63 time=3.028 ms
64 bytes from 41.5.214.67: seq=2 ttl=63 time=1.331 ms
--- 41.5.214.67 ping statistics ---
3 packets transmitted, 2 packets received, 33% packet loss
round-trip min/avg/max = 1.331/2.179/3.028 ms
2025-10-30 14:41:03,332 - WARNING - Ping to IP 41.5.214.67 from VM ctest-vn1-vm1-50823450 failed
2025-10-30 14:41:04,333 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  41.5.214.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.254, gateway password: c0ntrail123
2025-10-30 14:41:04,333 - DEBUG - ping -s 56 -c 3 -W 1  41.5.214.67
2025-10-30 14:41:06,587 - DEBUG - PING 41.5.214.67 (41.5.214.67): 56 data bytes
64 bytes from 41.5.214.67: seq=0 ttl=63 time=1.587 ms
64 bytes from 41.5.214.67: seq=1 ttl=63 time=0.920 ms
64 bytes from 41.5.214.67: seq=2 ttl=63 time=1.065 ms
--- 41.5.214.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.920/1.190/1.587 ms
2025-10-30 14:41:06,588 - INFO - Ping to IP 41.5.214.67 from VM ctest-vn1-vm1-50823450 passed
2025-10-30 14:41:06,588 - INFO - Deleting interface with subnet_id a87031fb-34cc-455c-97a9-c06af8d0df19, port_id None from router 2d3ef96e-e10f-449e-ad55-c73abba76f5d
2025-10-30 14:41:06,702 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 14:41:06,703 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  41.5.214.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.254, gateway password: c0ntrail123
2025-10-30 14:41:06,703 - DEBUG - ping -s 56 -c 3 -W 1  41.5.214.67
2025-10-30 14:41:09,914 - DEBUG - PING 41.5.214.67 (41.5.214.67): 56 data bytes
--- 41.5.214.67 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2025-10-30 14:41:09,914 - WARNING - Ping to IP 41.5.214.67 from VM ctest-vn1-vm1-50823450 failed
2025-10-30 14:41:09,914 - INFO - Adding interface with subnet_id a87031fb-34cc-455c-97a9-c06af8d0df19, port_id None to router 2d3ef96e-e10f-449e-ad55-c73abba76f5d
2025-10-30 14:41:10,121 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 14:41:10,121 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1  41.5.214.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.254, gateway password: c0ntrail123
2025-10-30 14:41:10,121 - DEBUG - ping -s 56 -c 3 -W 1  41.5.214.67
2025-10-30 14:41:12,352 - DEBUG - PING 41.5.214.67 (41.5.214.67): 56 data bytes
64 bytes from 41.5.214.67: seq=0 ttl=63 time=1.413 ms
64 bytes from 41.5.214.67: seq=1 ttl=63 time=0.989 ms
64 bytes from 41.5.214.67: seq=2 ttl=63 time=0.892 ms
--- 41.5.214.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.892/1.098/1.413 ms
2025-10-30 14:41:12,352 - INFO - Ping to IP 41.5.214.67 from VM ctest-vn1-vm1-50823450 passed
2025-10-30 14:41:12,352 - INFO - Deleting interface with subnet_id 5340a986-1d8e-4a4f-92ff-52cc2b9ee116, port_id None from router 2d3ef96e-e10f-449e-ad55-c73abba76f5d
2025-10-30 14:41:12,463 - INFO - Deleting interface with subnet_id a87031fb-34cc-455c-97a9-c06af8d0df19, port_id None from router 2d3ef96e-e10f-449e-ad55-c73abba76f5d
2025-10-30 14:41:12,640 - INFO - Deleting VM ctest-vn2-vm1-05496843
2025-10-30 14:41:12,716 - INFO - Deleting VM ctest-vn1-vm1-50823450
2025-10-30 14:41:12,788 - INFO - Deleting VN ctest-vn2-68639025 
2025-10-30 14:41:12,821 - DEBUG - VN db87b823-bd11-4ab2-8a76-345a4cb10b89 still in use: Unable to complete operation on network db87b823-bd11-4ab2-8a76-345a4cb10b89. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-1e0e8cde-69de-4d7b-81ae-a15a5e21786f']
2025-10-30 14:41:12,822 - WARNING - Deleting VN ctest-vn2-68639025 failed..Will retry
2025-10-30 14:41:14,911 - DEBUG - Response for deleting network ()
2025-10-30 14:41:14,911 - INFO - Deleting VN ctest-vn1-31549451 
2025-10-30 14:41:15,007 - DEBUG - Response for deleting network ()
2025-10-30 14:41:15,265 - DEBUG - No XMPP flaps were noticed during the test
2025-10-30 14:41:15,265 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:38]
2025-10-30 14:41:15,265 - INFO - --------------------------------------------------------------------------------
2025-10-30 14:41:15,951 - INFO - Deleted project: ctest-TestRouters-72366399, ID : 3ce30f82-b6c2-4a5a-93ef-e4b3cca2ddf1