2025-08-07 20:34:48,950 - INFO - Domain Default found not creating 2025-08-07 20:34:49,479 - INFO - Project ctest-TestBGPaasZone-17583238 not found, creating it 2025-08-07 20:34:50,049 - INFO - Created Project:ctest-TestBGPaasZone-17583238, ID : 91804f99-b356-46e3-aeeb-e8aef378778d 2025-08-07 20:34:52,029 - DEBUG - Services list from nova: [, , , ] 2025-08-07 20:34:52,030 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3775-2', 'an-jenkins-deploy-platform-ansible-os-3775-1']} 2025-08-07 20:34:52,032 - INFO - ================================================================================ 2025-08-07 20:34:52,032 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-08-07 20:34:53,480 - DEBUG - Skipping xmpp flap check 2025-08-07 20:34:53,481 - INFO - Initial checks done. Running the testcase now 2025-08-07 20:34:53,481 - INFO - 2025-08-07 20:34:53,481 - INFO - executing bgp_control_zone test 2025-08-07 20:34:54,180 - DEBUG - Response for create_network : {'network': {'id': '2c30a38d-0205-4a3b-9695-b82acb5c569b', 'name': 'ctest-cnz_vn-19400353', 'tenant_id': '91804f99b35646e3aeebe8aef378778d', 'project_id': '91804f99b35646e3aeebe8aef378778d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-17583238', 'ctest-cnz_vn-19400353'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 20:34:54,465 - DEBUG - Response for create_subnet : {'subnet': {'id': '186c7d83-59ed-43ec-b947-0fd035ca0710', 'name': '', 'tenant_id': '91804f99b35646e3aeebe8aef378778d', 'network_id': '2c30a38d-0205-4a3b-9695-b82acb5c569b', 'ip_version': 4, 'cidr': '43.125.200.0/26', 'allocation_pools': [{'start': '43.125.200.2', 'end': '43.125.200.62'}], 'gateway_ip': '43.125.200.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '43.125.200.2', 'tags': [], 'project_id': '91804f99b35646e3aeebe8aef378778d'}} 2025-08-07 20:34:54,493 - INFO - Created VN ctest-cnz_vn-19400353 2025-08-07 20:34:54,511 - DEBUG - VN ctest-cnz_vn-19400353 UUID is 2c30a38d-0205-4a3b-9695-b82acb5c569b 2025-08-07 20:34:55,892 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3775-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3775-2) 2025-08-07 20:34:57,529 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3775-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3775-1) 2025-08-07 20:34:59,284 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3775-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3775-2) 2025-08-07 20:34:59,285 - INFO - Waiting for VM ctest-TestBGPaasZone-17583238-12739192 to be up.. 2025-08-07 20:34:59,417 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-07 20:35:04,557 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-07 20:35:09,665 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-07 20:35:14,764 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-07 20:35:19,856 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-07 20:35:24,981 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-07 20:35:30,081 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-07 20:35:35,185 - DEBUG - VM is in ACTIVE state now 2025-08-07 20:35:35,185 - INFO - VM name : ctest-TestBGPaasZone-17583238-12739192 2025-08-07 20:35:35,272 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 ID is 08ccd2cb-3b11-4ac0-bfb9-a7f08e618dd1 2025-08-07 20:35:35,298 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 launched on Node an-jenkins-deploy-platform-ansible-os-3775-2 2025-08-07 20:35:35,384 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/08ccd2cb-3b11-4ac0-bfb9-a7f08e618dd1 2025-08-07 20:35:35,691 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/08ccd2cb-3b11-4ac0-bfb9-a7f08e618dd1 2025-08-07 20:35:35,746 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/1862c4c1-58e0-492a-9911-63d36451b050 2025-08-07 20:35:38,979 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-08-07 20:35:38,980 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:35:38,999 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:35:43,075 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-08-07 20:35:43,075 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:35:43,093 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:35:47,175 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-07 20:35:47,175 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:35:47,192 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:35:51,274 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-08-07 20:35:51,274 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:35:51,290 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:35:55,369 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-07 20:35:55,370 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:35:55,387 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:35:59,459 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-08-07 20:35:59,459 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:35:59,476 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:03,553 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-07 20:36:03,553 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:03,569 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:07,652 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-08-07 20:36:07,653 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:07,669 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:11,750 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-07 20:36:11,751 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:11,767 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:15,848 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-07 20:36:15,848 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:15,868 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:19,939 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-07 20:36:19,940 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:19,959 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:24,041 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-07 20:36:24,041 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:24,061 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:28,137 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-08-07 20:36:28,137 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:28,156 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:32,234 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-08-07 20:36:32,234 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:32,251 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:36,330 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-07 20:36:36,330 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:36,348 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:40,422 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-07 20:36:40,422 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:40,447 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:44,545 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1034ms') 2025-08-07 20:36:44,545 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:44,562 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:48,648 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-07 20:36:48,649 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:48,667 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:52,742 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-08-07 20:36:52,743 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:52,762 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:56,839 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-08-07 20:36:56,839 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 failed! 2025-08-07 20:36:56,857 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-19400353 is 43.125.200.1 and allocation pool is NOT set 2025-08-07 20:36:58,929 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.87 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.806 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.806/3.340/5.874/2.534 ms') 2025-08-07 20:36:58,930 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-12739192 passed 2025-08-07 20:36:59,049 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:36:59,049 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-12739192, IP 43.125.200.3, Port 22 2025-08-07 20:36:59,118 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:36:59,234 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:37:04,234 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:04,235 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-12739192, IP 43.125.200.3, Port 22 2025-08-07 20:37:04,314 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:37:04,419 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:37:09,420 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:09,420 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-12739192, IP 43.125.200.3, Port 22 2025-08-07 20:37:09,490 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:37:09,595 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:37:14,596 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:14,596 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-12739192, IP 43.125.200.3, Port 22 2025-08-07 20:37:14,662 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:37:14,762 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:37:19,762 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:19,762 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-12739192, IP 43.125.200.3, Port 22 2025-08-07 20:37:19,830 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:37:19,925 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:37:24,926 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:24,926 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-12739192, IP 43.125.200.3, Port 22 2025-08-07 20:37:24,995 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:37:25,090 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:37:30,091 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:30,091 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-12739192, IP 43.125.200.3, Port 22 2025-08-07 20:37:30,158 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:37:30,262 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:37:35,263 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:35,263 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-12739192, IP 43.125.200.3, Port 22 2025-08-07 20:37:35,330 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:37:35,430 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:37:40,431 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:40,431 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-12739192, IP 43.125.200.3, Port 22 2025-08-07 20:37:40,492 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:37:40,585 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:37:45,586 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:45,586 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-12739192, IP 43.125.200.3, Port 22 2025-08-07 20:37:45,658 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:37:45,761 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:37:50,762 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:50,763 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-12739192, IP 43.125.200.3, Port 22 2025-08-07 20:37:50,930 - DEBUG - VM ctest-TestBGPaasZone-17583238-12739192 is ready for SSH connections 2025-08-07 20:37:50,930 - INFO - Waiting for VM ctest-TestBGPaasZone-17583238-45367186 to be up.. 2025-08-07 20:37:51,025 - DEBUG - VM is in ACTIVE state now 2025-08-07 20:37:51,025 - INFO - VM name : ctest-TestBGPaasZone-17583238-45367186 2025-08-07 20:37:51,121 - DEBUG - VM ctest-TestBGPaasZone-17583238-45367186 ID is 773c1a6a-81f7-4c39-948d-766891a6d8bf 2025-08-07 20:37:51,122 - DEBUG - VM ctest-TestBGPaasZone-17583238-45367186 launched on Node an-jenkins-deploy-platform-ansible-os-3775-1 2025-08-07 20:37:51,236 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/773c1a6a-81f7-4c39-948d-766891a6d8bf 2025-08-07 20:37:51,248 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/3e62e612-7ce6-43a5-8346-6db3393b9c4e 2025-08-07 20:37:52,500 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=15.0 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.46 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.455/8.249/15.044/6.794 ms') 2025-08-07 20:37:52,500 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-45367186 passed 2025-08-07 20:37:52,624 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:52,624 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-45367186, IP 43.125.200.4, Port 22 2025-08-07 20:37:52,822 - DEBUG - VM ctest-TestBGPaasZone-17583238-45367186 is ready for SSH connections 2025-08-07 20:37:52,822 - INFO - Waiting for VM ctest-TestBGPaasZone-17583238-94903069 to be up.. 2025-08-07 20:37:52,919 - DEBUG - VM is in ACTIVE state now 2025-08-07 20:37:52,919 - INFO - VM name : ctest-TestBGPaasZone-17583238-94903069 2025-08-07 20:37:53,022 - DEBUG - VM ctest-TestBGPaasZone-17583238-94903069 ID is 00c153bc-f464-4bd8-8e80-5f23c4265798 2025-08-07 20:37:53,022 - DEBUG - VM ctest-TestBGPaasZone-17583238-94903069 launched on Node an-jenkins-deploy-platform-ansible-os-3775-2 2025-08-07 20:37:53,122 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/00c153bc-f464-4bd8-8e80-5f23c4265798 2025-08-07 20:37:53,136 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/2d66497a-2726-4360-8ffd-b4bf30c0ae35 2025-08-07 20:37:54,368 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.87 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.735 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.735/2.300/3.866/1.565 ms') 2025-08-07 20:37:54,368 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-17583238-94903069 passed 2025-08-07 20:37:54,490 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:54,490 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-94903069, IP 43.125.200.5, Port 22 2025-08-07 20:37:54,670 - DEBUG - VM ctest-TestBGPaasZone-17583238-94903069 is ready for SSH connections 2025-08-07 20:37:54,827 - INFO - Created control node zone ctest-test-zone-84212134(b8e36536-a7b4-40fa-8126-fd32f3a8a49b) 2025-08-07 20:37:55,219 - INFO - Created control node zone ctest-test-zone-38377914(e3a50ac8-2fa0-4397-87db-e77580ea5db3) 2025-08-07 20:37:55,587 - INFO - Created control node zone ctest-test-zone-05465497(be9808a4-cf1e-4b9e-b9fc-7078616b4795) 2025-08-07 20:37:55,867 - INFO - Creating BGPaaS ctest-TestBGPaasZone-17583238-18572465 2025-08-07 20:37:55,943 - INFO - BGPaaS: ctest-TestBGPaasZone-17583238-18572465(d617bd0d-6176-4d1c-ae09-03f292eb3e30) 2025-08-07 20:37:55,943 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/d617bd0d-6176-4d1c-ae09-03f292eb3e30 2025-08-07 20:37:56,253 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/d617bd0d-6176-4d1c-ae09-03f292eb3e30 2025-08-07 20:37:56,297 - INFO - verify_in_api_server passed for BGPaaS obj d617bd0d-6176-4d1c-ae09-03f292eb3e30 2025-08-07 20:37:56,297 - INFO - BGPaaS(d617bd0d-6176-4d1c-ae09-03f292eb3e30): verify_on_setup passed 2025-08-07 20:37:56,297 - INFO - We will configure BGP on the VM 2025-08-07 20:37:56,571 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:37:56,571 - INFO - Configuring BGP on ctest-TestBGPaasZone-17583238-12739192 2025-08-07 20:37:56,571 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.3; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.3; } protocol bfd { neighbor 43.125.200.1 local 43.125.200.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:37:56,571 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.3; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.3; } protocol bfd { neighbor 43.125.200.1 local 43.125.200.3 multihop on; } EOS 2025-08-07 20:38:11,413 - DEBUG - None 2025-08-07 20:38:11,413 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.3; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.3; } protocol bfd { neighbor 43.125.200.1 local 43.125.200.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:38:11,413 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.3; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.3; } protocol bfd { neighbor 43.125.200.1 local 43.125.200.3 multihop on; } EOS 2025-08-07 20:38:12,578 - DEBUG - None 2025-08-07 20:38:12,578 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:38:12,578 - DEBUG - service bird restart 2025-08-07 20:38:16,103 - DEBUG - bird stop/waiting bird start/running, process 1425 2025-08-07 20:38:16,103 - INFO - Attaching VMI 1862c4c1-58e0-492a-9911-63d36451b050 to BGPaaS d617bd0d-6176-4d1c-ae09-03f292eb3e30 2025-08-07 20:38:16,191 - INFO - Attaching the VMI 08ccd2cb-3b11-4ac0-bfb9-a7f08e618dd1 to the BGPaaS d617bd0d-6176-4d1c-ae09-03f292eb3e30 object 2025-08-07 20:38:16,191 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 43.125.200.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:38:16,191 - DEBUG - sudo ip addr add 43.125.200.20 dev eth0 2025-08-07 20:38:17,810 - DEBUG - None 2025-08-07 20:38:17,879 - INFO - Creating BGPaaS ctest-TestBGPaasZone-17583238-08047299 2025-08-07 20:38:17,959 - INFO - BGPaaS: ctest-TestBGPaasZone-17583238-08047299(02428898-8a90-4f78-903b-e60a211bb814) 2025-08-07 20:38:17,959 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/02428898-8a90-4f78-903b-e60a211bb814 2025-08-07 20:38:17,971 - INFO - verify_in_api_server passed for BGPaaS obj 02428898-8a90-4f78-903b-e60a211bb814 2025-08-07 20:38:17,972 - INFO - BGPaaS(02428898-8a90-4f78-903b-e60a211bb814): verify_on_setup passed 2025-08-07 20:38:17,972 - INFO - We will configure BGP on the VM 2025-08-07 20:38:18,259 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:38:18,259 - INFO - Configuring BGP on ctest-TestBGPaasZone-17583238-45367186 2025-08-07 20:38:18,259 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.4; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.4; } protocol bfd { neighbor 43.125.200.2 local 43.125.200.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:38:18,260 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.4; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.4; } protocol bfd { neighbor 43.125.200.2 local 43.125.200.4 multihop on; } EOS 2025-08-07 20:38:23,949 - DEBUG - None 2025-08-07 20:38:23,949 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.4; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.4; } protocol bfd { neighbor 43.125.200.2 local 43.125.200.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:38:23,949 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.4; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.4; } protocol bfd { neighbor 43.125.200.2 local 43.125.200.4 multihop on; } EOS 2025-08-07 20:38:24,547 - DEBUG - None 2025-08-07 20:38:24,547 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:38:24,548 - DEBUG - service bird restart 2025-08-07 20:38:26,351 - DEBUG - bird stop/waiting bird start/running, process 1431 2025-08-07 20:38:26,351 - INFO - Attaching VMI 3e62e612-7ce6-43a5-8346-6db3393b9c4e to BGPaaS 02428898-8a90-4f78-903b-e60a211bb814 2025-08-07 20:38:26,439 - INFO - Attaching the VMI 773c1a6a-81f7-4c39-948d-766891a6d8bf to the BGPaaS 02428898-8a90-4f78-903b-e60a211bb814 object 2025-08-07 20:38:26,439 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 43.125.200.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:38:26,439 - DEBUG - sudo ip addr add 43.125.200.20 dev eth0 2025-08-07 20:38:27,141 - DEBUG - None 2025-08-07 20:38:27,141 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:38:27,163 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-07 20:38:27,171 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:38:27,171 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-07 20:38:27,191 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-08-07 20:38:33,193 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-07 20:38:33,212 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-08-07 20:38:39,215 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-07 20:38:39,234 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-07 20:38:39,251 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 43.125.200.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:38:39,251 - DEBUG - ping -s 56 -c 3 -W 1 43.125.200.20 2025-08-07 20:38:46,359 - DEBUG - PING 43.125.200.20 (43.125.200.20) 56(84) bytes of data. 64 bytes from 43.125.200.20: icmp_seq=1 ttl=64 time=10.1 ms 64 bytes from 43.125.200.20: icmp_seq=2 ttl=64 time=0.842 ms 64 bytes from 43.125.200.20: icmp_seq=3 ttl=64 time=0.994 ms --- 43.125.200.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.842/4.010/10.195/4.373 ms 2025-08-07 20:38:46,359 - INFO - Ping to IP 43.125.200.20 from VM ctest-TestBGPaasZone-17583238-94903069 passed 2025-08-07 20:38:47,259 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:38:47,259 - DEBUG - service bird restart 2025-08-07 20:38:49,081 - DEBUG - bird stop/waiting bird start/running, process 1463 2025-08-07 20:38:49,081 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:38:49,081 - DEBUG - service bird restart 2025-08-07 20:38:50,766 - DEBUG - bird stop/waiting bird start/running, process 1458 2025-08-07 20:38:50,767 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:38:50,787 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193'] 2025-08-07 20:38:56,809 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-08-07 20:38:56,816 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:38:56,817 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-07 20:38:56,842 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-07 20:38:56,864 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 43.125.200.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:38:56,865 - DEBUG - ping -s 56 -c 3 -W 1 43.125.200.20 2025-08-07 20:38:59,398 - DEBUG - PING 43.125.200.20 (43.125.200.20) 56(84) bytes of data. 64 bytes from 43.125.200.20: icmp_seq=1 ttl=64 time=1.80 ms 64 bytes from 43.125.200.20: icmp_seq=2 ttl=64 time=0.864 ms 64 bytes from 43.125.200.20: icmp_seq=3 ttl=64 time=0.908 ms --- 43.125.200.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.864/1.192/1.804/0.433 ms 2025-08-07 20:38:59,398 - INFO - Ping to IP 43.125.200.20 from VM ctest-TestBGPaasZone-17583238-94903069 passed 2025-08-07 20:38:59,708 - INFO - We will configure BGP on the VM 2025-08-07 20:38:59,955 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:38:59,955 - INFO - Configuring BGP on ctest-TestBGPaasZone-17583238-12739192 2025-08-07 20:38:59,955 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.3; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.3; } protocol bfd { neighbor 43.125.200.1 local 43.125.200.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:38:59,955 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.3; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.3; } protocol bfd { neighbor 43.125.200.1 local 43.125.200.3 multihop on; } EOS 2025-08-07 20:39:00,480 - DEBUG - None 2025-08-07 20:39:00,480 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.3; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.3; } protocol bfd { neighbor 43.125.200.1 local 43.125.200.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:39:00,480 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 43.125.200.3; protocol bgp bgp_1{ local as 65000; neighbor 43.125.200.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 43.125.200.3; } protocol bfd { neighbor 43.125.200.1 local 43.125.200.3 multihop on; } EOS 2025-08-07 20:39:01,023 - DEBUG - None 2025-08-07 20:39:01,023 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:39:01,023 - DEBUG - service bird restart 2025-08-07 20:39:02,862 - DEBUG - bird stop/waiting bird start/running, process 1495 2025-08-07 20:39:02,863 - INFO - Attaching VMI 1862c4c1-58e0-492a-9911-63d36451b050 to BGPaaS d617bd0d-6176-4d1c-ae09-03f292eb3e30 2025-08-07 20:39:02,889 - INFO - Attaching the VMI 08ccd2cb-3b11-4ac0-bfb9-a7f08e618dd1 to the BGPaaS d617bd0d-6176-4d1c-ae09-03f292eb3e30 object 2025-08-07 20:39:02,889 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 43.125.200.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:39:02,889 - DEBUG - sudo ip addr add 43.125.200.20 dev eth0 2025-08-07 20:39:03,639 - DEBUG - RTNETLINK answers: File exists 2025-08-07 20:39:03,640 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:39:03,640 - DEBUG - service bird restart 2025-08-07 20:39:05,705 - DEBUG - bird stop/waiting bird start/running, process 1522 2025-08-07 20:39:05,705 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:39:05,705 - DEBUG - service bird restart 2025-08-07 20:39:07,395 - DEBUG - bird stop/waiting bird start/running, process 1480 2025-08-07 20:39:07,395 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:39:07,415 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-08-07 20:39:13,434 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-07 20:39:13,446 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:39:13,446 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-07 20:39:13,463 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-08-07 20:39:19,465 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-07 20:39:19,489 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-07 20:39:19,507 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 43.125.200.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:39:19,507 - DEBUG - ping -s 56 -c 3 -W 1 43.125.200.20 2025-08-07 20:39:22,036 - DEBUG - PING 43.125.200.20 (43.125.200.20) 56(84) bytes of data. 64 bytes from 43.125.200.20: icmp_seq=1 ttl=64 time=15.1 ms 64 bytes from 43.125.200.20: icmp_seq=2 ttl=64 time=2.46 ms 64 bytes from 43.125.200.20: icmp_seq=3 ttl=64 time=1.75 ms --- 43.125.200.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2002ms rtt min/avg/max/mdev = 1.751/6.438/15.103/6.133 ms 2025-08-07 20:39:22,036 - INFO - Ping to IP 43.125.200.20 from VM ctest-TestBGPaasZone-17583238-94903069 passed 2025-08-07 20:39:22,037 - INFO - Detaching VMI 1862c4c1-58e0-492a-9911-63d36451b050 from BGPaaS d617bd0d-6176-4d1c-ae09-03f292eb3e30 2025-08-07 20:39:22,114 - INFO - Detaching VMI 3e62e612-7ce6-43a5-8346-6db3393b9c4e from BGPaaS 02428898-8a90-4f78-903b-e60a211bb814 2025-08-07 20:39:22,227 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-17583238-08047299(02428898-8a90-4f78-903b-e60a211bb814) 2025-08-07 20:39:22,308 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/02428898-8a90-4f78-903b-e60a211bb814 2025-08-07 20:39:22,317 - DEBUG - Response Code: 404 2025-08-07 20:39:22,317 - DEBUG - BGPaaS: 02428898-8a90-4f78-903b-e60a211bb814 deleted from api server 2025-08-07 20:39:22,317 - INFO - BGPaaS(02428898-8a90-4f78-903b-e60a211bb814): verify_on_cleanup passed 2025-08-07 20:39:22,317 - INFO - Detaching VMI 1862c4c1-58e0-492a-9911-63d36451b050 from BGPaaS d617bd0d-6176-4d1c-ae09-03f292eb3e30 2025-08-07 20:39:22,368 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-17583238-18572465(d617bd0d-6176-4d1c-ae09-03f292eb3e30) 2025-08-07 20:39:22,430 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/d617bd0d-6176-4d1c-ae09-03f292eb3e30 2025-08-07 20:39:22,442 - DEBUG - Response Code: 404 2025-08-07 20:39:22,443 - DEBUG - BGPaaS: d617bd0d-6176-4d1c-ae09-03f292eb3e30 deleted from api server 2025-08-07 20:39:22,443 - INFO - BGPaaS(d617bd0d-6176-4d1c-ae09-03f292eb3e30): verify_on_cleanup passed 2025-08-07 20:39:22,443 - INFO - Deleting Control node zone ctest-test-zone-05465497(be9808a4-cf1e-4b9e-b9fc-7078616b4795) 2025-08-07 20:39:22,617 - INFO - Deleting Control node zone ctest-test-zone-38377914(e3a50ac8-2fa0-4397-87db-e77580ea5db3) 2025-08-07 20:39:22,781 - INFO - Deleting Control node zone ctest-test-zone-84212134(b8e36536-a7b4-40fa-8126-fd32f3a8a49b) 2025-08-07 20:39:22,881 - INFO - Deleting VM ctest-TestBGPaasZone-17583238-94903069 2025-08-07 20:39:22,979 - INFO - Deleting VM ctest-TestBGPaasZone-17583238-45367186 2025-08-07 20:39:23,057 - INFO - Deleting VM ctest-TestBGPaasZone-17583238-12739192 2025-08-07 20:39:23,141 - INFO - Deleting VN ctest-cnz_vn-19400353 2025-08-07 20:39:23,191 - DEBUG - VN 2c30a38d-0205-4a3b-9695-b82acb5c569b still in use: Unable to complete operation on network 2c30a38d-0205-4a3b-9695-b82acb5c569b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-01ddbb7f-3d9d-4c1d-83e3-77ef00962e23'] 2025-08-07 20:39:23,191 - WARNING - Deleting VN ctest-cnz_vn-19400353 failed..Will retry 2025-08-07 20:39:25,471 - DEBUG - Response for deleting network () 2025-08-07 20:39:26,787 - DEBUG - Skipping xmpp flap check 2025-08-07 20:39:26,787 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:34] 2025-08-07 20:39:26,788 - INFO - -------------------------------------------------------------------------------- 2025-08-07 20:39:26,791 - INFO - ================================================================================ 2025-08-07 20:39:26,791 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-08-07 20:39:28,112 - DEBUG - Skipping xmpp flap check 2025-08-07 20:39:28,112 - INFO - Initial checks done. Running the testcase now 2025-08-07 20:39:28,112 - INFO - 2025-08-07 20:39:28,113 - INFO - executing bgp_control_zone agent restart test 2025-08-07 20:39:28,434 - DEBUG - Response for create_network : {'network': {'id': '33ce89da-b3d3-4f18-b5d8-81028782560b', 'name': 'ctest-cnz_vn-04511939', 'tenant_id': '91804f99b35646e3aeebe8aef378778d', 'project_id': '91804f99b35646e3aeebe8aef378778d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-17583238', 'ctest-cnz_vn-04511939'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 20:39:28,703 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd0caed6d-5a6d-4744-9f12-4b924d8d403b', 'name': '', 'tenant_id': '91804f99b35646e3aeebe8aef378778d', 'network_id': '33ce89da-b3d3-4f18-b5d8-81028782560b', 'ip_version': 4, 'cidr': '209.118.199.64/26', 'allocation_pools': [{'start': '209.118.199.66', 'end': '209.118.199.126'}], 'gateway_ip': '209.118.199.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '209.118.199.66', 'tags': [], 'project_id': '91804f99b35646e3aeebe8aef378778d'}} 2025-08-07 20:39:28,727 - INFO - Created VN ctest-cnz_vn-04511939 2025-08-07 20:39:28,741 - DEBUG - VN ctest-cnz_vn-04511939 UUID is 33ce89da-b3d3-4f18-b5d8-81028782560b 2025-08-07 20:39:30,029 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3775-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3775-1) 2025-08-07 20:39:31,473 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3775-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3775-2) 2025-08-07 20:39:33,099 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3775-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3775-1) 2025-08-07 20:39:33,099 - INFO - Waiting for VM ctest-TestBGPaasZone-17583238-34519438 to be up.. 2025-08-07 20:39:33,203 - DEBUG - VM is in ACTIVE state now 2025-08-07 20:39:33,203 - INFO - VM name : ctest-TestBGPaasZone-17583238-34519438 2025-08-07 20:39:33,303 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 ID is 840cffc3-3234-4cfe-a100-32d4cb0928f1 2025-08-07 20:39:33,303 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 launched on Node an-jenkins-deploy-platform-ansible-os-3775-1 2025-08-07 20:39:33,404 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/840cffc3-3234-4cfe-a100-32d4cb0928f1 2025-08-07 20:39:33,420 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/dd70ae7e-586b-49f0-8af1-3719a94c67e8 2025-08-07 20:39:36,748 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-08-07 20:39:36,748 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:39:36,767 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:39:40,842 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-07 20:39:40,842 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:39:40,859 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:39:44,935 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-08-07 20:39:44,935 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:39:44,955 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:39:49,034 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-08-07 20:39:49,034 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:39:49,051 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:39:53,130 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-08-07 20:39:53,130 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:39:53,176 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:39:57,259 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-07 20:39:57,259 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:39:57,276 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:01,359 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-07 20:40:01,359 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:01,382 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:05,450 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-07 20:40:05,450 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:05,473 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:09,546 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-08-07 20:40:09,546 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:09,568 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:13,635 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-07 20:40:13,635 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:13,652 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:17,732 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-08-07 20:40:17,732 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:17,756 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:21,831 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-08-07 20:40:21,831 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:21,847 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:25,926 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-07 20:40:25,926 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:25,946 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:30,017 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-07 20:40:30,018 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:30,038 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:34,123 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-07 20:40:34,123 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:34,139 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:38,219 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-08-07 20:40:38,219 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:38,237 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:42,315 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-07 20:40:42,316 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:42,335 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:46,411 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-08-07 20:40:46,411 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 failed! 2025-08-07 20:40:46,431 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-17583238:ctest-cnz_vn-04511939 is 209.118.199.65 and allocation pool is NOT set 2025-08-07 20:40:48,500 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.92 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.28 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.276/2.099/2.922/0.823 ms') 2025-08-07 20:40:48,500 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-34519438 passed 2025-08-07 20:40:48,623 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:40:48,623 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-34519438, IP 209.118.199.67, Port 22 2025-08-07 20:40:48,691 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:40:48,859 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:40:53,859 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:40:53,860 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-34519438, IP 209.118.199.67, Port 22 2025-08-07 20:40:53,926 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:40:54,065 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:40:59,066 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:40:59,066 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-34519438, IP 209.118.199.67, Port 22 2025-08-07 20:40:59,135 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:40:59,246 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:41:04,247 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:04,247 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-34519438, IP 209.118.199.67, Port 22 2025-08-07 20:41:04,314 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:41:04,414 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:41:09,415 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:09,415 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-34519438, IP 209.118.199.67, Port 22 2025-08-07 20:41:09,482 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:41:09,580 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:41:14,581 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:14,581 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-34519438, IP 209.118.199.67, Port 22 2025-08-07 20:41:14,639 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:41:14,737 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:41:19,738 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:19,738 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-34519438, IP 209.118.199.67, Port 22 2025-08-07 20:41:19,807 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:41:19,908 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:41:24,908 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:24,909 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-34519438, IP 209.118.199.67, Port 22 2025-08-07 20:41:24,969 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:41:25,075 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:41:30,076 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:30,076 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-34519438, IP 209.118.199.67, Port 22 2025-08-07 20:41:30,132 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:41:30,244 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:41:35,245 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:35,246 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-34519438, IP 209.118.199.67, Port 22 2025-08-07 20:41:35,404 - DEBUG - VM ctest-TestBGPaasZone-17583238-34519438 is ready for SSH connections 2025-08-07 20:41:35,404 - INFO - Waiting for VM ctest-TestBGPaasZone-17583238-15863370 to be up.. 2025-08-07 20:41:35,498 - DEBUG - VM is in ACTIVE state now 2025-08-07 20:41:35,499 - INFO - VM name : ctest-TestBGPaasZone-17583238-15863370 2025-08-07 20:41:35,592 - DEBUG - VM ctest-TestBGPaasZone-17583238-15863370 ID is 19d20ff2-ab0f-4dc3-85c8-a4ec25b8dedf 2025-08-07 20:41:35,592 - DEBUG - VM ctest-TestBGPaasZone-17583238-15863370 launched on Node an-jenkins-deploy-platform-ansible-os-3775-2 2025-08-07 20:41:35,676 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/19d20ff2-ab0f-4dc3-85c8-a4ec25b8dedf 2025-08-07 20:41:35,717 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/2d2eb391-d34d-4ed7-9a17-ec2de2855cfb 2025-08-07 20:41:36,958 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.37 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.429 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.429/1.899/3.370/1.470 ms') 2025-08-07 20:41:36,959 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-17583238-15863370 passed 2025-08-07 20:41:37,081 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:37,081 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-15863370, IP 209.118.199.68, Port 22 2025-08-07 20:41:37,254 - DEBUG - VM ctest-TestBGPaasZone-17583238-15863370 is ready for SSH connections 2025-08-07 20:41:37,254 - INFO - Waiting for VM ctest-TestBGPaasZone-17583238-56948815 to be up.. 2025-08-07 20:41:37,353 - DEBUG - VM is in ACTIVE state now 2025-08-07 20:41:37,353 - INFO - VM name : ctest-TestBGPaasZone-17583238-56948815 2025-08-07 20:41:37,446 - DEBUG - VM ctest-TestBGPaasZone-17583238-56948815 ID is 4bcbba39-b3d1-406d-9c56-5c864a71cc05 2025-08-07 20:41:37,446 - DEBUG - VM ctest-TestBGPaasZone-17583238-56948815 launched on Node an-jenkins-deploy-platform-ansible-os-3775-1 2025-08-07 20:41:37,546 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/4bcbba39-b3d1-406d-9c56-5c864a71cc05 2025-08-07 20:41:37,558 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/de4154d8-64c4-41c7-8160-6c32ca2a2e7a 2025-08-07 20:41:38,780 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.23 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.760 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.760/1.997/3.234/1.237 ms') 2025-08-07 20:41:38,781 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-17583238-56948815 passed 2025-08-07 20:41:38,902 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:38,903 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-56948815, IP 209.118.199.69, Port 22 2025-08-07 20:41:38,971 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-07 20:41:39,079 - DEBUG - VM ctest-TestBGPaasZone-17583238-56948815 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-07 20:41:44,080 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:44,080 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-17583238-56948815, IP 209.118.199.69, Port 22 2025-08-07 20:41:44,236 - DEBUG - VM ctest-TestBGPaasZone-17583238-56948815 is ready for SSH connections 2025-08-07 20:41:44,403 - INFO - Created control node zone ctest-test-zone-34497123(c3b22d1c-9b81-4d9e-aa98-8566b21fc3ca) 2025-08-07 20:41:44,771 - INFO - Created control node zone ctest-test-zone-30803659(dded13c6-f170-439b-ae91-3f1bbfb59b2d) 2025-08-07 20:41:45,143 - INFO - Created control node zone ctest-test-zone-36166971(c474d183-8445-49e0-b785-99d60f77c21c) 2025-08-07 20:41:45,439 - INFO - Creating BGPaaS ctest-TestBGPaasZone-17583238-87862921 2025-08-07 20:41:45,523 - INFO - BGPaaS: ctest-TestBGPaasZone-17583238-87862921(4641ac99-05b1-4913-8d7e-403d4f7d1b35) 2025-08-07 20:41:45,523 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/4641ac99-05b1-4913-8d7e-403d4f7d1b35 2025-08-07 20:41:45,535 - INFO - verify_in_api_server passed for BGPaaS obj 4641ac99-05b1-4913-8d7e-403d4f7d1b35 2025-08-07 20:41:45,535 - INFO - BGPaaS(4641ac99-05b1-4913-8d7e-403d4f7d1b35): verify_on_setup passed 2025-08-07 20:41:45,535 - INFO - We will configure BGP on the VM 2025-08-07 20:41:45,967 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:45,967 - INFO - Configuring BGP on ctest-TestBGPaasZone-17583238-34519438 2025-08-07 20:41:45,967 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 209.118.199.67; protocol bgp bgp_1{ local as 65000; neighbor 209.118.199.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.118.199.67; } protocol bfd { neighbor 209.118.199.65 local 209.118.199.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:41:45,967 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 209.118.199.67; protocol bgp bgp_1{ local as 65000; neighbor 209.118.199.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.118.199.67; } protocol bfd { neighbor 209.118.199.65 local 209.118.199.67 multihop on; } EOS 2025-08-07 20:41:55,736 - DEBUG - None 2025-08-07 20:41:55,737 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 209.118.199.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.118.199.67; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:41:55,737 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 209.118.199.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.118.199.67; } EOS 2025-08-07 20:41:56,267 - DEBUG - None 2025-08-07 20:41:56,267 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:41:56,268 - DEBUG - service bird restart 2025-08-07 20:41:57,948 - DEBUG - bird stop/waiting bird start/running, process 1442 2025-08-07 20:41:57,948 - INFO - Attaching VMI dd70ae7e-586b-49f0-8af1-3719a94c67e8 to BGPaaS 4641ac99-05b1-4913-8d7e-403d4f7d1b35 2025-08-07 20:41:58,031 - INFO - Attaching the VMI 840cffc3-3234-4cfe-a100-32d4cb0928f1 to the BGPaaS 4641ac99-05b1-4913-8d7e-403d4f7d1b35 object 2025-08-07 20:41:58,031 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 209.118.199.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:41:58,031 - DEBUG - sudo ip addr add 209.118.199.84 dev eth0 2025-08-07 20:41:58,696 - DEBUG - None 2025-08-07 20:41:58,763 - INFO - Creating BGPaaS ctest-TestBGPaasZone-17583238-69769164 2025-08-07 20:41:58,859 - INFO - BGPaaS: ctest-TestBGPaasZone-17583238-69769164(5ab1c07f-bde3-413e-a474-7450ceec1ba2) 2025-08-07 20:41:58,859 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/5ab1c07f-bde3-413e-a474-7450ceec1ba2 2025-08-07 20:41:58,871 - INFO - verify_in_api_server passed for BGPaaS obj 5ab1c07f-bde3-413e-a474-7450ceec1ba2 2025-08-07 20:41:58,871 - INFO - BGPaaS(5ab1c07f-bde3-413e-a474-7450ceec1ba2): verify_on_setup passed 2025-08-07 20:41:58,872 - INFO - We will configure BGP on the VM 2025-08-07 20:41:59,339 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:41:59,339 - INFO - Configuring BGP on ctest-TestBGPaasZone-17583238-15863370 2025-08-07 20:41:59,339 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 209.118.199.68; protocol bgp bgp_1{ local as 65000; neighbor 209.118.199.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.118.199.68; } protocol bfd { neighbor 209.118.199.65 local 209.118.199.68 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:41:59,339 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 209.118.199.68; protocol bgp bgp_1{ local as 65000; neighbor 209.118.199.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.118.199.68; } protocol bfd { neighbor 209.118.199.65 local 209.118.199.68 multihop on; } EOS 2025-08-07 20:42:06,125 - DEBUG - None 2025-08-07 20:42:06,125 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 209.118.199.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.118.199.68; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:42:06,125 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 209.118.199.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.118.199.68; } EOS 2025-08-07 20:42:06,670 - DEBUG - None 2025-08-07 20:42:06,670 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:42:06,670 - DEBUG - service bird restart 2025-08-07 20:42:08,591 - DEBUG - bird stop/waiting bird start/running, process 1441 2025-08-07 20:42:08,591 - INFO - Attaching VMI 2d2eb391-d34d-4ed7-9a17-ec2de2855cfb to BGPaaS 5ab1c07f-bde3-413e-a474-7450ceec1ba2 2025-08-07 20:42:08,675 - INFO - Attaching the VMI 19d20ff2-ab0f-4dc3-85c8-a4ec25b8dedf to the BGPaaS 5ab1c07f-bde3-413e-a474-7450ceec1ba2 object 2025-08-07 20:42:08,675 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 209.118.199.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-07 20:42:08,675 - DEBUG - sudo ip addr add 209.118.199.84 dev eth0 2025-08-07 20:42:09,407 - DEBUG - None 2025-08-07 20:42:09,407 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:42:09,426 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-07 20:42:09,427 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:42:09,427 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-07 20:42:09,446 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-07 20:42:09,460 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:42:09,480 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-08-07 20:42:15,499 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-08-07 20:42:21,521 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-07 20:42:21,522 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:42:21,522 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-07 20:42:21,541 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-07 20:42:21,549 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 209.118.199.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:42:21,549 - DEBUG - ping -s 56 -c 3 -W 1 209.118.199.84 2025-08-07 20:42:28,460 - DEBUG - PING 209.118.199.84 (209.118.199.84) 56(84) bytes of data. 64 bytes from 209.118.199.84: icmp_seq=1 ttl=64 time=11.6 ms 64 bytes from 209.118.199.84: icmp_seq=2 ttl=64 time=2.03 ms 64 bytes from 209.118.199.84: icmp_seq=3 ttl=64 time=2.43 ms --- 209.118.199.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 2.034/5.359/11.611/4.423 ms 2025-08-07 20:42:28,460 - INFO - Ping to IP 209.118.199.84 from VM ctest-TestBGPaasZone-17583238-56948815 passed 2025-08-07 20:42:28,460 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:42:28,479 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-07 20:42:28,479 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:42:28,479 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-07 20:42:28,497 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-07 20:42:28,505 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:42:28,522 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-07 20:42:28,522 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-07 20:42:28,522 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-07 20:42:28,541 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-07 20:42:28,549 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 209.118.199.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-08-07 20:42:28,549 - DEBUG - ping -s 56 -c 3 -W 1 209.118.199.84 2025-08-07 20:42:31,166 - DEBUG - PING 209.118.199.84 (209.118.199.84) 56(84) bytes of data. 64 bytes from 209.118.199.84: icmp_seq=1 ttl=64 time=2.69 ms 64 bytes from 209.118.199.84: icmp_seq=2 ttl=64 time=2.47 ms 64 bytes from 209.118.199.84: icmp_seq=3 ttl=64 time=2.24 ms --- 209.118.199.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 2.245/2.470/2.697/0.193 ms 2025-08-07 20:42:31,166 - INFO - Ping to IP 209.118.199.84 from VM ctest-TestBGPaasZone-17583238-56948815 passed 2025-08-07 20:42:31,166 - INFO - Detaching VMI 2d2eb391-d34d-4ed7-9a17-ec2de2855cfb from BGPaaS 5ab1c07f-bde3-413e-a474-7450ceec1ba2 2025-08-07 20:42:31,256 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-17583238-69769164(5ab1c07f-bde3-413e-a474-7450ceec1ba2) 2025-08-07 20:42:31,324 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/5ab1c07f-bde3-413e-a474-7450ceec1ba2 2025-08-07 20:42:31,333 - DEBUG - Response Code: 404 2025-08-07 20:42:31,333 - DEBUG - BGPaaS: 5ab1c07f-bde3-413e-a474-7450ceec1ba2 deleted from api server 2025-08-07 20:42:31,333 - INFO - BGPaaS(5ab1c07f-bde3-413e-a474-7450ceec1ba2): verify_on_cleanup passed 2025-08-07 20:42:31,333 - INFO - Detaching VMI dd70ae7e-586b-49f0-8af1-3719a94c67e8 from BGPaaS 4641ac99-05b1-4913-8d7e-403d4f7d1b35 2025-08-07 20:42:31,439 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-17583238-87862921(4641ac99-05b1-4913-8d7e-403d4f7d1b35) 2025-08-07 20:42:31,513 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/4641ac99-05b1-4913-8d7e-403d4f7d1b35 2025-08-07 20:42:31,523 - DEBUG - Response Code: 404 2025-08-07 20:42:31,523 - DEBUG - BGPaaS: 4641ac99-05b1-4913-8d7e-403d4f7d1b35 deleted from api server 2025-08-07 20:42:31,523 - INFO - BGPaaS(4641ac99-05b1-4913-8d7e-403d4f7d1b35): verify_on_cleanup passed 2025-08-07 20:42:31,524 - INFO - Deleting Control node zone ctest-test-zone-36166971(c474d183-8445-49e0-b785-99d60f77c21c) 2025-08-07 20:42:31,688 - INFO - Deleting Control node zone ctest-test-zone-30803659(dded13c6-f170-439b-ae91-3f1bbfb59b2d) 2025-08-07 20:42:31,839 - INFO - Deleting Control node zone ctest-test-zone-34497123(c3b22d1c-9b81-4d9e-aa98-8566b21fc3ca) 2025-08-07 20:42:31,992 - INFO - Deleting VM ctest-TestBGPaasZone-17583238-56948815 2025-08-07 20:42:32,087 - INFO - Deleting VM ctest-TestBGPaasZone-17583238-15863370 2025-08-07 20:42:32,164 - INFO - Deleting VM ctest-TestBGPaasZone-17583238-34519438 2025-08-07 20:42:32,251 - INFO - Deleting VN ctest-cnz_vn-04511939 2025-08-07 20:42:32,298 - DEBUG - VN 33ce89da-b3d3-4f18-b5d8-81028782560b still in use: Unable to complete operation on network 33ce89da-b3d3-4f18-b5d8-81028782560b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-552afb86-d0b9-49f1-a9a8-2e56017d0d0e'] 2025-08-07 20:42:32,298 - WARNING - Deleting VN ctest-cnz_vn-04511939 failed..Will retry 2025-08-07 20:42:34,505 - DEBUG - Response for deleting network () 2025-08-07 20:42:35,864 - DEBUG - Skipping xmpp flap check 2025-08-07 20:42:35,864 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:09] 2025-08-07 20:42:35,864 - INFO - -------------------------------------------------------------------------------- 2025-08-07 20:42:36,791 - INFO - Deleted project: ctest-TestBGPaasZone-17583238, ID : 91804f99-b356-46e3-aeeb-e8aef378778d