2025-11-13 03:53:45,305 - INFO - Domain Default found not creating 2025-11-13 03:53:45,459 - INFO - Project ctest-TestBGPaasZone-31857541 not found, creating it 2025-11-13 03:53:46,004 - INFO - Created Project:ctest-TestBGPaasZone-31857541, ID : 3423b299-3442-4440-b16b-c6038f01b29d 2025-11-13 03:53:47,562 - DEBUG - Services list from nova: [, , , ] 2025-11-13 03:53:47,562 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4712-2', 'an-jenkins-deploy-platform-ansible-os-4712-1']} 2025-11-13 03:53:47,564 - INFO - ================================================================================ 2025-11-13 03:53:47,564 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-11-13 03:53:48,819 - DEBUG - Skipping xmpp flap check 2025-11-13 03:53:48,819 - INFO - Initial checks done. Running the testcase now 2025-11-13 03:53:48,819 - INFO - 2025-11-13 03:53:48,819 - INFO - executing bgp_control_zone test 2025-11-13 03:53:49,493 - DEBUG - Response for create_network : {'network': {'id': 'f16f2670-c075-4b67-8645-8235f79b6569', 'name': 'ctest-cnz_vn-64256557', 'tenant_id': '3423b29934424440b16bc6038f01b29d', 'project_id': '3423b29934424440b16bc6038f01b29d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-31857541', 'ctest-cnz_vn-64256557'], 'port_security_enabled': True, 'description': ''}} 2025-11-13 03:53:49,771 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd705cbf7-e401-4559-8790-0beebf0b0ad4', 'name': '', 'tenant_id': '3423b29934424440b16bc6038f01b29d', 'network_id': 'f16f2670-c075-4b67-8645-8235f79b6569', 'ip_version': 4, 'cidr': '21.177.50.0/26', 'allocation_pools': [{'start': '21.177.50.2', 'end': '21.177.50.62'}], 'gateway_ip': '21.177.50.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '21.177.50.2', 'tags': [], 'project_id': '3423b29934424440b16bc6038f01b29d'}} 2025-11-13 03:53:49,792 - INFO - Created VN ctest-cnz_vn-64256557 2025-11-13 03:53:49,805 - DEBUG - VN ctest-cnz_vn-64256557 UUID is f16f2670-c075-4b67-8645-8235f79b6569 2025-11-13 03:53:51,074 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4712-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4712-2) 2025-11-13 03:53:52,524 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4712-1) 2025-11-13 03:53:54,407 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4712-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4712-2) 2025-11-13 03:53:54,408 - INFO - Waiting for VM ctest-TestBGPaasZone-31857541-49630661 to be up.. 2025-11-13 03:53:54,513 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-13 03:53:59,593 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-13 03:54:04,670 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-13 03:54:09,758 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-13 03:54:14,850 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-13 03:54:19,928 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-13 03:54:25,014 - DEBUG - VM is in ACTIVE state now 2025-11-13 03:54:25,014 - INFO - VM name : ctest-TestBGPaasZone-31857541-49630661 2025-11-13 03:54:25,092 - DEBUG - VM ctest-TestBGPaasZone-31857541-49630661 ID is b1ab896f-0113-4895-b8f8-7ef42ab6751b 2025-11-13 03:54:25,125 - DEBUG - VM ctest-TestBGPaasZone-31857541-49630661 launched on Node an-jenkins-deploy-platform-ansible-os-4712-2 2025-11-13 03:54:25,204 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/b1ab896f-0113-4895-b8f8-7ef42ab6751b 2025-11-13 03:54:25,542 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/b1ab896f-0113-4895-b8f8-7ef42ab6751b 2025-11-13 03:54:25,573 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/c4caa505-b4f3-4c5d-9a76-83206d02b820 2025-11-13 03:54:28,757 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2025-11-13 03:54:28,757 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:54:28,770 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:54:32,846 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-11-13 03:54:32,847 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:54:32,864 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:54:36,940 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-13 03:54:36,940 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:54:36,953 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:54:41,037 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-13 03:54:41,038 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:54:41,052 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:54:45,135 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-13 03:54:45,135 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:54:45,148 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:54:49,228 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-13 03:54:49,228 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:54:49,242 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:54:53,325 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-13 03:54:53,325 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:54:53,339 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:54:57,421 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-11-13 03:54:57,421 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:54:57,434 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:55:01,520 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-11-13 03:55:01,520 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:55:01,533 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:55:05,617 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-13 03:55:05,617 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:55:05,632 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:55:09,709 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-13 03:55:09,709 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:55:09,724 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:55:13,807 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-13 03:55:13,807 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:55:13,820 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:55:17,902 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-13 03:55:17,902 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:55:17,917 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:55:21,994 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-13 03:55:21,994 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:55:22,009 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:55:26,090 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-11-13 03:55:26,091 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:55:26,104 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:55:30,190 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-13 03:55:30,190 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:55:30,204 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:55:34,289 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-11-13 03:55:34,289 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:55:34,302 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:55:38,386 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-13 03:55:38,386 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 failed! 2025-11-13 03:55:38,399 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-64256557 is 21.177.50.1 and allocation pool is NOT set 2025-11-13 03:55:40,463 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.78 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=5.57 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 4.778/5.176/5.574/0.398 ms') 2025-11-13 03:55:40,463 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-49630661 passed 2025-11-13 03:55:40,534 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:55:40,534 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-49630661, IP 21.177.50.3, Port 22 2025-11-13 03:55:40,602 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:55:40,701 - DEBUG - VM ctest-TestBGPaasZone-31857541-49630661 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:55:45,702 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:55:45,702 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-49630661, IP 21.177.50.3, Port 22 2025-11-13 03:55:45,759 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:55:45,837 - DEBUG - VM ctest-TestBGPaasZone-31857541-49630661 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:55:50,837 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:55:50,838 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-49630661, IP 21.177.50.3, Port 22 2025-11-13 03:55:50,906 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:55:50,992 - DEBUG - VM ctest-TestBGPaasZone-31857541-49630661 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:55:55,993 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:55:55,993 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-49630661, IP 21.177.50.3, Port 22 2025-11-13 03:55:56,066 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:55:56,141 - DEBUG - VM ctest-TestBGPaasZone-31857541-49630661 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:56:01,142 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:56:01,142 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-49630661, IP 21.177.50.3, Port 22 2025-11-13 03:56:01,199 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:56:01,290 - DEBUG - VM ctest-TestBGPaasZone-31857541-49630661 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:56:06,291 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:56:06,291 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-49630661, IP 21.177.50.3, Port 22 2025-11-13 03:56:06,357 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:56:06,436 - DEBUG - VM ctest-TestBGPaasZone-31857541-49630661 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:56:11,437 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:56:11,437 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-49630661, IP 21.177.50.3, Port 22 2025-11-13 03:56:11,496 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:56:11,588 - DEBUG - VM ctest-TestBGPaasZone-31857541-49630661 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:56:16,588 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:56:16,588 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-49630661, IP 21.177.50.3, Port 22 2025-11-13 03:56:16,658 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:56:16,760 - DEBUG - VM ctest-TestBGPaasZone-31857541-49630661 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:56:21,762 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:56:21,762 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-49630661, IP 21.177.50.3, Port 22 2025-11-13 03:56:21,937 - DEBUG - VM ctest-TestBGPaasZone-31857541-49630661 is ready for SSH connections 2025-11-13 03:56:21,937 - INFO - Waiting for VM ctest-TestBGPaasZone-31857541-23109243 to be up.. 2025-11-13 03:56:22,027 - DEBUG - VM is in ACTIVE state now 2025-11-13 03:56:22,027 - INFO - VM name : ctest-TestBGPaasZone-31857541-23109243 2025-11-13 03:56:22,104 - DEBUG - VM ctest-TestBGPaasZone-31857541-23109243 ID is e62c51b6-51ca-4b07-8f02-96c6c4dba7f8 2025-11-13 03:56:22,104 - DEBUG - VM ctest-TestBGPaasZone-31857541-23109243 launched on Node an-jenkins-deploy-platform-ansible-os-4712-1 2025-11-13 03:56:22,181 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/e62c51b6-51ca-4b07-8f02-96c6c4dba7f8 2025-11-13 03:56:22,190 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/d38894ae-4130-4cae-aa1f-1f59e52a068b 2025-11-13 03:56:23,345 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.87 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.06 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.062/4.464/6.867/2.402 ms') 2025-11-13 03:56:23,345 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-23109243 passed 2025-11-13 03:56:23,412 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:56:23,412 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-23109243, IP 21.177.50.4, Port 22 2025-11-13 03:56:23,585 - DEBUG - VM ctest-TestBGPaasZone-31857541-23109243 is ready for SSH connections 2025-11-13 03:56:23,585 - INFO - Waiting for VM ctest-TestBGPaasZone-31857541-72760705 to be up.. 2025-11-13 03:56:23,664 - DEBUG - VM is in ACTIVE state now 2025-11-13 03:56:23,664 - INFO - VM name : ctest-TestBGPaasZone-31857541-72760705 2025-11-13 03:56:23,747 - DEBUG - VM ctest-TestBGPaasZone-31857541-72760705 ID is bfdc031c-fbd5-4ff0-8bd0-236cb4bd712e 2025-11-13 03:56:23,747 - DEBUG - VM ctest-TestBGPaasZone-31857541-72760705 launched on Node an-jenkins-deploy-platform-ansible-os-4712-2 2025-11-13 03:56:23,820 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/bfdc031c-fbd5-4ff0-8bd0-236cb4bd712e 2025-11-13 03:56:23,828 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/b690fb54-e531-4833-a732-32dc13782a4c 2025-11-13 03:56:25,007 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.04 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.619 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.619/1.828/3.037/1.209 ms') 2025-11-13 03:56:25,007 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-31857541-72760705 passed 2025-11-13 03:56:25,076 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:56:25,076 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-72760705, IP 21.177.50.5, Port 22 2025-11-13 03:56:25,242 - DEBUG - VM ctest-TestBGPaasZone-31857541-72760705 is ready for SSH connections 2025-11-13 03:56:25,375 - INFO - Created control node zone ctest-test-zone-69608271(0ba923f4-77f8-463f-bb38-251bc0dcb0f5) 2025-11-13 03:56:25,719 - INFO - Created control node zone ctest-test-zone-16650665(73b45f1b-80b0-47c6-a32a-87005d3fae29) 2025-11-13 03:56:26,059 - INFO - Created control node zone ctest-test-zone-32321717(411c9fc9-002a-4ba6-bae0-c7133d60d620) 2025-11-13 03:56:26,331 - INFO - Creating BGPaaS ctest-TestBGPaasZone-31857541-06171375 2025-11-13 03:56:26,407 - INFO - BGPaaS: ctest-TestBGPaasZone-31857541-06171375(43199858-7772-4870-b33f-3e17d686d8ef) 2025-11-13 03:56:26,407 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/43199858-7772-4870-b33f-3e17d686d8ef 2025-11-13 03:56:26,741 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/43199858-7772-4870-b33f-3e17d686d8ef 2025-11-13 03:56:26,774 - INFO - verify_in_api_server passed for BGPaaS obj 43199858-7772-4870-b33f-3e17d686d8ef 2025-11-13 03:56:26,774 - INFO - BGPaaS(43199858-7772-4870-b33f-3e17d686d8ef): verify_on_setup passed 2025-11-13 03:56:26,774 - INFO - We will configure BGP on the VM 2025-11-13 03:56:27,027 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:56:27,027 - INFO - Configuring BGP on ctest-TestBGPaasZone-31857541-49630661 2025-11-13 03:56:27,028 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.3; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.3; } protocol bfd { neighbor 21.177.50.1 local 21.177.50.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:56:27,028 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.3; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.3; } protocol bfd { neighbor 21.177.50.1 local 21.177.50.3 multihop on; } EOS 2025-11-13 03:56:40,261 - DEBUG - None 2025-11-13 03:56:40,262 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.3; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.3; } protocol bfd { neighbor 21.177.50.1 local 21.177.50.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:56:40,262 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.3; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.3; } protocol bfd { neighbor 21.177.50.1 local 21.177.50.3 multihop on; } EOS 2025-11-13 03:56:41,264 - DEBUG - None 2025-11-13 03:56:41,264 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:56:41,264 - DEBUG - service bird restart 2025-11-13 03:56:44,173 - DEBUG - bird stop/waiting bird start/running, process 1426 2025-11-13 03:56:44,173 - INFO - Attaching VMI c4caa505-b4f3-4c5d-9a76-83206d02b820 to BGPaaS 43199858-7772-4870-b33f-3e17d686d8ef 2025-11-13 03:56:44,243 - INFO - Attaching the VMI b1ab896f-0113-4895-b8f8-7ef42ab6751b to the BGPaaS 43199858-7772-4870-b33f-3e17d686d8ef object 2025-11-13 03:56:44,244 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 21.177.50.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:56:44,244 - DEBUG - sudo ip addr add 21.177.50.20 dev eth0 2025-11-13 03:56:45,602 - DEBUG - None 2025-11-13 03:56:45,663 - INFO - Creating BGPaaS ctest-TestBGPaasZone-31857541-90160108 2025-11-13 03:56:45,739 - INFO - BGPaaS: ctest-TestBGPaasZone-31857541-90160108(bb67ef00-244d-4f91-a209-1df6dfa0e2a6) 2025-11-13 03:56:45,739 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/bb67ef00-244d-4f91-a209-1df6dfa0e2a6 2025-11-13 03:56:45,750 - INFO - verify_in_api_server passed for BGPaaS obj bb67ef00-244d-4f91-a209-1df6dfa0e2a6 2025-11-13 03:56:45,750 - INFO - BGPaaS(bb67ef00-244d-4f91-a209-1df6dfa0e2a6): verify_on_setup passed 2025-11-13 03:56:45,750 - INFO - We will configure BGP on the VM 2025-11-13 03:56:46,023 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:56:46,024 - INFO - Configuring BGP on ctest-TestBGPaasZone-31857541-23109243 2025-11-13 03:56:46,024 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.4; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.4; } protocol bfd { neighbor 21.177.50.2 local 21.177.50.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 03:56:46,024 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.4; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.4; } protocol bfd { neighbor 21.177.50.2 local 21.177.50.4 multihop on; } EOS 2025-11-13 03:56:52,239 - DEBUG - None 2025-11-13 03:56:52,240 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.4; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.4; } protocol bfd { neighbor 21.177.50.2 local 21.177.50.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 03:56:52,240 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.4; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.4; } protocol bfd { neighbor 21.177.50.2 local 21.177.50.4 multihop on; } EOS 2025-11-13 03:56:52,813 - DEBUG - None 2025-11-13 03:56:52,813 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 03:56:52,813 - DEBUG - service bird restart 2025-11-13 03:56:54,692 - DEBUG - bird stop/waiting bird start/running, process 1441 2025-11-13 03:56:54,692 - INFO - Attaching VMI d38894ae-4130-4cae-aa1f-1f59e52a068b to BGPaaS bb67ef00-244d-4f91-a209-1df6dfa0e2a6 2025-11-13 03:56:54,763 - INFO - Attaching the VMI e62c51b6-51ca-4b07-8f02-96c6c4dba7f8 to the BGPaaS bb67ef00-244d-4f91-a209-1df6dfa0e2a6 object 2025-11-13 03:56:54,764 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 21.177.50.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 03:56:54,764 - DEBUG - sudo ip addr add 21.177.50.20 dev eth0 2025-11-13 03:56:55,501 - DEBUG - None 2025-11-13 03:56:55,501 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:56:55,516 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-13 03:56:55,522 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:56:55,522 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-13 03:56:55,539 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193'] 2025-11-13 03:57:01,540 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-13 03:57:01,557 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193'] 2025-11-13 03:57:07,558 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-13 03:57:07,576 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-13 03:57:07,582 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 21.177.50.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:57:07,583 - DEBUG - ping -s 56 -c 3 -W 1 21.177.50.20 2025-11-13 03:57:13,910 - DEBUG - PING 21.177.50.20 (21.177.50.20) 56(84) bytes of data. 64 bytes from 21.177.50.20: icmp_seq=1 ttl=64 time=9.42 ms 64 bytes from 21.177.50.20: icmp_seq=2 ttl=64 time=1.56 ms 64 bytes from 21.177.50.20: icmp_seq=3 ttl=64 time=1.26 ms --- 21.177.50.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.264/4.083/9.423/3.777 ms 2025-11-13 03:57:13,910 - INFO - Ping to IP 21.177.50.20 from VM ctest-TestBGPaasZone-31857541-72760705 passed 2025-11-13 03:57:14,751 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:57:14,752 - DEBUG - service bird restart 2025-11-13 03:57:16,397 - DEBUG - bird stop/waiting bird start/running, process 1464 2025-11-13 03:57:16,397 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 03:57:16,397 - DEBUG - service bird restart 2025-11-13 03:57:18,280 - DEBUG - bird stop/waiting bird start/running, process 1468 2025-11-13 03:57:18,280 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:57:18,297 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-11-13 03:57:24,313 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-11-13 03:57:24,318 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:57:24,318 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-13 03:57:24,336 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-13 03:57:24,341 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 21.177.50.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:57:24,341 - DEBUG - ping -s 56 -c 3 -W 1 21.177.50.20 2025-11-13 03:57:26,808 - DEBUG - PING 21.177.50.20 (21.177.50.20) 56(84) bytes of data. 64 bytes from 21.177.50.20: icmp_seq=1 ttl=64 time=3.66 ms 64 bytes from 21.177.50.20: icmp_seq=2 ttl=64 time=1.73 ms 64 bytes from 21.177.50.20: icmp_seq=3 ttl=64 time=1.37 ms --- 21.177.50.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.374/2.260/3.667/1.005 ms 2025-11-13 03:57:26,809 - INFO - Ping to IP 21.177.50.20 from VM ctest-TestBGPaasZone-31857541-72760705 passed 2025-11-13 03:57:27,096 - INFO - We will configure BGP on the VM 2025-11-13 03:57:27,303 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:57:27,303 - INFO - Configuring BGP on ctest-TestBGPaasZone-31857541-49630661 2025-11-13 03:57:27,304 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.3; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.3; } protocol bfd { neighbor 21.177.50.1 local 21.177.50.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:57:27,304 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.3; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.3; } protocol bfd { neighbor 21.177.50.1 local 21.177.50.3 multihop on; } EOS 2025-11-13 03:57:27,776 - DEBUG - None 2025-11-13 03:57:27,776 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.3; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.3; } protocol bfd { neighbor 21.177.50.1 local 21.177.50.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:57:27,776 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 21.177.50.3; protocol bgp bgp_1{ local as 65000; neighbor 21.177.50.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 21.177.50.3; } protocol bfd { neighbor 21.177.50.1 local 21.177.50.3 multihop on; } EOS 2025-11-13 03:57:28,273 - DEBUG - None 2025-11-13 03:57:28,273 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:57:28,273 - DEBUG - service bird restart 2025-11-13 03:57:29,903 - DEBUG - bird stop/waiting bird start/running, process 1496 2025-11-13 03:57:29,903 - INFO - Attaching VMI c4caa505-b4f3-4c5d-9a76-83206d02b820 to BGPaaS 43199858-7772-4870-b33f-3e17d686d8ef 2025-11-13 03:57:29,923 - INFO - Attaching the VMI b1ab896f-0113-4895-b8f8-7ef42ab6751b to the BGPaaS 43199858-7772-4870-b33f-3e17d686d8ef object 2025-11-13 03:57:29,923 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 21.177.50.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:57:29,923 - DEBUG - sudo ip addr add 21.177.50.20 dev eth0 2025-11-13 03:57:30,590 - DEBUG - RTNETLINK answers: File exists 2025-11-13 03:57:30,590 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:57:30,590 - DEBUG - service bird restart 2025-11-13 03:57:32,217 - DEBUG - bird stop/waiting bird start/running, process 1523 2025-11-13 03:57:32,218 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 03:57:32,218 - DEBUG - service bird restart 2025-11-13 03:57:34,121 - DEBUG - bird stop/waiting bird start/running, process 1490 2025-11-13 03:57:34,121 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:57:34,136 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-11-13 03:57:40,152 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-13 03:57:40,157 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:57:40,158 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-13 03:57:40,176 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-13 03:57:40,181 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 21.177.50.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 03:57:40,181 - DEBUG - ping -s 56 -c 3 -W 1 21.177.50.20 2025-11-13 03:57:42,637 - DEBUG - PING 21.177.50.20 (21.177.50.20) 56(84) bytes of data. 64 bytes from 21.177.50.20: icmp_seq=1 ttl=64 time=4.99 ms 64 bytes from 21.177.50.20: icmp_seq=2 ttl=64 time=0.931 ms 64 bytes from 21.177.50.20: icmp_seq=3 ttl=64 time=0.832 ms --- 21.177.50.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 0.832/2.251/4.992/1.938 ms 2025-11-13 03:57:42,637 - INFO - Ping to IP 21.177.50.20 from VM ctest-TestBGPaasZone-31857541-72760705 passed 2025-11-13 03:57:42,637 - INFO - Detaching VMI c4caa505-b4f3-4c5d-9a76-83206d02b820 from BGPaaS 43199858-7772-4870-b33f-3e17d686d8ef 2025-11-13 03:57:42,711 - INFO - Detaching VMI d38894ae-4130-4cae-aa1f-1f59e52a068b from BGPaaS bb67ef00-244d-4f91-a209-1df6dfa0e2a6 2025-11-13 03:57:42,811 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-31857541-90160108(bb67ef00-244d-4f91-a209-1df6dfa0e2a6) 2025-11-13 03:57:42,890 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/bb67ef00-244d-4f91-a209-1df6dfa0e2a6 2025-11-13 03:57:42,897 - DEBUG - Response Code: 404 2025-11-13 03:57:42,897 - DEBUG - BGPaaS: bb67ef00-244d-4f91-a209-1df6dfa0e2a6 deleted from api server 2025-11-13 03:57:42,897 - INFO - BGPaaS(bb67ef00-244d-4f91-a209-1df6dfa0e2a6): verify_on_cleanup passed 2025-11-13 03:57:42,898 - INFO - Detaching VMI c4caa505-b4f3-4c5d-9a76-83206d02b820 from BGPaaS 43199858-7772-4870-b33f-3e17d686d8ef 2025-11-13 03:57:42,938 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-31857541-06171375(43199858-7772-4870-b33f-3e17d686d8ef) 2025-11-13 03:57:43,011 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/43199858-7772-4870-b33f-3e17d686d8ef 2025-11-13 03:57:43,029 - DEBUG - Response Code: 404 2025-11-13 03:57:43,029 - DEBUG - BGPaaS: 43199858-7772-4870-b33f-3e17d686d8ef deleted from api server 2025-11-13 03:57:43,029 - INFO - BGPaaS(43199858-7772-4870-b33f-3e17d686d8ef): verify_on_cleanup passed 2025-11-13 03:57:43,029 - INFO - Deleting Control node zone ctest-test-zone-32321717(411c9fc9-002a-4ba6-bae0-c7133d60d620) 2025-11-13 03:57:43,176 - INFO - Deleting Control node zone ctest-test-zone-16650665(73b45f1b-80b0-47c6-a32a-87005d3fae29) 2025-11-13 03:57:43,316 - INFO - Deleting Control node zone ctest-test-zone-69608271(0ba923f4-77f8-463f-bb38-251bc0dcb0f5) 2025-11-13 03:57:43,393 - INFO - Deleting VM ctest-TestBGPaasZone-31857541-72760705 2025-11-13 03:57:43,491 - INFO - Deleting VM ctest-TestBGPaasZone-31857541-23109243 2025-11-13 03:57:43,565 - INFO - Deleting VM ctest-TestBGPaasZone-31857541-49630661 2025-11-13 03:57:43,633 - INFO - Deleting VN ctest-cnz_vn-64256557 2025-11-13 03:57:43,677 - DEBUG - VN f16f2670-c075-4b67-8645-8235f79b6569 still in use: Unable to complete operation on network f16f2670-c075-4b67-8645-8235f79b6569. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a520ea89-ee6c-4011-8cb0-03af08a27072'] 2025-11-13 03:57:43,677 - WARNING - Deleting VN ctest-cnz_vn-64256557 failed..Will retry 2025-11-13 03:57:45,861 - DEBUG - Response for deleting network () 2025-11-13 03:57:47,139 - DEBUG - Skipping xmpp flap check 2025-11-13 03:57:47,139 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:00] 2025-11-13 03:57:47,139 - INFO - -------------------------------------------------------------------------------- 2025-11-13 03:57:47,142 - INFO - ================================================================================ 2025-11-13 03:57:47,142 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-11-13 03:57:48,404 - DEBUG - Skipping xmpp flap check 2025-11-13 03:57:48,404 - INFO - Initial checks done. Running the testcase now 2025-11-13 03:57:48,404 - INFO - 2025-11-13 03:57:48,404 - INFO - executing bgp_control_zone agent restart test 2025-11-13 03:57:48,688 - DEBUG - Response for create_network : {'network': {'id': '24e1447c-e1e3-451d-98de-e09332f28e1d', 'name': 'ctest-cnz_vn-06131606', 'tenant_id': '3423b29934424440b16bc6038f01b29d', 'project_id': '3423b29934424440b16bc6038f01b29d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-31857541', 'ctest-cnz_vn-06131606'], 'port_security_enabled': True, 'description': ''}} 2025-11-13 03:57:48,924 - DEBUG - Response for create_subnet : {'subnet': {'id': '38e1b3ce-a890-4c5b-8658-a85c9b372a41', 'name': '', 'tenant_id': '3423b29934424440b16bc6038f01b29d', 'network_id': '24e1447c-e1e3-451d-98de-e09332f28e1d', 'ip_version': 4, 'cidr': '170.240.88.192/26', 'allocation_pools': [{'start': '170.240.88.194', 'end': '170.240.88.254'}], 'gateway_ip': '170.240.88.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '170.240.88.194', 'tags': [], 'project_id': '3423b29934424440b16bc6038f01b29d'}} 2025-11-13 03:57:48,948 - INFO - Created VN ctest-cnz_vn-06131606 2025-11-13 03:57:48,959 - DEBUG - VN ctest-cnz_vn-06131606 UUID is 24e1447c-e1e3-451d-98de-e09332f28e1d 2025-11-13 03:57:50,220 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4712-1) 2025-11-13 03:57:51,725 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4712-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4712-2) 2025-11-13 03:57:53,304 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4712-1) 2025-11-13 03:57:53,305 - INFO - Waiting for VM ctest-TestBGPaasZone-31857541-69643466 to be up.. 2025-11-13 03:57:53,402 - DEBUG - VM is in ACTIVE state now 2025-11-13 03:57:53,403 - INFO - VM name : ctest-TestBGPaasZone-31857541-69643466 2025-11-13 03:57:53,483 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 ID is 1cb765cd-7963-4aa2-bd24-dc394af01a4c 2025-11-13 03:57:53,483 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 launched on Node an-jenkins-deploy-platform-ansible-os-4712-1 2025-11-13 03:57:53,585 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/1cb765cd-7963-4aa2-bd24-dc394af01a4c 2025-11-13 03:57:53,605 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/d41c27a0-ea54-4de7-8f59-0fbd93815ade 2025-11-13 03:57:56,806 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-11-13 03:57:56,806 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:57:56,819 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:00,904 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-11-13 03:58:00,904 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:00,919 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:05,006 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-13 03:58:05,007 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:05,020 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:09,092 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-11-13 03:58:09,092 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:09,106 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:13,193 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-13 03:58:13,193 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:13,207 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:17,285 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-11-13 03:58:17,285 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:17,299 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:21,385 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-13 03:58:21,385 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:21,402 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:25,474 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-11-13 03:58:25,474 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:25,488 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:29,570 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-13 03:58:29,570 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:29,584 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:33,678 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-11-13 03:58:33,678 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:33,691 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:37,769 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-13 03:58:37,769 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:37,782 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:41,859 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-13 03:58:41,859 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:41,875 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:45,962 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-13 03:58:45,962 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:45,976 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:50,050 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-11-13 03:58:50,050 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:50,090 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:54,184 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms') 2025-11-13 03:58:54,184 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:54,199 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:58:58,286 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-11-13 03:58:58,286 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:58:58,300 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:59:02,381 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-11-13 03:59:02,381 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:59:02,394 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:59:06,465 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-11-13 03:59:06,465 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:59:06,478 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:59:10,565 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-11-13 03:59:10,565 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:59:10,580 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:59:14,662 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-11-13 03:59:14,662 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:59:14,682 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:59:18,761 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-13 03:59:18,761 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 failed! 2025-11-13 03:59:18,776 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-31857541:ctest-cnz_vn-06131606 is 170.240.88.193 and allocation pool is NOT set 2025-11-13 03:59:20,842 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=1.95 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.02 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.020/1.484/1.949/0.464 ms') 2025-11-13 03:59:20,843 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-69643466 passed 2025-11-13 03:59:20,912 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:59:20,913 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-69643466, IP 170.240.88.195, Port 22 2025-11-13 03:59:20,978 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:59:21,486 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:59:26,486 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:59:26,486 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-69643466, IP 170.240.88.195, Port 22 2025-11-13 03:59:26,557 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:59:26,663 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:59:31,663 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:59:31,663 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-69643466, IP 170.240.88.195, Port 22 2025-11-13 03:59:31,733 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:59:31,846 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:59:36,846 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:59:36,847 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-69643466, IP 170.240.88.195, Port 22 2025-11-13 03:59:36,914 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:59:36,993 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:59:41,994 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:59:41,995 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-69643466, IP 170.240.88.195, Port 22 2025-11-13 03:59:42,062 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:59:42,141 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:59:47,142 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:59:47,143 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-69643466, IP 170.240.88.195, Port 22 2025-11-13 03:59:47,220 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:59:47,299 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:59:52,300 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:59:52,300 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-69643466, IP 170.240.88.195, Port 22 2025-11-13 03:59:52,366 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:59:52,480 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 03:59:57,481 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 03:59:57,481 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-69643466, IP 170.240.88.195, Port 22 2025-11-13 03:59:57,550 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 03:59:57,633 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 04:00:02,633 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:00:02,633 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-69643466, IP 170.240.88.195, Port 22 2025-11-13 04:00:02,692 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 04:00:02,784 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 04:00:07,785 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:00:07,786 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-69643466, IP 170.240.88.195, Port 22 2025-11-13 04:00:07,843 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 04:00:07,935 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 04:00:12,936 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:00:12,936 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-69643466, IP 170.240.88.195, Port 22 2025-11-13 04:00:13,091 - DEBUG - VM ctest-TestBGPaasZone-31857541-69643466 is ready for SSH connections 2025-11-13 04:00:13,092 - INFO - Waiting for VM ctest-TestBGPaasZone-31857541-86524154 to be up.. 2025-11-13 04:00:13,179 - DEBUG - VM is in ACTIVE state now 2025-11-13 04:00:13,179 - INFO - VM name : ctest-TestBGPaasZone-31857541-86524154 2025-11-13 04:00:13,263 - DEBUG - VM ctest-TestBGPaasZone-31857541-86524154 ID is 783034a5-007f-4206-8168-98ff349c839d 2025-11-13 04:00:13,263 - DEBUG - VM ctest-TestBGPaasZone-31857541-86524154 launched on Node an-jenkins-deploy-platform-ansible-os-4712-2 2025-11-13 04:00:13,352 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/783034a5-007f-4206-8168-98ff349c839d 2025-11-13 04:00:13,394 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/248b71e4-1f8c-4ee7-8d55-ba1b1267f06e 2025-11-13 04:00:14,572 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.53 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.506 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.506/2.017/3.529/1.511 ms') 2025-11-13 04:00:14,572 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-31857541-86524154 passed 2025-11-13 04:00:14,640 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:00:14,640 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-86524154, IP 170.240.88.196, Port 22 2025-11-13 04:00:14,805 - DEBUG - VM ctest-TestBGPaasZone-31857541-86524154 is ready for SSH connections 2025-11-13 04:00:14,805 - INFO - Waiting for VM ctest-TestBGPaasZone-31857541-47000224 to be up.. 2025-11-13 04:00:14,891 - DEBUG - VM is in ACTIVE state now 2025-11-13 04:00:14,891 - INFO - VM name : ctest-TestBGPaasZone-31857541-47000224 2025-11-13 04:00:14,986 - DEBUG - VM ctest-TestBGPaasZone-31857541-47000224 ID is 0aad2ac3-2e50-4a84-b8b2-1d73db02201a 2025-11-13 04:00:14,987 - DEBUG - VM ctest-TestBGPaasZone-31857541-47000224 launched on Node an-jenkins-deploy-platform-ansible-os-4712-1 2025-11-13 04:00:15,085 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/0aad2ac3-2e50-4a84-b8b2-1d73db02201a 2025-11-13 04:00:15,095 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/da1c2848-14e9-4634-9a3d-a015b381c0f0 2025-11-13 04:00:16,258 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.78 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.22 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.220/2.498/3.777/1.278 ms') 2025-11-13 04:00:16,259 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-31857541-47000224 passed 2025-11-13 04:00:16,329 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:00:16,329 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-47000224, IP 170.240.88.197, Port 22 2025-11-13 04:00:16,393 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-13 04:00:16,473 - DEBUG - VM ctest-TestBGPaasZone-31857541-47000224 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-13 04:00:21,475 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:00:21,475 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-31857541-47000224, IP 170.240.88.197, Port 22 2025-11-13 04:00:21,654 - DEBUG - VM ctest-TestBGPaasZone-31857541-47000224 is ready for SSH connections 2025-11-13 04:00:21,791 - INFO - Created control node zone ctest-test-zone-36642010(e8e24bbe-ca20-4f80-a545-1f3d9b65d2a6) 2025-11-13 04:00:22,139 - INFO - Created control node zone ctest-test-zone-48483464(4596ff33-4de6-4342-b616-772f2d3dde83) 2025-11-13 04:00:22,495 - INFO - Created control node zone ctest-test-zone-05123442(5ffe7f84-4af0-4f7b-a723-991624bf7a4a) 2025-11-13 04:00:22,787 - INFO - Creating BGPaaS ctest-TestBGPaasZone-31857541-89080620 2025-11-13 04:00:22,859 - INFO - BGPaaS: ctest-TestBGPaasZone-31857541-89080620(08dfa57e-44cf-4533-9564-634d0a07a553) 2025-11-13 04:00:22,860 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/08dfa57e-44cf-4533-9564-634d0a07a553 2025-11-13 04:00:22,871 - INFO - verify_in_api_server passed for BGPaaS obj 08dfa57e-44cf-4533-9564-634d0a07a553 2025-11-13 04:00:22,871 - INFO - BGPaaS(08dfa57e-44cf-4533-9564-634d0a07a553): verify_on_setup passed 2025-11-13 04:00:22,871 - INFO - We will configure BGP on the VM 2025-11-13 04:00:23,295 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:00:23,295 - INFO - Configuring BGP on ctest-TestBGPaasZone-31857541-69643466 2025-11-13 04:00:23,296 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 170.240.88.195; protocol bgp bgp_1{ local as 65000; neighbor 170.240.88.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 170.240.88.195; } protocol bfd { neighbor 170.240.88.193 local 170.240.88.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 04:00:23,296 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 170.240.88.195; protocol bgp bgp_1{ local as 65000; neighbor 170.240.88.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 170.240.88.195; } protocol bfd { neighbor 170.240.88.193 local 170.240.88.195 multihop on; } EOS 2025-11-13 04:00:37,894 - DEBUG - None 2025-11-13 04:00:37,894 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 170.240.88.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 170.240.88.195; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 04:00:37,895 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 170.240.88.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 170.240.88.195; } EOS 2025-11-13 04:00:38,919 - DEBUG - None 2025-11-13 04:00:38,919 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 04:00:38,919 - DEBUG - service bird restart 2025-11-13 04:00:41,052 - DEBUG - bird stop/waiting bird start/running, process 1434 2025-11-13 04:00:41,052 - INFO - Attaching VMI d41c27a0-ea54-4de7-8f59-0fbd93815ade to BGPaaS 08dfa57e-44cf-4533-9564-634d0a07a553 2025-11-13 04:00:41,123 - INFO - Attaching the VMI 1cb765cd-7963-4aa2-bd24-dc394af01a4c to the BGPaaS 08dfa57e-44cf-4533-9564-634d0a07a553 object 2025-11-13 04:00:41,124 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 170.240.88.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 04:00:41,124 - DEBUG - sudo ip addr add 170.240.88.212 dev eth0 2025-11-13 04:00:41,958 - DEBUG - None 2025-11-13 04:00:42,023 - INFO - Creating BGPaaS ctest-TestBGPaasZone-31857541-60598794 2025-11-13 04:00:42,095 - INFO - BGPaaS: ctest-TestBGPaasZone-31857541-60598794(85219ed2-e7c5-42d4-829f-4a29590cd83f) 2025-11-13 04:00:42,096 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/85219ed2-e7c5-42d4-829f-4a29590cd83f 2025-11-13 04:00:42,105 - INFO - verify_in_api_server passed for BGPaaS obj 85219ed2-e7c5-42d4-829f-4a29590cd83f 2025-11-13 04:00:42,105 - INFO - BGPaaS(85219ed2-e7c5-42d4-829f-4a29590cd83f): verify_on_setup passed 2025-11-13 04:00:42,105 - INFO - We will configure BGP on the VM 2025-11-13 04:00:42,515 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:00:42,516 - INFO - Configuring BGP on ctest-TestBGPaasZone-31857541-86524154 2025-11-13 04:00:42,516 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 170.240.88.196; protocol bgp bgp_1{ local as 65000; neighbor 170.240.88.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 170.240.88.196; } protocol bfd { neighbor 170.240.88.193 local 170.240.88.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 04:00:42,516 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 170.240.88.196; protocol bgp bgp_1{ local as 65000; neighbor 170.240.88.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 170.240.88.196; } protocol bfd { neighbor 170.240.88.193 local 170.240.88.196 multihop on; } EOS 2025-11-13 04:00:47,784 - DEBUG - None 2025-11-13 04:00:47,784 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 170.240.88.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 170.240.88.196; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 04:00:47,784 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 170.240.88.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 170.240.88.196; } EOS 2025-11-13 04:00:48,300 - DEBUG - None 2025-11-13 04:00:48,300 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 04:00:48,300 - DEBUG - service bird restart 2025-11-13 04:00:49,913 - DEBUG - bird stop/waiting bird start/running, process 1441 2025-11-13 04:00:49,913 - INFO - Attaching VMI 248b71e4-1f8c-4ee7-8d55-ba1b1267f06e to BGPaaS 85219ed2-e7c5-42d4-829f-4a29590cd83f 2025-11-13 04:00:49,988 - INFO - Attaching the VMI 783034a5-007f-4206-8168-98ff349c839d to the BGPaaS 85219ed2-e7c5-42d4-829f-4a29590cd83f object 2025-11-13 04:00:49,988 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 170.240.88.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2025-11-13 04:00:49,988 - DEBUG - sudo ip addr add 170.240.88.212 dev eth0 2025-11-13 04:00:50,611 - DEBUG - None 2025-11-13 04:00:50,611 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:00:50,628 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-13 04:00:50,629 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:00:50,629 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-13 04:00:50,651 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-13 04:00:50,657 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:00:50,672 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-11-13 04:00:56,687 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-11-13 04:01:02,702 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-13 04:01:02,703 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:01:02,703 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-13 04:01:02,721 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-13 04:01:02,729 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 170.240.88.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 04:01:02,729 - DEBUG - ping -s 56 -c 3 -W 1 170.240.88.212 2025-11-13 04:01:09,957 - DEBUG - PING 170.240.88.212 (170.240.88.212) 56(84) bytes of data. 64 bytes from 170.240.88.212: icmp_seq=1 ttl=64 time=7.94 ms 64 bytes from 170.240.88.212: icmp_seq=2 ttl=64 time=0.926 ms 64 bytes from 170.240.88.212: icmp_seq=3 ttl=64 time=1.04 ms --- 170.240.88.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.926/3.306/7.944/3.280 ms 2025-11-13 04:01:09,957 - INFO - Ping to IP 170.240.88.212 from VM ctest-TestBGPaasZone-31857541-47000224 passed 2025-11-13 04:01:09,957 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:01:09,973 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-13 04:01:09,973 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:01:09,973 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-13 04:01:09,990 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-13 04:01:09,996 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:01:10,013 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-11-13 04:01:10,013 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-13 04:01:10,013 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-13 04:01:10,031 - INFO - BGPaaS session seen in control-node 10.20.0.193 2025-11-13 04:01:10,038 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 170.240.88.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-11-13 04:01:10,038 - DEBUG - ping -s 56 -c 3 -W 1 170.240.88.212 2025-11-13 04:01:12,614 - DEBUG - PING 170.240.88.212 (170.240.88.212) 56(84) bytes of data. 64 bytes from 170.240.88.212: icmp_seq=1 ttl=64 time=3.46 ms 64 bytes from 170.240.88.212: icmp_seq=2 ttl=64 time=0.995 ms 64 bytes from 170.240.88.212: icmp_seq=3 ttl=64 time=1.23 ms --- 170.240.88.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.995/1.899/3.469/1.115 ms 2025-11-13 04:01:12,614 - INFO - Ping to IP 170.240.88.212 from VM ctest-TestBGPaasZone-31857541-47000224 passed 2025-11-13 04:01:12,614 - INFO - Detaching VMI 248b71e4-1f8c-4ee7-8d55-ba1b1267f06e from BGPaaS 85219ed2-e7c5-42d4-829f-4a29590cd83f 2025-11-13 04:01:12,695 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-31857541-60598794(85219ed2-e7c5-42d4-829f-4a29590cd83f) 2025-11-13 04:01:12,758 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/85219ed2-e7c5-42d4-829f-4a29590cd83f 2025-11-13 04:01:12,767 - DEBUG - Response Code: 404 2025-11-13 04:01:12,768 - DEBUG - BGPaaS: 85219ed2-e7c5-42d4-829f-4a29590cd83f deleted from api server 2025-11-13 04:01:12,768 - INFO - BGPaaS(85219ed2-e7c5-42d4-829f-4a29590cd83f): verify_on_cleanup passed 2025-11-13 04:01:12,768 - INFO - Detaching VMI d41c27a0-ea54-4de7-8f59-0fbd93815ade from BGPaaS 08dfa57e-44cf-4533-9564-634d0a07a553 2025-11-13 04:01:12,879 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-31857541-89080620(08dfa57e-44cf-4533-9564-634d0a07a553) 2025-11-13 04:01:12,978 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/08dfa57e-44cf-4533-9564-634d0a07a553 2025-11-13 04:01:12,992 - DEBUG - Response Code: 404 2025-11-13 04:01:12,992 - DEBUG - BGPaaS: 08dfa57e-44cf-4533-9564-634d0a07a553 deleted from api server 2025-11-13 04:01:12,992 - INFO - BGPaaS(08dfa57e-44cf-4533-9564-634d0a07a553): verify_on_cleanup passed 2025-11-13 04:01:12,993 - INFO - Deleting Control node zone ctest-test-zone-05123442(5ffe7f84-4af0-4f7b-a723-991624bf7a4a) 2025-11-13 04:01:13,153 - INFO - Deleting Control node zone ctest-test-zone-48483464(4596ff33-4de6-4342-b616-772f2d3dde83) 2025-11-13 04:01:13,310 - INFO - Deleting Control node zone ctest-test-zone-36642010(e8e24bbe-ca20-4f80-a545-1f3d9b65d2a6) 2025-11-13 04:01:13,460 - INFO - Deleting VM ctest-TestBGPaasZone-31857541-47000224 2025-11-13 04:01:13,591 - INFO - Deleting VM ctest-TestBGPaasZone-31857541-86524154 2025-11-13 04:01:13,677 - INFO - Deleting VM ctest-TestBGPaasZone-31857541-69643466 2025-11-13 04:01:13,752 - INFO - Deleting VN ctest-cnz_vn-06131606 2025-11-13 04:01:13,880 - DEBUG - VN 24e1447c-e1e3-451d-98de-e09332f28e1d still in use: Unable to complete operation on network 24e1447c-e1e3-451d-98de-e09332f28e1d. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f581412d-a4a6-4818-ac72-830b52f5ec58'] 2025-11-13 04:01:13,880 - WARNING - Deleting VN ctest-cnz_vn-06131606 failed..Will retry 2025-11-13 04:01:16,079 - DEBUG - Response for deleting network () 2025-11-13 04:01:17,363 - DEBUG - Skipping xmpp flap check 2025-11-13 04:01:17,364 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:30] 2025-11-13 04:01:17,364 - INFO - -------------------------------------------------------------------------------- 2025-11-13 04:01:18,221 - INFO - Deleted project: ctest-TestBGPaasZone-31857541, ID : 3423b299-3442-4440-b16b-c6038f01b29d