2025-10-14 13:10:56,536 - INFO - Domain Default found not creating 2025-10-14 13:10:56,707 - INFO - Project ctest-TestBGPaasZone-14607823 not found, creating it 2025-10-14 13:10:57,304 - INFO - Created Project:ctest-TestBGPaasZone-14607823, ID : d7099770-148a-4d71-9d94-8f1b0fc6a6a6 2025-10-14 13:10:59,016 - DEBUG - Services list from nova: [, , , ] 2025-10-14 13:10:59,016 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4312-30', 'an-jenkins-deploy-platform-ansible-os-4312-1']} 2025-10-14 13:10:59,017 - INFO - ================================================================================ 2025-10-14 13:10:59,017 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-10-14 13:11:00,284 - DEBUG - Skipping xmpp flap check 2025-10-14 13:11:00,284 - INFO - Initial checks done. Running the testcase now 2025-10-14 13:11:00,284 - INFO - 2025-10-14 13:11:00,284 - INFO - executing bgp_control_zone test 2025-10-14 13:11:01,018 - DEBUG - Response for create_network : {'network': {'id': '18514b3c-9f70-4452-b3e6-4f6aca660ab7', 'name': 'ctest-cnz_vn-70447790', 'tenant_id': 'd7099770148a4d719d948f1b0fc6a6a6', 'project_id': 'd7099770148a4d719d948f1b0fc6a6a6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-14607823', 'ctest-cnz_vn-70447790'], 'port_security_enabled': True, 'description': ''}} 2025-10-14 13:11:01,346 - DEBUG - Response for create_subnet : {'subnet': {'id': '48b98500-15ca-4085-ba50-ae1c0396886c', 'name': '', 'tenant_id': 'd7099770148a4d719d948f1b0fc6a6a6', 'network_id': '18514b3c-9f70-4452-b3e6-4f6aca660ab7', 'ip_version': 4, 'cidr': '160.98.88.0/26', 'allocation_pools': [{'start': '160.98.88.2', 'end': '160.98.88.62'}], 'gateway_ip': '160.98.88.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '160.98.88.2', 'tags': [], 'project_id': 'd7099770148a4d719d948f1b0fc6a6a6'}} 2025-10-14 13:11:01,372 - INFO - Created VN ctest-cnz_vn-70447790 2025-10-14 13:11:01,386 - DEBUG - VN ctest-cnz_vn-70447790 UUID is 18514b3c-9f70-4452-b3e6-4f6aca660ab7 2025-10-14 13:11:02,802 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-30), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-30) 2025-10-14 13:11:04,508 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-1) 2025-10-14 13:11:06,312 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-30), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-30) 2025-10-14 13:11:06,313 - INFO - Waiting for VM ctest-TestBGPaasZone-14607823-71450883 to be up.. 2025-10-14 13:11:06,439 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-14 13:11:11,537 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-14 13:11:16,640 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-14 13:11:21,738 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-14 13:11:26,839 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-14 13:11:31,953 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-14 13:11:37,044 - DEBUG - VM is in ACTIVE state now 2025-10-14 13:11:37,044 - INFO - VM name : ctest-TestBGPaasZone-14607823-71450883 2025-10-14 13:11:37,137 - DEBUG - VM ctest-TestBGPaasZone-14607823-71450883 ID is 125a9821-ab3a-4fd5-96bd-e335faf94e17 2025-10-14 13:11:37,169 - DEBUG - VM ctest-TestBGPaasZone-14607823-71450883 launched on Node an-jenkins-deploy-platform-ansible-os-4312-30 2025-10-14 13:11:37,265 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/125a9821-ab3a-4fd5-96bd-e335faf94e17 2025-10-14 13:11:37,567 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/125a9821-ab3a-4fd5-96bd-e335faf94e17 2025-10-14 13:11:37,607 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/8ffe0a6a-4067-4eb3-b619-8ccd25a962cf 2025-10-14 13:11:40,782 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-10-14 13:11:40,782 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:11:40,802 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:11:44,887 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-14 13:11:44,888 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:11:44,905 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:11:48,971 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-10-14 13:11:48,971 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:11:48,991 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:11:53,075 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-14 13:11:53,076 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:11:53,093 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:11:57,169 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-14 13:11:57,169 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:11:57,190 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:01,258 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-10-14 13:12:01,258 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:01,277 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:05,362 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-10-14 13:12:05,362 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:05,378 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:09,463 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-10-14 13:12:09,463 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:09,483 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:13,559 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-14 13:12:13,559 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:13,576 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:17,651 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-10-14 13:12:17,651 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:17,668 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:21,740 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-10-14 13:12:21,740 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:21,758 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:25,841 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-14 13:12:25,841 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:25,859 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:29,935 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-14 13:12:29,935 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:29,952 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:34,030 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-14 13:12:34,030 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:34,046 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:38,122 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-14 13:12:38,122 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:38,139 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:42,220 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-14 13:12:42,220 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:42,237 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:46,320 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-14 13:12:46,320 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:46,336 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:50,410 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-14 13:12:50,410 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 failed! 2025-10-14 13:12:50,429 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-70447790 is 160.98.88.1 and allocation pool is NOT set 2025-10-14 13:12:52,493 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.19 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.02 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.022/3.603/4.185/0.581 ms') 2025-10-14 13:12:52,493 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-71450883 passed 2025-10-14 13:12:52,566 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:12:52,567 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-71450883, IP 160.98.88.3, Port 22 2025-10-14 13:12:52,635 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:12:52,801 - DEBUG - VM ctest-TestBGPaasZone-14607823-71450883 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:12:57,801 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:12:57,801 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-71450883, IP 160.98.88.3, Port 22 2025-10-14 13:12:57,867 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:12:57,956 - DEBUG - VM ctest-TestBGPaasZone-14607823-71450883 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:13:02,957 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:13:02,957 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-71450883, IP 160.98.88.3, Port 22 2025-10-14 13:13:03,027 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:13:03,134 - DEBUG - VM ctest-TestBGPaasZone-14607823-71450883 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:13:08,134 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:13:08,135 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-71450883, IP 160.98.88.3, Port 22 2025-10-14 13:13:08,206 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:13:08,305 - DEBUG - VM ctest-TestBGPaasZone-14607823-71450883 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:13:13,305 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:13:13,305 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-71450883, IP 160.98.88.3, Port 22 2025-10-14 13:13:13,371 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:13:13,480 - DEBUG - VM ctest-TestBGPaasZone-14607823-71450883 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:13:18,480 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:13:18,480 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-71450883, IP 160.98.88.3, Port 22 2025-10-14 13:13:18,537 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:13:18,629 - DEBUG - VM ctest-TestBGPaasZone-14607823-71450883 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:13:23,630 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:13:23,630 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-71450883, IP 160.98.88.3, Port 22 2025-10-14 13:13:23,698 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:13:23,789 - DEBUG - VM ctest-TestBGPaasZone-14607823-71450883 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:13:28,790 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:13:28,790 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-71450883, IP 160.98.88.3, Port 22 2025-10-14 13:13:28,849 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:13:28,952 - DEBUG - VM ctest-TestBGPaasZone-14607823-71450883 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:13:33,953 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:13:33,953 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-71450883, IP 160.98.88.3, Port 22 2025-10-14 13:13:34,118 - DEBUG - VM ctest-TestBGPaasZone-14607823-71450883 is ready for SSH connections 2025-10-14 13:13:34,118 - INFO - Waiting for VM ctest-TestBGPaasZone-14607823-38399375 to be up.. 2025-10-14 13:13:34,205 - DEBUG - VM is in ACTIVE state now 2025-10-14 13:13:34,206 - INFO - VM name : ctest-TestBGPaasZone-14607823-38399375 2025-10-14 13:13:34,287 - DEBUG - VM ctest-TestBGPaasZone-14607823-38399375 ID is 73e9d6b8-ffa6-48cd-bc2a-5b26de5f18aa 2025-10-14 13:13:34,287 - DEBUG - VM ctest-TestBGPaasZone-14607823-38399375 launched on Node an-jenkins-deploy-platform-ansible-os-4312-1 2025-10-14 13:13:34,393 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/73e9d6b8-ffa6-48cd-bc2a-5b26de5f18aa 2025-10-14 13:13:34,405 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/237619e9-4ff7-4baa-bb94-caf984c8b72f 2025-10-14 13:13:35,570 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.59 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.99 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.994/5.293/8.593/3.299 ms') 2025-10-14 13:13:35,570 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-38399375 passed 2025-10-14 13:13:35,645 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:13:35,645 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-38399375, IP 160.98.88.4, Port 22 2025-10-14 13:13:35,819 - DEBUG - VM ctest-TestBGPaasZone-14607823-38399375 is ready for SSH connections 2025-10-14 13:13:35,819 - INFO - Waiting for VM ctest-TestBGPaasZone-14607823-59168140 to be up.. 2025-10-14 13:13:35,908 - DEBUG - VM is in ACTIVE state now 2025-10-14 13:13:35,908 - INFO - VM name : ctest-TestBGPaasZone-14607823-59168140 2025-10-14 13:13:36,004 - DEBUG - VM ctest-TestBGPaasZone-14607823-59168140 ID is d2f12549-80c6-4510-99c0-010e0a6776fd 2025-10-14 13:13:36,005 - DEBUG - VM ctest-TestBGPaasZone-14607823-59168140 launched on Node an-jenkins-deploy-platform-ansible-os-4312-30 2025-10-14 13:13:36,098 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/d2f12549-80c6-4510-99c0-010e0a6776fd 2025-10-14 13:13:36,112 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/3f5ece37-4b08-46ef-813f-16c22a26cf5f 2025-10-14 13:13:37,301 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.07 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.71 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 2.712/3.392/4.073/0.680 ms') 2025-10-14 13:13:37,301 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-14607823-59168140 passed 2025-10-14 13:13:37,377 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:13:37,377 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-59168140, IP 160.98.88.5, Port 22 2025-10-14 13:13:37,543 - DEBUG - VM ctest-TestBGPaasZone-14607823-59168140 is ready for SSH connections 2025-10-14 13:13:37,694 - INFO - Created control node zone ctest-test-zone-65618059(263f48d8-17ba-4625-a976-d1bfe13cc527) 2025-10-14 13:13:38,078 - INFO - Created control node zone ctest-test-zone-11206902(149b9bbe-65fb-4f97-8f04-c86aecff2d73) 2025-10-14 13:13:38,450 - INFO - Created control node zone ctest-test-zone-64344944(84f40069-92d3-462c-b787-fa0ef8c85589) 2025-10-14 13:13:38,734 - INFO - Creating BGPaaS ctest-TestBGPaasZone-14607823-15910319 2025-10-14 13:13:38,814 - INFO - BGPaaS: ctest-TestBGPaasZone-14607823-15910319(7798e3bc-b707-4b08-8c2b-2de28788427c) 2025-10-14 13:13:38,814 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/7798e3bc-b707-4b08-8c2b-2de28788427c 2025-10-14 13:13:39,113 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/7798e3bc-b707-4b08-8c2b-2de28788427c 2025-10-14 13:13:39,149 - INFO - verify_in_api_server passed for BGPaaS obj 7798e3bc-b707-4b08-8c2b-2de28788427c 2025-10-14 13:13:39,150 - INFO - BGPaaS(7798e3bc-b707-4b08-8c2b-2de28788427c): verify_on_setup passed 2025-10-14 13:13:39,150 - INFO - We will configure BGP on the VM 2025-10-14 13:13:39,418 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:13:39,418 - INFO - Configuring BGP on ctest-TestBGPaasZone-14607823-71450883 2025-10-14 13:13:39,418 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.3; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.3; } protocol bfd { neighbor 160.98.88.1 local 160.98.88.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:13:39,419 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.3; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.3; } protocol bfd { neighbor 160.98.88.1 local 160.98.88.3 multihop on; } EOS 2025-10-14 13:13:52,171 - DEBUG - None 2025-10-14 13:13:52,171 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.3; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.3; } protocol bfd { neighbor 160.98.88.1 local 160.98.88.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:13:52,171 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.3; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.3; } protocol bfd { neighbor 160.98.88.1 local 160.98.88.3 multihop on; } EOS 2025-10-14 13:13:53,177 - DEBUG - None 2025-10-14 13:13:53,178 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:13:53,178 - DEBUG - service bird restart 2025-10-14 13:13:56,148 - DEBUG - bird stop/waiting bird start/running, process 1424 2025-10-14 13:13:56,148 - INFO - Attaching VMI 8ffe0a6a-4067-4eb3-b619-8ccd25a962cf to BGPaaS 7798e3bc-b707-4b08-8c2b-2de28788427c 2025-10-14 13:13:56,231 - INFO - Attaching the VMI 125a9821-ab3a-4fd5-96bd-e335faf94e17 to the BGPaaS 7798e3bc-b707-4b08-8c2b-2de28788427c object 2025-10-14 13:13:56,231 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 160.98.88.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:13:56,231 - DEBUG - sudo ip addr add 160.98.88.20 dev eth0 2025-10-14 13:13:57,550 - DEBUG - None 2025-10-14 13:13:57,618 - INFO - Creating BGPaaS ctest-TestBGPaasZone-14607823-02840338 2025-10-14 13:13:57,706 - INFO - BGPaaS: ctest-TestBGPaasZone-14607823-02840338(116d2fab-ded3-4ddd-8a48-9e703421c18b) 2025-10-14 13:13:57,706 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/116d2fab-ded3-4ddd-8a48-9e703421c18b 2025-10-14 13:13:57,718 - INFO - verify_in_api_server passed for BGPaaS obj 116d2fab-ded3-4ddd-8a48-9e703421c18b 2025-10-14 13:13:57,718 - INFO - BGPaaS(116d2fab-ded3-4ddd-8a48-9e703421c18b): verify_on_setup passed 2025-10-14 13:13:57,718 - INFO - We will configure BGP on the VM 2025-10-14 13:13:57,986 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:13:57,986 - INFO - Configuring BGP on ctest-TestBGPaasZone-14607823-38399375 2025-10-14 13:13:57,986 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.4; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.4; } protocol bfd { neighbor 160.98.88.2 local 160.98.88.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:13:57,986 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.4; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.4; } protocol bfd { neighbor 160.98.88.2 local 160.98.88.4 multihop on; } EOS 2025-10-14 13:14:04,259 - DEBUG - None 2025-10-14 13:14:04,259 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.4; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.4; } protocol bfd { neighbor 160.98.88.2 local 160.98.88.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:14:04,259 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.4; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.4; } protocol bfd { neighbor 160.98.88.2 local 160.98.88.4 multihop on; } EOS 2025-10-14 13:14:04,836 - DEBUG - None 2025-10-14 13:14:04,836 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:14:04,836 - DEBUG - service bird restart 2025-10-14 13:14:06,926 - DEBUG - bird stop/waiting bird start/running, process 1435 2025-10-14 13:14:06,926 - INFO - Attaching VMI 237619e9-4ff7-4baa-bb94-caf984c8b72f to BGPaaS 116d2fab-ded3-4ddd-8a48-9e703421c18b 2025-10-14 13:14:07,014 - INFO - Attaching the VMI 73e9d6b8-ffa6-48cd-bc2a-5b26de5f18aa to the BGPaaS 116d2fab-ded3-4ddd-8a48-9e703421c18b object 2025-10-14 13:14:07,014 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 160.98.88.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:14:07,014 - DEBUG - sudo ip addr add 160.98.88.20 dev eth0 2025-10-14 13:14:07,885 - DEBUG - None 2025-10-14 13:14:07,885 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:14:07,885 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-14 13:14:07,908 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-14 13:14:07,915 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:14:07,932 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-10-14 13:14:13,951 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17'] 2025-10-14 13:14:19,970 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-14 13:14:19,976 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 160.98.88.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:14:19,976 - DEBUG - ping -s 56 -c 3 -W 1 160.98.88.20 2025-10-14 13:14:26,151 - DEBUG - PING 160.98.88.20 (160.98.88.20) 56(84) bytes of data. 64 bytes from 160.98.88.20: icmp_seq=1 ttl=64 time=9.83 ms 64 bytes from 160.98.88.20: icmp_seq=2 ttl=64 time=1.62 ms 64 bytes from 160.98.88.20: icmp_seq=3 ttl=64 time=1.21 ms --- 160.98.88.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.218/4.226/9.835/3.969 ms 2025-10-14 13:14:26,151 - INFO - Ping to IP 160.98.88.20 from VM ctest-TestBGPaasZone-14607823-59168140 passed 2025-10-14 13:14:27,018 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:14:27,018 - DEBUG - service bird restart 2025-10-14 13:14:28,589 - DEBUG - bird stop/waiting bird start/running, process 1461 2025-10-14 13:14:28,589 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:14:28,589 - DEBUG - service bird restart 2025-10-14 13:14:30,609 - DEBUG - bird stop/waiting bird start/running, process 1462 2025-10-14 13:14:30,609 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:14:30,631 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.210'] 2025-10-14 13:14:36,653 - INFO - BGPaaS session seen in control-node 10.20.0.210 2025-10-14 13:14:36,659 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:14:36,676 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-14 13:14:36,682 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 160.98.88.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:14:36,682 - DEBUG - ping -s 56 -c 3 -W 1 160.98.88.20 2025-10-14 13:14:39,159 - DEBUG - PING 160.98.88.20 (160.98.88.20) 56(84) bytes of data. 64 bytes from 160.98.88.20: icmp_seq=1 ttl=64 time=4.00 ms 64 bytes from 160.98.88.20: icmp_seq=2 ttl=64 time=0.826 ms 64 bytes from 160.98.88.20: icmp_seq=3 ttl=64 time=1.41 ms --- 160.98.88.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.826/2.079/4.000/1.379 ms 2025-10-14 13:14:39,159 - INFO - Ping to IP 160.98.88.20 from VM ctest-TestBGPaasZone-14607823-59168140 passed 2025-10-14 13:14:39,473 - INFO - We will configure BGP on the VM 2025-10-14 13:14:39,706 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:14:39,706 - INFO - Configuring BGP on ctest-TestBGPaasZone-14607823-71450883 2025-10-14 13:14:39,706 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.3; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.3; } protocol bfd { neighbor 160.98.88.1 local 160.98.88.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:14:39,706 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.3; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.3; } protocol bfd { neighbor 160.98.88.1 local 160.98.88.3 multihop on; } EOS 2025-10-14 13:14:40,164 - DEBUG - None 2025-10-14 13:14:40,164 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.3; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.3; } protocol bfd { neighbor 160.98.88.1 local 160.98.88.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:14:40,164 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 160.98.88.3; protocol bgp bgp_1{ local as 65000; neighbor 160.98.88.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 160.98.88.3; } protocol bfd { neighbor 160.98.88.1 local 160.98.88.3 multihop on; } EOS 2025-10-14 13:14:40,660 - DEBUG - None 2025-10-14 13:14:40,660 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:14:40,660 - DEBUG - service bird restart 2025-10-14 13:14:42,239 - DEBUG - bird stop/waiting bird start/running, process 1493 2025-10-14 13:14:42,239 - INFO - Attaching VMI 8ffe0a6a-4067-4eb3-b619-8ccd25a962cf to BGPaaS 7798e3bc-b707-4b08-8c2b-2de28788427c 2025-10-14 13:14:42,264 - INFO - Attaching the VMI 125a9821-ab3a-4fd5-96bd-e335faf94e17 to the BGPaaS 7798e3bc-b707-4b08-8c2b-2de28788427c object 2025-10-14 13:14:42,264 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 160.98.88.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:14:42,264 - DEBUG - sudo ip addr add 160.98.88.20 dev eth0 2025-10-14 13:14:42,958 - DEBUG - RTNETLINK answers: File exists 2025-10-14 13:14:42,958 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:14:42,958 - DEBUG - service bird restart 2025-10-14 13:14:44,565 - DEBUG - bird stop/waiting bird start/running, process 1520 2025-10-14 13:14:44,565 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:14:44,566 - DEBUG - service bird restart 2025-10-14 13:14:46,535 - DEBUG - bird stop/waiting bird start/running, process 1484 2025-10-14 13:14:46,535 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:14:46,535 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-14 13:14:46,552 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-10-14 13:14:52,553 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-14 13:14:52,567 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-14 13:14:52,572 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:14:52,593 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-14 13:14:52,599 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 160.98.88.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:14:52,599 - DEBUG - ping -s 56 -c 3 -W 1 160.98.88.20 2025-10-14 13:14:55,062 - DEBUG - PING 160.98.88.20 (160.98.88.20) 56(84) bytes of data. 64 bytes from 160.98.88.20: icmp_seq=1 ttl=64 time=4.49 ms 64 bytes from 160.98.88.20: icmp_seq=2 ttl=64 time=1.37 ms 64 bytes from 160.98.88.20: icmp_seq=3 ttl=64 time=1.58 ms --- 160.98.88.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.377/2.486/4.495/1.423 ms 2025-10-14 13:14:55,062 - INFO - Ping to IP 160.98.88.20 from VM ctest-TestBGPaasZone-14607823-59168140 passed 2025-10-14 13:14:55,062 - INFO - Detaching VMI 8ffe0a6a-4067-4eb3-b619-8ccd25a962cf from BGPaaS 7798e3bc-b707-4b08-8c2b-2de28788427c 2025-10-14 13:14:55,150 - INFO - Detaching VMI 237619e9-4ff7-4baa-bb94-caf984c8b72f from BGPaaS 116d2fab-ded3-4ddd-8a48-9e703421c18b 2025-10-14 13:14:55,278 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-14607823-02840338(116d2fab-ded3-4ddd-8a48-9e703421c18b) 2025-10-14 13:14:55,376 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/116d2fab-ded3-4ddd-8a48-9e703421c18b 2025-10-14 13:14:55,394 - DEBUG - Response Code: 404 2025-10-14 13:14:55,395 - DEBUG - BGPaaS: 116d2fab-ded3-4ddd-8a48-9e703421c18b deleted from api server 2025-10-14 13:14:55,395 - INFO - BGPaaS(116d2fab-ded3-4ddd-8a48-9e703421c18b): verify_on_cleanup passed 2025-10-14 13:14:55,395 - INFO - Detaching VMI 8ffe0a6a-4067-4eb3-b619-8ccd25a962cf from BGPaaS 7798e3bc-b707-4b08-8c2b-2de28788427c 2025-10-14 13:14:55,445 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-14607823-15910319(7798e3bc-b707-4b08-8c2b-2de28788427c) 2025-10-14 13:14:55,528 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/7798e3bc-b707-4b08-8c2b-2de28788427c 2025-10-14 13:14:55,539 - DEBUG - Response Code: 404 2025-10-14 13:14:55,539 - DEBUG - BGPaaS: 7798e3bc-b707-4b08-8c2b-2de28788427c deleted from api server 2025-10-14 13:14:55,539 - INFO - BGPaaS(7798e3bc-b707-4b08-8c2b-2de28788427c): verify_on_cleanup passed 2025-10-14 13:14:55,539 - INFO - Deleting Control node zone ctest-test-zone-64344944(84f40069-92d3-462c-b787-fa0ef8c85589) 2025-10-14 13:14:55,692 - INFO - Deleting Control node zone ctest-test-zone-11206902(149b9bbe-65fb-4f97-8f04-c86aecff2d73) 2025-10-14 13:14:55,850 - INFO - Deleting Control node zone ctest-test-zone-65618059(263f48d8-17ba-4625-a976-d1bfe13cc527) 2025-10-14 13:14:55,937 - INFO - Deleting VM ctest-TestBGPaasZone-14607823-59168140 2025-10-14 13:14:56,030 - INFO - Deleting VM ctest-TestBGPaasZone-14607823-38399375 2025-10-14 13:14:56,115 - INFO - Deleting VM ctest-TestBGPaasZone-14607823-71450883 2025-10-14 13:14:56,199 - INFO - Deleting VN ctest-cnz_vn-70447790 2025-10-14 13:14:56,251 - DEBUG - VN 18514b3c-9f70-4452-b3e6-4f6aca660ab7 still in use: Unable to complete operation on network 18514b3c-9f70-4452-b3e6-4f6aca660ab7. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-ad5dcf83-24f1-4cb2-b31b-8bc9a43dfed4'] 2025-10-14 13:14:56,251 - WARNING - Deleting VN ctest-cnz_vn-70447790 failed..Will retry 2025-10-14 13:14:58,551 - DEBUG - Response for deleting network () 2025-10-14 13:14:59,841 - DEBUG - Skipping xmpp flap check
2025-10-14 13:14:59,841 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:00]
2025-10-14 13:14:59,841 - INFO - -------------------------------------------------------------------------------- 2025-10-14 13:14:59,843 - INFO - ================================================================================ 2025-10-14 13:14:59,843 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-10-14 13:15:01,120 - DEBUG - Skipping xmpp flap check 2025-10-14 13:15:01,120 - INFO - Initial checks done. Running the testcase now 2025-10-14 13:15:01,120 - INFO - 2025-10-14 13:15:01,120 - INFO - executing bgp_control_zone agent restart test 2025-10-14 13:15:01,469 - DEBUG - Response for create_network : {'network': {'id': 'a4341679-7c88-4f43-b30a-0bb492a43e1a', 'name': 'ctest-cnz_vn-39673709', 'tenant_id': 'd7099770148a4d719d948f1b0fc6a6a6', 'project_id': 'd7099770148a4d719d948f1b0fc6a6a6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-14607823', 'ctest-cnz_vn-39673709'], 'port_security_enabled': True, 'description': ''}} 2025-10-14 13:15:01,747 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a90b7776-30ce-4a5a-ae8f-fdb04f36fb2c', 'name': '', 'tenant_id': 'd7099770148a4d719d948f1b0fc6a6a6', 'network_id': 'a4341679-7c88-4f43-b30a-0bb492a43e1a', 'ip_version': 4, 'cidr': '144.87.185.0/26', 'allocation_pools': [{'start': '144.87.185.2', 'end': '144.87.185.62'}], 'gateway_ip': '144.87.185.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '144.87.185.2', 'tags': [], 'project_id': 'd7099770148a4d719d948f1b0fc6a6a6'}} 2025-10-14 13:15:01,774 - INFO - Created VN ctest-cnz_vn-39673709 2025-10-14 13:15:01,788 - DEBUG - VN ctest-cnz_vn-39673709 UUID is a4341679-7c88-4f43-b30a-0bb492a43e1a 2025-10-14 13:15:03,075 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-1) 2025-10-14 13:15:04,602 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-30), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-30) 2025-10-14 13:15:06,086 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-1) 2025-10-14 13:15:06,086 - INFO - Waiting for VM ctest-TestBGPaasZone-14607823-58597579 to be up.. 2025-10-14 13:15:06,203 - DEBUG - VM is in ACTIVE state now 2025-10-14 13:15:06,203 - INFO - VM name : ctest-TestBGPaasZone-14607823-58597579 2025-10-14 13:15:06,307 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 ID is 65d39d96-8bc5-4fbe-a403-0e4c6b9e8f04 2025-10-14 13:15:06,307 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 launched on Node an-jenkins-deploy-platform-ansible-os-4312-1 2025-10-14 13:15:06,414 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/65d39d96-8bc5-4fbe-a403-0e4c6b9e8f04 2025-10-14 13:15:06,426 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/4d6e797c-bbfc-4688-b319-6f8e2ecbf457 2025-10-14 13:15:09,654 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-10-14 13:15:09,654 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:09,681 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:13,745 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-10-14 13:15:13,745 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:13,769 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:17,839 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-10-14 13:15:17,839 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:17,859 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:21,937 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-14 13:15:21,937 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:21,954 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:26,038 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-10-14 13:15:26,038 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:26,055 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:30,136 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-10-14 13:15:30,136 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:30,152 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:34,224 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-10-14 13:15:34,224 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:34,240 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:38,325 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-10-14 13:15:38,326 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:38,342 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:42,422 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-10-14 13:15:42,422 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:42,438 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:46,519 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-10-14 13:15:46,519 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:46,536 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:50,617 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-14 13:15:50,617 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:50,633 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:54,711 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-14 13:15:54,711 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:54,727 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:15:58,812 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-10-14 13:15:58,812 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:15:58,827 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:16:02,907 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-14 13:16:02,907 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:16:02,948 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:16:07,026 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-14 13:16:07,026 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:16:07,043 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:16:11,126 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-14 13:16:11,126 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:16:11,142 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:16:15,218 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-14 13:16:15,218 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:16:15,233 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:16:19,311 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-10-14 13:16:19,311 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:16:19,329 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:16:23,407 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-14 13:16:23,407 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:16:23,426 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:16:27,504 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-14 13:16:27,504 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:16:27,523 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:16:31,607 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-10-14 13:16:31,608 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:16:31,627 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:16:35,698 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-10-14 13:16:35,698 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 failed! 2025-10-14 13:16:35,716 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14607823:ctest-cnz_vn-39673709 is 144.87.185.1 and allocation pool is NOT set 2025-10-14 13:16:37,782 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.48 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.79 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.793/5.136/7.479/2.343 ms') 2025-10-14 13:16:37,782 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-58597579 passed 2025-10-14 13:16:37,856 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:16:37,856 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:16:37,923 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:16:38,087 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:16:43,087 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:16:43,088 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:16:43,166 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:16:43,292 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:16:48,293 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:16:48,293 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:16:48,359 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:16:48,452 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:16:53,453 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:16:53,454 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:16:53,520 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:16:53,617 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:16:58,618 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:16:58,618 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:16:58,685 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:16:58,783 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:17:03,783 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:17:03,784 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:17:03,852 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:17:03,943 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:17:08,944 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:17:08,944 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:17:09,022 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:17:09,118 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:17:14,118 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:17:14,119 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:17:14,198 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:17:14,286 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:17:19,286 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:17:19,286 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:17:19,356 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:17:19,448 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:17:24,449 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:17:24,449 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:17:24,515 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:17:24,596 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:17:29,597 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:17:29,597 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:17:29,664 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:17:29,748 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:17:34,748 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:17:34,749 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:17:34,826 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-14 13:17:34,917 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-14 13:17:39,918 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:17:39,918 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-58597579, IP 144.87.185.3, Port 22 2025-10-14 13:17:40,096 - DEBUG - VM ctest-TestBGPaasZone-14607823-58597579 is ready for SSH connections 2025-10-14 13:17:40,096 - INFO - Waiting for VM ctest-TestBGPaasZone-14607823-26896567 to be up.. 2025-10-14 13:17:40,200 - DEBUG - VM is in ACTIVE state now 2025-10-14 13:17:40,200 - INFO - VM name : ctest-TestBGPaasZone-14607823-26896567 2025-10-14 13:17:40,286 - DEBUG - VM ctest-TestBGPaasZone-14607823-26896567 ID is ba03f587-8d72-4762-b6e0-88529fea56fa 2025-10-14 13:17:40,286 - DEBUG - VM ctest-TestBGPaasZone-14607823-26896567 launched on Node an-jenkins-deploy-platform-ansible-os-4312-30 2025-10-14 13:17:40,382 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/ba03f587-8d72-4762-b6e0-88529fea56fa 2025-10-14 13:17:40,421 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/55d07cb3-47af-4312-8da2-b01d633f36af 2025-10-14 13:17:41,580 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.90 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.568 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.568/2.232/3.896/1.664 ms') 2025-10-14 13:17:41,580 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14607823-26896567 passed 2025-10-14 13:17:41,652 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:17:41,652 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-26896567, IP 144.87.185.4, Port 22 2025-10-14 13:17:41,823 - DEBUG - VM ctest-TestBGPaasZone-14607823-26896567 is ready for SSH connections 2025-10-14 13:17:41,823 - INFO - Waiting for VM ctest-TestBGPaasZone-14607823-46072692 to be up.. 2025-10-14 13:17:41,909 - DEBUG - VM is in ACTIVE state now 2025-10-14 13:17:41,909 - INFO - VM name : ctest-TestBGPaasZone-14607823-46072692 2025-10-14 13:17:41,999 - DEBUG - VM ctest-TestBGPaasZone-14607823-46072692 ID is d1f41a04-104f-44c0-b7fd-7ec787c314f6 2025-10-14 13:17:42,000 - DEBUG - VM ctest-TestBGPaasZone-14607823-46072692 launched on Node an-jenkins-deploy-platform-ansible-os-4312-1 2025-10-14 13:17:42,092 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/d1f41a04-104f-44c0-b7fd-7ec787c314f6 2025-10-14 13:17:42,107 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/043d360f-b60d-481a-b89a-fd01a135684f 2025-10-14 13:17:43,280 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.64 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.74 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 1.735/2.687/3.639/0.952 ms') 2025-10-14 13:17:43,280 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-14607823-46072692 passed 2025-10-14 13:17:43,362 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:17:43,362 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14607823-46072692, IP 144.87.185.5, Port 22 2025-10-14 13:17:43,531 - DEBUG - VM ctest-TestBGPaasZone-14607823-46072692 is ready for SSH connections 2025-10-14 13:17:43,674 - INFO - Created control node zone ctest-test-zone-04113248(ba115592-c239-4c0f-a60e-f1b2095bcdad) 2025-10-14 13:17:44,066 - INFO - Created control node zone ctest-test-zone-76816004(d5367c06-5cf2-4356-a78f-dbdcc0491432) 2025-10-14 13:17:44,438 - INFO - Created control node zone ctest-test-zone-07688953(85b85727-caaa-4704-af53-ffd409205365) 2025-10-14 13:17:44,738 - INFO - Creating BGPaaS ctest-TestBGPaasZone-14607823-08744379 2025-10-14 13:17:44,826 - INFO - BGPaaS: ctest-TestBGPaasZone-14607823-08744379(817f1f27-cf2f-42db-8623-c537e940036c) 2025-10-14 13:17:44,826 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/817f1f27-cf2f-42db-8623-c537e940036c 2025-10-14 13:17:44,837 - INFO - verify_in_api_server passed for BGPaaS obj 817f1f27-cf2f-42db-8623-c537e940036c 2025-10-14 13:17:44,837 - INFO - BGPaaS(817f1f27-cf2f-42db-8623-c537e940036c): verify_on_setup passed 2025-10-14 13:17:44,837 - INFO - We will configure BGP on the VM 2025-10-14 13:17:45,270 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:17:45,270 - INFO - Configuring BGP on ctest-TestBGPaasZone-14607823-58597579 2025-10-14 13:17:45,270 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 144.87.185.3; protocol bgp bgp_1{ local as 65000; neighbor 144.87.185.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 144.87.185.3; } protocol bfd { neighbor 144.87.185.1 local 144.87.185.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:17:45,271 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 144.87.185.3; protocol bgp bgp_1{ local as 65000; neighbor 144.87.185.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 144.87.185.3; } protocol bfd { neighbor 144.87.185.1 local 144.87.185.3 multihop on; } EOS 2025-10-14 13:18:06,257 - DEBUG - None 2025-10-14 13:18:06,257 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 144.87.185.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 144.87.185.3; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:18:06,257 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 144.87.185.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 144.87.185.3; } EOS 2025-10-14 13:18:07,523 - DEBUG - None 2025-10-14 13:18:07,524 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:18:07,524 - DEBUG - service bird restart 2025-10-14 13:18:11,304 - DEBUG - bird stop/waiting bird start/running, process 1430 2025-10-14 13:18:11,304 - INFO - Attaching VMI 4d6e797c-bbfc-4688-b319-6f8e2ecbf457 to BGPaaS 817f1f27-cf2f-42db-8623-c537e940036c 2025-10-14 13:18:11,390 - INFO - Attaching the VMI 65d39d96-8bc5-4fbe-a403-0e4c6b9e8f04 to the BGPaaS 817f1f27-cf2f-42db-8623-c537e940036c object 2025-10-14 13:18:11,390 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 144.87.185.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:18:11,390 - DEBUG - sudo ip addr add 144.87.185.20 dev eth0 2025-10-14 13:18:13,464 - DEBUG - None 2025-10-14 13:18:13,530 - INFO - Creating BGPaaS ctest-TestBGPaasZone-14607823-11144886 2025-10-14 13:18:13,610 - INFO - BGPaaS: ctest-TestBGPaasZone-14607823-11144886(e7c93a9d-3f49-41f8-80d3-de1b3a7c0102) 2025-10-14 13:18:13,610 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/e7c93a9d-3f49-41f8-80d3-de1b3a7c0102 2025-10-14 13:18:13,620 - INFO - verify_in_api_server passed for BGPaaS obj e7c93a9d-3f49-41f8-80d3-de1b3a7c0102 2025-10-14 13:18:13,620 - INFO - BGPaaS(e7c93a9d-3f49-41f8-80d3-de1b3a7c0102): verify_on_setup passed 2025-10-14 13:18:13,620 - INFO - We will configure BGP on the VM 2025-10-14 13:18:14,070 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:18:14,070 - INFO - Configuring BGP on ctest-TestBGPaasZone-14607823-26896567 2025-10-14 13:18:14,070 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 144.87.185.4; protocol bgp bgp_1{ local as 65000; neighbor 144.87.185.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 144.87.185.4; } protocol bfd { neighbor 144.87.185.1 local 144.87.185.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:18:14,070 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 144.87.185.4; protocol bgp bgp_1{ local as 65000; neighbor 144.87.185.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 144.87.185.4; } protocol bfd { neighbor 144.87.185.1 local 144.87.185.4 multihop on; } EOS 2025-10-14 13:18:19,118 - DEBUG - None 2025-10-14 13:18:19,118 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 144.87.185.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 144.87.185.4; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:18:19,119 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 144.87.185.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 144.87.185.4; } EOS 2025-10-14 13:18:19,662 - DEBUG - None 2025-10-14 13:18:19,663 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:18:19,663 - DEBUG - service bird restart 2025-10-14 13:18:21,346 - DEBUG - bird stop/waiting bird start/running, process 1446 2025-10-14 13:18:21,346 - INFO - Attaching VMI 55d07cb3-47af-4312-8da2-b01d633f36af to BGPaaS e7c93a9d-3f49-41f8-80d3-de1b3a7c0102 2025-10-14 13:18:21,435 - INFO - Attaching the VMI ba03f587-8d72-4762-b6e0-88529fea56fa to the BGPaaS e7c93a9d-3f49-41f8-80d3-de1b3a7c0102 object 2025-10-14 13:18:21,435 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 144.87.185.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-10-14 13:18:21,436 - DEBUG - sudo ip addr add 144.87.185.20 dev eth0 2025-10-14 13:18:22,075 - DEBUG - None 2025-10-14 13:18:22,075 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:18:22,075 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-14 13:18:22,091 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-14 13:18:22,092 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:18:22,110 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-14 13:18:22,116 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:18:22,116 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-14 13:18:22,129 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-10-14 13:18:28,131 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-14 13:18:28,145 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-10-14 13:18:34,147 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-14 13:18:34,165 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-14 13:18:34,166 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:18:34,186 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-14 13:18:34,193 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 144.87.185.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:18:34,193 - DEBUG - ping -s 56 -c 3 -W 1 144.87.185.20 2025-10-14 13:18:41,845 - DEBUG - PING 144.87.185.20 (144.87.185.20) 56(84) bytes of data. 64 bytes from 144.87.185.20: icmp_seq=1 ttl=64 time=11.8 ms 64 bytes from 144.87.185.20: icmp_seq=2 ttl=64 time=1.00 ms 64 bytes from 144.87.185.20: icmp_seq=3 ttl=64 time=1.20 ms --- 144.87.185.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.003/4.671/11.806/5.045 ms 2025-10-14 13:18:41,845 - INFO - Ping to IP 144.87.185.20 from VM ctest-TestBGPaasZone-14607823-46072692 passed 2025-10-14 13:18:41,845 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:18:41,845 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-14 13:18:41,860 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-14 13:18:41,860 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:18:41,880 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-14 13:18:41,887 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:18:41,887 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-14 13:18:41,900 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-14 13:18:41,900 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 13:18:41,922 - INFO - BGPaaS session seen in control-node 10.20.0.17 2025-10-14 13:18:41,929 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 144.87.185.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-14 13:18:41,929 - DEBUG - ping -s 56 -c 3 -W 1 144.87.185.20 2025-10-14 13:18:44,505 - DEBUG - PING 144.87.185.20 (144.87.185.20) 56(84) bytes of data. 64 bytes from 144.87.185.20: icmp_seq=1 ttl=64 time=1.83 ms 64 bytes from 144.87.185.20: icmp_seq=2 ttl=64 time=1.38 ms 64 bytes from 144.87.185.20: icmp_seq=3 ttl=64 time=1.12 ms --- 144.87.185.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.127/1.449/1.833/0.291 ms 2025-10-14 13:18:44,505 - INFO - Ping to IP 144.87.185.20 from VM ctest-TestBGPaasZone-14607823-46072692 passed 2025-10-14 13:18:44,505 - INFO - Detaching VMI 55d07cb3-47af-4312-8da2-b01d633f36af from BGPaaS e7c93a9d-3f49-41f8-80d3-de1b3a7c0102 2025-10-14 13:18:44,594 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-14607823-11144886(e7c93a9d-3f49-41f8-80d3-de1b3a7c0102) 2025-10-14 13:18:44,661 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/e7c93a9d-3f49-41f8-80d3-de1b3a7c0102 2025-10-14 13:18:44,695 - DEBUG - Response Code: 404 2025-10-14 13:18:44,696 - DEBUG - BGPaaS: e7c93a9d-3f49-41f8-80d3-de1b3a7c0102 deleted from api server 2025-10-14 13:18:44,696 - INFO - BGPaaS(e7c93a9d-3f49-41f8-80d3-de1b3a7c0102): verify_on_cleanup passed 2025-10-14 13:18:44,696 - INFO - Detaching VMI 4d6e797c-bbfc-4688-b319-6f8e2ecbf457 from BGPaaS 817f1f27-cf2f-42db-8623-c537e940036c 2025-10-14 13:18:44,786 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-14607823-08744379(817f1f27-cf2f-42db-8623-c537e940036c) 2025-10-14 13:18:44,855 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/817f1f27-cf2f-42db-8623-c537e940036c 2025-10-14 13:18:44,862 - DEBUG - Response Code: 404 2025-10-14 13:18:44,863 - DEBUG - BGPaaS: 817f1f27-cf2f-42db-8623-c537e940036c deleted from api server 2025-10-14 13:18:44,863 - INFO - BGPaaS(817f1f27-cf2f-42db-8623-c537e940036c): verify_on_cleanup passed 2025-10-14 13:18:44,863 - INFO - Deleting Control node zone ctest-test-zone-07688953(85b85727-caaa-4704-af53-ffd409205365) 2025-10-14 13:18:45,025 - INFO - Deleting Control node zone ctest-test-zone-76816004(d5367c06-5cf2-4356-a78f-dbdcc0491432) 2025-10-14 13:18:45,220 - INFO - Deleting Control node zone ctest-test-zone-04113248(ba115592-c239-4c0f-a60e-f1b2095bcdad) 2025-10-14 13:18:45,411 - INFO - Deleting VM ctest-TestBGPaasZone-14607823-46072692 2025-10-14 13:18:45,496 - INFO - Deleting VM ctest-TestBGPaasZone-14607823-26896567 2025-10-14 13:18:45,568 - INFO - Deleting VM ctest-TestBGPaasZone-14607823-58597579 2025-10-14 13:18:45,632 - INFO - Deleting VN ctest-cnz_vn-39673709 2025-10-14 13:18:45,677 - DEBUG - VN a4341679-7c88-4f43-b30a-0bb492a43e1a still in use: Unable to complete operation on network a4341679-7c88-4f43-b30a-0bb492a43e1a. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f33853aa-b417-476e-858e-760d5e713a86'] 2025-10-14 13:18:45,677 - WARNING - Deleting VN ctest-cnz_vn-39673709 failed..Will retry 2025-10-14 13:18:47,919 - DEBUG - Response for deleting network () 2025-10-14 13:18:49,204 - DEBUG - Skipping xmpp flap check
2025-10-14 13:18:49,205 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:50]
2025-10-14 13:18:49,205 - INFO - -------------------------------------------------------------------------------- 2025-10-14 13:18:49,981 - INFO - Deleted project: ctest-TestBGPaasZone-14607823, ID : d7099770-148a-4d71-9d94-8f1b0fc6a6a6