2025-10-15 17:27:03,621 - INFO - Domain Default found not creating 2025-10-15 17:27:03,768 - INFO - Project ctest-TestBGPaasZone-14544265 not found, creating it 2025-10-15 17:27:04,290 - INFO - Created Project:ctest-TestBGPaasZone-14544265, ID : 7c707022-5bc8-440b-8a66-42c8a636d1cd 2025-10-15 17:27:05,729 - DEBUG - Services list from nova: [, , , ] 2025-10-15 17:27:05,729 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4330-1', 'an-jenkins-deploy-platform-ansible-os-4330-2']} 2025-10-15 17:27:05,731 - INFO - ================================================================================ 2025-10-15 17:27:05,731 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-10-15 17:27:07,024 - DEBUG - Skipping xmpp flap check 2025-10-15 17:27:07,024 - INFO - Initial checks done. Running the testcase now 2025-10-15 17:27:07,024 - INFO - 2025-10-15 17:27:07,024 - INFO - executing bgp_control_zone test 2025-10-15 17:27:07,643 - DEBUG - Response for create_network : {'network': {'id': 'ef3120ef-dfc1-4e01-807f-c93597763737', 'name': 'ctest-cnz_vn-73312686', 'tenant_id': '7c7070225bc8440b8a6642c8a636d1cd', 'project_id': '7c7070225bc8440b8a6642c8a636d1cd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-14544265', 'ctest-cnz_vn-73312686'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 17:27:07,870 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e6d6cdb7-791f-4331-83e9-720609b208b9', 'name': '', 'tenant_id': '7c7070225bc8440b8a6642c8a636d1cd', 'network_id': 'ef3120ef-dfc1-4e01-807f-c93597763737', 'ip_version': 4, 'cidr': '73.187.30.192/26', 'allocation_pools': [{'start': '73.187.30.194', 'end': '73.187.30.254'}], 'gateway_ip': '73.187.30.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '73.187.30.194', 'tags': [], 'project_id': '7c7070225bc8440b8a6642c8a636d1cd'}} 2025-10-15 17:27:07,895 - INFO - Created VN ctest-cnz_vn-73312686 2025-10-15 17:27:07,911 - DEBUG - VN ctest-cnz_vn-73312686 UUID is ef3120ef-dfc1-4e01-807f-c93597763737 2025-10-15 17:27:09,065 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-1) 2025-10-15 17:27:10,336 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-2) 2025-10-15 17:27:11,747 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-1) 2025-10-15 17:27:11,747 - INFO - Waiting for VM ctest-TestBGPaasZone-14544265-61086582 to be up.. 2025-10-15 17:27:11,872 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-15 17:27:17,005 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-15 17:27:22,088 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-15 17:27:27,169 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-15 17:27:32,255 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-15 17:27:37,343 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-15 17:27:42,426 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-15 17:27:47,509 - DEBUG - VM is in ACTIVE state now 2025-10-15 17:27:47,509 - INFO - VM name : ctest-TestBGPaasZone-14544265-61086582 2025-10-15 17:27:47,598 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 ID is 6a83d473-30b1-4a80-9f82-2b251c19d467 2025-10-15 17:27:47,626 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 launched on Node an-jenkins-deploy-platform-ansible-os-4330-1 2025-10-15 17:27:47,713 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/6a83d473-30b1-4a80-9f82-2b251c19d467 2025-10-15 17:27:48,003 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/6a83d473-30b1-4a80-9f82-2b251c19d467 2025-10-15 17:27:48,033 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/4b74d5ae-3c7b-4b25-958a-059225f320ba 2025-10-15 17:27:51,213 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-15 17:27:51,214 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:27:51,229 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:27:55,312 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-15 17:27:55,312 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:27:55,329 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:27:59,402 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-10-15 17:27:59,402 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:27:59,424 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:03,494 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-10-15 17:28:03,494 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:03,509 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:07,597 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-10-15 17:28:07,597 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:07,614 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:11,689 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-15 17:28:11,689 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:11,708 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:15,793 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-15 17:28:15,793 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:15,810 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:19,886 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-15 17:28:19,886 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:19,903 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:23,975 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-15 17:28:23,976 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:23,992 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:28,070 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-15 17:28:28,070 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:28,084 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:32,173 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-10-15 17:28:32,173 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:32,192 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:36,267 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-10-15 17:28:36,267 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:36,283 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:40,364 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-15 17:28:40,364 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:40,379 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:44,462 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-15 17:28:44,462 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:44,479 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:48,554 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-10-15 17:28:48,554 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:48,570 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:52,652 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-15 17:28:52,652 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:52,668 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:28:56,749 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-15 17:28:56,749 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:28:56,771 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:29:00,842 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-10-15 17:29:00,842 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 failed! 2025-10-15 17:29:00,857 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-73312686 is 73.187.30.193 and allocation pool is NOT set 2025-10-15 17:29:02,932 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.76 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.25 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.254/4.507/6.761/2.253 ms') 2025-10-15 17:29:02,933 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-61086582 passed 2025-10-15 17:29:03,009 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:03,009 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-61086582, IP 73.187.30.195, Port 22 2025-10-15 17:29:03,075 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:29:03,195 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:29:08,196 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:08,196 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-61086582, IP 73.187.30.195, Port 22 2025-10-15 17:29:08,263 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:29:08,356 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:29:13,357 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:13,357 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-61086582, IP 73.187.30.195, Port 22 2025-10-15 17:29:13,413 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:29:13,487 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:29:18,487 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:18,488 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-61086582, IP 73.187.30.195, Port 22 2025-10-15 17:29:18,555 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:29:18,639 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:29:23,640 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:23,640 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-61086582, IP 73.187.30.195, Port 22 2025-10-15 17:29:23,707 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:29:23,796 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:29:28,797 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:28,797 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-61086582, IP 73.187.30.195, Port 22 2025-10-15 17:29:28,862 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:29:28,944 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:29:33,946 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:33,946 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-61086582, IP 73.187.30.195, Port 22 2025-10-15 17:29:34,001 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:29:34,078 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:29:39,079 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:39,080 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-61086582, IP 73.187.30.195, Port 22 2025-10-15 17:29:39,138 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:29:39,222 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:29:44,222 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:44,222 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-61086582, IP 73.187.30.195, Port 22 2025-10-15 17:29:44,290 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:29:44,370 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:29:49,371 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:49,371 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-61086582, IP 73.187.30.195, Port 22 2025-10-15 17:29:49,429 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:29:49,507 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:29:54,508 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:54,508 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-61086582, IP 73.187.30.195, Port 22 2025-10-15 17:29:54,687 - DEBUG - VM ctest-TestBGPaasZone-14544265-61086582 is ready for SSH connections 2025-10-15 17:29:54,687 - INFO - Waiting for VM ctest-TestBGPaasZone-14544265-88851721 to be up.. 2025-10-15 17:29:54,776 - DEBUG - VM is in ACTIVE state now 2025-10-15 17:29:54,776 - INFO - VM name : ctest-TestBGPaasZone-14544265-88851721 2025-10-15 17:29:54,861 - DEBUG - VM ctest-TestBGPaasZone-14544265-88851721 ID is 78fe6946-2c80-4155-ae74-8b3827609baa 2025-10-15 17:29:54,861 - DEBUG - VM ctest-TestBGPaasZone-14544265-88851721 launched on Node an-jenkins-deploy-platform-ansible-os-4330-2 2025-10-15 17:29:54,941 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/78fe6946-2c80-4155-ae74-8b3827609baa 2025-10-15 17:29:54,951 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/c9c3db83-514c-4a06-b113-dc7f4ba285d6 2025-10-15 17:29:56,113 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.44 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.543 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.543/1.990/3.437/1.447 ms') 2025-10-15 17:29:56,113 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-88851721 passed 2025-10-15 17:29:56,198 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:56,199 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-88851721, IP 73.187.30.196, Port 22 2025-10-15 17:29:56,368 - DEBUG - VM ctest-TestBGPaasZone-14544265-88851721 is ready for SSH connections 2025-10-15 17:29:56,368 - INFO - Waiting for VM ctest-TestBGPaasZone-14544265-46806128 to be up.. 2025-10-15 17:29:56,447 - DEBUG - VM is in ACTIVE state now 2025-10-15 17:29:56,448 - INFO - VM name : ctest-TestBGPaasZone-14544265-46806128 2025-10-15 17:29:56,527 - DEBUG - VM ctest-TestBGPaasZone-14544265-46806128 ID is e4e6b8dd-0da7-4f2e-97c8-bf629ba658fe 2025-10-15 17:29:56,527 - DEBUG - VM ctest-TestBGPaasZone-14544265-46806128 launched on Node an-jenkins-deploy-platform-ansible-os-4330-1 2025-10-15 17:29:56,605 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/e4e6b8dd-0da7-4f2e-97c8-bf629ba658fe 2025-10-15 17:29:56,615 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/a24273cc-0a54-4ca1-afa6-4ed0a2621b41 2025-10-15 17:29:57,789 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=8.95 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=8.87 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 8.874/8.912/8.951/0.038 ms') 2025-10-15 17:29:57,789 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-14544265-46806128 passed 2025-10-15 17:29:57,859 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:57,860 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-46806128, IP 73.187.30.197, Port 22 2025-10-15 17:29:58,045 - DEBUG - VM ctest-TestBGPaasZone-14544265-46806128 is ready for SSH connections 2025-10-15 17:29:58,193 - INFO - Created control node zone ctest-test-zone-95902879(f35e9cd2-fe51-4342-969a-54cd758cdc8c) 2025-10-15 17:29:58,581 - INFO - Created control node zone ctest-test-zone-87174331(c1c6a0cf-0506-46a8-8084-5f921df4f661) 2025-10-15 17:29:58,949 - INFO - Created control node zone ctest-test-zone-42309066(c5a726d5-4c4e-4158-af9b-997b664b72a7) 2025-10-15 17:29:59,229 - INFO - Creating BGPaaS ctest-TestBGPaasZone-14544265-56461842 2025-10-15 17:29:59,309 - INFO - BGPaaS: ctest-TestBGPaasZone-14544265-56461842(f6d84ead-eb15-4e07-9017-0f1c055b56ff) 2025-10-15 17:29:59,309 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/f6d84ead-eb15-4e07-9017-0f1c055b56ff 2025-10-15 17:29:59,600 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/f6d84ead-eb15-4e07-9017-0f1c055b56ff 2025-10-15 17:29:59,632 - INFO - verify_in_api_server passed for BGPaaS obj f6d84ead-eb15-4e07-9017-0f1c055b56ff 2025-10-15 17:29:59,632 - INFO - BGPaaS(f6d84ead-eb15-4e07-9017-0f1c055b56ff): verify_on_setup passed 2025-10-15 17:29:59,632 - INFO - We will configure BGP on the VM 2025-10-15 17:29:59,897 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:29:59,897 - INFO - Configuring BGP on ctest-TestBGPaasZone-14544265-61086582 2025-10-15 17:29:59,897 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.195; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.195; } protocol bfd { neighbor 73.187.30.193 local 73.187.30.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:29:59,898 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.195; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.195; } protocol bfd { neighbor 73.187.30.193 local 73.187.30.195 multihop on; } EOS 2025-10-15 17:30:12,902 - DEBUG - None 2025-10-15 17:30:12,902 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.195; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.195; } protocol bfd { neighbor 73.187.30.193 local 73.187.30.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:30:12,902 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.195; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.195; } protocol bfd { neighbor 73.187.30.193 local 73.187.30.195 multihop on; } EOS 2025-10-15 17:30:13,427 - DEBUG - None 2025-10-15 17:30:13,427 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:30:13,427 - DEBUG - service bird restart 2025-10-15 17:30:15,174 - DEBUG - bird stop/waiting bird start/running, process 1441 2025-10-15 17:30:15,175 - INFO - Attaching VMI 4b74d5ae-3c7b-4b25-958a-059225f320ba to BGPaaS f6d84ead-eb15-4e07-9017-0f1c055b56ff 2025-10-15 17:30:15,265 - INFO - Attaching the VMI 6a83d473-30b1-4a80-9f82-2b251c19d467 to the BGPaaS f6d84ead-eb15-4e07-9017-0f1c055b56ff object 2025-10-15 17:30:15,265 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 73.187.30.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:30:15,265 - DEBUG - sudo ip addr add 73.187.30.212 dev eth0 2025-10-15 17:30:16,111 - DEBUG - None 2025-10-15 17:30:16,181 - INFO - Creating BGPaaS ctest-TestBGPaasZone-14544265-88970691 2025-10-15 17:30:16,269 - INFO - BGPaaS: ctest-TestBGPaasZone-14544265-88970691(5ee42165-4dba-428c-bcfc-9ee533aaa247) 2025-10-15 17:30:16,269 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/5ee42165-4dba-428c-bcfc-9ee533aaa247 2025-10-15 17:30:16,281 - INFO - verify_in_api_server passed for BGPaaS obj 5ee42165-4dba-428c-bcfc-9ee533aaa247 2025-10-15 17:30:16,281 - INFO - BGPaaS(5ee42165-4dba-428c-bcfc-9ee533aaa247): verify_on_setup passed 2025-10-15 17:30:16,281 - INFO - We will configure BGP on the VM 2025-10-15 17:30:16,573 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:30:16,573 - INFO - Configuring BGP on ctest-TestBGPaasZone-14544265-88851721 2025-10-15 17:30:16,574 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.196; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.196; } protocol bfd { neighbor 73.187.30.194 local 73.187.30.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:30:16,574 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.196; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.196; } protocol bfd { neighbor 73.187.30.194 local 73.187.30.196 multihop on; } EOS 2025-10-15 17:30:31,811 - DEBUG - None 2025-10-15 17:30:31,811 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.196; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.196; } protocol bfd { neighbor 73.187.30.194 local 73.187.30.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:30:31,811 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.196; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.196; } protocol bfd { neighbor 73.187.30.194 local 73.187.30.196 multihop on; } EOS 2025-10-15 17:30:32,314 - DEBUG - None 2025-10-15 17:30:32,314 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:30:32,314 - DEBUG - service bird restart 2025-10-15 17:30:34,001 - DEBUG - bird stop/waiting bird start/running, process 1443 2025-10-15 17:30:34,001 - INFO - Attaching VMI c9c3db83-514c-4a06-b113-dc7f4ba285d6 to BGPaaS 5ee42165-4dba-428c-bcfc-9ee533aaa247 2025-10-15 17:30:34,089 - INFO - Attaching the VMI 78fe6946-2c80-4155-ae74-8b3827609baa to the BGPaaS 5ee42165-4dba-428c-bcfc-9ee533aaa247 object 2025-10-15 17:30:34,089 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 73.187.30.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:30:34,089 - DEBUG - sudo ip addr add 73.187.30.212 dev eth0 2025-10-15 17:30:34,725 - DEBUG - None 2025-10-15 17:30:34,725 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:30:34,745 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-10-15 17:30:34,754 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:30:34,774 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.252'] 2025-10-15 17:30:40,794 - INFO - BGPaaS session seen in control-node 10.20.0.252 2025-10-15 17:30:40,800 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 73.187.30.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:30:40,800 - DEBUG - ping -s 56 -c 3 -W 1 73.187.30.212 2025-10-15 17:30:57,039 - DEBUG - PING 73.187.30.212 (73.187.30.212) 56(84) bytes of data. 64 bytes from 73.187.30.212: icmp_seq=1 ttl=64 time=6.97 ms 64 bytes from 73.187.30.212: icmp_seq=2 ttl=64 time=0.968 ms 64 bytes from 73.187.30.212: icmp_seq=3 ttl=64 time=0.935 ms --- 73.187.30.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.935/2.959/6.975/2.839 ms 2025-10-15 17:30:57,039 - INFO - Ping to IP 73.187.30.212 from VM ctest-TestBGPaasZone-14544265-46806128 passed 2025-10-15 17:30:57,909 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:30:57,909 - DEBUG - service bird restart 2025-10-15 17:30:59,550 - DEBUG - bird stop/waiting bird start/running, process 1468 2025-10-15 17:30:59,550 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:30:59,550 - DEBUG - service bird restart 2025-10-15 17:31:01,272 - DEBUG - bird stop/waiting bird start/running, process 1470 2025-10-15 17:31:01,272 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:31:01,272 - DEBUG - Requesting: http://10.20.0.5:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-15 17:31:01,293 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.5'] 2025-10-15 17:31:07,295 - DEBUG - Requesting: http://10.20.0.5:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-15 17:31:07,312 - INFO - BGPaaS session seen in control-node 10.20.0.5 2025-10-15 17:31:07,318 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:31:07,335 - INFO - BGPaaS session seen in control-node 10.20.0.252 2025-10-15 17:31:07,341 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 73.187.30.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:31:07,341 - DEBUG - ping -s 56 -c 3 -W 1 73.187.30.212 2025-10-15 17:31:09,834 - DEBUG - PING 73.187.30.212 (73.187.30.212) 56(84) bytes of data. 64 bytes from 73.187.30.212: icmp_seq=1 ttl=64 time=8.02 ms 64 bytes from 73.187.30.212: icmp_seq=2 ttl=64 time=1.44 ms 64 bytes from 73.187.30.212: icmp_seq=3 ttl=64 time=1.53 ms --- 73.187.30.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.447/3.668/8.028/3.083 ms 2025-10-15 17:31:09,834 - INFO - Ping to IP 73.187.30.212 from VM ctest-TestBGPaasZone-14544265-46806128 passed 2025-10-15 17:31:10,156 - INFO - We will configure BGP on the VM 2025-10-15 17:31:10,385 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:31:10,385 - INFO - Configuring BGP on ctest-TestBGPaasZone-14544265-61086582 2025-10-15 17:31:10,386 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.195; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.195; } protocol bfd { neighbor 73.187.30.193 local 73.187.30.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:31:10,386 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.195; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.195; } protocol bfd { neighbor 73.187.30.193 local 73.187.30.195 multihop on; } EOS 2025-10-15 17:31:10,860 - DEBUG - None 2025-10-15 17:31:10,861 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.195; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.195; } protocol bfd { neighbor 73.187.30.193 local 73.187.30.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:31:10,861 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 73.187.30.195; protocol bgp bgp_1{ local as 65000; neighbor 73.187.30.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 73.187.30.195; } protocol bfd { neighbor 73.187.30.193 local 73.187.30.195 multihop on; } EOS 2025-10-15 17:31:11,368 - DEBUG - None 2025-10-15 17:31:11,368 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:31:11,368 - DEBUG - service bird restart 2025-10-15 17:31:12,987 - DEBUG - bird stop/waiting bird start/running, process 1500 2025-10-15 17:31:12,987 - INFO - Attaching VMI 4b74d5ae-3c7b-4b25-958a-059225f320ba to BGPaaS f6d84ead-eb15-4e07-9017-0f1c055b56ff 2025-10-15 17:31:13,011 - INFO - Attaching the VMI 6a83d473-30b1-4a80-9f82-2b251c19d467 to the BGPaaS f6d84ead-eb15-4e07-9017-0f1c055b56ff object 2025-10-15 17:31:13,012 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 73.187.30.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:31:13,012 - DEBUG - sudo ip addr add 73.187.30.212 dev eth0 2025-10-15 17:31:13,712 - DEBUG - RTNETLINK answers: File exists 2025-10-15 17:31:13,712 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:31:13,712 - DEBUG - service bird restart 2025-10-15 17:31:15,390 - DEBUG - bird stop/waiting bird start/running, process 1527 2025-10-15 17:31:15,390 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:31:15,390 - DEBUG - service bird restart 2025-10-15 17:31:17,014 - DEBUG - bird stop/waiting bird start/running, process 1492 2025-10-15 17:31:17,015 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:31:17,029 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18'] 2025-10-15 17:31:23,044 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-10-15 17:31:23,051 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:31:23,067 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.252'] 2025-10-15 17:31:29,090 - INFO - BGPaaS session seen in control-node 10.20.0.252 2025-10-15 17:31:29,097 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 73.187.30.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:31:29,097 - DEBUG - ping -s 56 -c 3 -W 1 73.187.30.212 2025-10-15 17:31:31,564 - DEBUG - PING 73.187.30.212 (73.187.30.212) 56(84) bytes of data. 64 bytes from 73.187.30.212: icmp_seq=1 ttl=64 time=3.85 ms 64 bytes from 73.187.30.212: icmp_seq=2 ttl=64 time=1.28 ms 64 bytes from 73.187.30.212: icmp_seq=3 ttl=64 time=1.21 ms --- 73.187.30.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.210/2.116/3.850/1.226 ms 2025-10-15 17:31:31,565 - INFO - Ping to IP 73.187.30.212 from VM ctest-TestBGPaasZone-14544265-46806128 passed 2025-10-15 17:31:31,565 - INFO - Detaching VMI 4b74d5ae-3c7b-4b25-958a-059225f320ba from BGPaaS f6d84ead-eb15-4e07-9017-0f1c055b56ff 2025-10-15 17:31:31,653 - INFO - Detaching VMI c9c3db83-514c-4a06-b113-dc7f4ba285d6 from BGPaaS 5ee42165-4dba-428c-bcfc-9ee533aaa247 2025-10-15 17:31:31,733 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-14544265-88970691(5ee42165-4dba-428c-bcfc-9ee533aaa247) 2025-10-15 17:31:31,778 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/5ee42165-4dba-428c-bcfc-9ee533aaa247 2025-10-15 17:31:31,783 - DEBUG - Response Code: 404 2025-10-15 17:31:31,783 - DEBUG - BGPaaS: 5ee42165-4dba-428c-bcfc-9ee533aaa247 deleted from api server 2025-10-15 17:31:31,783 - INFO - BGPaaS(5ee42165-4dba-428c-bcfc-9ee533aaa247): verify_on_cleanup passed 2025-10-15 17:31:31,784 - INFO - Detaching VMI 4b74d5ae-3c7b-4b25-958a-059225f320ba from BGPaaS f6d84ead-eb15-4e07-9017-0f1c055b56ff 2025-10-15 17:31:31,803 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-14544265-56461842(f6d84ead-eb15-4e07-9017-0f1c055b56ff) 2025-10-15 17:31:31,846 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/f6d84ead-eb15-4e07-9017-0f1c055b56ff 2025-10-15 17:31:31,852 - DEBUG - Response Code: 404 2025-10-15 17:31:31,853 - DEBUG - BGPaaS: f6d84ead-eb15-4e07-9017-0f1c055b56ff deleted from api server 2025-10-15 17:31:31,853 - INFO - BGPaaS(f6d84ead-eb15-4e07-9017-0f1c055b56ff): verify_on_cleanup passed 2025-10-15 17:31:31,853 - INFO - Deleting Control node zone ctest-test-zone-42309066(c5a726d5-4c4e-4158-af9b-997b664b72a7) 2025-10-15 17:31:32,007 - INFO - Deleting Control node zone ctest-test-zone-87174331(c1c6a0cf-0506-46a8-8084-5f921df4f661) 2025-10-15 17:31:32,152 - INFO - Deleting Control node zone ctest-test-zone-95902879(f35e9cd2-fe51-4342-969a-54cd758cdc8c) 2025-10-15 17:31:32,236 - INFO - Deleting VM ctest-TestBGPaasZone-14544265-46806128 2025-10-15 17:31:32,308 - INFO - Deleting VM ctest-TestBGPaasZone-14544265-88851721 2025-10-15 17:31:32,371 - INFO - Deleting VM ctest-TestBGPaasZone-14544265-61086582 2025-10-15 17:31:32,437 - INFO - Deleting VN ctest-cnz_vn-73312686 2025-10-15 17:31:32,483 - DEBUG - VN ef3120ef-dfc1-4e01-807f-c93597763737 still in use: Unable to complete operation on network ef3120ef-dfc1-4e01-807f-c93597763737. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-65aa5634-cef2-4baa-a84f-ac88f560c980'] 2025-10-15 17:31:32,483 - WARNING - Deleting VN ctest-cnz_vn-73312686 failed..Will retry 2025-10-15 17:31:34,697 - DEBUG - Response for deleting network () 2025-10-15 17:31:35,992 - DEBUG - Skipping xmpp flap check 2025-10-15 17:31:35,992 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:30] 2025-10-15 17:31:35,992 - INFO - -------------------------------------------------------------------------------- 2025-10-15 17:31:35,995 - INFO - ================================================================================ 2025-10-15 17:31:35,995 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-10-15 17:31:37,295 - DEBUG - Skipping xmpp flap check 2025-10-15 17:31:37,295 - INFO - Initial checks done. Running the testcase now 2025-10-15 17:31:37,295 - INFO - 2025-10-15 17:31:37,295 - INFO - executing bgp_control_zone agent restart test 2025-10-15 17:31:37,614 - DEBUG - Response for create_network : {'network': {'id': 'b496ec69-5d63-4fe8-8fba-cd3e02be20f8', 'name': 'ctest-cnz_vn-93085655', 'tenant_id': '7c7070225bc8440b8a6642c8a636d1cd', 'project_id': '7c7070225bc8440b8a6642c8a636d1cd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-14544265', 'ctest-cnz_vn-93085655'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 17:31:37,801 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e3e35575-9d9e-4215-bf30-46a464b00734', 'name': '', 'tenant_id': '7c7070225bc8440b8a6642c8a636d1cd', 'network_id': 'b496ec69-5d63-4fe8-8fba-cd3e02be20f8', 'ip_version': 4, 'cidr': '104.39.147.64/26', 'allocation_pools': [{'start': '104.39.147.66', 'end': '104.39.147.126'}], 'gateway_ip': '104.39.147.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '104.39.147.66', 'tags': [], 'project_id': '7c7070225bc8440b8a6642c8a636d1cd'}} 2025-10-15 17:31:37,823 - INFO - Created VN ctest-cnz_vn-93085655 2025-10-15 17:31:37,836 - DEBUG - VN ctest-cnz_vn-93085655 UUID is b496ec69-5d63-4fe8-8fba-cd3e02be20f8 2025-10-15 17:31:38,981 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-2) 2025-10-15 17:31:40,122 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-1) 2025-10-15 17:31:41,295 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-2) 2025-10-15 17:31:41,295 - INFO - Waiting for VM ctest-TestBGPaasZone-14544265-72479523 to be up.. 2025-10-15 17:31:41,377 - DEBUG - VM is in ACTIVE state now 2025-10-15 17:31:41,377 - INFO - VM name : ctest-TestBGPaasZone-14544265-72479523 2025-10-15 17:31:41,465 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 ID is f4566095-ad20-4c56-b4bd-96876264e33d 2025-10-15 17:31:41,465 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 launched on Node an-jenkins-deploy-platform-ansible-os-4330-2 2025-10-15 17:31:41,547 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/f4566095-ad20-4c56-b4bd-96876264e33d 2025-10-15 17:31:41,561 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/d2f4bba5-d687-4a81-8a7c-e16465b5fb16 2025-10-15 17:31:44,745 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1001ms') 2025-10-15 17:31:44,745 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:31:44,767 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:31:48,838 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-10-15 17:31:48,838 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:31:48,861 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:31:52,935 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-10-15 17:31:52,936 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:31:52,954 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:31:57,030 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-15 17:31:57,030 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:31:57,054 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:01,133 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-15 17:32:01,133 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:01,152 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:05,228 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-15 17:32:05,228 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:05,247 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:09,325 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-10-15 17:32:09,325 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:09,369 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:13,445 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-10-15 17:32:13,445 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:13,460 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:17,543 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-10-15 17:32:17,543 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:17,565 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:21,646 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-15 17:32:21,647 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:21,662 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:25,745 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-15 17:32:25,746 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:25,759 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:29,833 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-15 17:32:29,834 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:29,855 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:33,928 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-15 17:32:33,928 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:33,946 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:38,024 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-15 17:32:38,024 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:38,043 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:42,125 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-10-15 17:32:42,125 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:42,141 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:46,217 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-15 17:32:46,218 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:46,233 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:50,319 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-15 17:32:50,319 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:50,338 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:54,408 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-10-15 17:32:54,408 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 failed! 2025-10-15 17:32:54,428 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-14544265:ctest-cnz_vn-93085655 is 104.39.147.65 and allocation pool is NOT set 2025-10-15 17:32:56,500 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.54 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.373 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.373/1.457/2.541/1.084 ms') 2025-10-15 17:32:56,500 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-72479523 passed 2025-10-15 17:32:56,576 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:32:56,576 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-72479523, IP 104.39.147.67, Port 22 2025-10-15 17:32:56,643 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:32:56,794 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:33:01,794 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:01,795 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-72479523, IP 104.39.147.67, Port 22 2025-10-15 17:33:01,867 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:33:01,983 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:33:06,984 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:06,984 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-72479523, IP 104.39.147.67, Port 22 2025-10-15 17:33:07,055 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:33:07,139 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:33:12,140 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:12,140 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-72479523, IP 104.39.147.67, Port 22 2025-10-15 17:33:12,218 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:33:12,306 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:33:17,307 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:17,307 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-72479523, IP 104.39.147.67, Port 22 2025-10-15 17:33:17,374 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:33:17,452 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:33:22,454 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:22,454 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-72479523, IP 104.39.147.67, Port 22 2025-10-15 17:33:22,527 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:33:22,613 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:33:27,614 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:27,614 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-72479523, IP 104.39.147.67, Port 22 2025-10-15 17:33:27,682 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:33:27,771 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:33:32,772 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:32,773 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-72479523, IP 104.39.147.67, Port 22 2025-10-15 17:33:32,847 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:33:32,927 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:33:37,927 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:37,928 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-72479523, IP 104.39.147.67, Port 22 2025-10-15 17:33:37,999 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:33:38,113 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:33:43,114 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:43,115 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-72479523, IP 104.39.147.67, Port 22 2025-10-15 17:33:43,172 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 17:33:43,258 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 17:33:48,258 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:48,258 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-72479523, IP 104.39.147.67, Port 22 2025-10-15 17:33:48,442 - DEBUG - VM ctest-TestBGPaasZone-14544265-72479523 is ready for SSH connections 2025-10-15 17:33:48,443 - INFO - Waiting for VM ctest-TestBGPaasZone-14544265-15429207 to be up.. 2025-10-15 17:33:48,526 - DEBUG - VM is in ACTIVE state now 2025-10-15 17:33:48,526 - INFO - VM name : ctest-TestBGPaasZone-14544265-15429207 2025-10-15 17:33:48,602 - DEBUG - VM ctest-TestBGPaasZone-14544265-15429207 ID is e59f4d9c-e723-4bcf-97b3-30c073f1f7c1 2025-10-15 17:33:48,602 - DEBUG - VM ctest-TestBGPaasZone-14544265-15429207 launched on Node an-jenkins-deploy-platform-ansible-os-4330-1 2025-10-15 17:33:48,680 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/e59f4d9c-e723-4bcf-97b3-30c073f1f7c1 2025-10-15 17:33:48,716 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/e8a60fe1-1185-4b06-8156-7067376d202d 2025-10-15 17:33:49,875 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.55 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.611 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.611/2.580/4.549/1.969 ms') 2025-10-15 17:33:49,876 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-14544265-15429207 passed 2025-10-15 17:33:49,959 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:49,959 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-15429207, IP 104.39.147.68, Port 22 2025-10-15 17:33:50,130 - DEBUG - VM ctest-TestBGPaasZone-14544265-15429207 is ready for SSH connections 2025-10-15 17:33:50,130 - INFO - Waiting for VM ctest-TestBGPaasZone-14544265-33787556 to be up.. 2025-10-15 17:33:50,213 - DEBUG - VM is in ACTIVE state now 2025-10-15 17:33:50,213 - INFO - VM name : ctest-TestBGPaasZone-14544265-33787556 2025-10-15 17:33:50,297 - DEBUG - VM ctest-TestBGPaasZone-14544265-33787556 ID is 916493ac-b99a-40d5-a35e-465529bf1108 2025-10-15 17:33:50,297 - DEBUG - VM ctest-TestBGPaasZone-14544265-33787556 launched on Node an-jenkins-deploy-platform-ansible-os-4330-2 2025-10-15 17:33:50,385 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/916493ac-b99a-40d5-a35e-465529bf1108 2025-10-15 17:33:50,398 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/b602434e-1dd3-44da-8053-1b66d917f052 2025-10-15 17:33:51,569 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.14 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.463 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.463/3.303/6.143/2.840 ms') 2025-10-15 17:33:51,569 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-14544265-33787556 passed 2025-10-15 17:33:51,637 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:51,638 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-14544265-33787556, IP 104.39.147.69, Port 22 2025-10-15 17:33:51,815 - DEBUG - VM ctest-TestBGPaasZone-14544265-33787556 is ready for SSH connections 2025-10-15 17:33:51,953 - INFO - Created control node zone ctest-test-zone-09626437(4331bd3e-7f9e-44f1-9cc1-064d4b31fe8f) 2025-10-15 17:33:52,341 - INFO - Created control node zone ctest-test-zone-88006476(300c0075-c53a-4194-9712-c5dcfb48796b) 2025-10-15 17:33:52,702 - INFO - Created control node zone ctest-test-zone-46867188(275102c8-2323-43c1-8d01-768468dca6bd) 2025-10-15 17:33:52,989 - INFO - Creating BGPaaS ctest-TestBGPaasZone-14544265-64163996 2025-10-15 17:33:53,073 - INFO - BGPaaS: ctest-TestBGPaasZone-14544265-64163996(4152a116-a0c4-4060-8ca9-5b20b1f49f44) 2025-10-15 17:33:53,073 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/4152a116-a0c4-4060-8ca9-5b20b1f49f44 2025-10-15 17:33:53,083 - INFO - verify_in_api_server passed for BGPaaS obj 4152a116-a0c4-4060-8ca9-5b20b1f49f44 2025-10-15 17:33:53,083 - INFO - BGPaaS(4152a116-a0c4-4060-8ca9-5b20b1f49f44): verify_on_setup passed 2025-10-15 17:33:53,083 - INFO - We will configure BGP on the VM 2025-10-15 17:33:53,549 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:33:53,549 - INFO - Configuring BGP on ctest-TestBGPaasZone-14544265-72479523 2025-10-15 17:33:53,549 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 104.39.147.67; protocol bgp bgp_1{ local as 65000; neighbor 104.39.147.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 104.39.147.67; } protocol bfd { neighbor 104.39.147.65 local 104.39.147.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:33:53,549 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 104.39.147.67; protocol bgp bgp_1{ local as 65000; neighbor 104.39.147.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 104.39.147.67; } protocol bfd { neighbor 104.39.147.65 local 104.39.147.67 multihop on; } EOS 2025-10-15 17:34:06,430 - DEBUG - None 2025-10-15 17:34:06,430 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 104.39.147.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 104.39.147.67; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:34:06,431 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 104.39.147.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 104.39.147.67; } EOS 2025-10-15 17:34:07,409 - DEBUG - None 2025-10-15 17:34:07,410 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:34:07,410 - DEBUG - service bird restart 2025-10-15 17:34:09,506 - DEBUG - bird stop/waiting bird start/running, process 1441 2025-10-15 17:34:09,506 - INFO - Attaching VMI d2f4bba5-d687-4a81-8a7c-e16465b5fb16 to BGPaaS 4152a116-a0c4-4060-8ca9-5b20b1f49f44 2025-10-15 17:34:09,581 - INFO - Attaching the VMI f4566095-ad20-4c56-b4bd-96876264e33d to the BGPaaS 4152a116-a0c4-4060-8ca9-5b20b1f49f44 object 2025-10-15 17:34:09,581 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 104.39.147.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:34:09,581 - DEBUG - sudo ip addr add 104.39.147.84 dev eth0 2025-10-15 17:34:10,214 - DEBUG - None 2025-10-15 17:34:10,277 - INFO - Creating BGPaaS ctest-TestBGPaasZone-14544265-95801589 2025-10-15 17:34:10,361 - INFO - BGPaaS: ctest-TestBGPaasZone-14544265-95801589(58b4b403-d905-4421-b72c-ac014f503a82) 2025-10-15 17:34:10,361 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/58b4b403-d905-4421-b72c-ac014f503a82 2025-10-15 17:34:10,371 - INFO - verify_in_api_server passed for BGPaaS obj 58b4b403-d905-4421-b72c-ac014f503a82 2025-10-15 17:34:10,371 - INFO - BGPaaS(58b4b403-d905-4421-b72c-ac014f503a82): verify_on_setup passed 2025-10-15 17:34:10,371 - INFO - We will configure BGP on the VM 2025-10-15 17:34:10,789 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:34:10,790 - INFO - Configuring BGP on ctest-TestBGPaasZone-14544265-15429207 2025-10-15 17:34:10,790 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 104.39.147.68; protocol bgp bgp_1{ local as 65000; neighbor 104.39.147.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 104.39.147.68; } protocol bfd { neighbor 104.39.147.65 local 104.39.147.68 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:34:10,790 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 104.39.147.68; protocol bgp bgp_1{ local as 65000; neighbor 104.39.147.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 104.39.147.68; } protocol bfd { neighbor 104.39.147.65 local 104.39.147.68 multihop on; } EOS 2025-10-15 17:34:16,286 - DEBUG - None 2025-10-15 17:34:16,286 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 104.39.147.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 104.39.147.68; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:34:16,286 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 104.39.147.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 104.39.147.68; } EOS 2025-10-15 17:34:16,780 - DEBUG - None 2025-10-15 17:34:16,780 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:34:16,780 - DEBUG - service bird restart 2025-10-15 17:34:18,486 - DEBUG - bird stop/waiting bird start/running, process 1433 2025-10-15 17:34:18,486 - INFO - Attaching VMI e8a60fe1-1185-4b06-8156-7067376d202d to BGPaaS 58b4b403-d905-4421-b72c-ac014f503a82 2025-10-15 17:34:18,569 - INFO - Attaching the VMI e59f4d9c-e723-4bcf-97b3-30c073f1f7c1 to the BGPaaS 58b4b403-d905-4421-b72c-ac014f503a82 object 2025-10-15 17:34:18,569 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 104.39.147.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 17:34:18,569 - DEBUG - sudo ip addr add 104.39.147.84 dev eth0 2025-10-15 17:34:19,286 - DEBUG - None 2025-10-15 17:34:19,286 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:34:19,302 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-10-15 17:34:19,302 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:34:19,320 - INFO - BGPaaS session seen in control-node 10.20.0.252 2025-10-15 17:34:19,326 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:34:19,341 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18'] 2025-10-15 17:34:25,357 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18'] 2025-10-15 17:34:31,372 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-10-15 17:34:31,372 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:34:31,391 - INFO - BGPaaS session seen in control-node 10.20.0.252 2025-10-15 17:34:31,396 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 104.39.147.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:34:31,396 - DEBUG - ping -s 56 -c 3 -W 1 104.39.147.84 2025-10-15 17:34:37,382 - DEBUG - PING 104.39.147.84 (104.39.147.84) 56(84) bytes of data. 64 bytes from 104.39.147.84: icmp_seq=1 ttl=64 time=6.59 ms 64 bytes from 104.39.147.84: icmp_seq=2 ttl=64 time=0.999 ms 64 bytes from 104.39.147.84: icmp_seq=3 ttl=64 time=0.909 ms --- 104.39.147.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.909/2.832/6.590/2.657 ms 2025-10-15 17:34:37,382 - INFO - Ping to IP 104.39.147.84 from VM ctest-TestBGPaasZone-14544265-33787556 passed 2025-10-15 17:34:37,382 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:34:37,396 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-10-15 17:34:37,396 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:34:37,413 - INFO - BGPaaS session seen in control-node 10.20.0.252 2025-10-15 17:34:37,420 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:34:37,433 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-10-15 17:34:37,433 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 17:34:37,451 - INFO - BGPaaS session seen in control-node 10.20.0.252 2025-10-15 17:34:37,456 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 104.39.147.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-10-15 17:34:37,456 - DEBUG - ping -s 56 -c 3 -W 1 104.39.147.84 2025-10-15 17:34:39,956 - DEBUG - PING 104.39.147.84 (104.39.147.84) 56(84) bytes of data. 64 bytes from 104.39.147.84: icmp_seq=1 ttl=64 time=1.47 ms 64 bytes from 104.39.147.84: icmp_seq=2 ttl=64 time=0.868 ms 64 bytes from 104.39.147.84: icmp_seq=3 ttl=64 time=1.62 ms --- 104.39.147.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.868/1.322/1.622/0.326 ms 2025-10-15 17:34:39,956 - INFO - Ping to IP 104.39.147.84 from VM ctest-TestBGPaasZone-14544265-33787556 passed 2025-10-15 17:34:39,957 - INFO - Detaching VMI e8a60fe1-1185-4b06-8156-7067376d202d from BGPaaS 58b4b403-d905-4421-b72c-ac014f503a82 2025-10-15 17:34:40,049 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-14544265-95801589(58b4b403-d905-4421-b72c-ac014f503a82) 2025-10-15 17:34:40,109 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/58b4b403-d905-4421-b72c-ac014f503a82 2025-10-15 17:34:40,114 - DEBUG - Response Code: 404 2025-10-15 17:34:40,115 - DEBUG - BGPaaS: 58b4b403-d905-4421-b72c-ac014f503a82 deleted from api server 2025-10-15 17:34:40,115 - INFO - BGPaaS(58b4b403-d905-4421-b72c-ac014f503a82): verify_on_cleanup passed 2025-10-15 17:34:40,115 - INFO - Detaching VMI d2f4bba5-d687-4a81-8a7c-e16465b5fb16 from BGPaaS 4152a116-a0c4-4060-8ca9-5b20b1f49f44 2025-10-15 17:34:40,209 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-14544265-64163996(4152a116-a0c4-4060-8ca9-5b20b1f49f44) 2025-10-15 17:34:40,275 - DEBUG - Requesting: http://10.0.0.130:8082/bgp-as-a-service/4152a116-a0c4-4060-8ca9-5b20b1f49f44 2025-10-15 17:34:40,281 - DEBUG - Response Code: 404 2025-10-15 17:34:40,281 - DEBUG - BGPaaS: 4152a116-a0c4-4060-8ca9-5b20b1f49f44 deleted from api server 2025-10-15 17:34:40,281 - INFO - BGPaaS(4152a116-a0c4-4060-8ca9-5b20b1f49f44): verify_on_cleanup passed 2025-10-15 17:34:40,282 - INFO - Deleting Control node zone ctest-test-zone-46867188(275102c8-2323-43c1-8d01-768468dca6bd) 2025-10-15 17:34:40,437 - INFO - Deleting Control node zone ctest-test-zone-88006476(300c0075-c53a-4194-9712-c5dcfb48796b) 2025-10-15 17:34:40,598 - INFO - Deleting Control node zone ctest-test-zone-09626437(4331bd3e-7f9e-44f1-9cc1-064d4b31fe8f) 2025-10-15 17:34:40,756 - INFO - Deleting VM ctest-TestBGPaasZone-14544265-33787556 2025-10-15 17:34:40,819 - INFO - Deleting VM ctest-TestBGPaasZone-14544265-15429207 2025-10-15 17:34:40,880 - INFO - Deleting VM ctest-TestBGPaasZone-14544265-72479523 2025-10-15 17:34:40,940 - INFO - Deleting VN ctest-cnz_vn-93085655 2025-10-15 17:34:40,989 - DEBUG - VN b496ec69-5d63-4fe8-8fba-cd3e02be20f8 still in use: Unable to complete operation on network b496ec69-5d63-4fe8-8fba-cd3e02be20f8. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-25c1973d-2209-41a6-9359-b910a51f9a53'] 2025-10-15 17:34:40,989 - WARNING - Deleting VN ctest-cnz_vn-93085655 failed..Will retry 2025-10-15 17:34:43,180 - DEBUG - Response for deleting network () 2025-10-15 17:34:44,472 - DEBUG - Skipping xmpp flap check 2025-10-15 17:34:44,472 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:09] 2025-10-15 17:34:44,472 - INFO - -------------------------------------------------------------------------------- 2025-10-15 17:34:45,200 - INFO - Deleted project: ctest-TestBGPaasZone-14544265, ID : 7c707022-5bc8-440b-8a66-42c8a636d1cd