2025-11-20 03:38:18,135 - INFO - Domain Default found not creating 2025-11-20 03:38:18,311 - INFO - Project ctest-TestBGPaasZone-98057201 not found, creating it 2025-11-20 03:38:18,844 - INFO - Created Project:ctest-TestBGPaasZone-98057201, ID : 398c755c-41cd-4bf9-9d0a-2538e070b334 2025-11-20 03:38:20,434 - DEBUG - Services list from nova: [, , , ] 2025-11-20 03:38:20,434 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4768-2', 'an-jenkins-deploy-platform-ansible-os-4768-1']} 2025-11-20 03:38:20,436 - INFO - ================================================================================ 2025-11-20 03:38:20,436 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-11-20 03:38:21,704 - DEBUG - Skipping xmpp flap check 2025-11-20 03:38:21,704 - INFO - Initial checks done. Running the testcase now 2025-11-20 03:38:21,705 - INFO - 2025-11-20 03:38:21,706 - INFO - executing bgp_control_zone test 2025-11-20 03:38:22,680 - DEBUG - Response for create_network : {'network': {'id': '86924439-4e4d-4166-9840-0f1ba2dd1bb5', 'name': 'ctest-cnz_vn-17557187', 'tenant_id': '398c755c41cd4bf99d0a2538e070b334', 'project_id': '398c755c41cd4bf99d0a2538e070b334', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-98057201', 'ctest-cnz_vn-17557187'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 03:38:22,930 - DEBUG - Response for create_subnet : {'subnet': {'id': '70c58330-b6e7-45e0-91c7-3a44c47cfa3d', 'name': '', 'tenant_id': '398c755c41cd4bf99d0a2538e070b334', 'network_id': '86924439-4e4d-4166-9840-0f1ba2dd1bb5', 'ip_version': 4, 'cidr': '26.61.112.0/26', 'allocation_pools': [{'start': '26.61.112.2', 'end': '26.61.112.62'}], 'gateway_ip': '26.61.112.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '26.61.112.2', 'tags': [], 'project_id': '398c755c41cd4bf99d0a2538e070b334'}} 2025-11-20 03:38:22,959 - INFO - Created VN ctest-cnz_vn-17557187 2025-11-20 03:38:22,973 - DEBUG - VN ctest-cnz_vn-17557187 UUID is 86924439-4e4d-4166-9840-0f1ba2dd1bb5 2025-11-20 03:38:24,134 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-2) 2025-11-20 03:38:25,502 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-1) 2025-11-20 03:38:27,257 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-2) 2025-11-20 03:38:27,258 - INFO - Waiting for VM ctest-TestBGPaasZone-98057201-86547495 to be up.. 2025-11-20 03:38:27,375 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-20 03:38:32,483 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-20 03:38:37,560 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-20 03:38:42,637 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-20 03:38:47,725 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-20 03:38:52,802 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-20 03:38:57,896 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-20 03:39:02,974 - DEBUG - VM is in ACTIVE state now 2025-11-20 03:39:02,974 - INFO - VM name : ctest-TestBGPaasZone-98057201-86547495 2025-11-20 03:39:03,050 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 ID is 9539b786-d11a-4790-a15a-52204b53a105 2025-11-20 03:39:03,073 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 launched on Node an-jenkins-deploy-platform-ansible-os-4768-2 2025-11-20 03:39:03,152 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/9539b786-d11a-4790-a15a-52204b53a105 2025-11-20 03:39:03,452 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/9539b786-d11a-4790-a15a-52204b53a105 2025-11-20 03:39:03,488 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/d87b74c5-da14-46ab-ad96-86a6abf154ab 2025-11-20 03:39:06,655 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-11-20 03:39:06,655 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:06,669 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:10,751 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-20 03:39:10,751 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:10,766 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:14,842 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-20 03:39:14,842 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:14,858 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:18,946 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-20 03:39:18,946 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:18,960 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:23,040 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-20 03:39:23,040 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:23,055 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:27,135 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-20 03:39:27,135 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:27,151 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:31,233 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-20 03:39:31,233 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:31,247 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:35,327 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-20 03:39:35,327 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:35,344 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:39,424 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-20 03:39:39,424 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:39,439 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:43,520 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-20 03:39:43,520 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:43,536 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:47,614 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-20 03:39:47,614 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:47,627 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:51,717 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-20 03:39:51,717 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:51,731 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:55,804 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-20 03:39:55,804 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:55,818 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:39:59,906 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-20 03:39:59,906 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:39:59,920 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:40:03,996 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-11-20 03:40:03,996 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:40:04,011 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:40:08,097 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-20 03:40:08,097 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:40:08,112 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:40:12,198 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-20 03:40:12,198 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:40:12,212 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:40:16,286 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-11-20 03:40:16,286 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:40:16,304 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:40:20,385 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-20 03:40:20,385 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 failed! 2025-11-20 03:40:20,399 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-17557187 is 26.61.112.1 and allocation pool is NOT set 2025-11-20 03:40:22,468 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.24 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.16 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.161/5.202/8.244/3.041 ms') 2025-11-20 03:40:22,468 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-86547495 passed 2025-11-20 03:40:22,541 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:40:22,541 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-86547495, IP 26.61.112.3, Port 22 2025-11-20 03:40:22,608 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:40:22,744 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:40:27,744 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:40:27,744 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-86547495, IP 26.61.112.3, Port 22 2025-11-20 03:40:27,810 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:40:27,888 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:40:32,888 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:40:32,889 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-86547495, IP 26.61.112.3, Port 22 2025-11-20 03:40:32,959 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:40:33,041 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:40:38,041 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:40:38,041 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-86547495, IP 26.61.112.3, Port 22 2025-11-20 03:40:38,106 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:40:38,186 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:40:43,186 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:40:43,186 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-86547495, IP 26.61.112.3, Port 22 2025-11-20 03:40:43,244 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:40:43,336 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:40:48,337 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:40:48,337 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-86547495, IP 26.61.112.3, Port 22 2025-11-20 03:40:48,402 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:40:48,480 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:40:53,481 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:40:53,482 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-86547495, IP 26.61.112.3, Port 22 2025-11-20 03:40:53,551 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:40:53,637 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:40:58,638 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:40:58,638 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-86547495, IP 26.61.112.3, Port 22 2025-11-20 03:40:58,696 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:40:58,775 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:41:03,776 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:41:03,776 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-86547495, IP 26.61.112.3, Port 22 2025-11-20 03:41:03,833 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:41:03,921 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:41:08,922 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:41:08,922 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-86547495, IP 26.61.112.3, Port 22 2025-11-20 03:41:08,990 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:41:09,074 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:41:14,075 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:41:14,075 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-86547495, IP 26.61.112.3, Port 22 2025-11-20 03:41:14,251 - DEBUG - VM ctest-TestBGPaasZone-98057201-86547495 is ready for SSH connections 2025-11-20 03:41:14,251 - INFO - Waiting for VM ctest-TestBGPaasZone-98057201-23038777 to be up.. 2025-11-20 03:41:14,337 - DEBUG - VM is in ACTIVE state now 2025-11-20 03:41:14,337 - INFO - VM name : ctest-TestBGPaasZone-98057201-23038777 2025-11-20 03:41:14,423 - DEBUG - VM ctest-TestBGPaasZone-98057201-23038777 ID is de6fdab5-51ef-4c81-95ad-17dae9c81589 2025-11-20 03:41:14,423 - DEBUG - VM ctest-TestBGPaasZone-98057201-23038777 launched on Node an-jenkins-deploy-platform-ansible-os-4768-1 2025-11-20 03:41:14,512 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/de6fdab5-51ef-4c81-95ad-17dae9c81589 2025-11-20 03:41:14,522 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/c6c995b1-b4a1-4607-bd89-e15e159f8bca 2025-11-20 03:41:15,681 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.34 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.528 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.528/1.933/3.338/1.405 ms') 2025-11-20 03:41:15,681 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-23038777 passed 2025-11-20 03:41:15,751 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:41:15,751 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-23038777, IP 26.61.112.4, Port 22 2025-11-20 03:41:15,923 - DEBUG - VM ctest-TestBGPaasZone-98057201-23038777 is ready for SSH connections 2025-11-20 03:41:15,923 - INFO - Waiting for VM ctest-TestBGPaasZone-98057201-18545758 to be up.. 2025-11-20 03:41:16,011 - DEBUG - VM is in ACTIVE state now 2025-11-20 03:41:16,011 - INFO - VM name : ctest-TestBGPaasZone-98057201-18545758 2025-11-20 03:41:16,099 - DEBUG - VM ctest-TestBGPaasZone-98057201-18545758 ID is 9ca027da-f2f7-40a7-b611-a20e95399435 2025-11-20 03:41:16,099 - DEBUG - VM ctest-TestBGPaasZone-98057201-18545758 launched on Node an-jenkins-deploy-platform-ansible-os-4768-2 2025-11-20 03:41:16,180 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/9ca027da-f2f7-40a7-b611-a20e95399435 2025-11-20 03:41:16,193 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/4b42be48-9b5f-478f-930d-5f3dda3987fb 2025-11-20 03:41:17,352 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.34 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.80 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.803/4.070/6.337/2.267 ms') 2025-11-20 03:41:17,352 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-98057201-18545758 passed 2025-11-20 03:41:17,417 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:41:17,417 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-18545758, IP 26.61.112.5, Port 22 2025-11-20 03:41:17,577 - DEBUG - VM ctest-TestBGPaasZone-98057201-18545758 is ready for SSH connections 2025-11-20 03:41:17,712 - INFO - Created control node zone ctest-test-zone-67829565(0a83da18-efc2-4edf-a8e1-83fb6cc89f6f) 2025-11-20 03:41:18,056 - INFO - Created control node zone ctest-test-zone-29384305(ff8d825c-9776-47a4-9a14-3464119a005f) 2025-11-20 03:41:18,412 - INFO - Created control node zone ctest-test-zone-57836736(0ea2b362-ba49-43d0-a2de-3289c797a6ae) 2025-11-20 03:41:18,693 - INFO - Creating BGPaaS ctest-TestBGPaasZone-98057201-11289133 2025-11-20 03:41:18,772 - INFO - BGPaaS: ctest-TestBGPaasZone-98057201-11289133(4391dfee-6656-43f0-b325-90f3ef6f7945) 2025-11-20 03:41:18,773 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/4391dfee-6656-43f0-b325-90f3ef6f7945 2025-11-20 03:41:19,070 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/4391dfee-6656-43f0-b325-90f3ef6f7945 2025-11-20 03:41:19,108 - INFO - verify_in_api_server passed for BGPaaS obj 4391dfee-6656-43f0-b325-90f3ef6f7945 2025-11-20 03:41:19,108 - INFO - BGPaaS(4391dfee-6656-43f0-b325-90f3ef6f7945): verify_on_setup passed 2025-11-20 03:41:19,108 - INFO - We will configure BGP on the VM 2025-11-20 03:41:19,364 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:41:19,365 - INFO - Configuring BGP on ctest-TestBGPaasZone-98057201-86547495 2025-11-20 03:41:19,365 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.3; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.3; } protocol bfd { neighbor 26.61.112.1 local 26.61.112.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:41:19,365 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.3; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.3; } protocol bfd { neighbor 26.61.112.1 local 26.61.112.3 multihop on; } EOS 2025-11-20 03:41:32,807 - DEBUG - None 2025-11-20 03:41:32,807 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.3; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.3; } protocol bfd { neighbor 26.61.112.1 local 26.61.112.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:41:32,807 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.3; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.3; } protocol bfd { neighbor 26.61.112.1 local 26.61.112.3 multihop on; } EOS 2025-11-20 03:41:33,925 - DEBUG - None 2025-11-20 03:41:33,925 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:41:33,925 - DEBUG - service bird restart 2025-11-20 03:41:36,146 - DEBUG - bird stop/waiting bird start/running, process 1440 2025-11-20 03:41:36,146 - INFO - Attaching VMI d87b74c5-da14-46ab-ad96-86a6abf154ab to BGPaaS 4391dfee-6656-43f0-b325-90f3ef6f7945 2025-11-20 03:41:36,221 - INFO - Attaching the VMI 9539b786-d11a-4790-a15a-52204b53a105 to the BGPaaS 4391dfee-6656-43f0-b325-90f3ef6f7945 object 2025-11-20 03:41:36,221 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 26.61.112.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:41:36,221 - DEBUG - sudo ip addr add 26.61.112.20 dev eth0 2025-11-20 03:41:36,853 - DEBUG - None 2025-11-20 03:41:36,918 - INFO - Creating BGPaaS ctest-TestBGPaasZone-98057201-20516256 2025-11-20 03:41:37,006 - INFO - BGPaaS: ctest-TestBGPaasZone-98057201-20516256(db626121-4cd2-41be-accd-fa0808f13256) 2025-11-20 03:41:37,006 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/db626121-4cd2-41be-accd-fa0808f13256 2025-11-20 03:41:37,018 - INFO - verify_in_api_server passed for BGPaaS obj db626121-4cd2-41be-accd-fa0808f13256 2025-11-20 03:41:37,018 - INFO - BGPaaS(db626121-4cd2-41be-accd-fa0808f13256): verify_on_setup passed 2025-11-20 03:41:37,018 - INFO - We will configure BGP on the VM 2025-11-20 03:41:37,285 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:41:37,285 - INFO - Configuring BGP on ctest-TestBGPaasZone-98057201-23038777 2025-11-20 03:41:37,285 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.4; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.4; } protocol bfd { neighbor 26.61.112.2 local 26.61.112.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:41:37,285 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.4; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.4; } protocol bfd { neighbor 26.61.112.2 local 26.61.112.4 multihop on; } EOS 2025-11-20 03:41:42,790 - DEBUG - None 2025-11-20 03:41:42,790 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.4; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.4; } protocol bfd { neighbor 26.61.112.2 local 26.61.112.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:41:42,790 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.4; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.4; } protocol bfd { neighbor 26.61.112.2 local 26.61.112.4 multihop on; } EOS 2025-11-20 03:41:43,332 - DEBUG - None 2025-11-20 03:41:43,332 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:41:43,332 - DEBUG - service bird restart 2025-11-20 03:41:45,123 - DEBUG - bird stop/waiting bird start/running, process 1441 2025-11-20 03:41:45,123 - INFO - Attaching VMI c6c995b1-b4a1-4607-bd89-e15e159f8bca to BGPaaS db626121-4cd2-41be-accd-fa0808f13256 2025-11-20 03:41:45,202 - INFO - Attaching the VMI de6fdab5-51ef-4c81-95ad-17dae9c81589 to the BGPaaS db626121-4cd2-41be-accd-fa0808f13256 object 2025-11-20 03:41:45,202 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 26.61.112.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:41:45,203 - DEBUG - sudo ip addr add 26.61.112.20 dev eth0 2025-11-20 03:41:45,918 - DEBUG - None 2025-11-20 03:41:45,918 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:41:45,935 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-20 03:41:45,945 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:41:45,945 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-20 03:41:45,967 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18'] 2025-11-20 03:41:51,969 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-20 03:41:51,984 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-11-20 03:41:51,990 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 26.61.112.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:41:51,990 - DEBUG - ping -s 56 -c 3 -W 1 26.61.112.20 2025-11-20 03:41:58,137 - DEBUG - PING 26.61.112.20 (26.61.112.20) 56(84) bytes of data. 64 bytes from 26.61.112.20: icmp_seq=1 ttl=64 time=8.42 ms 64 bytes from 26.61.112.20: icmp_seq=2 ttl=64 time=1.07 ms 64 bytes from 26.61.112.20: icmp_seq=3 ttl=64 time=0.943 ms --- 26.61.112.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.943/3.480/8.421/3.494 ms 2025-11-20 03:41:58,137 - INFO - Ping to IP 26.61.112.20 from VM ctest-TestBGPaasZone-98057201-18545758 passed 2025-11-20 03:41:58,952 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:41:58,953 - DEBUG - service bird restart 2025-11-20 03:42:00,797 - DEBUG - bird stop/waiting bird start/running, process 1467 2025-11-20 03:42:00,797 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:42:00,797 - DEBUG - service bird restart 2025-11-20 03:42:02,529 - DEBUG - bird stop/waiting bird start/running, process 1468 2025-11-20 03:42:02,530 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:42:02,546 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.201'] 2025-11-20 03:42:08,564 - INFO - BGPaaS session seen in control-node 10.20.0.201 2025-11-20 03:42:08,569 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:42:08,570 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-20 03:42:08,584 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-11-20 03:42:08,590 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 26.61.112.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:42:08,590 - DEBUG - ping -s 56 -c 3 -W 1 26.61.112.20 2025-11-20 03:42:11,053 - DEBUG - PING 26.61.112.20 (26.61.112.20) 56(84) bytes of data. 64 bytes from 26.61.112.20: icmp_seq=1 ttl=64 time=6.88 ms 64 bytes from 26.61.112.20: icmp_seq=2 ttl=64 time=1.37 ms 64 bytes from 26.61.112.20: icmp_seq=3 ttl=64 time=1.53 ms --- 26.61.112.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.378/3.266/6.885/2.560 ms 2025-11-20 03:42:11,053 - INFO - Ping to IP 26.61.112.20 from VM ctest-TestBGPaasZone-98057201-18545758 passed 2025-11-20 03:42:11,346 - INFO - We will configure BGP on the VM 2025-11-20 03:42:11,564 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:42:11,565 - INFO - Configuring BGP on ctest-TestBGPaasZone-98057201-86547495 2025-11-20 03:42:11,565 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.3; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.3; } protocol bfd { neighbor 26.61.112.1 local 26.61.112.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:42:11,565 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.3; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.3; } protocol bfd { neighbor 26.61.112.1 local 26.61.112.3 multihop on; } EOS 2025-11-20 03:42:12,055 - DEBUG - None 2025-11-20 03:42:12,055 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.3; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.3; } protocol bfd { neighbor 26.61.112.1 local 26.61.112.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:42:12,056 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 26.61.112.3; protocol bgp bgp_1{ local as 65000; neighbor 26.61.112.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 26.61.112.3; } protocol bfd { neighbor 26.61.112.1 local 26.61.112.3 multihop on; } EOS 2025-11-20 03:42:12,621 - DEBUG - None 2025-11-20 03:42:12,621 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:42:12,621 - DEBUG - service bird restart 2025-11-20 03:42:14,409 - DEBUG - bird stop/waiting bird start/running, process 1499 2025-11-20 03:42:14,409 - INFO - Attaching VMI d87b74c5-da14-46ab-ad96-86a6abf154ab to BGPaaS 4391dfee-6656-43f0-b325-90f3ef6f7945 2025-11-20 03:42:14,429 - INFO - Attaching the VMI 9539b786-d11a-4790-a15a-52204b53a105 to the BGPaaS 4391dfee-6656-43f0-b325-90f3ef6f7945 object 2025-11-20 03:42:14,430 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 26.61.112.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:42:14,430 - DEBUG - sudo ip addr add 26.61.112.20 dev eth0 2025-11-20 03:42:15,173 - DEBUG - RTNETLINK answers: File exists 2025-11-20 03:42:15,173 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:42:15,173 - DEBUG - service bird restart 2025-11-20 03:42:16,996 - DEBUG - bird stop/waiting bird start/running, process 1526 2025-11-20 03:42:16,996 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:42:16,996 - DEBUG - service bird restart 2025-11-20 03:42:18,725 - DEBUG - bird stop/waiting bird start/running, process 1490 2025-11-20 03:42:18,726 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:42:18,739 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129'] 2025-11-20 03:42:24,755 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-20 03:42:24,766 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:42:24,766 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-20 03:42:24,785 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-11-20 03:42:24,791 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 26.61.112.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:42:24,791 - DEBUG - ping -s 56 -c 3 -W 1 26.61.112.20 2025-11-20 03:42:27,298 - DEBUG - PING 26.61.112.20 (26.61.112.20) 56(84) bytes of data. 64 bytes from 26.61.112.20: icmp_seq=1 ttl=64 time=3.72 ms 64 bytes from 26.61.112.20: icmp_seq=2 ttl=64 time=1.31 ms 64 bytes from 26.61.112.20: icmp_seq=3 ttl=64 time=1.04 ms --- 26.61.112.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 1.042/2.027/3.723/1.205 ms 2025-11-20 03:42:27,298 - INFO - Ping to IP 26.61.112.20 from VM ctest-TestBGPaasZone-98057201-18545758 passed 2025-11-20 03:42:27,298 - INFO - Detaching VMI d87b74c5-da14-46ab-ad96-86a6abf154ab from BGPaaS 4391dfee-6656-43f0-b325-90f3ef6f7945 2025-11-20 03:42:27,373 - INFO - Detaching VMI c6c995b1-b4a1-4607-bd89-e15e159f8bca from BGPaaS db626121-4cd2-41be-accd-fa0808f13256 2025-11-20 03:42:27,457 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-98057201-20516256(db626121-4cd2-41be-accd-fa0808f13256) 2025-11-20 03:42:27,504 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/db626121-4cd2-41be-accd-fa0808f13256 2025-11-20 03:42:27,512 - DEBUG - Response Code: 404 2025-11-20 03:42:27,512 - DEBUG - BGPaaS: db626121-4cd2-41be-accd-fa0808f13256 deleted from api server 2025-11-20 03:42:27,512 - INFO - BGPaaS(db626121-4cd2-41be-accd-fa0808f13256): verify_on_cleanup passed 2025-11-20 03:42:27,512 - INFO - Detaching VMI d87b74c5-da14-46ab-ad96-86a6abf154ab from BGPaaS 4391dfee-6656-43f0-b325-90f3ef6f7945 2025-11-20 03:42:27,528 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-98057201-11289133(4391dfee-6656-43f0-b325-90f3ef6f7945) 2025-11-20 03:42:27,572 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/4391dfee-6656-43f0-b325-90f3ef6f7945 2025-11-20 03:42:27,579 - DEBUG - Response Code: 404 2025-11-20 03:42:27,579 - DEBUG - BGPaaS: 4391dfee-6656-43f0-b325-90f3ef6f7945 deleted from api server 2025-11-20 03:42:27,580 - INFO - BGPaaS(4391dfee-6656-43f0-b325-90f3ef6f7945): verify_on_cleanup passed 2025-11-20 03:42:27,580 - INFO - Deleting Control node zone ctest-test-zone-57836736(0ea2b362-ba49-43d0-a2de-3289c797a6ae) 2025-11-20 03:42:27,720 - INFO - Deleting Control node zone ctest-test-zone-29384305(ff8d825c-9776-47a4-9a14-3464119a005f) 2025-11-20 03:42:27,864 - INFO - Deleting Control node zone ctest-test-zone-67829565(0a83da18-efc2-4edf-a8e1-83fb6cc89f6f) 2025-11-20 03:42:27,968 - INFO - Deleting VM ctest-TestBGPaasZone-98057201-18545758 2025-11-20 03:42:28,107 - INFO - Deleting VM ctest-TestBGPaasZone-98057201-23038777 2025-11-20 03:42:28,191 - INFO - Deleting VM ctest-TestBGPaasZone-98057201-86547495 2025-11-20 03:42:28,265 - INFO - Deleting VN ctest-cnz_vn-17557187 2025-11-20 03:42:28,309 - DEBUG - VN 86924439-4e4d-4166-9840-0f1ba2dd1bb5 still in use: Unable to complete operation on network 86924439-4e4d-4166-9840-0f1ba2dd1bb5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-7f90b393-987e-45c7-81a8-75475f7ba361'] 2025-11-20 03:42:28,309 - WARNING - Deleting VN ctest-cnz_vn-17557187 failed..Will retry 2025-11-20 03:42:30,523 - DEBUG - Response for deleting network () 2025-11-20 03:42:31,793 - DEBUG - Skipping xmpp flap check 2025-11-20 03:42:31,793 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:11] 2025-11-20 03:42:31,793 - INFO - -------------------------------------------------------------------------------- 2025-11-20 03:42:31,795 - INFO - ================================================================================ 2025-11-20 03:42:31,795 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-11-20 03:42:33,083 - DEBUG - Skipping xmpp flap check 2025-11-20 03:42:33,083 - INFO - Initial checks done. Running the testcase now 2025-11-20 03:42:33,083 - INFO - 2025-11-20 03:42:33,083 - INFO - executing bgp_control_zone agent restart test 2025-11-20 03:42:33,385 - DEBUG - Response for create_network : {'network': {'id': 'a78c9484-61e5-45c3-a9e7-337b8b271c39', 'name': 'ctest-cnz_vn-48128050', 'tenant_id': '398c755c41cd4bf99d0a2538e070b334', 'project_id': '398c755c41cd4bf99d0a2538e070b334', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-98057201', 'ctest-cnz_vn-48128050'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 03:42:33,635 - DEBUG - Response for create_subnet : {'subnet': {'id': '03cf5a90-aa72-429c-a4a7-fae9e85eb6f3', 'name': '', 'tenant_id': '398c755c41cd4bf99d0a2538e070b334', 'network_id': 'a78c9484-61e5-45c3-a9e7-337b8b271c39', 'ip_version': 4, 'cidr': '151.176.128.0/26', 'allocation_pools': [{'start': '151.176.128.2', 'end': '151.176.128.62'}], 'gateway_ip': '151.176.128.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '151.176.128.2', 'tags': [], 'project_id': '398c755c41cd4bf99d0a2538e070b334'}} 2025-11-20 03:42:33,657 - INFO - Created VN ctest-cnz_vn-48128050 2025-11-20 03:42:33,667 - DEBUG - VN ctest-cnz_vn-48128050 UUID is a78c9484-61e5-45c3-a9e7-337b8b271c39 2025-11-20 03:42:34,846 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-1) 2025-11-20 03:42:36,143 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-2) 2025-11-20 03:42:37,621 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-1) 2025-11-20 03:42:37,621 - INFO - Waiting for VM ctest-TestBGPaasZone-98057201-48108783 to be up.. 2025-11-20 03:42:37,711 - DEBUG - VM is in ACTIVE state now 2025-11-20 03:42:37,711 - INFO - VM name : ctest-TestBGPaasZone-98057201-48108783 2025-11-20 03:42:37,794 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 ID is aa0df71a-5871-4701-99f6-2e99a7a9d8d8 2025-11-20 03:42:37,794 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 launched on Node an-jenkins-deploy-platform-ansible-os-4768-1 2025-11-20 03:42:37,883 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/aa0df71a-5871-4701-99f6-2e99a7a9d8d8 2025-11-20 03:42:37,894 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/0ffe1474-0e0d-4a2e-83ac-82f5f75a4026 2025-11-20 03:42:41,105 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1034ms') 2025-11-20 03:42:41,105 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:42:41,119 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:42:45,203 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-20 03:42:45,203 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:42:45,217 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:42:49,299 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-11-20 03:42:49,299 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:42:49,316 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:42:53,388 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-11-20 03:42:53,388 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:42:53,403 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:42:57,489 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-20 03:42:57,489 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:42:57,506 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:01,586 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-20 03:43:01,587 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:01,605 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:05,678 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-11-20 03:43:05,678 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:05,693 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:09,769 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-20 03:43:09,769 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:09,783 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:13,875 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-11-20 03:43:13,875 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:13,890 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:17,966 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-11-20 03:43:17,966 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:17,981 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:22,057 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-20 03:43:22,057 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:22,103 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:26,187 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-11-20 03:43:26,187 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:26,203 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:30,292 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-20 03:43:30,292 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:30,306 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:34,378 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-20 03:43:34,379 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:34,392 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:38,474 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-11-20 03:43:38,474 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:38,489 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:42,569 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-20 03:43:42,569 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:42,584 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:46,672 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-11-20 03:43:46,672 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:46,685 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:50,768 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-20 03:43:50,769 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 failed! 2025-11-20 03:43:50,784 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-98057201:ctest-cnz_vn-48128050 is 151.176.128.1 and allocation pool is NOT set 2025-11-20 03:43:52,853 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.25 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.90 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.895/4.074/6.254/2.179 ms') 2025-11-20 03:43:52,853 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-48108783 passed 2025-11-20 03:43:52,921 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:43:52,921 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-48108783, IP 151.176.128.3, Port 22 2025-11-20 03:43:52,978 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:43:53,169 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:43:58,170 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:43:58,170 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-48108783, IP 151.176.128.3, Port 22 2025-11-20 03:43:58,249 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:43:58,377 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:44:03,378 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:03,378 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-48108783, IP 151.176.128.3, Port 22 2025-11-20 03:44:03,445 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:44:03,536 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:44:08,537 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:08,538 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-48108783, IP 151.176.128.3, Port 22 2025-11-20 03:44:08,606 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:44:08,684 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:44:13,685 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:13,685 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-48108783, IP 151.176.128.3, Port 22 2025-11-20 03:44:13,750 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:44:13,833 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:44:18,834 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:18,834 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-48108783, IP 151.176.128.3, Port 22 2025-11-20 03:44:18,902 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:44:18,978 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:44:23,979 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:23,979 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-48108783, IP 151.176.128.3, Port 22 2025-11-20 03:44:24,046 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:44:24,132 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:44:29,132 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:29,132 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-48108783, IP 151.176.128.3, Port 22 2025-11-20 03:44:29,189 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:44:29,275 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:44:34,276 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:34,276 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-48108783, IP 151.176.128.3, Port 22 2025-11-20 03:44:34,343 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:44:34,424 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:44:39,424 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:39,425 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-48108783, IP 151.176.128.3, Port 22 2025-11-20 03:44:39,480 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:44:39,570 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:44:44,570 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:44,571 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-48108783, IP 151.176.128.3, Port 22 2025-11-20 03:44:44,738 - DEBUG - VM ctest-TestBGPaasZone-98057201-48108783 is ready for SSH connections 2025-11-20 03:44:44,738 - INFO - Waiting for VM ctest-TestBGPaasZone-98057201-26938143 to be up.. 2025-11-20 03:44:44,829 - DEBUG - VM is in ACTIVE state now 2025-11-20 03:44:44,829 - INFO - VM name : ctest-TestBGPaasZone-98057201-26938143 2025-11-20 03:44:44,912 - DEBUG - VM ctest-TestBGPaasZone-98057201-26938143 ID is c071ab94-9f9c-481c-a866-367e7b989f34 2025-11-20 03:44:44,913 - DEBUG - VM ctest-TestBGPaasZone-98057201-26938143 launched on Node an-jenkins-deploy-platform-ansible-os-4768-2 2025-11-20 03:44:45,013 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/c071ab94-9f9c-481c-a866-367e7b989f34 2025-11-20 03:44:45,054 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/5acc8ef2-5e53-447a-a29e-f12480595ca2 2025-11-20 03:44:46,221 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.62 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.15 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.154/3.384/5.615/2.230 ms') 2025-11-20 03:44:46,222 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-98057201-26938143 passed 2025-11-20 03:44:46,297 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:46,297 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-26938143, IP 151.176.128.4, Port 22 2025-11-20 03:44:46,471 - DEBUG - VM ctest-TestBGPaasZone-98057201-26938143 is ready for SSH connections 2025-11-20 03:44:46,471 - INFO - Waiting for VM ctest-TestBGPaasZone-98057201-19771818 to be up.. 2025-11-20 03:44:46,562 - DEBUG - VM is in ACTIVE state now 2025-11-20 03:44:46,562 - INFO - VM name : ctest-TestBGPaasZone-98057201-19771818 2025-11-20 03:44:46,651 - DEBUG - VM ctest-TestBGPaasZone-98057201-19771818 ID is a37a2342-b328-4d1c-bf66-c6e03b5f79f7 2025-11-20 03:44:46,651 - DEBUG - VM ctest-TestBGPaasZone-98057201-19771818 launched on Node an-jenkins-deploy-platform-ansible-os-4768-1 2025-11-20 03:44:46,743 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/a37a2342-b328-4d1c-bf66-c6e03b5f79f7 2025-11-20 03:44:46,753 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/f97d7b54-d66a-468c-ae5f-9a5c39751602 2025-11-20 03:44:47,988 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.99 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.541 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.541/1.765/2.989/1.224 ms') 2025-11-20 03:44:47,988 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-98057201-19771818 passed 2025-11-20 03:44:48,058 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:48,059 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-98057201-19771818, IP 151.176.128.5, Port 22 2025-11-20 03:44:48,230 - DEBUG - VM ctest-TestBGPaasZone-98057201-19771818 is ready for SSH connections 2025-11-20 03:44:48,360 - INFO - Created control node zone ctest-test-zone-68916022(95cfa753-41f0-4d24-b5c2-e837f80e5dff) 2025-11-20 03:44:48,717 - INFO - Created control node zone ctest-test-zone-13594995(5c061327-b785-4a64-986d-f283da0b6d17) 2025-11-20 03:44:49,081 - INFO - Created control node zone ctest-test-zone-88178021(c2bd3667-4be7-47e3-b1bf-980e775ad2a2) 2025-11-20 03:44:49,364 - INFO - Creating BGPaaS ctest-TestBGPaasZone-98057201-26673731 2025-11-20 03:44:49,440 - INFO - BGPaaS: ctest-TestBGPaasZone-98057201-26673731(f0ef7258-c546-474a-81f4-9752636a1add) 2025-11-20 03:44:49,441 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/f0ef7258-c546-474a-81f4-9752636a1add 2025-11-20 03:44:49,451 - INFO - verify_in_api_server passed for BGPaaS obj f0ef7258-c546-474a-81f4-9752636a1add 2025-11-20 03:44:49,451 - INFO - BGPaaS(f0ef7258-c546-474a-81f4-9752636a1add): verify_on_setup passed 2025-11-20 03:44:49,451 - INFO - We will configure BGP on the VM 2025-11-20 03:44:49,880 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:44:49,881 - INFO - Configuring BGP on ctest-TestBGPaasZone-98057201-48108783 2025-11-20 03:44:49,881 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 151.176.128.3; protocol bgp bgp_1{ local as 65000; neighbor 151.176.128.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 151.176.128.3; } protocol bfd { neighbor 151.176.128.1 local 151.176.128.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:44:49,881 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 151.176.128.3; protocol bgp bgp_1{ local as 65000; neighbor 151.176.128.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 151.176.128.3; } protocol bfd { neighbor 151.176.128.1 local 151.176.128.3 multihop on; } EOS 2025-11-20 03:45:04,475 - DEBUG - None 2025-11-20 03:45:04,475 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 151.176.128.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 151.176.128.3; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:45:04,475 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 151.176.128.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 151.176.128.3; } EOS 2025-11-20 03:45:05,545 - DEBUG - None 2025-11-20 03:45:05,545 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:45:05,545 - DEBUG - service bird restart 2025-11-20 03:45:09,121 - DEBUG - bird stop/waiting bird start/running, process 1429 2025-11-20 03:45:09,121 - INFO - Attaching VMI 0ffe1474-0e0d-4a2e-83ac-82f5f75a4026 to BGPaaS f0ef7258-c546-474a-81f4-9752636a1add 2025-11-20 03:45:09,196 - INFO - Attaching the VMI aa0df71a-5871-4701-99f6-2e99a7a9d8d8 to the BGPaaS f0ef7258-c546-474a-81f4-9752636a1add object 2025-11-20 03:45:09,197 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 151.176.128.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:45:09,197 - DEBUG - sudo ip addr add 151.176.128.20 dev eth0 2025-11-20 03:45:10,753 - DEBUG - None 2025-11-20 03:45:10,816 - INFO - Creating BGPaaS ctest-TestBGPaasZone-98057201-08516166 2025-11-20 03:45:10,897 - INFO - BGPaaS: ctest-TestBGPaasZone-98057201-08516166(a85c0bff-254e-4f7f-bcbf-9499907ca3a5) 2025-11-20 03:45:10,897 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/a85c0bff-254e-4f7f-bcbf-9499907ca3a5 2025-11-20 03:45:10,909 - INFO - verify_in_api_server passed for BGPaaS obj a85c0bff-254e-4f7f-bcbf-9499907ca3a5 2025-11-20 03:45:10,909 - INFO - BGPaaS(a85c0bff-254e-4f7f-bcbf-9499907ca3a5): verify_on_setup passed 2025-11-20 03:45:10,909 - INFO - We will configure BGP on the VM 2025-11-20 03:45:11,357 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:45:11,357 - INFO - Configuring BGP on ctest-TestBGPaasZone-98057201-26938143 2025-11-20 03:45:11,357 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 151.176.128.4; protocol bgp bgp_1{ local as 65000; neighbor 151.176.128.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 151.176.128.4; } protocol bfd { neighbor 151.176.128.1 local 151.176.128.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:45:11,357 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 151.176.128.4; protocol bgp bgp_1{ local as 65000; neighbor 151.176.128.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 151.176.128.4; } protocol bfd { neighbor 151.176.128.1 local 151.176.128.4 multihop on; } EOS 2025-11-20 03:45:16,906 - DEBUG - None 2025-11-20 03:45:16,906 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 151.176.128.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 151.176.128.4; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:45:16,906 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 151.176.128.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 151.176.128.4; } EOS 2025-11-20 03:45:17,423 - DEBUG - None 2025-11-20 03:45:17,423 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:45:17,423 - DEBUG - service bird restart 2025-11-20 03:45:19,303 - DEBUG - bird stop/waiting bird start/running, process 1434 2025-11-20 03:45:19,303 - INFO - Attaching VMI 5acc8ef2-5e53-447a-a29e-f12480595ca2 to BGPaaS a85c0bff-254e-4f7f-bcbf-9499907ca3a5 2025-11-20 03:45:19,384 - INFO - Attaching the VMI c071ab94-9f9c-481c-a866-367e7b989f34 to the BGPaaS a85c0bff-254e-4f7f-bcbf-9499907ca3a5 object 2025-11-20 03:45:19,385 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 151.176.128.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:45:19,385 - DEBUG - sudo ip addr add 151.176.128.20 dev eth0 2025-11-20 03:45:20,116 - DEBUG - None 2025-11-20 03:45:20,116 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:45:20,130 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-20 03:45:20,131 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:45:20,131 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-20 03:45:20,145 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-11-20 03:45:20,151 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:45:20,165 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129'] 2025-11-20 03:45:26,183 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129'] 2025-11-20 03:45:32,199 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-20 03:45:32,199 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:45:32,199 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-20 03:45:32,215 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-11-20 03:45:32,222 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 151.176.128.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:45:32,222 - DEBUG - ping -s 56 -c 3 -W 1 151.176.128.20 2025-11-20 03:45:38,845 - DEBUG - PING 151.176.128.20 (151.176.128.20) 56(84) bytes of data. 64 bytes from 151.176.128.20: icmp_seq=1 ttl=64 time=7.56 ms 64 bytes from 151.176.128.20: icmp_seq=2 ttl=64 time=0.920 ms 64 bytes from 151.176.128.20: icmp_seq=3 ttl=64 time=1.00 ms --- 151.176.128.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.920/3.162/7.563/3.112 ms 2025-11-20 03:45:38,845 - INFO - Ping to IP 151.176.128.20 from VM ctest-TestBGPaasZone-98057201-19771818 passed 2025-11-20 03:45:38,845 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:45:38,860 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-20 03:45:38,860 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:45:38,860 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-20 03:45:38,877 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-11-20 03:45:38,884 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:45:38,901 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-11-20 03:45:38,901 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:45:38,901 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-11-20 03:45:38,918 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-11-20 03:45:38,925 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 151.176.128.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-11-20 03:45:38,925 - DEBUG - ping -s 56 -c 3 -W 1 151.176.128.20 2025-11-20 03:45:41,446 - DEBUG - PING 151.176.128.20 (151.176.128.20) 56(84) bytes of data. 64 bytes from 151.176.128.20: icmp_seq=1 ttl=64 time=5.11 ms 64 bytes from 151.176.128.20: icmp_seq=2 ttl=64 time=1.70 ms 64 bytes from 151.176.128.20: icmp_seq=3 ttl=64 time=1.66 ms --- 151.176.128.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.662/2.828/5.114/1.616 ms 2025-11-20 03:45:41,446 - INFO - Ping to IP 151.176.128.20 from VM ctest-TestBGPaasZone-98057201-19771818 passed 2025-11-20 03:45:41,446 - INFO - Detaching VMI 5acc8ef2-5e53-447a-a29e-f12480595ca2 from BGPaaS a85c0bff-254e-4f7f-bcbf-9499907ca3a5 2025-11-20 03:45:41,541 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-98057201-08516166(a85c0bff-254e-4f7f-bcbf-9499907ca3a5) 2025-11-20 03:45:41,619 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/a85c0bff-254e-4f7f-bcbf-9499907ca3a5 2025-11-20 03:45:41,628 - DEBUG - Response Code: 404 2025-11-20 03:45:41,629 - DEBUG - BGPaaS: a85c0bff-254e-4f7f-bcbf-9499907ca3a5 deleted from api server 2025-11-20 03:45:41,629 - INFO - BGPaaS(a85c0bff-254e-4f7f-bcbf-9499907ca3a5): verify_on_cleanup passed 2025-11-20 03:45:41,629 - INFO - Detaching VMI 0ffe1474-0e0d-4a2e-83ac-82f5f75a4026 from BGPaaS f0ef7258-c546-474a-81f4-9752636a1add 2025-11-20 03:45:41,744 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-98057201-26673731(f0ef7258-c546-474a-81f4-9752636a1add) 2025-11-20 03:45:41,820 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/f0ef7258-c546-474a-81f4-9752636a1add 2025-11-20 03:45:41,826 - DEBUG - Response Code: 404 2025-11-20 03:45:41,827 - DEBUG - BGPaaS: f0ef7258-c546-474a-81f4-9752636a1add deleted from api server 2025-11-20 03:45:41,827 - INFO - BGPaaS(f0ef7258-c546-474a-81f4-9752636a1add): verify_on_cleanup passed 2025-11-20 03:45:41,827 - INFO - Deleting Control node zone ctest-test-zone-88178021(c2bd3667-4be7-47e3-b1bf-980e775ad2a2) 2025-11-20 03:45:41,981 - INFO - Deleting Control node zone ctest-test-zone-13594995(5c061327-b785-4a64-986d-f283da0b6d17) 2025-11-20 03:45:42,133 - INFO - Deleting Control node zone ctest-test-zone-68916022(95cfa753-41f0-4d24-b5c2-e837f80e5dff) 2025-11-20 03:45:42,278 - INFO - Deleting VM ctest-TestBGPaasZone-98057201-19771818 2025-11-20 03:45:42,363 - INFO - Deleting VM ctest-TestBGPaasZone-98057201-26938143 2025-11-20 03:45:42,435 - INFO - Deleting VM ctest-TestBGPaasZone-98057201-48108783 2025-11-20 03:45:42,507 - INFO - Deleting VN ctest-cnz_vn-48128050 2025-11-20 03:45:42,550 - DEBUG - VN a78c9484-61e5-45c3-a9e7-337b8b271c39 still in use: Unable to complete operation on network a78c9484-61e5-45c3-a9e7-337b8b271c39. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1d216178-8ce2-4bc6-b8e3-f4e8a1da8dff'] 2025-11-20 03:45:42,550 - WARNING - Deleting VN ctest-cnz_vn-48128050 failed..Will retry 2025-11-20 03:45:44,762 - DEBUG - Response for deleting network () 2025-11-20 03:45:46,065 - DEBUG - Skipping xmpp flap check 2025-11-20 03:45:46,066 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:15] 2025-11-20 03:45:46,066 - INFO - -------------------------------------------------------------------------------- 2025-11-20 03:45:46,859 - INFO - Deleted project: ctest-TestBGPaasZone-98057201, ID : 398c755c-41cd-4bf9-9d0a-2538e070b334