2025-08-26 01:41:12,183 - INFO - Domain Default found not creating 2025-08-26 01:41:12,345 - INFO - Project ctest-TestBGPaasZone-26778466 not found, creating it 2025-08-26 01:41:13,015 - INFO - Created Project:ctest-TestBGPaasZone-26778466, ID : eb341ea2-ebbb-4971-9088-243c552f43c1 2025-08-26 01:41:14,670 - DEBUG - Services list from nova: [, , , ] 2025-08-26 01:41:14,670 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3931-1', 'an-jenkins-deploy-platform-ansible-os-3931-2']} 2025-08-26 01:41:14,673 - INFO - ================================================================================ 2025-08-26 01:41:14,673 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-08-26 01:41:16,046 - DEBUG - Skipping xmpp flap check 2025-08-26 01:41:16,047 - INFO - Initial checks done. Running the testcase now 2025-08-26 01:41:16,047 - INFO - 2025-08-26 01:41:16,048 - INFO - executing bgp_control_zone test 2025-08-26 01:41:16,867 - DEBUG - Response for create_network : {'network': {'id': '8e93db75-4881-4db7-b878-dee00d8324b5', 'name': 'ctest-cnz_vn-33076676', 'tenant_id': 'eb341ea2ebbb49719088243c552f43c1', 'project_id': 'eb341ea2ebbb49719088243c552f43c1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-26778466', 'ctest-cnz_vn-33076676'], 'port_security_enabled': True, 'description': ''}} 2025-08-26 01:41:17,195 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c6e3bcc9-63b4-481b-ab97-be929acc4727', 'name': '', 'tenant_id': 'eb341ea2ebbb49719088243c552f43c1', 'network_id': '8e93db75-4881-4db7-b878-dee00d8324b5', 'ip_version': 4, 'cidr': '191.204.32.128/26', 'allocation_pools': [{'start': '191.204.32.130', 'end': '191.204.32.190'}], 'gateway_ip': '191.204.32.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '191.204.32.130', 'tags': [], 'project_id': 'eb341ea2ebbb49719088243c552f43c1'}} 2025-08-26 01:41:17,224 - INFO - Created VN ctest-cnz_vn-33076676 2025-08-26 01:41:17,247 - DEBUG - VN ctest-cnz_vn-33076676 UUID is 8e93db75-4881-4db7-b878-dee00d8324b5 2025-08-26 01:41:18,508 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3931-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3931-1) 2025-08-26 01:41:20,219 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3931-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3931-2) 2025-08-26 01:41:22,003 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3931-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3931-1) 2025-08-26 01:41:22,004 - INFO - Waiting for VM ctest-TestBGPaasZone-26778466-09451972 to be up.. 2025-08-26 01:41:22,108 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-26 01:41:27,217 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-26 01:41:32,309 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-26 01:41:37,425 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-26 01:41:42,529 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-26 01:41:47,625 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-26 01:41:52,736 - DEBUG - VM is in ACTIVE state now 2025-08-26 01:41:52,736 - INFO - VM name : ctest-TestBGPaasZone-26778466-09451972 2025-08-26 01:41:52,828 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 ID is e9f94f20-3d4a-4797-ac42-1d383d65c9b8 2025-08-26 01:41:52,852 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 launched on Node an-jenkins-deploy-platform-ansible-os-3931-1 2025-08-26 01:41:52,947 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/e9f94f20-3d4a-4797-ac42-1d383d65c9b8 2025-08-26 01:41:53,325 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/e9f94f20-3d4a-4797-ac42-1d383d65c9b8 2025-08-26 01:41:53,360 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/31cccee8-a8f2-446f-9b69-f203f18e87f7 2025-08-26 01:41:56,569 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms') 2025-08-26 01:41:56,570 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:41:56,587 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:00,663 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-08-26 01:42:00,663 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:00,680 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:04,766 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-26 01:42:04,766 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:04,786 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:08,865 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-08-26 01:42:08,865 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:08,911 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:12,990 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-26 01:42:12,990 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:13,009 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:17,085 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-08-26 01:42:17,085 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:17,121 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:21,214 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-08-26 01:42:21,214 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:21,236 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:25,307 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-08-26 01:42:25,307 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:25,324 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:29,411 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-26 01:42:29,411 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:29,455 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:33,530 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-08-26 01:42:33,530 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:33,545 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:37,623 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-26 01:42:37,624 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:37,665 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:41,759 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-08-26 01:42:41,759 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:41,774 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:45,856 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-26 01:42:45,857 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:45,892 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:49,985 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-08-26 01:42:49,986 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:50,000 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:54,077 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-08-26 01:42:54,077 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:54,097 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:42:58,170 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-26 01:42:58,171 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:42:58,194 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:43:02,270 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-08-26 01:43:02,270 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 failed! 2025-08-26 01:43:02,293 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-33076676 is 191.204.32.129 and allocation pool is NOT set 2025-08-26 01:43:04,364 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=5.76 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.62 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.620/3.692/5.764/2.072 ms') 2025-08-26 01:43:04,364 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-09451972 passed 2025-08-26 01:43:04,454 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:04,454 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-09451972, IP 191.204.32.131, Port 22 2025-08-26 01:43:04,522 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:43:04,652 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:43:09,653 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:09,653 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-09451972, IP 191.204.32.131, Port 22 2025-08-26 01:43:09,721 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:43:09,824 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:43:14,825 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:14,825 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-09451972, IP 191.204.32.131, Port 22 2025-08-26 01:43:14,885 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:43:15,028 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:43:20,030 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:20,030 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-09451972, IP 191.204.32.131, Port 22 2025-08-26 01:43:20,098 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:43:20,191 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:43:25,192 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:25,192 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-09451972, IP 191.204.32.131, Port 22 2025-08-26 01:43:25,265 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:43:25,388 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:43:30,389 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:30,389 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-09451972, IP 191.204.32.131, Port 22 2025-08-26 01:43:30,464 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:43:30,596 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:43:35,596 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:35,596 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-09451972, IP 191.204.32.131, Port 22 2025-08-26 01:43:35,668 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:43:35,782 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:43:40,782 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:40,782 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-09451972, IP 191.204.32.131, Port 22 2025-08-26 01:43:40,841 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:43:41,019 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:43:46,019 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:46,020 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-09451972, IP 191.204.32.131, Port 22 2025-08-26 01:43:46,077 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:43:46,194 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:43:51,195 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:51,195 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-09451972, IP 191.204.32.131, Port 22 2025-08-26 01:43:51,261 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:43:51,360 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:43:56,367 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:56,367 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-09451972, IP 191.204.32.131, Port 22 2025-08-26 01:43:56,671 - DEBUG - VM ctest-TestBGPaasZone-26778466-09451972 is ready for SSH connections 2025-08-26 01:43:56,671 - INFO - Waiting for VM ctest-TestBGPaasZone-26778466-33269472 to be up.. 2025-08-26 01:43:56,835 - DEBUG - VM is in ACTIVE state now 2025-08-26 01:43:56,835 - INFO - VM name : ctest-TestBGPaasZone-26778466-33269472 2025-08-26 01:43:56,963 - DEBUG - VM ctest-TestBGPaasZone-26778466-33269472 ID is f18d1920-16a7-402a-8397-2364fa5999fa 2025-08-26 01:43:56,963 - DEBUG - VM ctest-TestBGPaasZone-26778466-33269472 launched on Node an-jenkins-deploy-platform-ansible-os-3931-2 2025-08-26 01:43:57,070 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/f18d1920-16a7-402a-8397-2364fa5999fa 2025-08-26 01:43:57,085 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/46e78fd3-00ca-4461-bdab-bcd4e50e2897 2025-08-26 01:43:58,301 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.53 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.808 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.808/3.667/6.527/2.859 ms') 2025-08-26 01:43:58,301 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-33269472 passed 2025-08-26 01:43:58,384 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:43:58,384 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-33269472, IP 191.204.32.132, Port 22 2025-08-26 01:43:58,595 - DEBUG - VM ctest-TestBGPaasZone-26778466-33269472 is ready for SSH connections 2025-08-26 01:43:58,595 - INFO - Waiting for VM ctest-TestBGPaasZone-26778466-01017202 to be up.. 2025-08-26 01:43:58,706 - DEBUG - VM is in ACTIVE state now 2025-08-26 01:43:58,706 - INFO - VM name : ctest-TestBGPaasZone-26778466-01017202 2025-08-26 01:43:58,801 - DEBUG - VM ctest-TestBGPaasZone-26778466-01017202 ID is f9364e98-78b3-4666-a219-b3ae5e7f780c 2025-08-26 01:43:58,801 - DEBUG - VM ctest-TestBGPaasZone-26778466-01017202 launched on Node an-jenkins-deploy-platform-ansible-os-3931-1 2025-08-26 01:43:58,906 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/f9364e98-78b3-4666-a219-b3ae5e7f780c 2025-08-26 01:43:58,919 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/c79cbaea-ee32-40b6-a0d4-b25ad711024d 2025-08-26 01:44:00,095 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.73 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.76 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.762/4.246/6.730/2.484 ms') 2025-08-26 01:44:00,095 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-01017202 passed 2025-08-26 01:44:00,177 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:44:00,177 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-01017202, IP 191.204.32.133, Port 22 2025-08-26 01:44:00,349 - DEBUG - VM ctest-TestBGPaasZone-26778466-01017202 is ready for SSH connections 2025-08-26 01:44:00,503 - INFO - Created control node zone ctest-test-zone-53177615(327a951b-a622-4707-9075-01ac7056c581) 2025-08-26 01:44:00,895 - INFO - Created control node zone ctest-test-zone-45344115(96346076-3b62-43bd-8a7a-96bf38d256f3) 2025-08-26 01:44:01,307 - INFO - Created control node zone ctest-test-zone-40707070(d83438c7-1379-45c5-9fb4-2ec59d47b9e2) 2025-08-26 01:44:01,607 - INFO - Creating BGPaaS ctest-TestBGPaasZone-26778466-39807734 2025-08-26 01:44:01,687 - INFO - BGPaaS: ctest-TestBGPaasZone-26778466-39807734(7697d664-1ed7-433f-98d7-65a129859d8d) 2025-08-26 01:44:01,687 - DEBUG - Requesting: http://10.0.0.49:8082/bgp-as-a-service/7697d664-1ed7-433f-98d7-65a129859d8d 2025-08-26 01:44:02,013 - DEBUG - Requesting: http://10.0.0.49:8082/bgp-as-a-service/7697d664-1ed7-433f-98d7-65a129859d8d 2025-08-26 01:44:02,062 - INFO - verify_in_api_server passed for BGPaaS obj 7697d664-1ed7-433f-98d7-65a129859d8d 2025-08-26 01:44:02,062 - INFO - BGPaaS(7697d664-1ed7-433f-98d7-65a129859d8d): verify_on_setup passed 2025-08-26 01:44:02,062 - INFO - We will configure BGP on the VM 2025-08-26 01:44:02,351 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:44:02,351 - INFO - Configuring BGP on ctest-TestBGPaasZone-26778466-09451972 2025-08-26 01:44:02,351 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.131; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.131; } protocol bfd { neighbor 191.204.32.129 local 191.204.32.131 multihop on; } EOS , host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:44:02,351 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.131; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.131; } protocol bfd { neighbor 191.204.32.129 local 191.204.32.131 multihop on; } EOS 2025-08-26 01:44:12,822 - DEBUG - None 2025-08-26 01:44:12,823 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.131; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.131; } protocol bfd { neighbor 191.204.32.129 local 191.204.32.131 multihop on; } EOS , host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:44:12,823 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.131; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.131; } protocol bfd { neighbor 191.204.32.129 local 191.204.32.131 multihop on; } EOS 2025-08-26 01:44:13,810 - DEBUG - None 2025-08-26 01:44:13,810 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:44:13,810 - DEBUG - service bird restart 2025-08-26 01:44:15,494 - DEBUG - bird stop/waiting bird start/running, process 1442 2025-08-26 01:44:15,494 - INFO - Attaching VMI 31cccee8-a8f2-446f-9b69-f203f18e87f7 to BGPaaS 7697d664-1ed7-433f-98d7-65a129859d8d 2025-08-26 01:44:15,579 - INFO - Attaching the VMI e9f94f20-3d4a-4797-ac42-1d383d65c9b8 to the BGPaaS 7697d664-1ed7-433f-98d7-65a129859d8d object 2025-08-26 01:44:15,579 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 191.204.32.148 dev eth0, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:44:15,579 - DEBUG - sudo ip addr add 191.204.32.148 dev eth0 2025-08-26 01:44:16,342 - DEBUG - None 2025-08-26 01:44:16,423 - INFO - Creating BGPaaS ctest-TestBGPaasZone-26778466-56956868 2025-08-26 01:44:16,511 - INFO - BGPaaS: ctest-TestBGPaasZone-26778466-56956868(04ce82c8-39a6-4f53-b461-a71228130785) 2025-08-26 01:44:16,511 - DEBUG - Requesting: http://10.0.0.49:8082/bgp-as-a-service/04ce82c8-39a6-4f53-b461-a71228130785 2025-08-26 01:44:16,522 - INFO - verify_in_api_server passed for BGPaaS obj 04ce82c8-39a6-4f53-b461-a71228130785 2025-08-26 01:44:16,522 - INFO - BGPaaS(04ce82c8-39a6-4f53-b461-a71228130785): verify_on_setup passed 2025-08-26 01:44:16,522 - INFO - We will configure BGP on the VM 2025-08-26 01:44:16,799 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:44:16,799 - INFO - Configuring BGP on ctest-TestBGPaasZone-26778466-33269472 2025-08-26 01:44:16,799 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.132; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.132; } protocol bfd { neighbor 191.204.32.130 local 191.204.32.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:44:16,799 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.132; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.132; } protocol bfd { neighbor 191.204.32.130 local 191.204.32.132 multihop on; } EOS 2025-08-26 01:44:23,535 - DEBUG - None 2025-08-26 01:44:23,535 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.132; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.132; } protocol bfd { neighbor 191.204.32.130 local 191.204.32.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:44:23,535 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.132; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.132; } protocol bfd { neighbor 191.204.32.130 local 191.204.32.132 multihop on; } EOS 2025-08-26 01:44:24,042 - DEBUG - None 2025-08-26 01:44:24,043 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:44:24,043 - DEBUG - service bird restart 2025-08-26 01:44:25,708 - DEBUG - bird stop/waiting bird start/running, process 1441 2025-08-26 01:44:25,708 - INFO - Attaching VMI 46e78fd3-00ca-4461-bdab-bcd4e50e2897 to BGPaaS 04ce82c8-39a6-4f53-b461-a71228130785 2025-08-26 01:44:25,807 - INFO - Attaching the VMI f18d1920-16a7-402a-8397-2364fa5999fa to the BGPaaS 04ce82c8-39a6-4f53-b461-a71228130785 object 2025-08-26 01:44:25,807 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 191.204.32.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:44:25,807 - DEBUG - sudo ip addr add 191.204.32.148 dev eth0 2025-08-26 01:44:26,441 - DEBUG - None 2025-08-26 01:44:26,441 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:44:26,441 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-26 01:44:26,485 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-08-26 01:44:26,493 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:44:26,512 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-08-26 01:44:32,534 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-08-26 01:44:38,555 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-26 01:44:38,570 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 191.204.32.148, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:44:38,570 - DEBUG - ping -s 56 -c 3 -W 1 191.204.32.148 2025-08-26 01:44:45,231 - DEBUG - PING 191.204.32.148 (191.204.32.148) 56(84) bytes of data. 64 bytes from 191.204.32.148: icmp_seq=1 ttl=64 time=8.56 ms 64 bytes from 191.204.32.148: icmp_seq=2 ttl=64 time=1.21 ms 64 bytes from 191.204.32.148: icmp_seq=3 ttl=64 time=0.899 ms --- 191.204.32.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.899/3.560/8.567/3.542 ms 2025-08-26 01:44:45,231 - INFO - Ping to IP 191.204.32.148 from VM ctest-TestBGPaasZone-26778466-01017202 passed 2025-08-26 01:44:46,136 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:44:46,137 - DEBUG - service bird restart 2025-08-26 01:44:47,838 - DEBUG - bird stop/waiting bird start/running, process 1469 2025-08-26 01:44:47,839 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:44:47,839 - DEBUG - service bird restart 2025-08-26 01:44:49,528 - DEBUG - bird stop/waiting bird start/running, process 1468 2025-08-26 01:44:49,529 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:44:49,549 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-08-26 01:44:55,575 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-08-26 01:44:55,582 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:44:55,618 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-08-26 01:45:01,652 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-26 01:45:01,660 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 191.204.32.148, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:45:01,660 - DEBUG - ping -s 56 -c 3 -W 1 191.204.32.148 2025-08-26 01:45:04,170 - DEBUG - PING 191.204.32.148 (191.204.32.148) 56(84) bytes of data. 64 bytes from 191.204.32.148: icmp_seq=1 ttl=64 time=1.53 ms 64 bytes from 191.204.32.148: icmp_seq=2 ttl=64 time=0.897 ms 64 bytes from 191.204.32.148: icmp_seq=3 ttl=64 time=0.858 ms --- 191.204.32.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 0.858/1.095/1.532/0.311 ms 2025-08-26 01:45:04,170 - INFO - Ping to IP 191.204.32.148 from VM ctest-TestBGPaasZone-26778466-01017202 passed 2025-08-26 01:45:04,497 - INFO - We will configure BGP on the VM 2025-08-26 01:45:04,723 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:45:04,723 - INFO - Configuring BGP on ctest-TestBGPaasZone-26778466-09451972 2025-08-26 01:45:04,723 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.131; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.131; } protocol bfd { neighbor 191.204.32.129 local 191.204.32.131 multihop on; } EOS , host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:45:04,723 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.131; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.131; } protocol bfd { neighbor 191.204.32.129 local 191.204.32.131 multihop on; } EOS 2025-08-26 01:45:05,196 - DEBUG - None 2025-08-26 01:45:05,197 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.131; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.131; } protocol bfd { neighbor 191.204.32.129 local 191.204.32.131 multihop on; } EOS , host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:45:05,197 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 191.204.32.131; protocol bgp bgp_1{ local as 65000; neighbor 191.204.32.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 191.204.32.131; } protocol bfd { neighbor 191.204.32.129 local 191.204.32.131 multihop on; } EOS 2025-08-26 01:45:05,688 - DEBUG - None 2025-08-26 01:45:05,688 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:45:05,688 - DEBUG - service bird restart 2025-08-26 01:45:07,243 - DEBUG - bird stop/waiting bird start/running, process 1501 2025-08-26 01:45:07,244 - INFO - Attaching VMI 31cccee8-a8f2-446f-9b69-f203f18e87f7 to BGPaaS 7697d664-1ed7-433f-98d7-65a129859d8d 2025-08-26 01:45:07,284 - INFO - Attaching the VMI e9f94f20-3d4a-4797-ac42-1d383d65c9b8 to the BGPaaS 7697d664-1ed7-433f-98d7-65a129859d8d object 2025-08-26 01:45:07,284 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 191.204.32.148 dev eth0, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:45:07,285 - DEBUG - sudo ip addr add 191.204.32.148 dev eth0 2025-08-26 01:45:07,943 - DEBUG - RTNETLINK answers: File exists 2025-08-26 01:45:07,943 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:45:07,944 - DEBUG - service bird restart 2025-08-26 01:45:09,530 - DEBUG - bird stop/waiting bird start/running, process 1528 2025-08-26 01:45:09,530 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:45:09,530 - DEBUG - service bird restart 2025-08-26 01:45:11,099 - DEBUG - bird stop/waiting bird start/running, process 1490 2025-08-26 01:45:11,099 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:45:11,099 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-26 01:45:11,123 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-08-26 01:45:17,124 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-26 01:45:17,146 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-08-26 01:45:17,153 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:45:17,175 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-08-26 01:45:23,211 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-26 01:45:23,242 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 191.204.32.148, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:45:23,242 - DEBUG - ping -s 56 -c 3 -W 1 191.204.32.148 2025-08-26 01:45:25,706 - DEBUG - PING 191.204.32.148 (191.204.32.148) 56(84) bytes of data. 64 bytes from 191.204.32.148: icmp_seq=1 ttl=64 time=12.6 ms 64 bytes from 191.204.32.148: icmp_seq=2 ttl=64 time=1.95 ms 64 bytes from 191.204.32.148: icmp_seq=3 ttl=64 time=1.88 ms --- 191.204.32.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.888/5.501/12.662/5.063 ms 2025-08-26 01:45:25,706 - INFO - Ping to IP 191.204.32.148 from VM ctest-TestBGPaasZone-26778466-01017202 passed 2025-08-26 01:45:25,706 - INFO - Detaching VMI 31cccee8-a8f2-446f-9b69-f203f18e87f7 from BGPaaS 7697d664-1ed7-433f-98d7-65a129859d8d 2025-08-26 01:45:25,800 - INFO - Detaching VMI 46e78fd3-00ca-4461-bdab-bcd4e50e2897 from BGPaaS 04ce82c8-39a6-4f53-b461-a71228130785 2025-08-26 01:45:25,963 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-26778466-56956868(04ce82c8-39a6-4f53-b461-a71228130785) 2025-08-26 01:45:26,049 - DEBUG - Requesting: http://10.0.0.49:8082/bgp-as-a-service/04ce82c8-39a6-4f53-b461-a71228130785 2025-08-26 01:45:26,060 - DEBUG - Response Code: 404 2025-08-26 01:45:26,060 - DEBUG - BGPaaS: 04ce82c8-39a6-4f53-b461-a71228130785 deleted from api server 2025-08-26 01:45:26,060 - INFO - BGPaaS(04ce82c8-39a6-4f53-b461-a71228130785): verify_on_cleanup passed 2025-08-26 01:45:26,061 - INFO - Detaching VMI 31cccee8-a8f2-446f-9b69-f203f18e87f7 from BGPaaS 7697d664-1ed7-433f-98d7-65a129859d8d 2025-08-26 01:45:26,114 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-26778466-39807734(7697d664-1ed7-433f-98d7-65a129859d8d) 2025-08-26 01:45:26,206 - DEBUG - Requesting: http://10.0.0.49:8082/bgp-as-a-service/7697d664-1ed7-433f-98d7-65a129859d8d 2025-08-26 01:45:26,212 - DEBUG - Response Code: 404 2025-08-26 01:45:26,213 - DEBUG - BGPaaS: 7697d664-1ed7-433f-98d7-65a129859d8d deleted from api server 2025-08-26 01:45:26,213 - INFO - BGPaaS(7697d664-1ed7-433f-98d7-65a129859d8d): verify_on_cleanup passed 2025-08-26 01:45:26,213 - INFO - Deleting Control node zone ctest-test-zone-40707070(d83438c7-1379-45c5-9fb4-2ec59d47b9e2) 2025-08-26 01:45:26,371 - INFO - Deleting Control node zone ctest-test-zone-45344115(96346076-3b62-43bd-8a7a-96bf38d256f3) 2025-08-26 01:45:26,548 - INFO - Deleting Control node zone ctest-test-zone-53177615(327a951b-a622-4707-9075-01ac7056c581) 2025-08-26 01:45:26,655 - INFO - Deleting VM ctest-TestBGPaasZone-26778466-01017202 2025-08-26 01:45:26,738 - INFO - Deleting VM ctest-TestBGPaasZone-26778466-33269472 2025-08-26 01:45:26,840 - INFO - Deleting VM ctest-TestBGPaasZone-26778466-09451972 2025-08-26 01:45:26,924 - INFO - Deleting VN ctest-cnz_vn-33076676 2025-08-26 01:45:26,972 - DEBUG - VN 8e93db75-4881-4db7-b878-dee00d8324b5 still in use: Unable to complete operation on network 8e93db75-4881-4db7-b878-dee00d8324b5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-3c4cea54-4c6f-42b6-a6bd-2df64053e1d8'] 2025-08-26 01:45:26,972 - WARNING - Deleting VN ctest-cnz_vn-33076676 failed..Will retry 2025-08-26 01:45:29,273 - DEBUG - Response for deleting network () 2025-08-26 01:45:30,621 - DEBUG - Skipping xmpp flap check 2025-08-26 01:45:30,621 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:16] 2025-08-26 01:45:30,621 - INFO - -------------------------------------------------------------------------------- 2025-08-26 01:45:30,628 - INFO - ================================================================================ 2025-08-26 01:45:30,628 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-08-26 01:45:31,987 - DEBUG - Skipping xmpp flap check 2025-08-26 01:45:31,987 - INFO - Initial checks done. Running the testcase now 2025-08-26 01:45:31,987 - INFO - 2025-08-26 01:45:31,987 - INFO - executing bgp_control_zone agent restart test 2025-08-26 01:45:32,371 - DEBUG - Response for create_network : {'network': {'id': '976bc226-b175-4a6e-828c-640c9cbb84eb', 'name': 'ctest-cnz_vn-58074503', 'tenant_id': 'eb341ea2ebbb49719088243c552f43c1', 'project_id': 'eb341ea2ebbb49719088243c552f43c1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-26778466', 'ctest-cnz_vn-58074503'], 'port_security_enabled': True, 'description': ''}} 2025-08-26 01:45:32,684 - DEBUG - Response for create_subnet : {'subnet': {'id': '7c67500c-b756-45a2-9b92-9a817c309071', 'name': '', 'tenant_id': 'eb341ea2ebbb49719088243c552f43c1', 'network_id': '976bc226-b175-4a6e-828c-640c9cbb84eb', 'ip_version': 4, 'cidr': '209.47.29.0/26', 'allocation_pools': [{'start': '209.47.29.2', 'end': '209.47.29.62'}], 'gateway_ip': '209.47.29.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '209.47.29.2', 'tags': [], 'project_id': 'eb341ea2ebbb49719088243c552f43c1'}} 2025-08-26 01:45:32,719 - INFO - Created VN ctest-cnz_vn-58074503 2025-08-26 01:45:32,734 - DEBUG - VN ctest-cnz_vn-58074503 UUID is 976bc226-b175-4a6e-828c-640c9cbb84eb 2025-08-26 01:45:34,074 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3931-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3931-2) 2025-08-26 01:45:35,727 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3931-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3931-1) 2025-08-26 01:45:37,696 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3931-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3931-2) 2025-08-26 01:45:37,696 - INFO - Waiting for VM ctest-TestBGPaasZone-26778466-11362191 to be up.. 2025-08-26 01:45:37,795 - DEBUG - VM is in ACTIVE state now 2025-08-26 01:45:37,795 - INFO - VM name : ctest-TestBGPaasZone-26778466-11362191 2025-08-26 01:45:37,922 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 ID is add1a375-6f30-428f-b772-a9339b6adbfb 2025-08-26 01:45:37,922 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 launched on Node an-jenkins-deploy-platform-ansible-os-3931-2 2025-08-26 01:45:38,035 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/add1a375-6f30-428f-b772-a9339b6adbfb 2025-08-26 01:45:38,046 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/5cd54dac-09af-4b9f-a947-2008d86210cf 2025-08-26 01:45:41,289 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-08-26 01:45:41,290 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:45:41,306 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:45:45,389 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-26 01:45:45,389 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:45:45,409 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:45:49,476 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-08-26 01:45:49,476 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:45:49,500 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:45:53,579 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-26 01:45:53,579 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:45:53,603 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:45:57,673 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-26 01:45:57,674 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:45:57,695 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:01,765 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-08-26 01:46:01,765 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:46:01,782 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:05,863 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-26 01:46:05,863 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:46:05,879 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:09,963 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-08-26 01:46:09,963 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:46:09,991 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:14,059 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms') 2025-08-26 01:46:14,060 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:46:14,080 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:18,155 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-08-26 01:46:18,155 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:46:18,201 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:22,283 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-26 01:46:22,284 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:46:22,311 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:26,417 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1034ms') 2025-08-26 01:46:26,417 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:46:26,437 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:30,505 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-08-26 01:46:30,505 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:46:30,533 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:34,633 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-08-26 01:46:34,633 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:46:34,653 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:38,728 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-08-26 01:46:38,729 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:46:38,749 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:42,827 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-26 01:46:42,827 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 failed! 2025-08-26 01:46:42,842 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-26778466:ctest-cnz_vn-58074503 is 209.47.29.1 and allocation pool is NOT set 2025-08-26 01:46:44,914 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.88 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.787 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.787/2.333/3.879/1.546 ms') 2025-08-26 01:46:44,914 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-11362191 passed 2025-08-26 01:46:44,986 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:46:44,987 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-11362191, IP 209.47.29.3, Port 22 2025-08-26 01:46:45,052 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:46:45,323 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:46:50,325 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:46:50,325 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-11362191, IP 209.47.29.3, Port 22 2025-08-26 01:46:50,391 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:46:50,527 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:46:55,527 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:46:55,527 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-11362191, IP 209.47.29.3, Port 22 2025-08-26 01:46:55,595 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:46:55,713 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:47:00,715 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:00,715 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-11362191, IP 209.47.29.3, Port 22 2025-08-26 01:47:00,778 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:47:00,912 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:47:05,913 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:05,913 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-11362191, IP 209.47.29.3, Port 22 2025-08-26 01:47:05,979 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:47:06,087 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:47:11,088 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:11,088 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-11362191, IP 209.47.29.3, Port 22 2025-08-26 01:47:11,148 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:47:11,269 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:47:16,270 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:16,271 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-11362191, IP 209.47.29.3, Port 22 2025-08-26 01:47:16,346 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:47:16,461 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:47:21,462 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:21,462 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-11362191, IP 209.47.29.3, Port 22 2025-08-26 01:47:21,528 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:47:21,632 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:47:26,632 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:26,632 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-11362191, IP 209.47.29.3, Port 22 2025-08-26 01:47:26,700 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:47:26,797 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:47:31,798 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:31,799 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-11362191, IP 209.47.29.3, Port 22 2025-08-26 01:47:31,968 - DEBUG - VM ctest-TestBGPaasZone-26778466-11362191 is ready for SSH connections 2025-08-26 01:47:31,968 - INFO - Waiting for VM ctest-TestBGPaasZone-26778466-61280894 to be up.. 2025-08-26 01:47:32,073 - DEBUG - VM is in ACTIVE state now 2025-08-26 01:47:32,073 - INFO - VM name : ctest-TestBGPaasZone-26778466-61280894 2025-08-26 01:47:32,188 - DEBUG - VM ctest-TestBGPaasZone-26778466-61280894 ID is b24ff285-b5ee-4db5-a076-ab5a906b4fdf 2025-08-26 01:47:32,188 - DEBUG - VM ctest-TestBGPaasZone-26778466-61280894 launched on Node an-jenkins-deploy-platform-ansible-os-3931-1 2025-08-26 01:47:32,293 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/b24ff285-b5ee-4db5-a076-ab5a906b4fdf 2025-08-26 01:47:32,327 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/b1231823-c452-45b5-b489-adbcaa0a9c32 2025-08-26 01:47:33,512 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.91 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.58 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.581/4.243/5.905/1.662 ms') 2025-08-26 01:47:33,512 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-26778466-61280894 passed 2025-08-26 01:47:33,633 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:33,633 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-61280894, IP 209.47.29.4, Port 22 2025-08-26 01:47:33,799 - DEBUG - VM ctest-TestBGPaasZone-26778466-61280894 is ready for SSH connections 2025-08-26 01:47:33,800 - INFO - Waiting for VM ctest-TestBGPaasZone-26778466-03105143 to be up.. 2025-08-26 01:47:33,916 - DEBUG - VM is in ACTIVE state now 2025-08-26 01:47:33,916 - INFO - VM name : ctest-TestBGPaasZone-26778466-03105143 2025-08-26 01:47:34,036 - DEBUG - VM ctest-TestBGPaasZone-26778466-03105143 ID is 551dee35-8d5a-455c-a87e-efff2b71678a 2025-08-26 01:47:34,037 - DEBUG - VM ctest-TestBGPaasZone-26778466-03105143 launched on Node an-jenkins-deploy-platform-ansible-os-3931-2 2025-08-26 01:47:34,136 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/551dee35-8d5a-455c-a87e-efff2b71678a 2025-08-26 01:47:34,150 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/35ea4b9d-597b-4073-937b-8edd5b60b2a5 2025-08-26 01:47:35,332 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.16 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.32 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.318/2.236/3.155/0.918 ms') 2025-08-26 01:47:35,333 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-26778466-03105143 passed 2025-08-26 01:47:35,413 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:35,413 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-03105143, IP 209.47.29.5, Port 22 2025-08-26 01:47:35,485 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-26 01:47:35,593 - DEBUG - VM ctest-TestBGPaasZone-26778466-03105143 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-26 01:47:40,594 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:40,594 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-26778466-03105143, IP 209.47.29.5, Port 22 2025-08-26 01:47:40,764 - DEBUG - VM ctest-TestBGPaasZone-26778466-03105143 is ready for SSH connections 2025-08-26 01:47:40,915 - INFO - Created control node zone ctest-test-zone-61677738(eb358f97-52b5-4ddc-81ba-00e794c73a9d) 2025-08-26 01:47:41,347 - INFO - Created control node zone ctest-test-zone-29568423(5f841a06-8130-49d7-8e76-4f6374e320c8) 2025-08-26 01:47:41,715 - INFO - Created control node zone ctest-test-zone-51210276(0e573f7b-5067-4961-9987-ee70d807f8bc) 2025-08-26 01:47:42,027 - INFO - Creating BGPaaS ctest-TestBGPaasZone-26778466-32410089 2025-08-26 01:47:42,103 - INFO - BGPaaS: ctest-TestBGPaasZone-26778466-32410089(672e4cf4-05e0-479a-baeb-214298f87221) 2025-08-26 01:47:42,104 - DEBUG - Requesting: http://10.0.0.49:8082/bgp-as-a-service/672e4cf4-05e0-479a-baeb-214298f87221 2025-08-26 01:47:42,117 - INFO - verify_in_api_server passed for BGPaaS obj 672e4cf4-05e0-479a-baeb-214298f87221 2025-08-26 01:47:42,117 - INFO - BGPaaS(672e4cf4-05e0-479a-baeb-214298f87221): verify_on_setup passed 2025-08-26 01:47:42,117 - INFO - We will configure BGP on the VM 2025-08-26 01:47:42,551 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:42,551 - INFO - Configuring BGP on ctest-TestBGPaasZone-26778466-11362191 2025-08-26 01:47:42,551 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 209.47.29.3; protocol bgp bgp_1{ local as 65000; neighbor 209.47.29.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.47.29.3; } protocol bfd { neighbor 209.47.29.1 local 209.47.29.3 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:47:42,551 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 209.47.29.3; protocol bgp bgp_1{ local as 65000; neighbor 209.47.29.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.47.29.3; } protocol bfd { neighbor 209.47.29.1 local 209.47.29.3 multihop on; } EOS 2025-08-26 01:47:50,623 - DEBUG - None 2025-08-26 01:47:50,623 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 209.47.29.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.47.29.3; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:47:50,624 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 209.47.29.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.47.29.3; } EOS 2025-08-26 01:47:51,130 - DEBUG - None 2025-08-26 01:47:51,130 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:47:51,131 - DEBUG - service bird restart 2025-08-26 01:47:52,931 - DEBUG - bird stop/waiting bird start/running, process 1435 2025-08-26 01:47:52,931 - INFO - Attaching VMI 5cd54dac-09af-4b9f-a947-2008d86210cf to BGPaaS 672e4cf4-05e0-479a-baeb-214298f87221 2025-08-26 01:47:53,019 - INFO - Attaching the VMI add1a375-6f30-428f-b772-a9339b6adbfb to the BGPaaS 672e4cf4-05e0-479a-baeb-214298f87221 object 2025-08-26 01:47:53,019 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 209.47.29.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:47:53,019 - DEBUG - sudo ip addr add 209.47.29.20 dev eth0 2025-08-26 01:47:53,707 - DEBUG - None 2025-08-26 01:47:53,815 - INFO - Creating BGPaaS ctest-TestBGPaasZone-26778466-65809635 2025-08-26 01:47:53,903 - INFO - BGPaaS: ctest-TestBGPaasZone-26778466-65809635(28684049-4fa3-4716-b069-7179e656b313) 2025-08-26 01:47:53,904 - DEBUG - Requesting: http://10.0.0.49:8082/bgp-as-a-service/28684049-4fa3-4716-b069-7179e656b313 2025-08-26 01:47:53,925 - INFO - verify_in_api_server passed for BGPaaS obj 28684049-4fa3-4716-b069-7179e656b313 2025-08-26 01:47:53,926 - INFO - BGPaaS(28684049-4fa3-4716-b069-7179e656b313): verify_on_setup passed 2025-08-26 01:47:53,926 - INFO - We will configure BGP on the VM 2025-08-26 01:47:54,403 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:47:54,404 - INFO - Configuring BGP on ctest-TestBGPaasZone-26778466-61280894 2025-08-26 01:47:54,405 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 209.47.29.4; protocol bgp bgp_1{ local as 65000; neighbor 209.47.29.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.47.29.4; } protocol bfd { neighbor 209.47.29.1 local 209.47.29.4 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:47:54,405 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 209.47.29.4; protocol bgp bgp_1{ local as 65000; neighbor 209.47.29.1 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.47.29.4; } protocol bfd { neighbor 209.47.29.1 local 209.47.29.4 multihop on; } EOS 2025-08-26 01:47:59,463 - DEBUG - None 2025-08-26 01:47:59,463 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 209.47.29.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.47.29.4; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:47:59,463 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 209.47.29.2 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 209.47.29.4; } EOS 2025-08-26 01:47:59,935 - DEBUG - None 2025-08-26 01:47:59,935 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:47:59,935 - DEBUG - service bird restart 2025-08-26 01:48:01,583 - DEBUG - bird stop/waiting bird start/running, process 1482 2025-08-26 01:48:01,583 - INFO - Attaching VMI b1231823-c452-45b5-b489-adbcaa0a9c32 to BGPaaS 28684049-4fa3-4716-b069-7179e656b313 2025-08-26 01:48:01,671 - INFO - Attaching the VMI b24ff285-b5ee-4db5-a076-ab5a906b4fdf to the BGPaaS 28684049-4fa3-4716-b069-7179e656b313 object 2025-08-26 01:48:01,671 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 209.47.29.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.137, gateway password: c0ntrail123 2025-08-26 01:48:01,671 - DEBUG - sudo ip addr add 209.47.29.20 dev eth0 2025-08-26 01:48:02,296 - DEBUG - None 2025-08-26 01:48:02,296 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:48:02,296 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-26 01:48:02,311 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-08-26 01:48:02,311 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:48:02,330 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-26 01:48:02,345 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:48:02,345 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-26 01:48:02,361 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-08-26 01:48:08,362 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-26 01:48:08,409 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-08-26 01:48:08,409 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:48:08,454 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-26 01:48:08,466 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 209.47.29.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:48:08,466 - DEBUG - ping -s 56 -c 3 -W 1 209.47.29.20 2025-08-26 01:48:14,959 - DEBUG - PING 209.47.29.20 (209.47.29.20) 56(84) bytes of data. 64 bytes from 209.47.29.20: icmp_seq=1 ttl=64 time=10.3 ms 64 bytes from 209.47.29.20: icmp_seq=2 ttl=64 time=2.21 ms 64 bytes from 209.47.29.20: icmp_seq=3 ttl=64 time=2.99 ms --- 209.47.29.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 2.219/5.192/10.362/3.669 ms 2025-08-26 01:48:14,966 - INFO - Ping to IP 209.47.29.20 from VM ctest-TestBGPaasZone-26778466-03105143 passed 2025-08-26 01:48:14,968 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:48:14,968 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-26 01:48:15,030 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-08-26 01:48:15,031 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:48:15,075 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-26 01:48:15,098 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:48:15,098 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-08-26 01:48:15,158 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-08-26 01:48:15,159 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-26 01:48:15,191 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-08-26 01:48:15,203 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 209.47.29.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-26 01:48:15,204 - DEBUG - ping -s 56 -c 3 -W 1 209.47.29.20 2025-08-26 01:48:17,831 - DEBUG - PING 209.47.29.20 (209.47.29.20) 56(84) bytes of data. 64 bytes from 209.47.29.20: icmp_seq=1 ttl=64 time=8.66 ms 64 bytes from 209.47.29.20: icmp_seq=2 ttl=64 time=2.48 ms 64 bytes from 209.47.29.20: icmp_seq=3 ttl=64 time=2.01 ms --- 209.47.29.20 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 2.015/4.386/8.662/3.029 ms 2025-08-26 01:48:17,831 - INFO - Ping to IP 209.47.29.20 from VM ctest-TestBGPaasZone-26778466-03105143 passed 2025-08-26 01:48:17,831 - INFO - Detaching VMI b1231823-c452-45b5-b489-adbcaa0a9c32 from BGPaaS 28684049-4fa3-4716-b069-7179e656b313 2025-08-26 01:48:17,923 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-26778466-65809635(28684049-4fa3-4716-b069-7179e656b313) 2025-08-26 01:48:18,058 - DEBUG - Requesting: http://10.0.0.49:8082/bgp-as-a-service/28684049-4fa3-4716-b069-7179e656b313 2025-08-26 01:48:18,073 - DEBUG - Response Code: 404 2025-08-26 01:48:18,073 - DEBUG - BGPaaS: 28684049-4fa3-4716-b069-7179e656b313 deleted from api server 2025-08-26 01:48:18,073 - INFO - BGPaaS(28684049-4fa3-4716-b069-7179e656b313): verify_on_cleanup passed 2025-08-26 01:48:18,073 - INFO - Detaching VMI 5cd54dac-09af-4b9f-a947-2008d86210cf from BGPaaS 672e4cf4-05e0-479a-baeb-214298f87221 2025-08-26 01:48:18,159 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-26778466-32410089(672e4cf4-05e0-479a-baeb-214298f87221) 2025-08-26 01:48:18,266 - DEBUG - Requesting: http://10.0.0.49:8082/bgp-as-a-service/672e4cf4-05e0-479a-baeb-214298f87221 2025-08-26 01:48:18,297 - DEBUG - Response Code: 404 2025-08-26 01:48:18,297 - DEBUG - BGPaaS: 672e4cf4-05e0-479a-baeb-214298f87221 deleted from api server 2025-08-26 01:48:18,297 - INFO - BGPaaS(672e4cf4-05e0-479a-baeb-214298f87221): verify_on_cleanup passed 2025-08-26 01:48:18,298 - INFO - Deleting Control node zone ctest-test-zone-51210276(0e573f7b-5067-4961-9987-ee70d807f8bc) 2025-08-26 01:48:18,474 - INFO - Deleting Control node zone ctest-test-zone-29568423(5f841a06-8130-49d7-8e76-4f6374e320c8) 2025-08-26 01:48:18,631 - INFO - Deleting Control node zone ctest-test-zone-61677738(eb358f97-52b5-4ddc-81ba-00e794c73a9d) 2025-08-26 01:48:18,805 - INFO - Deleting VM ctest-TestBGPaasZone-26778466-03105143 2025-08-26 01:48:18,874 - INFO - Deleting VM ctest-TestBGPaasZone-26778466-61280894 2025-08-26 01:48:18,978 - INFO - Deleting VM ctest-TestBGPaasZone-26778466-11362191 2025-08-26 01:48:19,077 - INFO - Deleting VN ctest-cnz_vn-58074503 2025-08-26 01:48:19,126 - DEBUG - VN 976bc226-b175-4a6e-828c-640c9cbb84eb still in use: Unable to complete operation on network 976bc226-b175-4a6e-828c-640c9cbb84eb. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-d47fd0b1-60ec-438e-a34c-ac37b4f28d7c'] 2025-08-26 01:48:19,126 - WARNING - Deleting VN ctest-cnz_vn-58074503 failed..Will retry 2025-08-26 01:48:21,366 - DEBUG - Response for deleting network () 2025-08-26 01:48:22,738 - DEBUG - Skipping xmpp flap check 2025-08-26 01:48:22,739 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:02:52] 2025-08-26 01:48:22,739 - INFO - -------------------------------------------------------------------------------- 2025-08-26 01:48:23,629 - INFO - Deleted project: ctest-TestBGPaasZone-26778466, ID : eb341ea2-ebbb-4971-9088-243c552f43c1