2025-12-25 04:17:03,826 - INFO - Domain Default found not creating 2025-12-25 04:17:04,075 - INFO - Project ctest-TestBGPaasZone-46799700 not found, creating it 2025-12-25 04:17:04,789 - INFO - Created Project:ctest-TestBGPaasZone-46799700, ID : 6ef08197-3c41-4fb0-9c46-b34d4066cfb1 2025-12-25 04:17:06,954 - DEBUG - Services list from nova: [, , , ] 2025-12-25 04:17:06,954 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4927-1', 'an-jenkins-deploy-platform-ansible-os-4927-2']} 2025-12-25 04:17:06,957 - INFO - ================================================================================ 2025-12-25 04:17:06,957 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-12-25 04:17:08,271 - DEBUG - Skipping xmpp flap check 2025-12-25 04:17:08,271 - INFO - Initial checks done. Running the testcase now 2025-12-25 04:17:08,272 - INFO - 2025-12-25 04:17:08,272 - INFO - executing bgp_control_zone test 2025-12-25 04:17:09,092 - DEBUG - Response for create_network : {'network': {'id': 'a854e828-77c4-47cc-ad82-3865997dc1f9', 'name': 'ctest-cnz_vn-48997808', 'tenant_id': '6ef081973c414fb09c46b34d4066cfb1', 'project_id': '6ef081973c414fb09c46b34d4066cfb1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-46799700', 'ctest-cnz_vn-48997808'], 'port_security_enabled': True, 'description': ''}} 2025-12-25 04:17:09,458 - DEBUG - Response for create_subnet : {'subnet': {'id': '26494180-52f2-4b0b-9f92-13f9f72c91a1', 'name': '', 'tenant_id': '6ef081973c414fb09c46b34d4066cfb1', 'network_id': 'a854e828-77c4-47cc-ad82-3865997dc1f9', 'ip_version': 4, 'cidr': '175.112.106.128/26', 'allocation_pools': [{'start': '175.112.106.130', 'end': '175.112.106.190'}], 'gateway_ip': '175.112.106.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '175.112.106.130', 'tags': [], 'project_id': '6ef081973c414fb09c46b34d4066cfb1'}} 2025-12-25 04:17:09,489 - INFO - Created VN ctest-cnz_vn-48997808 2025-12-25 04:17:09,505 - DEBUG - VN ctest-cnz_vn-48997808 UUID is a854e828-77c4-47cc-ad82-3865997dc1f9 2025-12-25 04:17:10,996 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4927-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4927-1) 2025-12-25 04:17:12,782 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4927-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4927-2) 2025-12-25 04:17:14,870 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4927-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4927-1) 2025-12-25 04:17:14,870 - INFO - Waiting for VM ctest-TestBGPaasZone-46799700-73236244 to be up.. 2025-12-25 04:17:15,027 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-25 04:17:20,188 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-25 04:17:25,303 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-25 04:17:30,408 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-25 04:17:35,511 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-25 04:17:40,625 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-25 04:17:45,721 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-25 04:17:50,820 - DEBUG - VM is in ACTIVE state now 2025-12-25 04:17:50,820 - INFO - VM name : ctest-TestBGPaasZone-46799700-73236244 2025-12-25 04:17:50,921 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 ID is ddacafb9-2c34-453a-a927-532e8f985333 2025-12-25 04:17:50,973 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 launched on Node an-jenkins-deploy-platform-ansible-os-4927-1 2025-12-25 04:17:51,090 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/ddacafb9-2c34-453a-a927-532e8f985333 2025-12-25 04:17:51,476 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/ddacafb9-2c34-453a-a927-532e8f985333 2025-12-25 04:17:51,534 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/e45394f3-93b5-4bc9-812b-cf5a5c1a2d14 2025-12-25 04:17:54,741 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms') 2025-12-25 04:17:54,741 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:17:54,763 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:17:58,838 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-12-25 04:17:58,838 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:17:58,854 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:02,936 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-12-25 04:18:02,936 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:02,951 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:07,031 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-12-25 04:18:07,031 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:07,050 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:11,128 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-12-25 04:18:11,128 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:11,146 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:15,223 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-12-25 04:18:15,223 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:15,241 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:19,320 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-12-25 04:18:19,321 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:19,337 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:23,414 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-12-25 04:18:23,414 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:23,431 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:27,504 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-25 04:18:27,504 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:27,522 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:31,612 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-12-25 04:18:31,612 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:31,632 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:35,700 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-12-25 04:18:35,700 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:35,721 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:39,799 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-12-25 04:18:39,799 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:39,816 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:43,896 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-25 04:18:43,896 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:43,915 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:47,987 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-12-25 04:18:47,987 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:48,004 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:52,083 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-12-25 04:18:52,083 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:52,100 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:18:56,177 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-12-25 04:18:56,177 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:18:56,197 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:19:00,274 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-12-25 04:19:00,274 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:19:00,296 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:19:04,380 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-12-25 04:19:04,381 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:19:04,397 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:19:08,501 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1034ms') 2025-12-25 04:19:08,502 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:19:08,519 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:19:12,596 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-12-25 04:19:12,596 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:19:12,614 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:19:16,692 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-12-25 04:19:16,692 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 failed! 2025-12-25 04:19:16,709 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-48997808 is 175.112.106.129 and allocation pool is NOT set 2025-12-25 04:19:18,775 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.40 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.729 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.729/5.062/9.395/4.333 ms') 2025-12-25 04:19:18,776 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-73236244 passed 2025-12-25 04:19:18,850 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:19:18,850 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-73236244, IP 175.112.106.131, Port 22 2025-12-25 04:19:18,909 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:19:19,046 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:19:24,048 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:19:24,048 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-73236244, IP 175.112.106.131, Port 22 2025-12-25 04:19:24,117 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:19:24,226 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:19:29,227 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:19:29,227 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-73236244, IP 175.112.106.131, Port 22 2025-12-25 04:19:29,285 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:19:29,388 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:19:34,388 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:19:34,388 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-73236244, IP 175.112.106.131, Port 22 2025-12-25 04:19:34,496 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:19:34,614 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:19:39,615 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:19:39,615 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-73236244, IP 175.112.106.131, Port 22 2025-12-25 04:19:39,683 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:19:39,818 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:19:44,819 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:19:44,819 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-73236244, IP 175.112.106.131, Port 22 2025-12-25 04:19:44,887 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:19:44,983 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:19:49,984 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:19:49,984 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-73236244, IP 175.112.106.131, Port 22 2025-12-25 04:19:50,073 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:19:50,183 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:19:55,184 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:19:55,184 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-73236244, IP 175.112.106.131, Port 22 2025-12-25 04:19:55,252 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:19:55,450 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:20:00,451 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:20:00,451 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-73236244, IP 175.112.106.131, Port 22 2025-12-25 04:20:00,520 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:20:00,639 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:20:05,640 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:20:05,640 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-73236244, IP 175.112.106.131, Port 22 2025-12-25 04:20:05,707 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:20:05,820 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:20:10,821 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:20:10,821 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-73236244, IP 175.112.106.131, Port 22 2025-12-25 04:20:10,978 - DEBUG - VM ctest-TestBGPaasZone-46799700-73236244 is ready for SSH connections 2025-12-25 04:20:10,978 - INFO - Waiting for VM ctest-TestBGPaasZone-46799700-82866930 to be up.. 2025-12-25 04:20:11,109 - DEBUG - VM is in ACTIVE state now 2025-12-25 04:20:11,109 - INFO - VM name : ctest-TestBGPaasZone-46799700-82866930 2025-12-25 04:20:11,237 - DEBUG - VM ctest-TestBGPaasZone-46799700-82866930 ID is dd6b284e-a757-4642-ad2f-19b1ac1eea73 2025-12-25 04:20:11,237 - DEBUG - VM ctest-TestBGPaasZone-46799700-82866930 launched on Node an-jenkins-deploy-platform-ansible-os-4927-2 2025-12-25 04:20:11,355 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/dd6b284e-a757-4642-ad2f-19b1ac1eea73 2025-12-25 04:20:11,371 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/72cc8294-a8df-423d-9286-5ee163df1ba2 2025-12-25 04:20:12,554 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.08 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.540 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.540/2.312/4.084/1.772 ms') 2025-12-25 04:20:12,555 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-82866930 passed 2025-12-25 04:20:12,633 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:20:12,633 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-82866930, IP 175.112.106.132, Port 22 2025-12-25 04:20:12,810 - DEBUG - VM ctest-TestBGPaasZone-46799700-82866930 is ready for SSH connections 2025-12-25 04:20:12,811 - INFO - Waiting for VM ctest-TestBGPaasZone-46799700-74816370 to be up.. 2025-12-25 04:20:12,933 - DEBUG - VM is in ACTIVE state now 2025-12-25 04:20:12,933 - INFO - VM name : ctest-TestBGPaasZone-46799700-74816370 2025-12-25 04:20:13,072 - DEBUG - VM ctest-TestBGPaasZone-46799700-74816370 ID is 85020e88-64ef-4793-8950-e9661910b293 2025-12-25 04:20:13,072 - DEBUG - VM ctest-TestBGPaasZone-46799700-74816370 launched on Node an-jenkins-deploy-platform-ansible-os-4927-1 2025-12-25 04:20:13,181 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/85020e88-64ef-4793-8950-e9661910b293 2025-12-25 04:20:13,194 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/a841d17a-bf80-4f19-9e82-f7e9044202ef 2025-12-25 04:20:14,360 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.77 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.683 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.683/1.728/2.773/1.045 ms') 2025-12-25 04:20:14,361 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-46799700-74816370 passed 2025-12-25 04:20:14,434 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:20:14,434 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-74816370, IP 175.112.106.133, Port 22 2025-12-25 04:20:14,611 - DEBUG - VM ctest-TestBGPaasZone-46799700-74816370 is ready for SSH connections 2025-12-25 04:20:14,765 - INFO - Created control node zone ctest-test-zone-74400608(1bf38343-a730-4eb4-a0b3-d18975a2427e) 2025-12-25 04:20:15,140 - INFO - Created control node zone ctest-test-zone-28989340(95988c63-e880-4564-99c0-b5b52ffcb99b) 2025-12-25 04:20:15,520 - INFO - Created control node zone ctest-test-zone-95707464(db737a98-4fb5-408b-8902-cf115755795e) 2025-12-25 04:20:15,824 - INFO - Creating BGPaaS ctest-TestBGPaasZone-46799700-48367374 2025-12-25 04:20:15,908 - INFO - BGPaaS: ctest-TestBGPaasZone-46799700-48367374(4bbf220e-b259-4d2b-bd28-193cf69901d2) 2025-12-25 04:20:15,909 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/4bbf220e-b259-4d2b-bd28-193cf69901d2 2025-12-25 04:20:16,277 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/4bbf220e-b259-4d2b-bd28-193cf69901d2 2025-12-25 04:20:16,320 - INFO - verify_in_api_server passed for BGPaaS obj 4bbf220e-b259-4d2b-bd28-193cf69901d2 2025-12-25 04:20:16,320 - INFO - BGPaaS(4bbf220e-b259-4d2b-bd28-193cf69901d2): verify_on_setup passed 2025-12-25 04:20:16,320 - INFO - We will configure BGP on the VM 2025-12-25 04:20:16,608 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:20:16,608 - INFO - Configuring BGP on ctest-TestBGPaasZone-46799700-73236244 2025-12-25 04:20:16,608 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.131; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.131; } protocol bfd { neighbor 175.112.106.129 local 175.112.106.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:20:16,609 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.131; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.131; } protocol bfd { neighbor 175.112.106.129 local 175.112.106.131 multihop on; } EOS 2025-12-25 04:20:31,196 - DEBUG - None 2025-12-25 04:20:31,196 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.131; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.131; } protocol bfd { neighbor 175.112.106.129 local 175.112.106.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:20:31,196 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.131; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.131; } protocol bfd { neighbor 175.112.106.129 local 175.112.106.131 multihop on; } EOS 2025-12-25 04:20:32,477 - DEBUG - None 2025-12-25 04:20:32,477 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:20:32,477 - DEBUG - service bird restart 2025-12-25 04:20:35,877 - DEBUG - bird stop/waiting bird start/running, process 1428 2025-12-25 04:20:35,878 - INFO - Attaching VMI e45394f3-93b5-4bc9-812b-cf5a5c1a2d14 to BGPaaS 4bbf220e-b259-4d2b-bd28-193cf69901d2 2025-12-25 04:20:35,960 - INFO - Attaching the VMI ddacafb9-2c34-453a-a927-532e8f985333 to the BGPaaS 4bbf220e-b259-4d2b-bd28-193cf69901d2 object 2025-12-25 04:20:35,960 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 175.112.106.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:20:35,960 - DEBUG - sudo ip addr add 175.112.106.148 dev eth0 2025-12-25 04:20:37,526 - DEBUG - None 2025-12-25 04:20:37,592 - INFO - Creating BGPaaS ctest-TestBGPaasZone-46799700-42762431 2025-12-25 04:20:37,676 - INFO - BGPaaS: ctest-TestBGPaasZone-46799700-42762431(9c62b9ab-4a23-445f-b981-a0b15c18ad24) 2025-12-25 04:20:37,676 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/9c62b9ab-4a23-445f-b981-a0b15c18ad24 2025-12-25 04:20:37,691 - INFO - verify_in_api_server passed for BGPaaS obj 9c62b9ab-4a23-445f-b981-a0b15c18ad24 2025-12-25 04:20:37,691 - INFO - BGPaaS(9c62b9ab-4a23-445f-b981-a0b15c18ad24): verify_on_setup passed 2025-12-25 04:20:37,691 - INFO - We will configure BGP on the VM 2025-12-25 04:20:37,968 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:20:37,968 - INFO - Configuring BGP on ctest-TestBGPaasZone-46799700-82866930 2025-12-25 04:20:37,968 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.132; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.132; } protocol bfd { neighbor 175.112.106.130 local 175.112.106.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:20:37,969 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.132; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.132; } protocol bfd { neighbor 175.112.106.130 local 175.112.106.132 multihop on; } EOS 2025-12-25 04:20:44,219 - DEBUG - None 2025-12-25 04:20:44,220 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.132; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.132; } protocol bfd { neighbor 175.112.106.130 local 175.112.106.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:20:44,220 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.132; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.132; } protocol bfd { neighbor 175.112.106.130 local 175.112.106.132 multihop on; } EOS 2025-12-25 04:20:44,786 - DEBUG - None 2025-12-25 04:20:44,786 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:20:44,786 - DEBUG - service bird restart 2025-12-25 04:20:46,761 - DEBUG - bird stop/waiting bird start/running, process 1439 2025-12-25 04:20:46,761 - INFO - Attaching VMI 72cc8294-a8df-423d-9286-5ee163df1ba2 to BGPaaS 9c62b9ab-4a23-445f-b981-a0b15c18ad24 2025-12-25 04:20:46,840 - INFO - Attaching the VMI dd6b284e-a757-4642-ad2f-19b1ac1eea73 to the BGPaaS 9c62b9ab-4a23-445f-b981-a0b15c18ad24 object 2025-12-25 04:20:46,840 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 175.112.106.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:20:46,840 - DEBUG - sudo ip addr add 175.112.106.148 dev eth0 2025-12-25 04:20:47,596 - DEBUG - None 2025-12-25 04:20:47,596 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:20:47,616 - INFO - BGPaaS session seen in control-node 10.20.0.209 2025-12-25 04:20:47,624 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:20:47,645 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-12-25 04:20:53,663 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-12-25 04:20:59,684 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-25 04:20:59,691 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 175.112.106.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:20:59,691 - DEBUG - ping -s 56 -c 3 -W 1 175.112.106.148 2025-12-25 04:21:06,718 - DEBUG - PING 175.112.106.148 (175.112.106.148) 56(84) bytes of data. 64 bytes from 175.112.106.148: icmp_seq=1 ttl=64 time=8.98 ms 64 bytes from 175.112.106.148: icmp_seq=2 ttl=64 time=1.78 ms 64 bytes from 175.112.106.148: icmp_seq=3 ttl=64 time=1.18 ms --- 175.112.106.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.184/3.985/8.989/3.546 ms 2025-12-25 04:21:06,718 - INFO - Ping to IP 175.112.106.148 from VM ctest-TestBGPaasZone-46799700-74816370 passed 2025-12-25 04:21:07,584 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:21:07,584 - DEBUG - service bird restart 2025-12-25 04:21:09,370 - DEBUG - bird stop/waiting bird start/running, process 1464 2025-12-25 04:21:09,370 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:21:09,370 - DEBUG - service bird restart 2025-12-25 04:21:11,295 - DEBUG - bird stop/waiting bird start/running, process 1466 2025-12-25 04:21:11,295 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:21:11,295 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-25 04:21:11,316 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18'] 2025-12-25 04:21:17,317 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-25 04:21:17,337 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-25 04:21:17,344 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:21:17,362 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-25 04:21:17,368 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 175.112.106.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:21:17,368 - DEBUG - ping -s 56 -c 3 -W 1 175.112.106.148 2025-12-25 04:21:19,908 - DEBUG - PING 175.112.106.148 (175.112.106.148) 56(84) bytes of data. 64 bytes from 175.112.106.148: icmp_seq=1 ttl=64 time=4.70 ms 64 bytes from 175.112.106.148: icmp_seq=2 ttl=64 time=1.48 ms 64 bytes from 175.112.106.148: icmp_seq=3 ttl=64 time=1.66 ms --- 175.112.106.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.481/2.616/4.703/1.477 ms 2025-12-25 04:21:19,908 - INFO - Ping to IP 175.112.106.148 from VM ctest-TestBGPaasZone-46799700-74816370 passed 2025-12-25 04:21:20,223 - INFO - We will configure BGP on the VM 2025-12-25 04:21:20,509 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:21:20,509 - INFO - Configuring BGP on ctest-TestBGPaasZone-46799700-73236244 2025-12-25 04:21:20,509 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.131; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.131; } protocol bfd { neighbor 175.112.106.129 local 175.112.106.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:21:20,509 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.131; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.131; } protocol bfd { neighbor 175.112.106.129 local 175.112.106.131 multihop on; } EOS 2025-12-25 04:21:21,072 - DEBUG - None 2025-12-25 04:21:21,072 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.131; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.131; } protocol bfd { neighbor 175.112.106.129 local 175.112.106.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:21:21,072 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 175.112.106.131; protocol bgp bgp_1{ local as 65000; neighbor 175.112.106.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 175.112.106.131; } protocol bfd { neighbor 175.112.106.129 local 175.112.106.131 multihop on; } EOS 2025-12-25 04:21:21,674 - DEBUG - None 2025-12-25 04:21:21,674 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:21:21,675 - DEBUG - service bird restart 2025-12-25 04:21:23,629 - DEBUG - bird stop/waiting bird start/running, process 1496 2025-12-25 04:21:23,630 - INFO - Attaching VMI e45394f3-93b5-4bc9-812b-cf5a5c1a2d14 to BGPaaS 4bbf220e-b259-4d2b-bd28-193cf69901d2 2025-12-25 04:21:23,651 - INFO - Attaching the VMI ddacafb9-2c34-453a-a927-532e8f985333 to the BGPaaS 4bbf220e-b259-4d2b-bd28-193cf69901d2 object 2025-12-25 04:21:23,651 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 175.112.106.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:21:23,651 - DEBUG - sudo ip addr add 175.112.106.148 dev eth0 2025-12-25 04:21:24,461 - DEBUG - RTNETLINK answers: File exists 2025-12-25 04:21:24,462 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:21:24,462 - DEBUG - service bird restart 2025-12-25 04:21:26,390 - DEBUG - bird stop/waiting bird start/running, process 1523 2025-12-25 04:21:26,390 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:21:26,390 - DEBUG - service bird restart 2025-12-25 04:21:28,303 - DEBUG - bird stop/waiting bird start/running, process 1488 2025-12-25 04:21:28,303 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:21:28,316 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.209'] 2025-12-25 04:21:34,335 - INFO - BGPaaS session seen in control-node 10.20.0.209 2025-12-25 04:21:34,343 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:21:34,359 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-25 04:21:34,367 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 175.112.106.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:21:34,367 - DEBUG - ping -s 56 -c 3 -W 1 175.112.106.148 2025-12-25 04:21:36,940 - DEBUG - PING 175.112.106.148 (175.112.106.148) 56(84) bytes of data. 64 bytes from 175.112.106.148: icmp_seq=1 ttl=64 time=4.14 ms 64 bytes from 175.112.106.148: icmp_seq=2 ttl=64 time=1.57 ms 64 bytes from 175.112.106.148: icmp_seq=3 ttl=64 time=1.25 ms --- 175.112.106.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.257/2.325/4.144/1.293 ms 2025-12-25 04:21:36,940 - INFO - Ping to IP 175.112.106.148 from VM ctest-TestBGPaasZone-46799700-74816370 passed 2025-12-25 04:21:36,940 - INFO - Detaching VMI e45394f3-93b5-4bc9-812b-cf5a5c1a2d14 from BGPaaS 4bbf220e-b259-4d2b-bd28-193cf69901d2 2025-12-25 04:21:37,020 - INFO - Detaching VMI 72cc8294-a8df-423d-9286-5ee163df1ba2 from BGPaaS 9c62b9ab-4a23-445f-b981-a0b15c18ad24 2025-12-25 04:21:37,135 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-46799700-42762431(9c62b9ab-4a23-445f-b981-a0b15c18ad24) 2025-12-25 04:21:37,228 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/9c62b9ab-4a23-445f-b981-a0b15c18ad24 2025-12-25 04:21:37,243 - DEBUG - Response Code: 404 2025-12-25 04:21:37,243 - DEBUG - BGPaaS: 9c62b9ab-4a23-445f-b981-a0b15c18ad24 deleted from api server 2025-12-25 04:21:37,243 - INFO - BGPaaS(9c62b9ab-4a23-445f-b981-a0b15c18ad24): verify_on_cleanup passed 2025-12-25 04:21:37,243 - INFO - Detaching VMI e45394f3-93b5-4bc9-812b-cf5a5c1a2d14 from BGPaaS 4bbf220e-b259-4d2b-bd28-193cf69901d2 2025-12-25 04:21:37,286 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-46799700-48367374(4bbf220e-b259-4d2b-bd28-193cf69901d2) 2025-12-25 04:21:37,376 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/4bbf220e-b259-4d2b-bd28-193cf69901d2 2025-12-25 04:21:37,382 - DEBUG - Response Code: 404 2025-12-25 04:21:37,383 - DEBUG - BGPaaS: 4bbf220e-b259-4d2b-bd28-193cf69901d2 deleted from api server 2025-12-25 04:21:37,383 - INFO - BGPaaS(4bbf220e-b259-4d2b-bd28-193cf69901d2): verify_on_cleanup passed 2025-12-25 04:21:37,383 - INFO - Deleting Control node zone ctest-test-zone-95707464(db737a98-4fb5-408b-8902-cf115755795e) 2025-12-25 04:21:37,550 - INFO - Deleting Control node zone ctest-test-zone-28989340(95988c63-e880-4564-99c0-b5b52ffcb99b) 2025-12-25 04:21:37,713 - INFO - Deleting Control node zone ctest-test-zone-74400608(1bf38343-a730-4eb4-a0b3-d18975a2427e) 2025-12-25 04:21:37,802 - INFO - Deleting VM ctest-TestBGPaasZone-46799700-74816370 2025-12-25 04:21:37,893 - INFO - Deleting VM ctest-TestBGPaasZone-46799700-82866930 2025-12-25 04:21:37,996 - INFO - Deleting VM ctest-TestBGPaasZone-46799700-73236244 2025-12-25 04:21:38,090 - INFO - Deleting VN ctest-cnz_vn-48997808 2025-12-25 04:21:38,156 - DEBUG - VN a854e828-77c4-47cc-ad82-3865997dc1f9 still in use: Unable to complete operation on network a854e828-77c4-47cc-ad82-3865997dc1f9. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-0949201f-e917-4754-81d7-7cfb34b17342'] 2025-12-25 04:21:38,157 - WARNING - Deleting VN ctest-cnz_vn-48997808 failed..Will retry 2025-12-25 04:21:40,472 - DEBUG - Response for deleting network () 2025-12-25 04:21:41,768 - DEBUG - Skipping xmpp flap check 2025-12-25 04:21:41,768 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:35] 2025-12-25 04:21:41,768 - INFO - -------------------------------------------------------------------------------- 2025-12-25 04:21:41,772 - INFO - ================================================================================ 2025-12-25 04:21:41,772 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-12-25 04:21:43,084 - DEBUG - Skipping xmpp flap check 2025-12-25 04:21:43,084 - INFO - Initial checks done. Running the testcase now 2025-12-25 04:21:43,084 - INFO - 2025-12-25 04:21:43,084 - INFO - executing bgp_control_zone agent restart test 2025-12-25 04:21:43,431 - DEBUG - Response for create_network : {'network': {'id': '611e7e5a-4140-4a2c-882d-116b3c4adf93', 'name': 'ctest-cnz_vn-73608801', 'tenant_id': '6ef081973c414fb09c46b34d4066cfb1', 'project_id': '6ef081973c414fb09c46b34d4066cfb1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-46799700', 'ctest-cnz_vn-73608801'], 'port_security_enabled': True, 'description': ''}} 2025-12-25 04:21:43,683 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c0b131d1-26aa-43a2-a081-537bcf2dda21', 'name': '', 'tenant_id': '6ef081973c414fb09c46b34d4066cfb1', 'network_id': '611e7e5a-4140-4a2c-882d-116b3c4adf93', 'ip_version': 4, 'cidr': '207.39.238.128/26', 'allocation_pools': [{'start': '207.39.238.130', 'end': '207.39.238.190'}], 'gateway_ip': '207.39.238.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '207.39.238.130', 'tags': [], 'project_id': '6ef081973c414fb09c46b34d4066cfb1'}} 2025-12-25 04:21:43,709 - INFO - Created VN ctest-cnz_vn-73608801 2025-12-25 04:21:43,722 - DEBUG - VN ctest-cnz_vn-73608801 UUID is 611e7e5a-4140-4a2c-882d-116b3c4adf93 2025-12-25 04:21:45,191 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4927-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4927-2) 2025-12-25 04:21:46,860 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4927-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4927-1) 2025-12-25 04:21:48,650 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4927-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4927-2) 2025-12-25 04:21:48,650 - INFO - Waiting for VM ctest-TestBGPaasZone-46799700-08580053 to be up.. 2025-12-25 04:21:48,772 - DEBUG - VM is in ACTIVE state now 2025-12-25 04:21:48,772 - INFO - VM name : ctest-TestBGPaasZone-46799700-08580053 2025-12-25 04:21:48,889 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 ID is e2ba9dfd-1691-4754-b68d-a3b444346ac3 2025-12-25 04:21:48,889 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 launched on Node an-jenkins-deploy-platform-ansible-os-4927-2 2025-12-25 04:21:49,004 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e2ba9dfd-1691-4754-b68d-a3b444346ac3 2025-12-25 04:21:49,017 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/f14dfd14-965a-4347-a088-d1dd7382b7a6 2025-12-25 04:21:52,225 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-12-25 04:21:52,225 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:21:52,242 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:21:56,325 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-25 04:21:56,325 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:21:56,347 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:00,415 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-12-25 04:22:00,415 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:00,436 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:04,518 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-12-25 04:22:04,518 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:04,539 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:08,607 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-12-25 04:22:08,607 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:08,665 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:12,736 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-12-25 04:22:12,736 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:12,755 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:16,830 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-25 04:22:16,830 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:16,848 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:20,926 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-25 04:22:20,926 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:20,947 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:25,028 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-25 04:22:25,029 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:25,045 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:29,127 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-12-25 04:22:29,127 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:29,147 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:33,221 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-12-25 04:22:33,221 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:33,241 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:37,312 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-12-25 04:22:37,312 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:37,329 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:41,413 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-12-25 04:22:41,413 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:41,428 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:45,512 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-25 04:22:45,512 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:45,527 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:49,602 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-12-25 04:22:49,603 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:49,618 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:53,695 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-12-25 04:22:53,695 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:53,712 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:22:57,796 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-25 04:22:57,796 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:22:57,812 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:23:01,895 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-25 04:23:01,895 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:23:01,919 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:23:05,986 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-12-25 04:23:05,986 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:23:06,003 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:23:10,084 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-25 04:23:10,084 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:23:10,101 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:23:14,178 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-12-25 04:23:14,178 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 failed! 2025-12-25 04:23:14,193 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-46799700:ctest-cnz_vn-73608801 is 207.39.238.129 and allocation pool is NOT set 2025-12-25 04:23:16,257 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.50 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.04 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.036/2.268/2.501/0.232 ms') 2025-12-25 04:23:16,257 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-08580053 passed 2025-12-25 04:23:16,331 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:23:16,331 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:23:16,397 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:23:16,602 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:23:21,602 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:23:21,602 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:23:21,669 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:23:21,818 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:23:26,819 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:23:26,819 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:23:26,886 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:23:27,016 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:23:32,017 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:23:32,018 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:23:32,089 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:23:32,196 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:23:37,197 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:23:37,197 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:23:37,265 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:23:37,362 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:23:42,362 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:23:42,363 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:23:42,429 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:23:42,541 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:23:47,541 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:23:47,542 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:23:47,607 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:23:47,713 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:23:52,714 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:23:52,715 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:23:52,782 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:23:52,890 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:23:57,891 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:23:57,892 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:23:57,958 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:23:58,078 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:24:03,078 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:24:03,079 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:24:03,145 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:24:03,291 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:24:08,291 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:24:08,291 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:24:08,358 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-25 04:24:08,474 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-25 04:24:13,475 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:24:13,475 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-08580053, IP 207.39.238.131, Port 22 2025-12-25 04:24:13,645 - DEBUG - VM ctest-TestBGPaasZone-46799700-08580053 is ready for SSH connections 2025-12-25 04:24:13,645 - INFO - Waiting for VM ctest-TestBGPaasZone-46799700-99297454 to be up.. 2025-12-25 04:24:13,765 - DEBUG - VM is in ACTIVE state now 2025-12-25 04:24:13,765 - INFO - VM name : ctest-TestBGPaasZone-46799700-99297454 2025-12-25 04:24:13,896 - DEBUG - VM ctest-TestBGPaasZone-46799700-99297454 ID is 3e0ee56e-d125-49ee-bfed-f99a751edd31 2025-12-25 04:24:13,896 - DEBUG - VM ctest-TestBGPaasZone-46799700-99297454 launched on Node an-jenkins-deploy-platform-ansible-os-4927-1 2025-12-25 04:24:14,015 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/3e0ee56e-d125-49ee-bfed-f99a751edd31 2025-12-25 04:24:14,068 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/cad42558-53d0-4918-aec3-1d1748477b28 2025-12-25 04:24:15,243 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.76 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.483 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.483/2.123/3.764/1.640 ms') 2025-12-25 04:24:15,244 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-46799700-99297454 passed 2025-12-25 04:24:15,317 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:24:15,318 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-99297454, IP 207.39.238.132, Port 22 2025-12-25 04:24:15,488 - DEBUG - VM ctest-TestBGPaasZone-46799700-99297454 is ready for SSH connections 2025-12-25 04:24:15,488 - INFO - Waiting for VM ctest-TestBGPaasZone-46799700-18571918 to be up.. 2025-12-25 04:24:15,636 - DEBUG - VM is in ACTIVE state now 2025-12-25 04:24:15,636 - INFO - VM name : ctest-TestBGPaasZone-46799700-18571918 2025-12-25 04:24:15,741 - DEBUG - VM ctest-TestBGPaasZone-46799700-18571918 ID is 662f0823-aadd-4b7f-b940-5c519a5168ae 2025-12-25 04:24:15,741 - DEBUG - VM ctest-TestBGPaasZone-46799700-18571918 launched on Node an-jenkins-deploy-platform-ansible-os-4927-2 2025-12-25 04:24:15,856 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/662f0823-aadd-4b7f-b940-5c519a5168ae 2025-12-25 04:24:15,867 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/61787bcf-ae89-454b-bb6a-595669ccdf9a 2025-12-25 04:24:17,040 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.99 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.87 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.868/2.927/3.986/1.059 ms') 2025-12-25 04:24:17,041 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-46799700-18571918 passed 2025-12-25 04:24:17,121 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:24:17,122 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-46799700-18571918, IP 207.39.238.133, Port 22 2025-12-25 04:24:17,297 - DEBUG - VM ctest-TestBGPaasZone-46799700-18571918 is ready for SSH connections 2025-12-25 04:24:17,448 - INFO - Created control node zone ctest-test-zone-97560282(2a1adf85-ac51-4a90-8ce8-3133ea119b17) 2025-12-25 04:24:17,828 - INFO - Created control node zone ctest-test-zone-30942371(d8ff1b2a-158f-49c2-b59d-159b20c91ca8) 2025-12-25 04:24:18,192 - INFO - Created control node zone ctest-test-zone-32826460(a899639f-7ccf-4f05-92ab-30dbd15eddd1) 2025-12-25 04:24:18,496 - INFO - Creating BGPaaS ctest-TestBGPaasZone-46799700-83004447 2025-12-25 04:24:18,584 - INFO - BGPaaS: ctest-TestBGPaasZone-46799700-83004447(d141437e-a4af-478f-824b-37b8669ed5d6) 2025-12-25 04:24:18,584 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/d141437e-a4af-478f-824b-37b8669ed5d6 2025-12-25 04:24:18,598 - INFO - verify_in_api_server passed for BGPaaS obj d141437e-a4af-478f-824b-37b8669ed5d6 2025-12-25 04:24:18,598 - INFO - BGPaaS(d141437e-a4af-478f-824b-37b8669ed5d6): verify_on_setup passed 2025-12-25 04:24:18,598 - INFO - We will configure BGP on the VM 2025-12-25 04:24:19,064 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:24:19,064 - INFO - Configuring BGP on ctest-TestBGPaasZone-46799700-08580053 2025-12-25 04:24:19,064 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 207.39.238.131; protocol bgp bgp_1{ local as 65000; neighbor 207.39.238.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 207.39.238.131; } protocol bfd { neighbor 207.39.238.129 local 207.39.238.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:24:19,064 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 207.39.238.131; protocol bgp bgp_1{ local as 65000; neighbor 207.39.238.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 207.39.238.131; } protocol bfd { neighbor 207.39.238.129 local 207.39.238.131 multihop on; } EOS 2025-12-25 04:24:35,233 - DEBUG - None 2025-12-25 04:24:35,233 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 207.39.238.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 207.39.238.131; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:24:35,233 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 207.39.238.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 207.39.238.131; } EOS 2025-12-25 04:24:36,557 - DEBUG - None 2025-12-25 04:24:36,558 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:24:36,558 - DEBUG - service bird restart 2025-12-25 04:24:40,304 - DEBUG - bird stop/waiting bird start/running, process 1425 2025-12-25 04:24:40,304 - INFO - Attaching VMI f14dfd14-965a-4347-a088-d1dd7382b7a6 to BGPaaS d141437e-a4af-478f-824b-37b8669ed5d6 2025-12-25 04:24:40,384 - INFO - Attaching the VMI e2ba9dfd-1691-4754-b68d-a3b444346ac3 to the BGPaaS d141437e-a4af-478f-824b-37b8669ed5d6 object 2025-12-25 04:24:40,384 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 207.39.238.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:24:40,385 - DEBUG - sudo ip addr add 207.39.238.148 dev eth0 2025-12-25 04:24:42,115 - DEBUG - None 2025-12-25 04:24:42,184 - INFO - Creating BGPaaS ctest-TestBGPaasZone-46799700-89223072 2025-12-25 04:24:42,272 - INFO - BGPaaS: ctest-TestBGPaasZone-46799700-89223072(b0810c38-420f-4dd9-ba65-8469c937bf39) 2025-12-25 04:24:42,272 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/b0810c38-420f-4dd9-ba65-8469c937bf39 2025-12-25 04:24:42,286 - INFO - verify_in_api_server passed for BGPaaS obj b0810c38-420f-4dd9-ba65-8469c937bf39 2025-12-25 04:24:42,286 - INFO - BGPaaS(b0810c38-420f-4dd9-ba65-8469c937bf39): verify_on_setup passed 2025-12-25 04:24:42,287 - INFO - We will configure BGP on the VM 2025-12-25 04:24:42,752 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:24:42,752 - INFO - Configuring BGP on ctest-TestBGPaasZone-46799700-99297454 2025-12-25 04:24:42,752 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 207.39.238.132; protocol bgp bgp_1{ local as 65000; neighbor 207.39.238.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 207.39.238.132; } protocol bfd { neighbor 207.39.238.129 local 207.39.238.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:24:42,753 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 207.39.238.132; protocol bgp bgp_1{ local as 65000; neighbor 207.39.238.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 207.39.238.132; } protocol bfd { neighbor 207.39.238.129 local 207.39.238.132 multihop on; } EOS 2025-12-25 04:24:48,742 - DEBUG - None 2025-12-25 04:24:48,742 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 207.39.238.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 207.39.238.132; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:24:48,743 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 207.39.238.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 207.39.238.132; } EOS 2025-12-25 04:24:49,352 - DEBUG - None 2025-12-25 04:24:49,352 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:24:49,352 - DEBUG - service bird restart 2025-12-25 04:24:51,206 - DEBUG - bird stop/waiting bird start/running, process 1440 2025-12-25 04:24:51,206 - INFO - Attaching VMI cad42558-53d0-4918-aec3-1d1748477b28 to BGPaaS b0810c38-420f-4dd9-ba65-8469c937bf39 2025-12-25 04:24:51,292 - INFO - Attaching the VMI 3e0ee56e-d125-49ee-bfed-f99a751edd31 to the BGPaaS b0810c38-420f-4dd9-ba65-8469c937bf39 object 2025-12-25 04:24:51,292 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 207.39.238.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-12-25 04:24:51,292 - DEBUG - sudo ip addr add 207.39.238.148 dev eth0 2025-12-25 04:24:52,102 - DEBUG - None 2025-12-25 04:24:52,102 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:24:52,116 - INFO - BGPaaS session seen in control-node 10.20.0.209 2025-12-25 04:24:52,117 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:24:52,136 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-25 04:24:52,143 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:24:52,158 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.209'] 2025-12-25 04:24:58,179 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.209'] 2025-12-25 04:25:04,197 - INFO - BGPaaS session seen in control-node 10.20.0.209 2025-12-25 04:25:04,200 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:25:04,223 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-25 04:25:04,232 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 207.39.238.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:25:04,232 - DEBUG - ping -s 56 -c 3 -W 1 207.39.238.148 2025-12-25 04:25:11,364 - DEBUG - PING 207.39.238.148 (207.39.238.148) 56(84) bytes of data. 64 bytes from 207.39.238.148: icmp_seq=1 ttl=64 time=8.77 ms 64 bytes from 207.39.238.148: icmp_seq=2 ttl=64 time=1.04 ms 64 bytes from 207.39.238.148: icmp_seq=3 ttl=64 time=1.22 ms --- 207.39.238.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.049/3.682/8.778/3.604 ms 2025-12-25 04:25:11,364 - INFO - Ping to IP 207.39.238.148 from VM ctest-TestBGPaasZone-46799700-18571918 passed 2025-12-25 04:25:11,364 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:25:11,381 - INFO - BGPaaS session seen in control-node 10.20.0.209 2025-12-25 04:25:11,382 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:25:11,400 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-25 04:25:11,407 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:25:11,423 - INFO - BGPaaS session seen in control-node 10.20.0.209 2025-12-25 04:25:11,423 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-25 04:25:11,447 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-12-25 04:25:11,454 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 207.39.238.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-25 04:25:11,454 - DEBUG - ping -s 56 -c 3 -W 1 207.39.238.148 2025-12-25 04:25:13,995 - DEBUG - PING 207.39.238.148 (207.39.238.148) 56(84) bytes of data. 64 bytes from 207.39.238.148: icmp_seq=1 ttl=64 time=1.21 ms 64 bytes from 207.39.238.148: icmp_seq=2 ttl=64 time=1.05 ms 64 bytes from 207.39.238.148: icmp_seq=3 ttl=64 time=0.856 ms --- 207.39.238.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.856/1.040/1.214/0.151 ms 2025-12-25 04:25:13,995 - INFO - Ping to IP 207.39.238.148 from VM ctest-TestBGPaasZone-46799700-18571918 passed 2025-12-25 04:25:13,995 - INFO - Detaching VMI cad42558-53d0-4918-aec3-1d1748477b28 from BGPaaS b0810c38-420f-4dd9-ba65-8469c937bf39 2025-12-25 04:25:14,084 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-46799700-89223072(b0810c38-420f-4dd9-ba65-8469c937bf39) 2025-12-25 04:25:14,170 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/b0810c38-420f-4dd9-ba65-8469c937bf39 2025-12-25 04:25:14,176 - DEBUG - Response Code: 404 2025-12-25 04:25:14,176 - DEBUG - BGPaaS: b0810c38-420f-4dd9-ba65-8469c937bf39 deleted from api server 2025-12-25 04:25:14,176 - INFO - BGPaaS(b0810c38-420f-4dd9-ba65-8469c937bf39): verify_on_cleanup passed 2025-12-25 04:25:14,176 - INFO - Detaching VMI f14dfd14-965a-4347-a088-d1dd7382b7a6 from BGPaaS d141437e-a4af-478f-824b-37b8669ed5d6 2025-12-25 04:25:14,300 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-46799700-83004447(d141437e-a4af-478f-824b-37b8669ed5d6) 2025-12-25 04:25:14,412 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/d141437e-a4af-478f-824b-37b8669ed5d6 2025-12-25 04:25:14,422 - DEBUG - Response Code: 404 2025-12-25 04:25:14,422 - DEBUG - BGPaaS: d141437e-a4af-478f-824b-37b8669ed5d6 deleted from api server 2025-12-25 04:25:14,422 - INFO - BGPaaS(d141437e-a4af-478f-824b-37b8669ed5d6): verify_on_cleanup passed 2025-12-25 04:25:14,423 - INFO - Deleting Control node zone ctest-test-zone-32826460(a899639f-7ccf-4f05-92ab-30dbd15eddd1) 2025-12-25 04:25:14,608 - INFO - Deleting Control node zone ctest-test-zone-30942371(d8ff1b2a-158f-49c2-b59d-159b20c91ca8) 2025-12-25 04:25:14,770 - INFO - Deleting Control node zone ctest-test-zone-97560282(2a1adf85-ac51-4a90-8ce8-3133ea119b17) 2025-12-25 04:25:14,926 - INFO - Deleting VM ctest-TestBGPaasZone-46799700-18571918 2025-12-25 04:25:15,018 - INFO - Deleting VM ctest-TestBGPaasZone-46799700-99297454 2025-12-25 04:25:15,107 - INFO - Deleting VM ctest-TestBGPaasZone-46799700-08580053 2025-12-25 04:25:15,196 - INFO - Deleting VN ctest-cnz_vn-73608801 2025-12-25 04:25:15,249 - DEBUG - VN 611e7e5a-4140-4a2c-882d-116b3c4adf93 still in use: Unable to complete operation on network 611e7e5a-4140-4a2c-882d-116b3c4adf93. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-30a536d9-a42e-4f34-8083-a0d1746de69a'] 2025-12-25 04:25:15,249 - WARNING - Deleting VN ctest-cnz_vn-73608801 failed..Will retry 2025-12-25 04:25:17,462 - DEBUG - Response for deleting network () 2025-12-25 04:25:18,772 - DEBUG - Skipping xmpp flap check 2025-12-25 04:25:18,772 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:37] 2025-12-25 04:25:18,772 - INFO - -------------------------------------------------------------------------------- 2025-12-25 04:25:19,717 - INFO - Deleted project: ctest-TestBGPaasZone-46799700, ID : 6ef08197-3c41-4fb0-9c46-b34d4066cfb1