2025-12-15 04:03:23,505 - INFO - Domain Default found not creating 2025-12-15 04:03:23,674 - INFO - Project ctest-TestBGPaasZone-19458942 not found, creating it 2025-12-15 04:03:24,274 - INFO - Created Project:ctest-TestBGPaasZone-19458942, ID : a49bcefe-82f3-4196-8e18-89cbf64b45ea 2025-12-15 04:03:25,907 - DEBUG - Services list from nova: [, , , ] 2025-12-15 04:03:25,907 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4894-2', 'an-jenkins-deploy-platform-ansible-os-4894-1']} 2025-12-15 04:03:25,909 - INFO - ================================================================================ 2025-12-15 04:03:25,909 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-12-15 04:03:27,159 - DEBUG - Skipping xmpp flap check 2025-12-15 04:03:27,159 - INFO - Initial checks done. Running the testcase now 2025-12-15 04:03:27,159 - INFO - 2025-12-15 04:03:27,159 - INFO - executing bgp_control_zone test 2025-12-15 04:03:27,808 - DEBUG - Response for create_network : {'network': {'id': '9ebff0f0-74bc-4aa7-8b8d-6d6b02fd7f19', 'name': 'ctest-cnz_vn-44817707', 'tenant_id': 'a49bcefe82f341968e1889cbf64b45ea', 'project_id': 'a49bcefe82f341968e1889cbf64b45ea', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-19458942', 'ctest-cnz_vn-44817707'], 'port_security_enabled': True, 'description': ''}} 2025-12-15 04:03:28,106 - DEBUG - Response for create_subnet : {'subnet': {'id': '8ae5c979-6388-4119-8a46-49d7c4b561ad', 'name': '', 'tenant_id': 'a49bcefe82f341968e1889cbf64b45ea', 'network_id': '9ebff0f0-74bc-4aa7-8b8d-6d6b02fd7f19', 'ip_version': 4, 'cidr': '140.40.88.64/26', 'allocation_pools': [{'start': '140.40.88.66', 'end': '140.40.88.126'}], 'gateway_ip': '140.40.88.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '140.40.88.66', 'tags': [], 'project_id': 'a49bcefe82f341968e1889cbf64b45ea'}} 2025-12-15 04:03:28,145 - INFO - Created VN ctest-cnz_vn-44817707 2025-12-15 04:03:28,158 - DEBUG - VN ctest-cnz_vn-44817707 UUID is 9ebff0f0-74bc-4aa7-8b8d-6d6b02fd7f19 2025-12-15 04:03:29,319 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4894-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4894-2) 2025-12-15 04:03:30,855 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4894-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4894-1) 2025-12-15 04:03:32,433 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4894-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4894-2) 2025-12-15 04:03:32,434 - INFO - Waiting for VM ctest-TestBGPaasZone-19458942-62319205 to be up.. 2025-12-15 04:03:32,558 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-15 04:03:37,669 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-15 04:03:42,786 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-15 04:03:47,866 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-15 04:03:52,945 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-15 04:03:58,030 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-15 04:04:03,108 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-15 04:04:08,192 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-15 04:04:13,272 - DEBUG - VM is in ACTIVE state now 2025-12-15 04:04:13,272 - INFO - VM name : ctest-TestBGPaasZone-19458942-62319205 2025-12-15 04:04:13,348 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 ID is 7c0553d4-646c-4f85-b72d-9fcdc2ad5c2b 2025-12-15 04:04:13,370 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 launched on Node an-jenkins-deploy-platform-ansible-os-4894-2 2025-12-15 04:04:13,453 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/7c0553d4-646c-4f85-b72d-9fcdc2ad5c2b 2025-12-15 04:04:13,745 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/7c0553d4-646c-4f85-b72d-9fcdc2ad5c2b 2025-12-15 04:04:13,780 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/c0eb870d-772c-44f5-9fe6-4429fc377974 2025-12-15 04:04:16,984 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1033ms') 2025-12-15 04:04:16,984 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:04:16,998 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:04:21,072 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-15 04:04:21,072 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:04:21,086 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:04:25,176 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2025-12-15 04:04:25,176 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:04:25,190 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:04:29,267 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-12-15 04:04:29,268 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:04:29,282 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:04:33,365 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-12-15 04:04:33,365 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:04:33,378 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:04:37,456 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-15 04:04:37,456 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:04:37,471 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:04:41,556 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-12-15 04:04:41,556 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:04:41,569 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:04:45,660 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-12-15 04:04:45,660 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:04:45,674 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:04:49,747 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-12-15 04:04:49,748 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:04:49,762 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:04:53,848 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-12-15 04:04:53,849 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:04:53,862 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:04:57,940 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-15 04:04:57,940 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:04:57,953 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:05:02,034 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-12-15 04:05:02,034 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:05:02,052 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:05:06,138 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-12-15 04:05:06,138 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:05:06,154 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:05:10,230 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-12-15 04:05:10,230 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:05:10,247 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:05:14,320 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-12-15 04:05:14,320 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:05:14,334 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:05:18,428 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-12-15 04:05:18,428 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:05:18,442 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:05:22,514 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-12-15 04:05:22,514 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:05:22,530 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:05:26,614 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-15 04:05:26,614 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:05:26,633 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:05:30,707 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-12-15 04:05:30,707 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 failed! 2025-12-15 04:05:30,723 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-44817707 is 140.40.88.65 and allocation pool is NOT set 2025-12-15 04:05:34,803 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=4.83 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1021ms\r\nrtt min/avg/max/mdev = 4.833/4.833/4.833/0.000 ms') 2025-12-15 04:05:34,803 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-62319205 passed 2025-12-15 04:05:34,872 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:05:34,872 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-62319205, IP 140.40.88.67, Port 22 2025-12-15 04:05:34,940 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:05:35,053 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:05:40,054 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:05:40,054 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-62319205, IP 140.40.88.67, Port 22 2025-12-15 04:05:40,131 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:05:40,228 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:05:45,229 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:05:45,229 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-62319205, IP 140.40.88.67, Port 22 2025-12-15 04:05:45,297 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:05:45,399 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:05:50,400 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:05:50,400 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-62319205, IP 140.40.88.67, Port 22 2025-12-15 04:05:50,468 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:05:50,548 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:05:55,549 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:05:55,550 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-62319205, IP 140.40.88.67, Port 22 2025-12-15 04:05:55,606 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:05:55,733 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:06:00,734 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:06:00,734 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-62319205, IP 140.40.88.67, Port 22 2025-12-15 04:06:00,801 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:06:00,881 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:06:05,881 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:06:05,882 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-62319205, IP 140.40.88.67, Port 22 2025-12-15 04:06:05,952 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:06:06,032 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:06:11,033 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:06:11,034 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-62319205, IP 140.40.88.67, Port 22 2025-12-15 04:06:11,100 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:06:11,186 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:06:16,187 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:06:16,187 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-62319205, IP 140.40.88.67, Port 22 2025-12-15 04:06:16,242 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:06:16,326 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:06:21,326 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:06:21,326 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-62319205, IP 140.40.88.67, Port 22 2025-12-15 04:06:21,392 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:06:21,472 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:06:26,473 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:06:26,473 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-62319205, IP 140.40.88.67, Port 22 2025-12-15 04:06:26,645 - DEBUG - VM ctest-TestBGPaasZone-19458942-62319205 is ready for SSH connections 2025-12-15 04:06:26,645 - INFO - Waiting for VM ctest-TestBGPaasZone-19458942-68101698 to be up.. 2025-12-15 04:06:26,725 - DEBUG - VM is in ACTIVE state now 2025-12-15 04:06:26,725 - INFO - VM name : ctest-TestBGPaasZone-19458942-68101698 2025-12-15 04:06:26,802 - DEBUG - VM ctest-TestBGPaasZone-19458942-68101698 ID is 9bcc2da1-53b9-4c7f-91f7-6901da7ddbb5 2025-12-15 04:06:26,802 - DEBUG - VM ctest-TestBGPaasZone-19458942-68101698 launched on Node an-jenkins-deploy-platform-ansible-os-4894-1 2025-12-15 04:06:26,880 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/9bcc2da1-53b9-4c7f-91f7-6901da7ddbb5 2025-12-15 04:06:26,891 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/240d8590-c5cc-4785-9ef8-2a6886cfc985 2025-12-15 04:06:28,057 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.59 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.563 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.563/2.078/3.594/1.515 ms') 2025-12-15 04:06:28,057 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-68101698 passed 2025-12-15 04:06:28,127 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:06:28,128 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-68101698, IP 140.40.88.68, Port 22 2025-12-15 04:06:28,296 - DEBUG - VM ctest-TestBGPaasZone-19458942-68101698 is ready for SSH connections 2025-12-15 04:06:28,296 - INFO - Waiting for VM ctest-TestBGPaasZone-19458942-28926420 to be up.. 2025-12-15 04:06:28,376 - DEBUG - VM is in ACTIVE state now 2025-12-15 04:06:28,376 - INFO - VM name : ctest-TestBGPaasZone-19458942-28926420 2025-12-15 04:06:28,447 - DEBUG - VM ctest-TestBGPaasZone-19458942-28926420 ID is 3b63ea40-09ea-4720-ab70-465cc2a14863 2025-12-15 04:06:28,447 - DEBUG - VM ctest-TestBGPaasZone-19458942-28926420 launched on Node an-jenkins-deploy-platform-ansible-os-4894-2 2025-12-15 04:06:28,522 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/3b63ea40-09ea-4720-ab70-465cc2a14863 2025-12-15 04:06:28,536 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/f57b6d97-b85b-4312-a3a3-84980b1c1e13 2025-12-15 04:06:29,801 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.99 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=113 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.991/58.131/113.271/55.140 ms') 2025-12-15 04:06:29,802 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-19458942-28926420 passed 2025-12-15 04:06:29,872 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:06:29,872 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-28926420, IP 140.40.88.69, Port 22 2025-12-15 04:06:30,045 - DEBUG - VM ctest-TestBGPaasZone-19458942-28926420 is ready for SSH connections 2025-12-15 04:06:30,192 - INFO - Created control node zone ctest-test-zone-41158722(7c5f7a44-5af4-45c1-a0a5-c01007b3eb77) 2025-12-15 04:06:30,547 - INFO - Created control node zone ctest-test-zone-64679424(ce91248b-ab0c-4d09-8d9d-f87abe44868d) 2025-12-15 04:06:30,899 - INFO - Created control node zone ctest-test-zone-71472881(fa120b7c-c175-4686-9575-b773836cf2af) 2025-12-15 04:06:31,195 - INFO - Creating BGPaaS ctest-TestBGPaasZone-19458942-90203157 2025-12-15 04:06:31,271 - INFO - BGPaaS: ctest-TestBGPaasZone-19458942-90203157(f0ab00e7-30c0-49c3-9682-0146f86c38c6) 2025-12-15 04:06:31,271 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/f0ab00e7-30c0-49c3-9682-0146f86c38c6 2025-12-15 04:06:31,562 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/f0ab00e7-30c0-49c3-9682-0146f86c38c6 2025-12-15 04:06:31,594 - INFO - verify_in_api_server passed for BGPaaS obj f0ab00e7-30c0-49c3-9682-0146f86c38c6 2025-12-15 04:06:31,594 - INFO - BGPaaS(f0ab00e7-30c0-49c3-9682-0146f86c38c6): verify_on_setup passed 2025-12-15 04:06:31,594 - INFO - We will configure BGP on the VM 2025-12-15 04:06:31,847 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:06:31,847 - INFO - Configuring BGP on ctest-TestBGPaasZone-19458942-62319205 2025-12-15 04:06:31,847 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.67; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.67; } protocol bfd { neighbor 140.40.88.65 local 140.40.88.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:06:31,848 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.67; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.67; } protocol bfd { neighbor 140.40.88.65 local 140.40.88.67 multihop on; } EOS 2025-12-15 04:06:46,772 - DEBUG - None 2025-12-15 04:06:46,773 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.67; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.67; } protocol bfd { neighbor 140.40.88.65 local 140.40.88.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:06:46,773 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.67; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.67; } protocol bfd { neighbor 140.40.88.65 local 140.40.88.67 multihop on; } EOS 2025-12-15 04:06:47,791 - DEBUG - None 2025-12-15 04:06:47,791 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:06:47,791 - DEBUG - service bird restart 2025-12-15 04:06:51,062 - DEBUG - bird stop/waiting bird start/running, process 1432 2025-12-15 04:06:51,062 - INFO - Attaching VMI c0eb870d-772c-44f5-9fe6-4429fc377974 to BGPaaS f0ab00e7-30c0-49c3-9682-0146f86c38c6 2025-12-15 04:06:51,135 - INFO - Attaching the VMI 7c0553d4-646c-4f85-b72d-9fcdc2ad5c2b to the BGPaaS f0ab00e7-30c0-49c3-9682-0146f86c38c6 object 2025-12-15 04:06:51,136 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 140.40.88.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:06:51,136 - DEBUG - sudo ip addr add 140.40.88.84 dev eth0 2025-12-15 04:06:52,715 - DEBUG - None 2025-12-15 04:06:52,779 - INFO - Creating BGPaaS ctest-TestBGPaasZone-19458942-74699999 2025-12-15 04:06:52,855 - INFO - BGPaaS: ctest-TestBGPaasZone-19458942-74699999(c9b0c8c3-ce1e-45f7-a527-ed77f952ffb9) 2025-12-15 04:06:52,855 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/c9b0c8c3-ce1e-45f7-a527-ed77f952ffb9 2025-12-15 04:06:52,866 - INFO - verify_in_api_server passed for BGPaaS obj c9b0c8c3-ce1e-45f7-a527-ed77f952ffb9 2025-12-15 04:06:52,866 - INFO - BGPaaS(c9b0c8c3-ce1e-45f7-a527-ed77f952ffb9): verify_on_setup passed 2025-12-15 04:06:52,866 - INFO - We will configure BGP on the VM 2025-12-15 04:06:53,131 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:06:53,131 - INFO - Configuring BGP on ctest-TestBGPaasZone-19458942-68101698 2025-12-15 04:06:53,131 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.68; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.68; } protocol bfd { neighbor 140.40.88.66 local 140.40.88.68 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:06:53,131 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.68; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.68; } protocol bfd { neighbor 140.40.88.66 local 140.40.88.68 multihop on; } EOS 2025-12-15 04:06:58,893 - DEBUG - None 2025-12-15 04:06:58,893 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.68; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.68; } protocol bfd { neighbor 140.40.88.66 local 140.40.88.68 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:06:58,893 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.68; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.66 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.68; } protocol bfd { neighbor 140.40.88.66 local 140.40.88.68 multihop on; } EOS 2025-12-15 04:06:59,413 - DEBUG - None 2025-12-15 04:06:59,414 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:06:59,414 - DEBUG - service bird restart 2025-12-15 04:07:01,331 - DEBUG - bird stop/waiting bird start/running, process 1442 2025-12-15 04:07:01,331 - INFO - Attaching VMI 240d8590-c5cc-4785-9ef8-2a6886cfc985 to BGPaaS c9b0c8c3-ce1e-45f7-a527-ed77f952ffb9 2025-12-15 04:07:01,415 - INFO - Attaching the VMI 9bcc2da1-53b9-4c7f-91f7-6901da7ddbb5 to the BGPaaS c9b0c8c3-ce1e-45f7-a527-ed77f952ffb9 object 2025-12-15 04:07:01,415 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 140.40.88.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:07:01,415 - DEBUG - sudo ip addr add 140.40.88.84 dev eth0 2025-12-15 04:07:02,169 - DEBUG - None 2025-12-15 04:07:02,169 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:07:02,182 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-12-15 04:07:02,190 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:07:02,211 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-12-15 04:07:08,231 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-12-15 04:07:14,248 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-12-15 04:07:14,254 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 140.40.88.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:07:14,254 - DEBUG - ping -s 56 -c 3 -W 1 140.40.88.84 2025-12-15 04:07:20,749 - DEBUG - PING 140.40.88.84 (140.40.88.84) 56(84) bytes of data. 64 bytes from 140.40.88.84: icmp_seq=1 ttl=64 time=9.79 ms 64 bytes from 140.40.88.84: icmp_seq=2 ttl=64 time=1.35 ms 64 bytes from 140.40.88.84: icmp_seq=3 ttl=64 time=1.27 ms --- 140.40.88.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.277/4.140/9.791/3.996 ms 2025-12-15 04:07:20,749 - INFO - Ping to IP 140.40.88.84 from VM ctest-TestBGPaasZone-19458942-28926420 passed 2025-12-15 04:07:21,583 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:07:21,583 - DEBUG - service bird restart 2025-12-15 04:07:23,340 - DEBUG - bird stop/waiting bird start/running, process 1470 2025-12-15 04:07:23,340 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:07:23,340 - DEBUG - service bird restart 2025-12-15 04:07:25,215 - DEBUG - bird stop/waiting bird start/running, process 1469 2025-12-15 04:07:25,215 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:07:25,215 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-15 04:07:25,235 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18'] 2025-12-15 04:07:31,236 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-12-15 04:07:31,257 - INFO - BGPaaS session seen in control-node 10.20.0.18 2025-12-15 04:07:31,264 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:07:31,281 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-12-15 04:07:37,301 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-12-15 04:07:37,307 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 140.40.88.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:07:37,307 - DEBUG - ping -s 56 -c 3 -W 1 140.40.88.84 2025-12-15 04:07:39,784 - DEBUG - PING 140.40.88.84 (140.40.88.84) 56(84) bytes of data. 64 bytes from 140.40.88.84: icmp_seq=1 ttl=64 time=3.84 ms 64 bytes from 140.40.88.84: icmp_seq=2 ttl=64 time=1.02 ms 64 bytes from 140.40.88.84: icmp_seq=3 ttl=64 time=1.01 ms --- 140.40.88.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.015/1.960/3.841/1.330 ms 2025-12-15 04:07:39,784 - INFO - Ping to IP 140.40.88.84 from VM ctest-TestBGPaasZone-19458942-28926420 passed 2025-12-15 04:07:40,085 - INFO - We will configure BGP on the VM 2025-12-15 04:07:40,303 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:07:40,303 - INFO - Configuring BGP on ctest-TestBGPaasZone-19458942-62319205 2025-12-15 04:07:40,303 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.67; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.67; } protocol bfd { neighbor 140.40.88.65 local 140.40.88.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:07:40,303 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.67; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.67; } protocol bfd { neighbor 140.40.88.65 local 140.40.88.67 multihop on; } EOS 2025-12-15 04:07:40,787 - DEBUG - None 2025-12-15 04:07:40,787 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.67; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.67; } protocol bfd { neighbor 140.40.88.65 local 140.40.88.67 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:07:40,787 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 140.40.88.67; protocol bgp bgp_1{ local as 65000; neighbor 140.40.88.65 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 140.40.88.67; } protocol bfd { neighbor 140.40.88.65 local 140.40.88.67 multihop on; } EOS 2025-12-15 04:07:41,299 - DEBUG - None 2025-12-15 04:07:41,299 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:07:41,299 - DEBUG - service bird restart 2025-12-15 04:07:43,168 - DEBUG - bird stop/waiting bird start/running, process 1502 2025-12-15 04:07:43,168 - INFO - Attaching VMI c0eb870d-772c-44f5-9fe6-4429fc377974 to BGPaaS f0ab00e7-30c0-49c3-9682-0146f86c38c6 2025-12-15 04:07:43,190 - INFO - Attaching the VMI 7c0553d4-646c-4f85-b72d-9fcdc2ad5c2b to the BGPaaS f0ab00e7-30c0-49c3-9682-0146f86c38c6 object 2025-12-15 04:07:43,190 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 140.40.88.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:07:43,191 - DEBUG - sudo ip addr add 140.40.88.84 dev eth0 2025-12-15 04:07:43,970 - DEBUG - RTNETLINK answers: File exists 2025-12-15 04:07:43,970 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:07:43,970 - DEBUG - service bird restart 2025-12-15 04:07:45,818 - DEBUG - bird stop/waiting bird start/running, process 1529 2025-12-15 04:07:45,818 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:07:45,818 - DEBUG - service bird restart 2025-12-15 04:07:47,697 - DEBUG - bird stop/waiting bird start/running, process 1491 2025-12-15 04:07:47,697 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:07:47,710 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129'] 2025-12-15 04:07:53,722 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-12-15 04:07:53,728 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:07:53,744 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-12-15 04:07:53,750 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 140.40.88.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:07:53,750 - DEBUG - ping -s 56 -c 3 -W 1 140.40.88.84 2025-12-15 04:07:56,334 - DEBUG - PING 140.40.88.84 (140.40.88.84) 56(84) bytes of data. 64 bytes from 140.40.88.84: icmp_seq=1 ttl=64 time=2.12 ms 64 bytes from 140.40.88.84: icmp_seq=2 ttl=64 time=0.936 ms 64 bytes from 140.40.88.84: icmp_seq=3 ttl=64 time=1.29 ms --- 140.40.88.84 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.936/1.451/2.121/0.496 ms 2025-12-15 04:07:56,335 - INFO - Ping to IP 140.40.88.84 from VM ctest-TestBGPaasZone-19458942-28926420 passed 2025-12-15 04:07:56,335 - INFO - Detaching VMI c0eb870d-772c-44f5-9fe6-4429fc377974 from BGPaaS f0ab00e7-30c0-49c3-9682-0146f86c38c6 2025-12-15 04:07:56,423 - INFO - Detaching VMI 240d8590-c5cc-4785-9ef8-2a6886cfc985 from BGPaaS c9b0c8c3-ce1e-45f7-a527-ed77f952ffb9 2025-12-15 04:07:56,503 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-19458942-74699999(c9b0c8c3-ce1e-45f7-a527-ed77f952ffb9) 2025-12-15 04:07:56,563 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/c9b0c8c3-ce1e-45f7-a527-ed77f952ffb9 2025-12-15 04:07:56,577 - DEBUG - Response Code: 404 2025-12-15 04:07:56,578 - DEBUG - BGPaaS: c9b0c8c3-ce1e-45f7-a527-ed77f952ffb9 deleted from api server 2025-12-15 04:07:56,578 - INFO - BGPaaS(c9b0c8c3-ce1e-45f7-a527-ed77f952ffb9): verify_on_cleanup passed 2025-12-15 04:07:56,578 - INFO - Detaching VMI c0eb870d-772c-44f5-9fe6-4429fc377974 from BGPaaS f0ab00e7-30c0-49c3-9682-0146f86c38c6 2025-12-15 04:07:56,615 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-19458942-90203157(f0ab00e7-30c0-49c3-9682-0146f86c38c6) 2025-12-15 04:07:56,706 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/f0ab00e7-30c0-49c3-9682-0146f86c38c6 2025-12-15 04:07:56,723 - DEBUG - Response Code: 404 2025-12-15 04:07:56,723 - DEBUG - BGPaaS: f0ab00e7-30c0-49c3-9682-0146f86c38c6 deleted from api server 2025-12-15 04:07:56,723 - INFO - BGPaaS(f0ab00e7-30c0-49c3-9682-0146f86c38c6): verify_on_cleanup passed 2025-12-15 04:07:56,723 - INFO - Deleting Control node zone ctest-test-zone-71472881(fa120b7c-c175-4686-9575-b773836cf2af) 2025-12-15 04:07:56,894 - INFO - Deleting Control node zone ctest-test-zone-64679424(ce91248b-ab0c-4d09-8d9d-f87abe44868d) 2025-12-15 04:07:57,063 - INFO - Deleting Control node zone ctest-test-zone-41158722(7c5f7a44-5af4-45c1-a0a5-c01007b3eb77) 2025-12-15 04:07:57,149 - INFO - Deleting VM ctest-TestBGPaasZone-19458942-28926420 2025-12-15 04:07:57,230 - INFO - Deleting VM ctest-TestBGPaasZone-19458942-68101698 2025-12-15 04:07:57,304 - INFO - Deleting VM ctest-TestBGPaasZone-19458942-62319205 2025-12-15 04:07:57,368 - INFO - Deleting VN ctest-cnz_vn-44817707 2025-12-15 04:07:57,416 - DEBUG - VN 9ebff0f0-74bc-4aa7-8b8d-6d6b02fd7f19 still in use: Unable to complete operation on network 9ebff0f0-74bc-4aa7-8b8d-6d6b02fd7f19. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-64af2bba-6eb1-49c7-8ba0-721453d71057'] 2025-12-15 04:07:57,416 - WARNING - Deleting VN ctest-cnz_vn-44817707 failed..Will retry 2025-12-15 04:07:59,660 - DEBUG - Response for deleting network () 2025-12-15 04:08:00,923 - DEBUG - Skipping xmpp flap check 2025-12-15 04:08:00,923 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:35] 2025-12-15 04:08:00,923 - INFO - -------------------------------------------------------------------------------- 2025-12-15 04:08:00,925 - INFO - ================================================================================ 2025-12-15 04:08:00,925 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-12-15 04:08:02,209 - DEBUG - Skipping xmpp flap check 2025-12-15 04:08:02,209 - INFO - Initial checks done. Running the testcase now 2025-12-15 04:08:02,209 - INFO - 2025-12-15 04:08:02,209 - INFO - executing bgp_control_zone agent restart test 2025-12-15 04:08:02,617 - DEBUG - Response for create_network : {'network': {'id': '705602c2-c44b-473c-b390-b16a442b9281', 'name': 'ctest-cnz_vn-22333563', 'tenant_id': 'a49bcefe82f341968e1889cbf64b45ea', 'project_id': 'a49bcefe82f341968e1889cbf64b45ea', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-19458942', 'ctest-cnz_vn-22333563'], 'port_security_enabled': True, 'description': ''}} 2025-12-15 04:08:02,895 - DEBUG - Response for create_subnet : {'subnet': {'id': '1ef3409d-a250-4046-bc7c-dca6112aa102', 'name': '', 'tenant_id': 'a49bcefe82f341968e1889cbf64b45ea', 'network_id': '705602c2-c44b-473c-b390-b16a442b9281', 'ip_version': 4, 'cidr': '67.102.235.192/26', 'allocation_pools': [{'start': '67.102.235.194', 'end': '67.102.235.254'}], 'gateway_ip': '67.102.235.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '67.102.235.194', 'tags': [], 'project_id': 'a49bcefe82f341968e1889cbf64b45ea'}} 2025-12-15 04:08:02,924 - INFO - Created VN ctest-cnz_vn-22333563 2025-12-15 04:08:02,941 - DEBUG - VN ctest-cnz_vn-22333563 UUID is 705602c2-c44b-473c-b390-b16a442b9281 2025-12-15 04:08:04,115 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4894-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4894-1) 2025-12-15 04:08:05,506 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4894-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4894-2) 2025-12-15 04:08:06,820 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4894-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4894-1) 2025-12-15 04:08:06,820 - INFO - Waiting for VM ctest-TestBGPaasZone-19458942-50508914 to be up.. 2025-12-15 04:08:06,896 - DEBUG - VM is in ACTIVE state now 2025-12-15 04:08:06,896 - INFO - VM name : ctest-TestBGPaasZone-19458942-50508914 2025-12-15 04:08:06,978 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 ID is c3a5114a-c12a-458b-a55e-9dbb490951a6 2025-12-15 04:08:06,978 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 launched on Node an-jenkins-deploy-platform-ansible-os-4894-1 2025-12-15 04:08:07,055 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/c3a5114a-c12a-458b-a55e-9dbb490951a6 2025-12-15 04:08:07,066 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/0fb5dd48-14ab-4902-8c25-150ec0168504 2025-12-15 04:08:10,267 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-12-15 04:08:10,267 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:10,280 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:14,360 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-12-15 04:08:14,360 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:14,375 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:18,455 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-12-15 04:08:18,455 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:18,470 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:22,561 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-15 04:08:22,561 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:22,575 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:26,659 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-15 04:08:26,659 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:26,673 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:30,747 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-12-15 04:08:30,747 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:30,788 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:34,881 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-12-15 04:08:34,882 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:34,897 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:38,976 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-12-15 04:08:38,976 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:38,992 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:43,070 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-12-15 04:08:43,070 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:43,084 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:47,166 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-12-15 04:08:47,167 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:47,180 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:51,262 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-15 04:08:51,262 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:51,280 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:55,358 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-12-15 04:08:55,359 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:55,376 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:08:59,452 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-12-15 04:08:59,452 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:08:59,467 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:09:03,550 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-12-15 04:09:03,550 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:09:03,566 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:09:07,638 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-15 04:09:07,639 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:09:07,653 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:09:11,736 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-12-15 04:09:11,736 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:09:11,751 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:09:15,838 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-12-15 04:09:15,838 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:09:15,852 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:09:19,931 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-12-15 04:09:19,931 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:09:19,946 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:09:24,032 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-12-15 04:09:24,033 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:09:24,050 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:09:28,127 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-12-15 04:09:28,127 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 failed! 2025-12-15 04:09:28,141 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-19458942:ctest-cnz_vn-22333563 is 67.102.235.193 and allocation pool is NOT set 2025-12-15 04:09:30,207 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.99 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.82 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.817/2.905/3.993/1.088 ms') 2025-12-15 04:09:30,207 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-50508914 passed 2025-12-15 04:09:30,284 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:09:30,284 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-50508914, IP 67.102.235.195, Port 22 2025-12-15 04:09:30,352 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:09:30,520 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:09:35,521 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:09:35,522 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-50508914, IP 67.102.235.195, Port 22 2025-12-15 04:09:35,588 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:09:35,726 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:09:40,728 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:09:40,728 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-50508914, IP 67.102.235.195, Port 22 2025-12-15 04:09:40,796 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:09:40,871 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:09:45,872 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:09:45,872 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-50508914, IP 67.102.235.195, Port 22 2025-12-15 04:09:45,940 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:09:46,018 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:09:51,019 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:09:51,019 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-50508914, IP 67.102.235.195, Port 22 2025-12-15 04:09:51,077 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:09:51,158 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:09:56,158 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:09:56,158 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-50508914, IP 67.102.235.195, Port 22 2025-12-15 04:09:56,223 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:09:56,296 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:10:01,298 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:10:01,298 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-50508914, IP 67.102.235.195, Port 22 2025-12-15 04:10:01,364 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:10:01,457 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:10:06,458 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:10:06,458 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-50508914, IP 67.102.235.195, Port 22 2025-12-15 04:10:06,525 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:10:06,616 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:10:11,616 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:10:11,616 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-50508914, IP 67.102.235.195, Port 22 2025-12-15 04:10:11,684 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:10:11,772 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:10:16,773 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:10:16,774 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-50508914, IP 67.102.235.195, Port 22 2025-12-15 04:10:16,839 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-15 04:10:16,918 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-15 04:10:21,919 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:10:21,919 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-50508914, IP 67.102.235.195, Port 22 2025-12-15 04:10:22,077 - DEBUG - VM ctest-TestBGPaasZone-19458942-50508914 is ready for SSH connections 2025-12-15 04:10:22,077 - INFO - Waiting for VM ctest-TestBGPaasZone-19458942-79577054 to be up.. 2025-12-15 04:10:22,160 - DEBUG - VM is in ACTIVE state now 2025-12-15 04:10:22,160 - INFO - VM name : ctest-TestBGPaasZone-19458942-79577054 2025-12-15 04:10:22,235 - DEBUG - VM ctest-TestBGPaasZone-19458942-79577054 ID is 414b7e16-f9a4-4079-91b2-e3405bcf284e 2025-12-15 04:10:22,236 - DEBUG - VM ctest-TestBGPaasZone-19458942-79577054 launched on Node an-jenkins-deploy-platform-ansible-os-4894-2 2025-12-15 04:10:22,307 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/414b7e16-f9a4-4079-91b2-e3405bcf284e 2025-12-15 04:10:22,347 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/38c61c0f-1c51-4ebb-acea-24d830bbac3b 2025-12-15 04:10:23,525 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.53 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.493 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.493/2.510/4.528/2.017 ms') 2025-12-15 04:10:23,525 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-19458942-79577054 passed 2025-12-15 04:10:23,600 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:10:23,600 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-79577054, IP 67.102.235.196, Port 22 2025-12-15 04:10:23,773 - DEBUG - VM ctest-TestBGPaasZone-19458942-79577054 is ready for SSH connections 2025-12-15 04:10:23,773 - INFO - Waiting for VM ctest-TestBGPaasZone-19458942-13517136 to be up.. 2025-12-15 04:10:23,875 - DEBUG - VM is in ACTIVE state now 2025-12-15 04:10:23,876 - INFO - VM name : ctest-TestBGPaasZone-19458942-13517136 2025-12-15 04:10:23,970 - DEBUG - VM ctest-TestBGPaasZone-19458942-13517136 ID is 26ef9c02-62a7-4b98-a982-ecf2f12f411e 2025-12-15 04:10:23,970 - DEBUG - VM ctest-TestBGPaasZone-19458942-13517136 launched on Node an-jenkins-deploy-platform-ansible-os-4894-1 2025-12-15 04:10:24,054 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/26ef9c02-62a7-4b98-a982-ecf2f12f411e 2025-12-15 04:10:24,065 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/f7f27eff-4be6-4800-9f76-34a530102e49 2025-12-15 04:10:25,221 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.32 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.798 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.798/2.556/4.315/1.758 ms') 2025-12-15 04:10:25,221 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-19458942-13517136 passed 2025-12-15 04:10:25,298 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:10:25,298 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-19458942-13517136, IP 67.102.235.197, Port 22 2025-12-15 04:10:25,467 - DEBUG - VM ctest-TestBGPaasZone-19458942-13517136 is ready for SSH connections 2025-12-15 04:10:25,615 - INFO - Created control node zone ctest-test-zone-38251128(33d735d0-1bc1-4b84-b211-256a76bf5150) 2025-12-15 04:10:25,988 - INFO - Created control node zone ctest-test-zone-37119183(6768987f-045d-479d-93e6-6fca07a61f2b) 2025-12-15 04:10:26,359 - INFO - Created control node zone ctest-test-zone-34541038(fb376ffa-9587-4ee8-bcf0-d9fcf3e29bb6) 2025-12-15 04:10:26,647 - INFO - Creating BGPaaS ctest-TestBGPaasZone-19458942-27734476 2025-12-15 04:10:26,723 - INFO - BGPaaS: ctest-TestBGPaasZone-19458942-27734476(9b92fab7-3f18-419e-aa14-489efbe11872) 2025-12-15 04:10:26,723 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/9b92fab7-3f18-419e-aa14-489efbe11872 2025-12-15 04:10:26,736 - INFO - verify_in_api_server passed for BGPaaS obj 9b92fab7-3f18-419e-aa14-489efbe11872 2025-12-15 04:10:26,736 - INFO - BGPaaS(9b92fab7-3f18-419e-aa14-489efbe11872): verify_on_setup passed 2025-12-15 04:10:26,736 - INFO - We will configure BGP on the VM 2025-12-15 04:10:27,171 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:10:27,171 - INFO - Configuring BGP on ctest-TestBGPaasZone-19458942-50508914 2025-12-15 04:10:27,172 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 67.102.235.195; protocol bgp bgp_1{ local as 65000; neighbor 67.102.235.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.102.235.195; } protocol bfd { neighbor 67.102.235.193 local 67.102.235.195 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:10:27,172 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 67.102.235.195; protocol bgp bgp_1{ local as 65000; neighbor 67.102.235.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.102.235.195; } protocol bfd { neighbor 67.102.235.193 local 67.102.235.195 multihop on; } EOS 2025-12-15 04:10:47,278 - DEBUG - None 2025-12-15 04:10:47,278 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 67.102.235.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.102.235.195; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:10:47,278 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 67.102.235.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.102.235.195; } EOS 2025-12-15 04:10:47,848 - DEBUG - None 2025-12-15 04:10:47,848 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:10:47,848 - DEBUG - service bird restart 2025-12-15 04:10:49,793 - DEBUG - bird stop/waiting bird start/running, process 1444 2025-12-15 04:10:49,793 - INFO - Attaching VMI 0fb5dd48-14ab-4902-8c25-150ec0168504 to BGPaaS 9b92fab7-3f18-419e-aa14-489efbe11872 2025-12-15 04:10:49,870 - INFO - Attaching the VMI c3a5114a-c12a-458b-a55e-9dbb490951a6 to the BGPaaS 9b92fab7-3f18-419e-aa14-489efbe11872 object 2025-12-15 04:10:49,870 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 67.102.235.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:10:49,870 - DEBUG - sudo ip addr add 67.102.235.212 dev eth0 2025-12-15 04:10:50,601 - DEBUG - None 2025-12-15 04:10:50,667 - INFO - Creating BGPaaS ctest-TestBGPaasZone-19458942-87570796 2025-12-15 04:10:50,747 - INFO - BGPaaS: ctest-TestBGPaasZone-19458942-87570796(bb7c2002-4ce4-4961-b088-7fb4359e1e19) 2025-12-15 04:10:50,748 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/bb7c2002-4ce4-4961-b088-7fb4359e1e19 2025-12-15 04:10:50,762 - INFO - verify_in_api_server passed for BGPaaS obj bb7c2002-4ce4-4961-b088-7fb4359e1e19 2025-12-15 04:10:50,762 - INFO - BGPaaS(bb7c2002-4ce4-4961-b088-7fb4359e1e19): verify_on_setup passed 2025-12-15 04:10:50,762 - INFO - We will configure BGP on the VM 2025-12-15 04:10:51,235 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:10:51,235 - INFO - Configuring BGP on ctest-TestBGPaasZone-19458942-79577054 2025-12-15 04:10:51,235 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 67.102.235.196; protocol bgp bgp_1{ local as 65000; neighbor 67.102.235.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.102.235.196; } protocol bfd { neighbor 67.102.235.193 local 67.102.235.196 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:10:51,235 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 67.102.235.196; protocol bgp bgp_1{ local as 65000; neighbor 67.102.235.193 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.102.235.196; } protocol bfd { neighbor 67.102.235.193 local 67.102.235.196 multihop on; } EOS 2025-12-15 04:11:06,957 - DEBUG - None 2025-12-15 04:11:06,958 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 67.102.235.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.102.235.196; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:11:06,958 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 67.102.235.194 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.102.235.196; } EOS 2025-12-15 04:11:07,479 - DEBUG - None 2025-12-15 04:11:07,479 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:11:07,479 - DEBUG - service bird restart 2025-12-15 04:11:09,303 - DEBUG - bird stop/waiting bird start/running, process 1435 2025-12-15 04:11:09,303 - INFO - Attaching VMI 38c61c0f-1c51-4ebb-acea-24d830bbac3b to BGPaaS bb7c2002-4ce4-4961-b088-7fb4359e1e19 2025-12-15 04:11:09,379 - INFO - Attaching the VMI 414b7e16-f9a4-4079-91b2-e3405bcf284e to the BGPaaS bb7c2002-4ce4-4961-b088-7fb4359e1e19 object 2025-12-15 04:11:09,379 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 67.102.235.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-12-15 04:11:09,379 - DEBUG - sudo ip addr add 67.102.235.212 dev eth0 2025-12-15 04:11:10,067 - DEBUG - None 2025-12-15 04:11:10,068 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:11:10,080 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-12-15 04:11:10,080 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:11:10,097 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-12-15 04:11:10,104 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:11:10,114 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129'] 2025-12-15 04:11:16,127 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129'] 2025-12-15 04:11:22,140 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-12-15 04:11:22,140 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:11:22,155 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-12-15 04:11:22,160 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 67.102.235.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:11:22,160 - DEBUG - ping -s 56 -c 3 -W 1 67.102.235.212 2025-12-15 04:11:38,809 - DEBUG - PING 67.102.235.212 (67.102.235.212) 56(84) bytes of data. 64 bytes from 67.102.235.212: icmp_seq=1 ttl=64 time=8.11 ms 64 bytes from 67.102.235.212: icmp_seq=2 ttl=64 time=0.954 ms 64 bytes from 67.102.235.212: icmp_seq=3 ttl=64 time=0.915 ms --- 67.102.235.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.915/3.327/8.113/3.384 ms 2025-12-15 04:11:38,809 - INFO - Ping to IP 67.102.235.212 from VM ctest-TestBGPaasZone-19458942-13517136 passed 2025-12-15 04:11:38,809 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:11:38,822 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-12-15 04:11:38,822 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:11:38,840 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-12-15 04:11:38,845 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:11:38,855 - INFO - BGPaaS session seen in control-node 10.20.0.129 2025-12-15 04:11:38,855 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-15 04:11:38,869 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-12-15 04:11:38,874 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 67.102.235.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-15 04:11:38,874 - DEBUG - ping -s 56 -c 3 -W 1 67.102.235.212 2025-12-15 04:11:41,415 - DEBUG - PING 67.102.235.212 (67.102.235.212) 56(84) bytes of data. 64 bytes from 67.102.235.212: icmp_seq=1 ttl=64 time=1.36 ms 64 bytes from 67.102.235.212: icmp_seq=2 ttl=64 time=1.11 ms 64 bytes from 67.102.235.212: icmp_seq=3 ttl=64 time=1.40 ms --- 67.102.235.212 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.112/1.291/1.401/0.131 ms 2025-12-15 04:11:41,415 - INFO - Ping to IP 67.102.235.212 from VM ctest-TestBGPaasZone-19458942-13517136 passed 2025-12-15 04:11:41,415 - INFO - Detaching VMI 38c61c0f-1c51-4ebb-acea-24d830bbac3b from BGPaaS bb7c2002-4ce4-4961-b088-7fb4359e1e19 2025-12-15 04:11:41,491 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-19458942-87570796(bb7c2002-4ce4-4961-b088-7fb4359e1e19) 2025-12-15 04:11:41,543 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/bb7c2002-4ce4-4961-b088-7fb4359e1e19 2025-12-15 04:11:41,576 - DEBUG - Response Code: 404 2025-12-15 04:11:41,576 - DEBUG - BGPaaS: bb7c2002-4ce4-4961-b088-7fb4359e1e19 deleted from api server 2025-12-15 04:11:41,576 - INFO - BGPaaS(bb7c2002-4ce4-4961-b088-7fb4359e1e19): verify_on_cleanup passed 2025-12-15 04:11:41,576 - INFO - Detaching VMI 0fb5dd48-14ab-4902-8c25-150ec0168504 from BGPaaS 9b92fab7-3f18-419e-aa14-489efbe11872 2025-12-15 04:11:41,659 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-19458942-27734476(9b92fab7-3f18-419e-aa14-489efbe11872) 2025-12-15 04:11:41,714 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/9b92fab7-3f18-419e-aa14-489efbe11872 2025-12-15 04:11:41,720 - DEBUG - Response Code: 404 2025-12-15 04:11:41,720 - DEBUG - BGPaaS: 9b92fab7-3f18-419e-aa14-489efbe11872 deleted from api server 2025-12-15 04:11:41,720 - INFO - BGPaaS(9b92fab7-3f18-419e-aa14-489efbe11872): verify_on_cleanup passed 2025-12-15 04:11:41,720 - INFO - Deleting Control node zone ctest-test-zone-34541038(fb376ffa-9587-4ee8-bcf0-d9fcf3e29bb6) 2025-12-15 04:11:41,867 - INFO - Deleting Control node zone ctest-test-zone-37119183(6768987f-045d-479d-93e6-6fca07a61f2b) 2025-12-15 04:11:42,044 - INFO - Deleting Control node zone ctest-test-zone-38251128(33d735d0-1bc1-4b84-b211-256a76bf5150) 2025-12-15 04:11:42,232 - INFO - Deleting VM ctest-TestBGPaasZone-19458942-13517136 2025-12-15 04:11:42,347 - INFO - Deleting VM ctest-TestBGPaasZone-19458942-79577054 2025-12-15 04:11:42,424 - INFO - Deleting VM ctest-TestBGPaasZone-19458942-50508914 2025-12-15 04:11:42,495 - INFO - Deleting VN ctest-cnz_vn-22333563 2025-12-15 04:11:42,537 - DEBUG - VN 705602c2-c44b-473c-b390-b16a442b9281 still in use: Unable to complete operation on network 705602c2-c44b-473c-b390-b16a442b9281. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-7be7570c-0671-45d1-8615-7fde189ad18c'] 2025-12-15 04:11:42,537 - WARNING - Deleting VN ctest-cnz_vn-22333563 failed..Will retry 2025-12-15 04:11:44,733 - DEBUG - Response for deleting network () 2025-12-15 04:11:46,042 - DEBUG - Skipping xmpp flap check 2025-12-15 04:11:46,042 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:46] 2025-12-15 04:11:46,042 - INFO - -------------------------------------------------------------------------------- 2025-12-15 04:11:46,800 - INFO - Deleted project: ctest-TestBGPaasZone-19458942, ID : a49bcefe-82f3-4196-8e18-89cbf64b45ea