2026-03-19 04:10:11,830 - INFO - Domain Default found not creating
2026-03-19 04:10:12,103 - INFO - Project ctest-TestBGPaasZone-63398194 not found, creating it
2026-03-19 04:10:12,680 - INFO - Created Project:ctest-TestBGPaasZone-63398194, ID : 677309a9-c9a1-4221-92a5-5d0f1b99a212
2026-03-19 04:10:14,440 - DEBUG - Services list from nova: [, , , ]
2026-03-19 04:10:14,440 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5493-2', 'an-jenkins-deploy-platform-ansible-os-5493-1']}
2026-03-19 04:10:14,442 - INFO - ================================================================================
2026-03-19 04:10:14,442 - INFO - STARTING TEST : test_bgp_control_node_zone
2026-03-19 04:10:15,709 - DEBUG - Skipping xmpp flap check
2026-03-19 04:10:15,709 - INFO - Initial checks done. Running the testcase now
2026-03-19 04:10:15,709 - INFO -
2026-03-19 04:10:15,709 - INFO - executing bgp_control_zone test
2026-03-19 04:10:16,455 - DEBUG - Response for create_network : {'network': {'id': 'd4c0190d-a8b3-4a2d-ba60-6941c4084a73', 'name': 'ctest-cnz_vn-69725553', 'tenant_id': '677309a9c9a1422192a55d0f1b99a212', 'project_id': '677309a9c9a1422192a55d0f1b99a212', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-63398194', 'ctest-cnz_vn-69725553'], 'port_security_enabled': True, 'description': ''}}
2026-03-19 04:10:16,796 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f7f014b0-a184-4f2d-997d-cf111541bb8b', 'name': '', 'tenant_id': '677309a9c9a1422192a55d0f1b99a212', 'network_id': 'd4c0190d-a8b3-4a2d-ba60-6941c4084a73', 'ip_version': 4, 'cidr': '72.77.37.0/26', 'allocation_pools': [{'start': '72.77.37.2', 'end': '72.77.37.62'}], 'gateway_ip': '72.77.37.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '72.77.37.2', 'tags': [], 'project_id': '677309a9c9a1422192a55d0f1b99a212'}}
2026-03-19 04:10:16,820 - INFO - Created VN ctest-cnz_vn-69725553
2026-03-19 04:10:16,835 - DEBUG - VN ctest-cnz_vn-69725553 UUID is d4c0190d-a8b3-4a2d-ba60-6941c4084a73
2026-03-19 04:10:18,222 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5493-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5493-2)
2026-03-19 04:10:19,861 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5493-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5493-1)
2026-03-19 04:10:21,664 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5493-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5493-2)
2026-03-19 04:10:21,665 - INFO - Waiting for VM ctest-TestBGPaasZone-63398194-15957707 to be up..
2026-03-19 04:10:21,822 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-19 04:10:26,965 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-19 04:10:32,069 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-19 04:10:37,189 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-19 04:10:42,284 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-19 04:10:47,370 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-19 04:10:52,465 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-19 04:10:57,562 - DEBUG - VM is in ACTIVE state now
2026-03-19 04:10:57,562 - INFO - VM name : ctest-TestBGPaasZone-63398194-15957707
2026-03-19 04:10:57,666 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 ID is e1e6303c-6b5f-4d91-b176-68ebdb0ee09d
2026-03-19 04:10:57,694 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 launched on Node an-jenkins-deploy-platform-ansible-os-5493-2
2026-03-19 04:10:57,788 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e1e6303c-6b5f-4d91-b176-68ebdb0ee09d
2026-03-19 04:10:58,128 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e1e6303c-6b5f-4d91-b176-68ebdb0ee09d
2026-03-19 04:10:58,171 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/815eac0d-7449-42f6-ba3f-e3da21b149a1
2026-03-19 04:11:01,342 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2026-03-19 04:11:01,343 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:01,359 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:05,447 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-03-19 04:11:05,447 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:05,462 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:09,543 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-03-19 04:11:09,543 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:09,565 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:13,637 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1001ms')
2026-03-19 04:11:13,637 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:13,655 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:17,727 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2026-03-19 04:11:17,727 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:17,742 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:21,827 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2026-03-19 04:11:21,827 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:21,843 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:25,918 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2026-03-19 04:11:25,918 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:25,932 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:30,014 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2026-03-19 04:11:30,014 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:30,029 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:34,116 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms')
2026-03-19 04:11:34,116 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:34,131 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:38,206 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2026-03-19 04:11:38,206 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:38,224 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:42,313 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2026-03-19 04:11:42,313 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:42,327 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:46,408 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2026-03-19 04:11:46,408 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:46,426 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:50,498 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2026-03-19 04:11:50,498 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:50,512 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:54,599 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms')
2026-03-19 04:11:54,599 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:54,614 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:11:58,688 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2026-03-19 04:11:58,688 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:11:58,703 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:12:02,787 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2026-03-19 04:12:02,787 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:12:02,803 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:12:06,880 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-03-19 04:12:06,880 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:12:06,894 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:12:10,977 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2026-03-19 04:12:10,978 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:12:10,995 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:12:15,078 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2026-03-19 04:12:15,078 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 failed!
2026-03-19 04:12:15,096 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-69725553 is 72.77.37.1 and allocation pool is NOT set
2026-03-19 04:12:19,166 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=5.00 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1012ms\r\nrtt min/avg/max/mdev = 5.002/5.002/5.002/0.000 ms')
2026-03-19 04:12:19,166 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-15957707 passed
2026-03-19 04:12:19,240 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:12:19,240 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-15957707, IP 72.77.37.3, Port 22
2026-03-19 04:12:19,308 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:12:19,527 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:12:24,527 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:12:24,527 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-15957707, IP 72.77.37.3, Port 22
2026-03-19 04:12:24,605 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:12:24,710 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:12:29,711 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:12:29,711 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-15957707, IP 72.77.37.3, Port 22
2026-03-19 04:12:29,768 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:12:29,869 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:12:34,870 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:12:34,870 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-15957707, IP 72.77.37.3, Port 22
2026-03-19 04:12:34,939 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:12:35,046 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:12:40,047 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:12:40,048 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-15957707, IP 72.77.37.3, Port 22
2026-03-19 04:12:40,115 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:12:40,216 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:12:45,218 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:12:45,218 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-15957707, IP 72.77.37.3, Port 22
2026-03-19 04:12:45,286 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:12:45,382 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:12:50,383 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:12:50,383 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-15957707, IP 72.77.37.3, Port 22
2026-03-19 04:12:50,452 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:12:50,543 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:12:55,543 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:12:55,544 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-15957707, IP 72.77.37.3, Port 22
2026-03-19 04:12:55,611 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:12:55,709 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:13:00,710 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:13:00,710 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-15957707, IP 72.77.37.3, Port 22
2026-03-19 04:13:00,779 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:13:00,885 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:13:05,886 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:13:05,886 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-15957707, IP 72.77.37.3, Port 22
2026-03-19 04:13:05,955 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:13:06,046 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:13:11,047 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:13:11,048 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-15957707, IP 72.77.37.3, Port 22
2026-03-19 04:13:11,222 - DEBUG - VM ctest-TestBGPaasZone-63398194-15957707 is ready for SSH connections
2026-03-19 04:13:11,222 - INFO - Waiting for VM ctest-TestBGPaasZone-63398194-45197596 to be up..
2026-03-19 04:13:11,333 - DEBUG - VM is in ACTIVE state now
2026-03-19 04:13:11,333 - INFO - VM name : ctest-TestBGPaasZone-63398194-45197596
2026-03-19 04:13:11,427 - DEBUG - VM ctest-TestBGPaasZone-63398194-45197596 ID is c9e89fde-d138-4015-98a8-32ab3665a1b6
2026-03-19 04:13:11,427 - DEBUG - VM ctest-TestBGPaasZone-63398194-45197596 launched on Node an-jenkins-deploy-platform-ansible-os-5493-1
2026-03-19 04:13:11,528 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/c9e89fde-d138-4015-98a8-32ab3665a1b6
2026-03-19 04:13:11,541 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/1df47e90-765a-4629-92ea-fc66f3b304e6
2026-03-19 04:13:12,697 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.46 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.528 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.528/2.495/4.462/1.967 ms')
2026-03-19 04:13:12,697 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-45197596 passed
2026-03-19 04:13:12,768 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:13:12,768 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-45197596, IP 72.77.37.4, Port 22
2026-03-19 04:13:12,931 - DEBUG - VM ctest-TestBGPaasZone-63398194-45197596 is ready for SSH connections
2026-03-19 04:13:12,931 - INFO - Waiting for VM ctest-TestBGPaasZone-63398194-16118662 to be up..
2026-03-19 04:13:13,041 - DEBUG - VM is in ACTIVE state now
2026-03-19 04:13:13,042 - INFO - VM name : ctest-TestBGPaasZone-63398194-16118662
2026-03-19 04:13:13,150 - DEBUG - VM ctest-TestBGPaasZone-63398194-16118662 ID is cb7f7b12-7e14-4c5c-99d3-ea2c35801486
2026-03-19 04:13:13,150 - DEBUG - VM ctest-TestBGPaasZone-63398194-16118662 launched on Node an-jenkins-deploy-platform-ansible-os-5493-2
2026-03-19 04:13:13,255 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/cb7f7b12-7e14-4c5c-99d3-ea2c35801486
2026-03-19 04:13:13,266 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/117b7b61-e687-4943-bf31-cce504773b92
2026-03-19 04:13:14,448 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.36 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.56 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.558/2.459/3.360/0.901 ms')
2026-03-19 04:13:14,448 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-63398194-16118662 passed
2026-03-19 04:13:14,517 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:13:14,517 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-16118662, IP 72.77.37.5, Port 22
2026-03-19 04:13:14,691 - DEBUG - VM ctest-TestBGPaasZone-63398194-16118662 is ready for SSH connections
2026-03-19 04:13:14,846 - INFO - Created control node zone ctest-test-zone-88196503(7a2c28a4-4577-49ce-b05c-24486d20eb1f)
2026-03-19 04:13:15,206 - INFO - Created control node zone ctest-test-zone-96585275(2f3bcd5b-ba68-442e-b8f8-22e8d3c8fa78)
2026-03-19 04:13:15,562 - INFO - Created control node zone ctest-test-zone-95134312(0750773c-c290-451b-835c-435b5651df92)
2026-03-19 04:13:15,850 - INFO - Creating BGPaaS ctest-TestBGPaasZone-63398194-48347526
2026-03-19 04:13:15,930 - INFO - BGPaaS: ctest-TestBGPaasZone-63398194-48347526(525a790f-f60e-4dcc-8895-3ba339444c07)
2026-03-19 04:13:15,930 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/525a790f-f60e-4dcc-8895-3ba339444c07
2026-03-19 04:13:16,241 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/525a790f-f60e-4dcc-8895-3ba339444c07
2026-03-19 04:13:16,283 - INFO - verify_in_api_server passed for BGPaaS obj 525a790f-f60e-4dcc-8895-3ba339444c07
2026-03-19 04:13:16,283 - INFO - BGPaaS(525a790f-f60e-4dcc-8895-3ba339444c07): verify_on_setup passed
2026-03-19 04:13:16,283 - INFO - We will configure BGP on the VM
2026-03-19 04:13:16,562 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:13:16,562 - INFO - Configuring BGP on ctest-TestBGPaasZone-63398194-15957707
2026-03-19 04:13:16,562 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.3;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.3;
}
protocol bfd {
neighbor 72.77.37.1 local 72.77.37.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:13:16,563 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.3;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.3;
}
protocol bfd {
neighbor 72.77.37.1 local 72.77.37.3 multihop on;
}
EOS
2026-03-19 04:13:32,674 - DEBUG - None
2026-03-19 04:13:32,675 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.3;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.3;
}
protocol bfd {
neighbor 72.77.37.1 local 72.77.37.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:13:32,675 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.3;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.3;
}
protocol bfd {
neighbor 72.77.37.1 local 72.77.37.3 multihop on;
}
EOS
2026-03-19 04:13:33,798 - DEBUG - None
2026-03-19 04:13:33,798 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:13:33,798 - DEBUG - service bird restart
2026-03-19 04:13:37,299 - DEBUG - bird stop/waiting
bird start/running, process 1441
2026-03-19 04:13:37,299 - INFO - Attaching VMI 815eac0d-7449-42f6-ba3f-e3da21b149a1 to BGPaaS 525a790f-f60e-4dcc-8895-3ba339444c07
2026-03-19 04:13:37,374 - INFO - Attaching the VMI e1e6303c-6b5f-4d91-b176-68ebdb0ee09d to the BGPaaS 525a790f-f60e-4dcc-8895-3ba339444c07 object
2026-03-19 04:13:37,375 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 72.77.37.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:13:37,375 - DEBUG - sudo ip addr add 72.77.37.20 dev eth0
2026-03-19 04:13:38,189 - DEBUG - None
2026-03-19 04:13:38,250 - INFO - Creating BGPaaS ctest-TestBGPaasZone-63398194-10931225
2026-03-19 04:13:38,326 - INFO - BGPaaS: ctest-TestBGPaasZone-63398194-10931225(4d29c176-aafe-417a-bdd6-5e2aa011576d)
2026-03-19 04:13:38,327 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/4d29c176-aafe-417a-bdd6-5e2aa011576d
2026-03-19 04:13:38,337 - INFO - verify_in_api_server passed for BGPaaS obj 4d29c176-aafe-417a-bdd6-5e2aa011576d
2026-03-19 04:13:38,337 - INFO - BGPaaS(4d29c176-aafe-417a-bdd6-5e2aa011576d): verify_on_setup passed
2026-03-19 04:13:38,337 - INFO - We will configure BGP on the VM
2026-03-19 04:13:38,586 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:13:38,586 - INFO - Configuring BGP on ctest-TestBGPaasZone-63398194-45197596
2026-03-19 04:13:38,586 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.4;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.4;
}
protocol bfd {
neighbor 72.77.37.2 local 72.77.37.4 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:13:38,586 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.4;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.4;
}
protocol bfd {
neighbor 72.77.37.2 local 72.77.37.4 multihop on;
}
EOS
2026-03-19 04:13:45,108 - DEBUG - None
2026-03-19 04:13:45,108 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.4;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.4;
}
protocol bfd {
neighbor 72.77.37.2 local 72.77.37.4 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:13:45,108 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.4;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.4;
}
protocol bfd {
neighbor 72.77.37.2 local 72.77.37.4 multihop on;
}
EOS
2026-03-19 04:13:45,618 - DEBUG - None
2026-03-19 04:13:45,618 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:13:45,618 - DEBUG - service bird restart
2026-03-19 04:13:47,561 - DEBUG - bird stop/waiting
bird start/running, process 1435
2026-03-19 04:13:47,562 - INFO - Attaching VMI 1df47e90-765a-4629-92ea-fc66f3b304e6 to BGPaaS 4d29c176-aafe-417a-bdd6-5e2aa011576d
2026-03-19 04:13:47,638 - INFO - Attaching the VMI c9e89fde-d138-4015-98a8-32ab3665a1b6 to the BGPaaS 4d29c176-aafe-417a-bdd6-5e2aa011576d object
2026-03-19 04:13:47,639 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 72.77.37.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:13:47,639 - DEBUG - sudo ip addr add 72.77.37.20 dev eth0
2026-03-19 04:13:48,331 - DEBUG - None
2026-03-19 04:13:48,331 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:13:48,331 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-19 04:13:48,356 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-03-19 04:13:48,364 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:13:48,380 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129']
2026-03-19 04:13:54,397 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.129']
2026-03-19 04:14:00,414 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-03-19 04:14:00,420 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 72.77.37.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:14:00,421 - DEBUG - ping -s 56 -c 3 -W 1 72.77.37.20
2026-03-19 04:14:07,056 - DEBUG - PING 72.77.37.20 (72.77.37.20) 56(84) bytes of data.
64 bytes from 72.77.37.20: icmp_seq=1 ttl=64 time=10.4 ms
64 bytes from 72.77.37.20: icmp_seq=2 ttl=64 time=1.67 ms
64 bytes from 72.77.37.20: icmp_seq=3 ttl=64 time=1.46 ms
--- 72.77.37.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.465/4.528/10.444/4.184 ms
2026-03-19 04:14:07,057 - INFO - Ping to IP 72.77.37.20 from VM ctest-TestBGPaasZone-63398194-16118662 passed
2026-03-19 04:14:07,890 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:14:07,890 - DEBUG - service bird restart
2026-03-19 04:14:09,607 - DEBUG - bird stop/waiting
bird start/running, process 1469
2026-03-19 04:14:09,607 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:14:09,607 - DEBUG - service bird restart
2026-03-19 04:14:11,411 - DEBUG - bird stop/waiting
bird start/running, process 1462
2026-03-19 04:14:11,412 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:14:16,452 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18']
2026-03-19 04:14:22,470 - INFO - BGPaaS session seen in control-node 10.20.0.18
2026-03-19 04:14:22,477 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:14:22,495 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-03-19 04:14:22,501 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 72.77.37.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:14:22,501 - DEBUG - ping -s 56 -c 3 -W 1 72.77.37.20
2026-03-19 04:14:25,008 - DEBUG - PING 72.77.37.20 (72.77.37.20) 56(84) bytes of data.
64 bytes from 72.77.37.20: icmp_seq=1 ttl=64 time=4.54 ms
64 bytes from 72.77.37.20: icmp_seq=2 ttl=64 time=1.17 ms
64 bytes from 72.77.37.20: icmp_seq=3 ttl=64 time=1.59 ms
--- 72.77.37.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.171/2.437/4.543/1.499 ms
2026-03-19 04:14:25,008 - INFO - Ping to IP 72.77.37.20 from VM ctest-TestBGPaasZone-63398194-16118662 passed
2026-03-19 04:14:25,318 - INFO - We will configure BGP on the VM
2026-03-19 04:14:25,558 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:14:25,558 - INFO - Configuring BGP on ctest-TestBGPaasZone-63398194-15957707
2026-03-19 04:14:25,559 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.3;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.3;
}
protocol bfd {
neighbor 72.77.37.1 local 72.77.37.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:14:25,559 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.3;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.3;
}
protocol bfd {
neighbor 72.77.37.1 local 72.77.37.3 multihop on;
}
EOS
2026-03-19 04:14:26,028 - DEBUG - None
2026-03-19 04:14:26,029 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.3;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.3;
}
protocol bfd {
neighbor 72.77.37.1 local 72.77.37.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:14:26,029 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 72.77.37.3;
protocol bgp bgp_1{
local as 65000;
neighbor 72.77.37.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 72.77.37.3;
}
protocol bfd {
neighbor 72.77.37.1 local 72.77.37.3 multihop on;
}
EOS
2026-03-19 04:14:26,550 - DEBUG - None
2026-03-19 04:14:26,550 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:14:26,550 - DEBUG - service bird restart
2026-03-19 04:14:28,305 - DEBUG - bird stop/waiting
bird start/running, process 1501
2026-03-19 04:14:28,305 - INFO - Attaching VMI 815eac0d-7449-42f6-ba3f-e3da21b149a1 to BGPaaS 525a790f-f60e-4dcc-8895-3ba339444c07
2026-03-19 04:14:28,325 - INFO - Attaching the VMI e1e6303c-6b5f-4d91-b176-68ebdb0ee09d to the BGPaaS 525a790f-f60e-4dcc-8895-3ba339444c07 object
2026-03-19 04:14:28,325 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 72.77.37.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:14:28,325 - DEBUG - sudo ip addr add 72.77.37.20 dev eth0
2026-03-19 04:14:29,044 - DEBUG - RTNETLINK answers: File exists
2026-03-19 04:14:29,044 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:14:29,044 - DEBUG - service bird restart
2026-03-19 04:14:30,738 - DEBUG - bird stop/waiting
bird start/running, process 1528
2026-03-19 04:14:30,738 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:14:30,738 - DEBUG - service bird restart
2026-03-19 04:14:32,504 - DEBUG - bird stop/waiting
bird start/running, process 1484
2026-03-19 04:14:32,504 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:14:32,505 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-19 04:14:32,517 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193']
2026-03-19 04:14:38,521 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-19 04:14:38,534 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-03-19 04:14:38,540 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:14:38,573 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-03-19 04:14:38,581 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 72.77.37.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:14:38,581 - DEBUG - ping -s 56 -c 3 -W 1 72.77.37.20
2026-03-19 04:14:41,078 - DEBUG - PING 72.77.37.20 (72.77.37.20) 56(84) bytes of data.
64 bytes from 72.77.37.20: icmp_seq=1 ttl=64 time=4.99 ms
64 bytes from 72.77.37.20: icmp_seq=2 ttl=64 time=1.26 ms
64 bytes from 72.77.37.20: icmp_seq=3 ttl=64 time=1.24 ms
--- 72.77.37.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.246/2.502/4.999/1.766 ms
2026-03-19 04:14:41,078 - INFO - Ping to IP 72.77.37.20 from VM ctest-TestBGPaasZone-63398194-16118662 passed
2026-03-19 04:14:41,078 - INFO - Detaching VMI 815eac0d-7449-42f6-ba3f-e3da21b149a1 from BGPaaS 525a790f-f60e-4dcc-8895-3ba339444c07
2026-03-19 04:14:41,154 - INFO - Detaching VMI 1df47e90-765a-4629-92ea-fc66f3b304e6 from BGPaaS 4d29c176-aafe-417a-bdd6-5e2aa011576d
2026-03-19 04:14:41,254 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-63398194-10931225(4d29c176-aafe-417a-bdd6-5e2aa011576d)
2026-03-19 04:14:41,322 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/4d29c176-aafe-417a-bdd6-5e2aa011576d
2026-03-19 04:14:41,328 - DEBUG - Response Code: 404
2026-03-19 04:14:41,328 - DEBUG - BGPaaS: 4d29c176-aafe-417a-bdd6-5e2aa011576d deleted from api server
2026-03-19 04:14:41,328 - INFO - BGPaaS(4d29c176-aafe-417a-bdd6-5e2aa011576d): verify_on_cleanup passed
2026-03-19 04:14:41,329 - INFO - Detaching VMI 815eac0d-7449-42f6-ba3f-e3da21b149a1 from BGPaaS 525a790f-f60e-4dcc-8895-3ba339444c07
2026-03-19 04:14:41,368 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-63398194-48347526(525a790f-f60e-4dcc-8895-3ba339444c07)
2026-03-19 04:14:41,439 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/525a790f-f60e-4dcc-8895-3ba339444c07
2026-03-19 04:14:41,445 - DEBUG - Response Code: 404
2026-03-19 04:14:41,446 - DEBUG - BGPaaS: 525a790f-f60e-4dcc-8895-3ba339444c07 deleted from api server
2026-03-19 04:14:41,446 - INFO - BGPaaS(525a790f-f60e-4dcc-8895-3ba339444c07): verify_on_cleanup passed
2026-03-19 04:14:41,446 - INFO - Deleting Control node zone ctest-test-zone-95134312(0750773c-c290-451b-835c-435b5651df92)
2026-03-19 04:14:41,601 - INFO - Deleting Control node zone ctest-test-zone-96585275(2f3bcd5b-ba68-442e-b8f8-22e8d3c8fa78)
2026-03-19 04:14:41,744 - INFO - Deleting Control node zone ctest-test-zone-88196503(7a2c28a4-4577-49ce-b05c-24486d20eb1f)
2026-03-19 04:14:41,830 - INFO - Deleting VM ctest-TestBGPaasZone-63398194-16118662
2026-03-19 04:14:41,920 - INFO - Deleting VM ctest-TestBGPaasZone-63398194-45197596
2026-03-19 04:14:42,011 - INFO - Deleting VM ctest-TestBGPaasZone-63398194-15957707
2026-03-19 04:14:42,097 - INFO - Deleting VN ctest-cnz_vn-69725553
2026-03-19 04:14:42,148 - DEBUG - VN d4c0190d-a8b3-4a2d-ba60-6941c4084a73 still in use: Unable to complete operation on network d4c0190d-a8b3-4a2d-ba60-6941c4084a73. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-bfdf6dd5-c300-4b78-8b17-a962a832a637']
2026-03-19 04:14:42,148 - WARNING - Deleting VN ctest-cnz_vn-69725553 failed..Will retry
2026-03-19 04:14:44,421 - DEBUG - Response for deleting network ()
2026-03-19 04:14:45,669 - DEBUG - Skipping xmpp flap check
2026-03-19 04:14:45,669 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:31]
2026-03-19 04:14:45,669 - INFO - --------------------------------------------------------------------------------
2026-03-19 04:14:45,675 - INFO - ================================================================================
2026-03-19 04:14:45,675 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf
2026-03-19 04:14:46,940 - DEBUG - Skipping xmpp flap check
2026-03-19 04:14:46,940 - INFO - Initial checks done. Running the testcase now
2026-03-19 04:14:46,940 - INFO -
2026-03-19 04:14:46,940 - INFO - executing bgp_control_zone agent restart test
2026-03-19 04:14:47,231 - DEBUG - Response for create_network : {'network': {'id': 'ea7fd6ad-93f1-4dda-8ec4-2f2fa22ee426', 'name': 'ctest-cnz_vn-25840136', 'tenant_id': '677309a9c9a1422192a55d0f1b99a212', 'project_id': '677309a9c9a1422192a55d0f1b99a212', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-63398194', 'ctest-cnz_vn-25840136'], 'port_security_enabled': True, 'description': ''}}
2026-03-19 04:14:47,513 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f1cd36bc-0ead-42f0-9fc7-421aefb9b89b', 'name': '', 'tenant_id': '677309a9c9a1422192a55d0f1b99a212', 'network_id': 'ea7fd6ad-93f1-4dda-8ec4-2f2fa22ee426', 'ip_version': 4, 'cidr': '197.104.205.64/26', 'allocation_pools': [{'start': '197.104.205.66', 'end': '197.104.205.126'}], 'gateway_ip': '197.104.205.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '197.104.205.66', 'tags': [], 'project_id': '677309a9c9a1422192a55d0f1b99a212'}}
2026-03-19 04:14:47,537 - INFO - Created VN ctest-cnz_vn-25840136
2026-03-19 04:14:47,552 - DEBUG - VN ctest-cnz_vn-25840136 UUID is ea7fd6ad-93f1-4dda-8ec4-2f2fa22ee426
2026-03-19 04:14:48,876 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5493-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5493-1)
2026-03-19 04:14:50,419 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5493-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5493-2)
2026-03-19 04:14:51,936 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5493-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5493-1)
2026-03-19 04:14:51,936 - INFO - Waiting for VM ctest-TestBGPaasZone-63398194-29421161 to be up..
2026-03-19 04:14:52,036 - DEBUG - VM is in ACTIVE state now
2026-03-19 04:14:52,037 - INFO - VM name : ctest-TestBGPaasZone-63398194-29421161
2026-03-19 04:14:52,149 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 ID is 5ed1f198-5655-4373-b899-dfd8c899145b
2026-03-19 04:14:52,150 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 launched on Node an-jenkins-deploy-platform-ansible-os-5493-1
2026-03-19 04:14:52,252 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/5ed1f198-5655-4373-b899-dfd8c899145b
2026-03-19 04:14:52,268 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/8e4dd2b0-932e-490d-b84c-c35ffa21b550
2026-03-19 04:14:55,523 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2026-03-19 04:14:55,523 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:14:55,536 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:14:59,629 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms')
2026-03-19 04:14:59,629 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:14:59,646 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:03,723 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2026-03-19 04:15:03,724 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:03,740 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:07,814 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms')
2026-03-19 04:15:07,814 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:07,828 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:11,909 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-03-19 04:15:11,909 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:11,926 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:16,011 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2026-03-19 04:15:16,011 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:16,063 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:20,137 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms')
2026-03-19 04:15:20,137 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:20,151 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:24,232 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2026-03-19 04:15:24,232 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:24,247 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:28,328 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2026-03-19 04:15:28,328 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:28,344 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:32,422 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2026-03-19 04:15:32,422 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:32,437 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:36,525 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-03-19 04:15:36,525 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:36,540 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:40,611 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2026-03-19 04:15:40,611 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:40,627 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:44,711 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2026-03-19 04:15:44,711 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:44,727 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:48,810 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2026-03-19 04:15:48,810 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:48,826 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:52,898 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2026-03-19 04:15:52,898 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:52,913 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:15:56,998 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms')
2026-03-19 04:15:56,998 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:15:57,016 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:16:01,093 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms')
2026-03-19 04:16:01,093 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:16:01,112 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:16:05,190 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2026-03-19 04:16:05,190 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:16:05,203 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:16:09,286 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-03-19 04:16:09,287 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 failed!
2026-03-19 04:16:09,300 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-63398194:ctest-cnz_vn-25840136 is 197.104.205.65 and allocation pool is NOT set
2026-03-19 04:16:11,364 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.35 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.14 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.137/2.742/4.347/1.605 ms')
2026-03-19 04:16:11,364 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-29421161 passed
2026-03-19 04:16:11,431 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:16:11,432 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:16:11,498 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:16:11,681 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:16:16,682 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:16:16,682 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:16:16,760 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:16:16,894 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:16:21,895 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:16:21,895 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:16:21,954 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:16:22,067 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:16:27,069 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:16:27,069 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:16:27,137 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:16:27,237 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:16:32,238 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:16:32,238 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:16:32,295 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:16:32,404 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:16:37,405 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:16:37,405 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:16:37,473 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:16:37,559 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:16:42,560 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:16:42,560 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:16:42,629 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:16:42,755 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:16:47,756 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:16:47,756 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:16:47,822 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:16:47,934 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:16:52,935 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:16:52,935 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:16:53,002 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:16:53,107 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:16:58,108 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:16:58,108 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:16:58,173 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:16:58,275 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:17:03,276 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:03,276 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:17:03,346 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 04:17:03,457 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 04:17:08,458 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:08,458 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-29421161, IP 197.104.205.67, Port 22
2026-03-19 04:17:08,625 - DEBUG - VM ctest-TestBGPaasZone-63398194-29421161 is ready for SSH connections
2026-03-19 04:17:08,625 - INFO - Waiting for VM ctest-TestBGPaasZone-63398194-34536730 to be up..
2026-03-19 04:17:08,724 - DEBUG - VM is in ACTIVE state now
2026-03-19 04:17:08,724 - INFO - VM name : ctest-TestBGPaasZone-63398194-34536730
2026-03-19 04:17:08,811 - DEBUG - VM ctest-TestBGPaasZone-63398194-34536730 ID is d242405f-1729-4b2b-98fb-3514607387b2
2026-03-19 04:17:08,811 - DEBUG - VM ctest-TestBGPaasZone-63398194-34536730 launched on Node an-jenkins-deploy-platform-ansible-os-5493-2
2026-03-19 04:17:08,903 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/d242405f-1729-4b2b-98fb-3514607387b2
2026-03-19 04:17:08,944 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/95ecd313-8106-4e83-98cd-f77e066361fb
2026-03-19 04:17:10,104 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.51 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.527 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.527/2.520/4.514/1.993 ms')
2026-03-19 04:17:10,104 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-63398194-34536730 passed
2026-03-19 04:17:10,175 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:10,176 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-34536730, IP 197.104.205.68, Port 22
2026-03-19 04:17:10,351 - DEBUG - VM ctest-TestBGPaasZone-63398194-34536730 is ready for SSH connections
2026-03-19 04:17:10,351 - INFO - Waiting for VM ctest-TestBGPaasZone-63398194-24638501 to be up..
2026-03-19 04:17:10,453 - DEBUG - VM is in ACTIVE state now
2026-03-19 04:17:10,453 - INFO - VM name : ctest-TestBGPaasZone-63398194-24638501
2026-03-19 04:17:10,543 - DEBUG - VM ctest-TestBGPaasZone-63398194-24638501 ID is d5ee0ee3-9a93-4e5e-a8a7-ef0d139c7347
2026-03-19 04:17:10,543 - DEBUG - VM ctest-TestBGPaasZone-63398194-24638501 launched on Node an-jenkins-deploy-platform-ansible-os-5493-1
2026-03-19 04:17:10,656 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/d5ee0ee3-9a93-4e5e-a8a7-ef0d139c7347
2026-03-19 04:17:10,668 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/647630be-b71b-4076-9ce3-6a48e59dd7e1
2026-03-19 04:17:11,828 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.70 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=3.32 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.324/4.009/4.695/0.685 ms')
2026-03-19 04:17:11,829 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-63398194-24638501 passed
2026-03-19 04:17:11,899 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:11,899 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-63398194-24638501, IP 197.104.205.69, Port 22
2026-03-19 04:17:12,065 - DEBUG - VM ctest-TestBGPaasZone-63398194-24638501 is ready for SSH connections
2026-03-19 04:17:12,202 - INFO - Created control node zone ctest-test-zone-80187155(e1e934cb-e3fb-4d0b-8948-e103b9b54267)
2026-03-19 04:17:12,550 - INFO - Created control node zone ctest-test-zone-47651191(900d4db7-6bf0-4894-b82b-0bd5895d300c)
2026-03-19 04:17:12,906 - INFO - Created control node zone ctest-test-zone-14029297(62016b94-ea5d-481b-b3d2-0952902eb5ba)
2026-03-19 04:17:13,186 - INFO - Creating BGPaaS ctest-TestBGPaasZone-63398194-93762862
2026-03-19 04:17:13,266 - INFO - BGPaaS: ctest-TestBGPaasZone-63398194-93762862(cba38c4e-5852-45bd-bdef-74cac3ded526)
2026-03-19 04:17:13,267 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/cba38c4e-5852-45bd-bdef-74cac3ded526
2026-03-19 04:17:13,285 - INFO - verify_in_api_server passed for BGPaaS obj cba38c4e-5852-45bd-bdef-74cac3ded526
2026-03-19 04:17:13,285 - INFO - BGPaaS(cba38c4e-5852-45bd-bdef-74cac3ded526): verify_on_setup passed
2026-03-19 04:17:13,285 - INFO - We will configure BGP on the VM
2026-03-19 04:17:13,730 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:13,731 - INFO - Configuring BGP on ctest-TestBGPaasZone-63398194-29421161
2026-03-19 04:17:13,731 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 197.104.205.67;
protocol bgp bgp_1{
local as 65000;
neighbor 197.104.205.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 197.104.205.67;
}
protocol bfd {
neighbor 197.104.205.65 local 197.104.205.67 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:17:13,731 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 197.104.205.67;
protocol bgp bgp_1{
local as 65000;
neighbor 197.104.205.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 197.104.205.67;
}
protocol bfd {
neighbor 197.104.205.65 local 197.104.205.67 multihop on;
}
EOS
2026-03-19 04:17:26,714 - DEBUG - None
2026-03-19 04:17:26,714 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 197.104.205.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 197.104.205.67;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:17:26,714 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 197.104.205.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 197.104.205.67;
}
EOS
2026-03-19 04:17:27,766 - DEBUG - None
2026-03-19 04:17:27,766 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:17:27,766 - DEBUG - service bird restart
2026-03-19 04:17:29,963 - DEBUG - bird stop/waiting
bird start/running, process 1441
2026-03-19 04:17:29,963 - INFO - Attaching VMI 8e4dd2b0-932e-490d-b84c-c35ffa21b550 to BGPaaS cba38c4e-5852-45bd-bdef-74cac3ded526
2026-03-19 04:17:30,042 - INFO - Attaching the VMI 5ed1f198-5655-4373-b899-dfd8c899145b to the BGPaaS cba38c4e-5852-45bd-bdef-74cac3ded526 object
2026-03-19 04:17:30,042 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 197.104.205.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:17:30,042 - DEBUG - sudo ip addr add 197.104.205.84 dev eth0
2026-03-19 04:17:30,691 - DEBUG - None
2026-03-19 04:17:30,754 - INFO - Creating BGPaaS ctest-TestBGPaasZone-63398194-31993066
2026-03-19 04:17:30,830 - INFO - BGPaaS: ctest-TestBGPaasZone-63398194-31993066(a89781fd-56af-4c86-b415-107103a7f00c)
2026-03-19 04:17:30,830 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/a89781fd-56af-4c86-b415-107103a7f00c
2026-03-19 04:17:30,843 - INFO - verify_in_api_server passed for BGPaaS obj a89781fd-56af-4c86-b415-107103a7f00c
2026-03-19 04:17:30,843 - INFO - BGPaaS(a89781fd-56af-4c86-b415-107103a7f00c): verify_on_setup passed
2026-03-19 04:17:30,843 - INFO - We will configure BGP on the VM
2026-03-19 04:17:31,266 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:31,266 - INFO - Configuring BGP on ctest-TestBGPaasZone-63398194-34536730
2026-03-19 04:17:31,266 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 197.104.205.68;
protocol bgp bgp_1{
local as 65000;
neighbor 197.104.205.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 197.104.205.68;
}
protocol bfd {
neighbor 197.104.205.65 local 197.104.205.68 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:17:31,266 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 197.104.205.68;
protocol bgp bgp_1{
local as 65000;
neighbor 197.104.205.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 197.104.205.68;
}
protocol bfd {
neighbor 197.104.205.65 local 197.104.205.68 multihop on;
}
EOS
2026-03-19 04:17:36,981 - DEBUG - None
2026-03-19 04:17:36,981 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 197.104.205.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 197.104.205.68;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:17:36,981 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 197.104.205.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 197.104.205.68;
}
EOS
2026-03-19 04:17:37,495 - DEBUG - None
2026-03-19 04:17:37,495 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:17:37,495 - DEBUG - service bird restart
2026-03-19 04:17:39,296 - DEBUG - bird stop/waiting
bird start/running, process 1444
2026-03-19 04:17:39,296 - INFO - Attaching VMI 95ecd313-8106-4e83-98cd-f77e066361fb to BGPaaS a89781fd-56af-4c86-b415-107103a7f00c
2026-03-19 04:17:39,374 - INFO - Attaching the VMI d242405f-1729-4b2b-98fb-3514607387b2 to the BGPaaS a89781fd-56af-4c86-b415-107103a7f00c object
2026-03-19 04:17:39,374 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 197.104.205.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-19 04:17:39,374 - DEBUG - sudo ip addr add 197.104.205.84 dev eth0
2026-03-19 04:17:40,152 - DEBUG - None
2026-03-19 04:17:40,152 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:40,152 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-19 04:17:40,167 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-03-19 04:17:40,167 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:40,185 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-03-19 04:17:40,193 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:40,193 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-19 04:17:40,208 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193']
2026-03-19 04:17:46,210 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-19 04:17:46,226 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193']
2026-03-19 04:17:52,227 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-19 04:17:52,242 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-03-19 04:17:52,243 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:52,261 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-03-19 04:17:52,269 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 197.104.205.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:17:52,269 - DEBUG - ping -s 56 -c 3 -W 1 197.104.205.84
2026-03-19 04:17:58,758 - DEBUG - PING 197.104.205.84 (197.104.205.84) 56(84) bytes of data.
64 bytes from 197.104.205.84: icmp_seq=1 ttl=64 time=7.58 ms
64 bytes from 197.104.205.84: icmp_seq=2 ttl=64 time=0.989 ms
64 bytes from 197.104.205.84: icmp_seq=3 ttl=64 time=1.01 ms
--- 197.104.205.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 0.989/3.194/7.580/3.101 ms
2026-03-19 04:17:58,758 - INFO - Ping to IP 197.104.205.84 from VM ctest-TestBGPaasZone-63398194-24638501 passed
2026-03-19 04:17:58,759 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:58,759 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-19 04:17:58,784 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-03-19 04:17:58,784 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:58,800 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-03-19 04:17:58,810 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:58,810 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-19 04:17:58,829 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-03-19 04:17:58,829 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 04:17:58,846 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-03-19 04:17:58,856 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 197.104.205.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-03-19 04:17:58,857 - DEBUG - ping -s 56 -c 3 -W 1 197.104.205.84
2026-03-19 04:18:01,379 - DEBUG - PING 197.104.205.84 (197.104.205.84) 56(84) bytes of data.
64 bytes from 197.104.205.84: icmp_seq=1 ttl=64 time=7.57 ms
64 bytes from 197.104.205.84: icmp_seq=2 ttl=64 time=1.54 ms
64 bytes from 197.104.205.84: icmp_seq=3 ttl=64 time=1.55 ms
--- 197.104.205.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.541/3.556/7.576/2.842 ms
2026-03-19 04:18:01,379 - INFO - Ping to IP 197.104.205.84 from VM ctest-TestBGPaasZone-63398194-24638501 passed
2026-03-19 04:18:01,379 - INFO - Detaching VMI 95ecd313-8106-4e83-98cd-f77e066361fb from BGPaaS a89781fd-56af-4c86-b415-107103a7f00c
2026-03-19 04:18:01,466 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-63398194-31993066(a89781fd-56af-4c86-b415-107103a7f00c)
2026-03-19 04:18:01,550 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/a89781fd-56af-4c86-b415-107103a7f00c
2026-03-19 04:18:01,560 - DEBUG - Response Code: 404
2026-03-19 04:18:01,561 - DEBUG - BGPaaS: a89781fd-56af-4c86-b415-107103a7f00c deleted from api server
2026-03-19 04:18:01,561 - INFO - BGPaaS(a89781fd-56af-4c86-b415-107103a7f00c): verify_on_cleanup passed
2026-03-19 04:18:01,561 - INFO - Detaching VMI 8e4dd2b0-932e-490d-b84c-c35ffa21b550 from BGPaaS cba38c4e-5852-45bd-bdef-74cac3ded526
2026-03-19 04:18:01,682 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-63398194-93762862(cba38c4e-5852-45bd-bdef-74cac3ded526)
2026-03-19 04:18:01,764 - DEBUG - Requesting: http://10.0.0.41:8082/bgp-as-a-service/cba38c4e-5852-45bd-bdef-74cac3ded526
2026-03-19 04:18:01,775 - DEBUG - Response Code: 404
2026-03-19 04:18:01,775 - DEBUG - BGPaaS: cba38c4e-5852-45bd-bdef-74cac3ded526 deleted from api server
2026-03-19 04:18:01,775 - INFO - BGPaaS(cba38c4e-5852-45bd-bdef-74cac3ded526): verify_on_cleanup passed
2026-03-19 04:18:01,775 - INFO - Deleting Control node zone ctest-test-zone-14029297(62016b94-ea5d-481b-b3d2-0952902eb5ba)
2026-03-19 04:18:01,938 - INFO - Deleting Control node zone ctest-test-zone-47651191(900d4db7-6bf0-4894-b82b-0bd5895d300c)
2026-03-19 04:18:02,095 - INFO - Deleting Control node zone ctest-test-zone-80187155(e1e934cb-e3fb-4d0b-8948-e103b9b54267)
2026-03-19 04:18:02,248 - INFO - Deleting VM ctest-TestBGPaasZone-63398194-24638501
2026-03-19 04:18:02,373 - INFO - Deleting VM ctest-TestBGPaasZone-63398194-34536730
2026-03-19 04:18:02,487 - INFO - Deleting VM ctest-TestBGPaasZone-63398194-29421161
2026-03-19 04:18:02,606 - INFO - Deleting VN ctest-cnz_vn-25840136
2026-03-19 04:18:02,663 - DEBUG - VN ea7fd6ad-93f1-4dda-8ec4-2f2fa22ee426 still in use: Unable to complete operation on network ea7fd6ad-93f1-4dda-8ec4-2f2fa22ee426. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d7e24851-6887-4163-a675-eccd8cd5317a']
2026-03-19 04:18:02,664 - WARNING - Deleting VN ctest-cnz_vn-25840136 failed..Will retry
2026-03-19 04:18:04,884 - DEBUG - Response for deleting network ()
2026-03-19 04:18:06,172 - DEBUG - Skipping xmpp flap check
2026-03-19 04:18:06,172 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:21]
2026-03-19 04:18:06,172 - INFO - --------------------------------------------------------------------------------
2026-03-19 04:18:06,990 - INFO - Deleted project: ctest-TestBGPaasZone-63398194, ID : 677309a9-c9a1-4221-92a5-5d0f1b99a212