2025-10-30 03:57:28,143 - INFO - Domain Default found not creating
2025-10-30 03:57:28,297 - INFO - Project ctest-TestBGPaasZone-10275657 not found, creating it
2025-10-30 03:57:28,829 - INFO - Created Project:ctest-TestBGPaasZone-10275657, ID : 6500ea42-243e-409b-873f-c62e609afe53
2025-10-30 03:57:30,327 - DEBUG - Services list from nova: [, , , ]
2025-10-30 03:57:30,328 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4535-2', 'an-jenkins-deploy-platform-ansible-os-4535-1']}
2025-10-30 03:57:30,330 - INFO - ================================================================================
2025-10-30 03:57:30,330 - INFO - STARTING TEST : test_bgp_control_node_zone
2025-10-30 03:57:31,602 - DEBUG - Skipping xmpp flap check
2025-10-30 03:57:31,603 - INFO - Initial checks done. Running the testcase now
2025-10-30 03:57:31,603 - INFO -
2025-10-30 03:57:31,603 - INFO - executing bgp_control_zone test
2025-10-30 03:57:32,285 - DEBUG - Response for create_network : {'network': {'id': '989c6be8-7421-466d-b512-fc071f5f3c11', 'name': 'ctest-cnz_vn-52751643', 'tenant_id': '6500ea42243e409b873fc62e609afe53', 'project_id': '6500ea42243e409b873fc62e609afe53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-10275657', 'ctest-cnz_vn-52751643'], 'port_security_enabled': True, 'description': ''}}
2025-10-30 03:57:32,543 - DEBUG - Response for create_subnet : {'subnet': {'id': '40d0d0f0-3cc8-4f6a-b35a-60e84a85a79f', 'name': '', 'tenant_id': '6500ea42243e409b873fc62e609afe53', 'network_id': '989c6be8-7421-466d-b512-fc071f5f3c11', 'ip_version': 4, 'cidr': '25.234.235.128/26', 'allocation_pools': [{'start': '25.234.235.130', 'end': '25.234.235.190'}], 'gateway_ip': '25.234.235.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '25.234.235.130', 'tags': [], 'project_id': '6500ea42243e409b873fc62e609afe53'}}
2025-10-30 03:57:32,567 - INFO - Created VN ctest-cnz_vn-52751643
2025-10-30 03:57:32,581 - DEBUG - VN ctest-cnz_vn-52751643 UUID is 989c6be8-7421-466d-b512-fc071f5f3c11
2025-10-30 03:57:33,926 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4535-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4535-2)
2025-10-30 03:57:35,487 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4535-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4535-1)
2025-10-30 03:57:37,323 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4535-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4535-2)
2025-10-30 03:57:37,323 - INFO - Waiting for VM ctest-TestBGPaasZone-10275657-09792416 to be up..
2025-10-30 03:57:37,469 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-30 03:57:42,561 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-30 03:57:47,653 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-30 03:57:52,731 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-30 03:57:57,826 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-30 03:58:02,910 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-30 03:58:08,011 - DEBUG - VM is in ACTIVE state now
2025-10-30 03:58:08,011 - INFO - VM name : ctest-TestBGPaasZone-10275657-09792416
2025-10-30 03:58:08,111 - DEBUG - VM ctest-TestBGPaasZone-10275657-09792416 ID is cc4e8398-3a93-47a0-953e-b17dde0b4180
2025-10-30 03:58:08,148 - DEBUG - VM ctest-TestBGPaasZone-10275657-09792416 launched on Node an-jenkins-deploy-platform-ansible-os-4535-2
2025-10-30 03:58:08,248 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/cc4e8398-3a93-47a0-953e-b17dde0b4180
2025-10-30 03:58:08,565 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/cc4e8398-3a93-47a0-953e-b17dde0b4180
2025-10-30 03:58:08,603 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/ef7eaff3-56cf-4f7f-acd8-4881abc59da2
2025-10-30 03:58:11,781 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms')
2025-10-30 03:58:11,781 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:11,795 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:58:15,878 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-30 03:58:15,878 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:15,895 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:58:19,973 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-10-30 03:58:19,973 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:19,987 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:58:24,072 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms')
2025-10-30 03:58:24,072 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:24,088 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:58:28,167 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-10-30 03:58:28,167 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:28,182 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:58:32,261 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2025-10-30 03:58:32,261 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:32,276 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:58:36,352 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-10-30 03:58:36,352 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:36,367 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:58:40,451 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms')
2025-10-30 03:58:40,451 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:40,466 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:58:44,544 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2025-10-30 03:58:44,544 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:44,559 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:58:48,643 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2025-10-30 03:58:48,643 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:48,660 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:58:52,739 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-10-30 03:58:52,739 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:52,755 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:58:56,838 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-30 03:58:56,838 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:58:56,853 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:59:00,929 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-10-30 03:59:00,929 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:59:00,949 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:59:05,028 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2025-10-30 03:59:05,028 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:59:05,046 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:59:09,125 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-10-30 03:59:09,125 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:59:09,141 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:59:13,223 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-10-30 03:59:13,223 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:59:13,238 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:59:17,311 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-30 03:59:17,311 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 failed!
2025-10-30 03:59:17,327 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-52751643 is 25.234.235.129 and allocation pool is NOT set
2025-10-30 03:59:19,507 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=1.71 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=114 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.712/58.074/114.436/56.362 ms')
2025-10-30 03:59:19,507 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-09792416 passed
2025-10-30 03:59:19,582 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 03:59:19,582 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-09792416, IP 25.234.235.131, Port 22
2025-10-30 03:59:19,647 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 03:59:19,785 - DEBUG - VM ctest-TestBGPaasZone-10275657-09792416 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 03:59:24,786 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 03:59:24,786 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-09792416, IP 25.234.235.131, Port 22
2025-10-30 03:59:24,852 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 03:59:24,935 - DEBUG - VM ctest-TestBGPaasZone-10275657-09792416 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 03:59:29,936 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 03:59:29,936 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-09792416, IP 25.234.235.131, Port 22
2025-10-30 03:59:30,005 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 03:59:30,096 - DEBUG - VM ctest-TestBGPaasZone-10275657-09792416 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 03:59:35,097 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 03:59:35,097 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-09792416, IP 25.234.235.131, Port 22
2025-10-30 03:59:35,164 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 03:59:35,243 - DEBUG - VM ctest-TestBGPaasZone-10275657-09792416 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 03:59:40,244 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 03:59:40,244 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-09792416, IP 25.234.235.131, Port 22
2025-10-30 03:59:40,313 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 03:59:40,401 - DEBUG - VM ctest-TestBGPaasZone-10275657-09792416 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 03:59:45,402 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 03:59:45,402 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-09792416, IP 25.234.235.131, Port 22
2025-10-30 03:59:45,468 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 03:59:45,557 - DEBUG - VM ctest-TestBGPaasZone-10275657-09792416 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 03:59:50,558 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 03:59:50,558 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-09792416, IP 25.234.235.131, Port 22
2025-10-30 03:59:50,625 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 03:59:50,720 - DEBUG - VM ctest-TestBGPaasZone-10275657-09792416 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 03:59:55,721 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 03:59:55,721 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-09792416, IP 25.234.235.131, Port 22
2025-10-30 03:59:55,788 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 03:59:55,885 - DEBUG - VM ctest-TestBGPaasZone-10275657-09792416 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:00:00,885 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:00:00,886 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-09792416, IP 25.234.235.131, Port 22
2025-10-30 04:00:01,052 - DEBUG - VM ctest-TestBGPaasZone-10275657-09792416 is ready for SSH connections
2025-10-30 04:00:01,052 - INFO - Waiting for VM ctest-TestBGPaasZone-10275657-57538977 to be up..
2025-10-30 04:00:01,166 - DEBUG - VM is in ACTIVE state now
2025-10-30 04:00:01,166 - INFO - VM name : ctest-TestBGPaasZone-10275657-57538977
2025-10-30 04:00:01,254 - DEBUG - VM ctest-TestBGPaasZone-10275657-57538977 ID is 3a58b554-d2ef-450d-8ae7-a6279b11aa0f
2025-10-30 04:00:01,254 - DEBUG - VM ctest-TestBGPaasZone-10275657-57538977 launched on Node an-jenkins-deploy-platform-ansible-os-4535-1
2025-10-30 04:00:01,340 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/3a58b554-d2ef-450d-8ae7-a6279b11aa0f
2025-10-30 04:00:01,353 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/a267c5c6-b5d3-47e6-a121-d2b88916c81c
2025-10-30 04:00:02,530 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.01 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.468 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.468/1.237/2.007/0.769 ms')
2025-10-30 04:00:02,530 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-57538977 passed
2025-10-30 04:00:02,603 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:00:02,603 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-57538977, IP 25.234.235.132, Port 22
2025-10-30 04:00:02,771 - DEBUG - VM ctest-TestBGPaasZone-10275657-57538977 is ready for SSH connections
2025-10-30 04:00:02,771 - INFO - Waiting for VM ctest-TestBGPaasZone-10275657-22679147 to be up..
2025-10-30 04:00:02,862 - DEBUG - VM is in ACTIVE state now
2025-10-30 04:00:02,862 - INFO - VM name : ctest-TestBGPaasZone-10275657-22679147
2025-10-30 04:00:02,950 - DEBUG - VM ctest-TestBGPaasZone-10275657-22679147 ID is 2ceefc7d-c774-4c56-a757-7e4c676a2727
2025-10-30 04:00:02,951 - DEBUG - VM ctest-TestBGPaasZone-10275657-22679147 launched on Node an-jenkins-deploy-platform-ansible-os-4535-2
2025-10-30 04:00:03,040 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/2ceefc7d-c774-4c56-a757-7e4c676a2727
2025-10-30 04:00:03,052 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/e4f21338-0420-48c8-88ca-8abecc46e258
2025-10-30 04:00:04,217 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.01 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.984 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.984/1.999/3.014/1.015 ms')
2025-10-30 04:00:04,217 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-10275657-22679147 passed
2025-10-30 04:00:04,290 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:00:04,290 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-22679147, IP 25.234.235.133, Port 22
2025-10-30 04:00:04,356 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:00:04,452 - DEBUG - VM ctest-TestBGPaasZone-10275657-22679147 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:00:09,453 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:00:09,453 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-22679147, IP 25.234.235.133, Port 22
2025-10-30 04:00:09,519 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:00:09,609 - DEBUG - VM ctest-TestBGPaasZone-10275657-22679147 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:00:14,610 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:00:14,610 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-22679147, IP 25.234.235.133, Port 22
2025-10-30 04:00:14,780 - DEBUG - VM ctest-TestBGPaasZone-10275657-22679147 is ready for SSH connections
2025-10-30 04:00:14,936 - INFO - Created control node zone ctest-test-zone-40914640(3f442048-e8f1-4dac-8d7a-6a2a5ecf110a)
2025-10-30 04:00:15,400 - INFO - Created control node zone ctest-test-zone-19922711(88caddfb-04f4-486a-9290-5407773448c3)
2025-10-30 04:00:15,760 - INFO - Created control node zone ctest-test-zone-71107429(d1d5b23a-323b-4d6b-b4d8-793ade8669c4)
2025-10-30 04:00:16,048 - INFO - Creating BGPaaS ctest-TestBGPaasZone-10275657-67158730
2025-10-30 04:00:16,132 - INFO - BGPaaS: ctest-TestBGPaasZone-10275657-67158730(f05c850d-df4c-4703-955f-1174ab356501)
2025-10-30 04:00:16,133 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/f05c850d-df4c-4703-955f-1174ab356501
2025-10-30 04:00:16,444 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/f05c850d-df4c-4703-955f-1174ab356501
2025-10-30 04:00:16,475 - INFO - verify_in_api_server passed for BGPaaS obj f05c850d-df4c-4703-955f-1174ab356501
2025-10-30 04:00:16,475 - INFO - BGPaaS(f05c850d-df4c-4703-955f-1174ab356501): verify_on_setup passed
2025-10-30 04:00:16,475 - INFO - We will configure BGP on the VM
2025-10-30 04:00:16,760 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:00:16,761 - INFO - Configuring BGP on ctest-TestBGPaasZone-10275657-09792416
2025-10-30 04:00:16,761 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.131;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.131;
}
protocol bfd {
neighbor 25.234.235.129 local 25.234.235.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:00:16,761 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.131;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.131;
}
protocol bfd {
neighbor 25.234.235.129 local 25.234.235.131 multihop on;
}
EOS
2025-10-30 04:00:21,117 - DEBUG - None
2025-10-30 04:00:21,117 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.131;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.131;
}
protocol bfd {
neighbor 25.234.235.129 local 25.234.235.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:00:21,117 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.131;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.131;
}
protocol bfd {
neighbor 25.234.235.129 local 25.234.235.131 multihop on;
}
EOS
2025-10-30 04:00:21,655 - DEBUG - None
2025-10-30 04:00:21,655 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:00:21,655 - DEBUG - service bird restart
2025-10-30 04:00:23,428 - DEBUG - bird stop/waiting
bird start/running, process 1432
2025-10-30 04:00:23,428 - INFO - Attaching VMI ef7eaff3-56cf-4f7f-acd8-4881abc59da2 to BGPaaS f05c850d-df4c-4703-955f-1174ab356501
2025-10-30 04:00:23,508 - INFO - Attaching the VMI cc4e8398-3a93-47a0-953e-b17dde0b4180 to the BGPaaS f05c850d-df4c-4703-955f-1174ab356501 object
2025-10-30 04:00:23,509 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 25.234.235.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:00:23,509 - DEBUG - sudo ip addr add 25.234.235.148 dev eth0
2025-10-30 04:00:24,188 - DEBUG - None
2025-10-30 04:00:24,252 - INFO - Creating BGPaaS ctest-TestBGPaasZone-10275657-57297960
2025-10-30 04:00:24,336 - INFO - BGPaaS: ctest-TestBGPaasZone-10275657-57297960(ae542973-4f11-4619-8069-9c7ced606084)
2025-10-30 04:00:24,337 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/ae542973-4f11-4619-8069-9c7ced606084
2025-10-30 04:00:24,347 - INFO - verify_in_api_server passed for BGPaaS obj ae542973-4f11-4619-8069-9c7ced606084
2025-10-30 04:00:24,347 - INFO - BGPaaS(ae542973-4f11-4619-8069-9c7ced606084): verify_on_setup passed
2025-10-30 04:00:24,347 - INFO - We will configure BGP on the VM
2025-10-30 04:00:24,601 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:00:24,601 - INFO - Configuring BGP on ctest-TestBGPaasZone-10275657-57538977
2025-10-30 04:00:24,601 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.132;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.132;
}
protocol bfd {
neighbor 25.234.235.130 local 25.234.235.132 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:00:24,601 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.132;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.132;
}
protocol bfd {
neighbor 25.234.235.130 local 25.234.235.132 multihop on;
}
EOS
2025-10-30 04:00:30,296 - DEBUG - None
2025-10-30 04:00:30,297 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.132;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.132;
}
protocol bfd {
neighbor 25.234.235.130 local 25.234.235.132 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:00:30,297 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.132;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.132;
}
protocol bfd {
neighbor 25.234.235.130 local 25.234.235.132 multihop on;
}
EOS
2025-10-30 04:00:30,862 - DEBUG - None
2025-10-30 04:00:30,863 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:00:30,863 - DEBUG - service bird restart
2025-10-30 04:00:32,726 - DEBUG - bird stop/waiting
bird start/running, process 1484
2025-10-30 04:00:32,726 - INFO - Attaching VMI a267c5c6-b5d3-47e6-a121-d2b88916c81c to BGPaaS ae542973-4f11-4619-8069-9c7ced606084
2025-10-30 04:00:32,804 - INFO - Attaching the VMI 3a58b554-d2ef-450d-8ae7-a6279b11aa0f to the BGPaaS ae542973-4f11-4619-8069-9c7ced606084 object
2025-10-30 04:00:32,805 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 25.234.235.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:00:32,805 - DEBUG - sudo ip addr add 25.234.235.148 dev eth0
2025-10-30 04:00:33,523 - DEBUG - None
2025-10-30 04:00:33,523 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:00:33,541 - INFO - BGPaaS session seen in control-node 10.20.0.131
2025-10-30 04:00:33,547 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:00:33,566 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2025-10-30 04:00:39,584 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2025-10-30 04:00:45,604 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-30 04:00:45,610 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 25.234.235.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:00:45,610 - DEBUG - ping -s 56 -c 3 -W 1 25.234.235.148
2025-10-30 04:00:51,804 - DEBUG - PING 25.234.235.148 (25.234.235.148) 56(84) bytes of data.
64 bytes from 25.234.235.148: icmp_seq=1 ttl=64 time=8.67 ms
64 bytes from 25.234.235.148: icmp_seq=2 ttl=64 time=1.53 ms
64 bytes from 25.234.235.148: icmp_seq=3 ttl=64 time=1.96 ms
--- 25.234.235.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.539/4.059/8.677/3.270 ms
2025-10-30 04:00:51,804 - INFO - Ping to IP 25.234.235.148 from VM ctest-TestBGPaasZone-10275657-22679147 passed
2025-10-30 04:00:52,656 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:00:52,657 - DEBUG - service bird restart
2025-10-30 04:00:54,284 - DEBUG - bird stop/waiting
bird start/running, process 1459
2025-10-30 04:00:54,285 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:00:54,285 - DEBUG - service bird restart
2025-10-30 04:00:56,123 - DEBUG - bird stop/waiting
bird start/running, process 1511
2025-10-30 04:00:56,123 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:00:56,123 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-30 04:00:56,147 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14']
2025-10-30 04:01:02,148 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-30 04:01:02,165 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-10-30 04:01:02,173 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:01:02,190 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2025-10-30 04:01:08,212 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-30 04:01:08,224 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 25.234.235.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:01:08,226 - DEBUG - ping -s 56 -c 3 -W 1 25.234.235.148
2025-10-30 04:01:10,709 - DEBUG - PING 25.234.235.148 (25.234.235.148) 56(84) bytes of data.
64 bytes from 25.234.235.148: icmp_seq=1 ttl=64 time=5.05 ms
64 bytes from 25.234.235.148: icmp_seq=2 ttl=64 time=0.984 ms
64 bytes from 25.234.235.148: icmp_seq=3 ttl=64 time=1.73 ms
--- 25.234.235.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 0.984/2.588/5.050/1.767 ms
2025-10-30 04:01:10,709 - INFO - Ping to IP 25.234.235.148 from VM ctest-TestBGPaasZone-10275657-22679147 passed
2025-10-30 04:01:11,006 - INFO - We will configure BGP on the VM
2025-10-30 04:01:11,225 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:01:11,225 - INFO - Configuring BGP on ctest-TestBGPaasZone-10275657-09792416
2025-10-30 04:01:11,225 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.131;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.131;
}
protocol bfd {
neighbor 25.234.235.129 local 25.234.235.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:01:11,225 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.131;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.131;
}
protocol bfd {
neighbor 25.234.235.129 local 25.234.235.131 multihop on;
}
EOS
2025-10-30 04:01:11,674 - DEBUG - None
2025-10-30 04:01:11,675 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.131;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.131;
}
protocol bfd {
neighbor 25.234.235.129 local 25.234.235.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:01:11,675 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 25.234.235.131;
protocol bgp bgp_1{
local as 65000;
neighbor 25.234.235.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 25.234.235.131;
}
protocol bfd {
neighbor 25.234.235.129 local 25.234.235.131 multihop on;
}
EOS
2025-10-30 04:01:12,179 - DEBUG - None
2025-10-30 04:01:12,179 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:01:12,179 - DEBUG - service bird restart
2025-10-30 04:01:13,779 - DEBUG - bird stop/waiting
bird start/running, process 1491
2025-10-30 04:01:13,780 - INFO - Attaching VMI ef7eaff3-56cf-4f7f-acd8-4881abc59da2 to BGPaaS f05c850d-df4c-4703-955f-1174ab356501
2025-10-30 04:01:13,799 - INFO - Attaching the VMI cc4e8398-3a93-47a0-953e-b17dde0b4180 to the BGPaaS f05c850d-df4c-4703-955f-1174ab356501 object
2025-10-30 04:01:13,799 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 25.234.235.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:01:13,799 - DEBUG - sudo ip addr add 25.234.235.148 dev eth0
2025-10-30 04:01:14,451 - DEBUG - RTNETLINK answers: File exists
2025-10-30 04:01:14,451 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:01:14,451 - DEBUG - service bird restart
2025-10-30 04:01:16,063 - DEBUG - bird stop/waiting
bird start/running, process 1518
2025-10-30 04:01:16,063 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:01:16,063 - DEBUG - service bird restart
2025-10-30 04:01:17,871 - DEBUG - bird stop/waiting
bird start/running, process 1533
2025-10-30 04:01:17,872 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:01:17,897 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.131']
2025-10-30 04:01:23,912 - INFO - BGPaaS session seen in control-node 10.20.0.131
2025-10-30 04:01:23,918 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:01:23,936 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-30 04:01:23,942 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 25.234.235.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:01:23,943 - DEBUG - ping -s 56 -c 3 -W 1 25.234.235.148
2025-10-30 04:01:26,430 - DEBUG - PING 25.234.235.148 (25.234.235.148) 56(84) bytes of data.
64 bytes from 25.234.235.148: icmp_seq=1 ttl=64 time=4.04 ms
64 bytes from 25.234.235.148: icmp_seq=2 ttl=64 time=1.46 ms
64 bytes from 25.234.235.148: icmp_seq=3 ttl=64 time=1.11 ms
--- 25.234.235.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.116/2.206/4.042/1.305 ms
2025-10-30 04:01:26,430 - INFO - Ping to IP 25.234.235.148 from VM ctest-TestBGPaasZone-10275657-22679147 passed
2025-10-30 04:01:26,430 - INFO - Detaching VMI ef7eaff3-56cf-4f7f-acd8-4881abc59da2 from BGPaaS f05c850d-df4c-4703-955f-1174ab356501
2025-10-30 04:01:26,509 - INFO - Detaching VMI a267c5c6-b5d3-47e6-a121-d2b88916c81c from BGPaaS ae542973-4f11-4619-8069-9c7ced606084
2025-10-30 04:01:26,580 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-10275657-57297960(ae542973-4f11-4619-8069-9c7ced606084)
2025-10-30 04:01:26,632 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/ae542973-4f11-4619-8069-9c7ced606084
2025-10-30 04:01:26,638 - DEBUG - Response Code: 404
2025-10-30 04:01:26,638 - DEBUG - BGPaaS: ae542973-4f11-4619-8069-9c7ced606084 deleted from api server
2025-10-30 04:01:26,638 - INFO - BGPaaS(ae542973-4f11-4619-8069-9c7ced606084): verify_on_cleanup passed
2025-10-30 04:01:26,638 - INFO - Detaching VMI ef7eaff3-56cf-4f7f-acd8-4881abc59da2 from BGPaaS f05c850d-df4c-4703-955f-1174ab356501
2025-10-30 04:01:26,664 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-10275657-67158730(f05c850d-df4c-4703-955f-1174ab356501)
2025-10-30 04:01:26,709 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/f05c850d-df4c-4703-955f-1174ab356501
2025-10-30 04:01:26,716 - DEBUG - Response Code: 404
2025-10-30 04:01:26,716 - DEBUG - BGPaaS: f05c850d-df4c-4703-955f-1174ab356501 deleted from api server
2025-10-30 04:01:26,716 - INFO - BGPaaS(f05c850d-df4c-4703-955f-1174ab356501): verify_on_cleanup passed
2025-10-30 04:01:26,716 - INFO - Deleting Control node zone ctest-test-zone-71107429(d1d5b23a-323b-4d6b-b4d8-793ade8669c4)
2025-10-30 04:01:26,865 - INFO - Deleting Control node zone ctest-test-zone-19922711(88caddfb-04f4-486a-9290-5407773448c3)
2025-10-30 04:01:27,037 - INFO - Deleting Control node zone ctest-test-zone-40914640(3f442048-e8f1-4dac-8d7a-6a2a5ecf110a)
2025-10-30 04:01:27,149 - INFO - Deleting VM ctest-TestBGPaasZone-10275657-22679147
2025-10-30 04:01:27,277 - INFO - Deleting VM ctest-TestBGPaasZone-10275657-57538977
2025-10-30 04:01:27,354 - INFO - Deleting VM ctest-TestBGPaasZone-10275657-09792416
2025-10-30 04:01:27,439 - INFO - Deleting VN ctest-cnz_vn-52751643
2025-10-30 04:01:27,487 - DEBUG - VN 989c6be8-7421-466d-b512-fc071f5f3c11 still in use: Unable to complete operation on network 989c6be8-7421-466d-b512-fc071f5f3c11. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-3dd41f87-19de-4f7a-a3f5-72151786617e']
2025-10-30 04:01:27,487 - WARNING - Deleting VN ctest-cnz_vn-52751643 failed..Will retry
2025-10-30 04:01:29,701 - DEBUG - Response for deleting network ()
2025-10-30 04:01:30,966 - DEBUG - Skipping xmpp flap check
2025-10-30 04:01:30,966 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:00]
2025-10-30 04:01:30,966 - INFO - --------------------------------------------------------------------------------
2025-10-30 04:01:30,968 - INFO - ================================================================================
2025-10-30 04:01:30,969 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf
2025-10-30 04:01:32,226 - DEBUG - Skipping xmpp flap check
2025-10-30 04:01:32,226 - INFO - Initial checks done. Running the testcase now
2025-10-30 04:01:32,226 - INFO -
2025-10-30 04:01:32,226 - INFO - executing bgp_control_zone agent restart test
2025-10-30 04:01:32,527 - DEBUG - Response for create_network : {'network': {'id': '1a5ab3e4-eee2-4b92-a064-1f3c65b8a8c3', 'name': 'ctest-cnz_vn-18310608', 'tenant_id': '6500ea42243e409b873fc62e609afe53', 'project_id': '6500ea42243e409b873fc62e609afe53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-10275657', 'ctest-cnz_vn-18310608'], 'port_security_enabled': True, 'description': ''}}
2025-10-30 04:01:32,800 - DEBUG - Response for create_subnet : {'subnet': {'id': '25e38cf6-a64b-496a-8b6c-12b58d53083f', 'name': '', 'tenant_id': '6500ea42243e409b873fc62e609afe53', 'network_id': '1a5ab3e4-eee2-4b92-a064-1f3c65b8a8c3', 'ip_version': 4, 'cidr': '12.142.4.192/26', 'allocation_pools': [{'start': '12.142.4.194', 'end': '12.142.4.254'}], 'gateway_ip': '12.142.4.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '12.142.4.194', 'tags': [], 'project_id': '6500ea42243e409b873fc62e609afe53'}}
2025-10-30 04:01:32,827 - INFO - Created VN ctest-cnz_vn-18310608
2025-10-30 04:01:32,842 - DEBUG - VN ctest-cnz_vn-18310608 UUID is 1a5ab3e4-eee2-4b92-a064-1f3c65b8a8c3
2025-10-30 04:01:34,064 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4535-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4535-1)
2025-10-30 04:01:35,386 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4535-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4535-2)
2025-10-30 04:01:36,903 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4535-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4535-1)
2025-10-30 04:01:36,904 - INFO - Waiting for VM ctest-TestBGPaasZone-10275657-62302743 to be up..
2025-10-30 04:01:37,003 - DEBUG - VM is in ACTIVE state now
2025-10-30 04:01:37,003 - INFO - VM name : ctest-TestBGPaasZone-10275657-62302743
2025-10-30 04:01:37,150 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 ID is a1382307-cbd5-4a67-8c61-25357bf28e0d
2025-10-30 04:01:37,150 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 launched on Node an-jenkins-deploy-platform-ansible-os-4535-1
2025-10-30 04:01:37,244 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/a1382307-cbd5-4a67-8c61-25357bf28e0d
2025-10-30 04:01:37,257 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/e771e22d-9c70-4ece-a551-005689e20017
2025-10-30 04:01:40,459 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2025-10-30 04:01:40,459 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:01:40,477 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:01:44,559 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms')
2025-10-30 04:01:44,559 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:01:44,576 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:01:48,652 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2025-10-30 04:01:48,653 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:01:48,668 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:01:52,745 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms')
2025-10-30 04:01:52,745 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:01:52,764 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:01:56,841 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-30 04:01:56,842 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:01:56,859 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:00,934 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-10-30 04:02:00,934 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:00,956 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:05,039 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-10-30 04:02:05,039 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:05,054 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:09,135 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-10-30 04:02:09,135 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:09,151 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:13,226 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-10-30 04:02:13,226 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:13,242 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:17,318 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-30 04:02:17,318 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:17,335 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:21,420 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms')
2025-10-30 04:02:21,420 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:21,436 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:25,515 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-30 04:02:25,515 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:25,532 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:29,614 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2025-10-30 04:02:29,614 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:29,630 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:33,712 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-10-30 04:02:33,712 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:33,754 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:37,831 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-10-30 04:02:37,831 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:37,847 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:41,934 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms')
2025-10-30 04:02:41,934 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:41,949 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:46,031 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2025-10-30 04:02:46,032 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:46,047 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:50,122 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms')
2025-10-30 04:02:50,123 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:50,139 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:54,221 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-30 04:02:54,222 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 failed!
2025-10-30 04:02:54,237 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-10275657:ctest-cnz_vn-18310608 is 12.142.4.193 and allocation pool is NOT set
2025-10-30 04:02:56,300 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.10 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.683 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.683/3.392/6.101/2.709 ms')
2025-10-30 04:02:56,301 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-62302743 passed
2025-10-30 04:02:56,370 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:02:56,370 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:02:56,439 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:02:56,591 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:03:01,592 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:01,592 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:03:01,658 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:03:01,783 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:03:06,784 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:06,784 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:03:06,850 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:03:06,957 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:03:11,957 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:11,958 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:03:12,020 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:03:12,107 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:03:17,108 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:17,108 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:03:17,164 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:03:17,262 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:03:22,263 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:22,263 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:03:22,330 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:03:22,442 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:03:27,443 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:27,443 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:03:27,500 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:03:27,592 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:03:32,593 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:32,593 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:03:32,656 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:03:32,743 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:03:37,744 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:37,745 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:03:37,805 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:03:37,898 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:03:42,899 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:42,899 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:03:42,966 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:03:43,055 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:03:48,056 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:48,056 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:03:48,126 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-30 04:03:48,217 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-30 04:03:53,217 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:53,217 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-62302743, IP 12.142.4.195, Port 22
2025-10-30 04:03:53,387 - DEBUG - VM ctest-TestBGPaasZone-10275657-62302743 is ready for SSH connections
2025-10-30 04:03:53,388 - INFO - Waiting for VM ctest-TestBGPaasZone-10275657-04698185 to be up..
2025-10-30 04:03:53,474 - DEBUG - VM is in ACTIVE state now
2025-10-30 04:03:53,474 - INFO - VM name : ctest-TestBGPaasZone-10275657-04698185
2025-10-30 04:03:53,567 - DEBUG - VM ctest-TestBGPaasZone-10275657-04698185 ID is 6f084fb9-a7ca-40bb-b636-803e2884a74b
2025-10-30 04:03:53,567 - DEBUG - VM ctest-TestBGPaasZone-10275657-04698185 launched on Node an-jenkins-deploy-platform-ansible-os-4535-2
2025-10-30 04:03:53,650 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/6f084fb9-a7ca-40bb-b636-803e2884a74b
2025-10-30 04:03:53,689 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/21ff9665-4376-4017-8826-22cd17000f02
2025-10-30 04:03:54,851 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.32 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.383 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.383/1.853/3.323/1.470 ms')
2025-10-30 04:03:54,852 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-10275657-04698185 passed
2025-10-30 04:03:54,921 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:54,921 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-04698185, IP 12.142.4.196, Port 22
2025-10-30 04:03:55,077 - DEBUG - VM ctest-TestBGPaasZone-10275657-04698185 is ready for SSH connections
2025-10-30 04:03:55,077 - INFO - Waiting for VM ctest-TestBGPaasZone-10275657-75005059 to be up..
2025-10-30 04:03:55,156 - DEBUG - VM is in ACTIVE state now
2025-10-30 04:03:55,156 - INFO - VM name : ctest-TestBGPaasZone-10275657-75005059
2025-10-30 04:03:55,237 - DEBUG - VM ctest-TestBGPaasZone-10275657-75005059 ID is 8362c5c8-96a6-468c-93d5-aa82542e0b8c
2025-10-30 04:03:55,237 - DEBUG - VM ctest-TestBGPaasZone-10275657-75005059 launched on Node an-jenkins-deploy-platform-ansible-os-4535-1
2025-10-30 04:03:55,327 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/8362c5c8-96a6-468c-93d5-aa82542e0b8c
2025-10-30 04:03:55,337 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/23d7dab2-a4fd-4de8-9403-bb8fb8c45b1e
2025-10-30 04:03:56,498 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.38 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.85 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.846/2.614/3.382/0.768 ms')
2025-10-30 04:03:56,498 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-10275657-75005059 passed
2025-10-30 04:03:56,571 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:56,571 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-10275657-75005059, IP 12.142.4.197, Port 22
2025-10-30 04:03:56,750 - DEBUG - VM ctest-TestBGPaasZone-10275657-75005059 is ready for SSH connections
2025-10-30 04:03:56,884 - INFO - Created control node zone ctest-test-zone-71256264(02da60b4-8a12-434e-833f-19578d4ff966)
2025-10-30 04:03:57,232 - INFO - Created control node zone ctest-test-zone-56560211(51de316b-626c-4572-97d5-df755007774a)
2025-10-30 04:03:57,592 - INFO - Created control node zone ctest-test-zone-00512352(f20986ff-b77c-405d-8f16-c7eb6ecb04d3)
2025-10-30 04:03:57,876 - INFO - Creating BGPaaS ctest-TestBGPaasZone-10275657-14332572
2025-10-30 04:03:57,953 - INFO - BGPaaS: ctest-TestBGPaasZone-10275657-14332572(a3fe7488-5d33-4554-b31b-adb131919874)
2025-10-30 04:03:57,953 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/a3fe7488-5d33-4554-b31b-adb131919874
2025-10-30 04:03:57,964 - INFO - verify_in_api_server passed for BGPaaS obj a3fe7488-5d33-4554-b31b-adb131919874
2025-10-30 04:03:57,964 - INFO - BGPaaS(a3fe7488-5d33-4554-b31b-adb131919874): verify_on_setup passed
2025-10-30 04:03:57,964 - INFO - We will configure BGP on the VM
2025-10-30 04:03:58,405 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:03:58,405 - INFO - Configuring BGP on ctest-TestBGPaasZone-10275657-62302743
2025-10-30 04:03:58,405 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 12.142.4.195;
protocol bgp bgp_1{
local as 65000;
neighbor 12.142.4.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.142.4.195;
}
protocol bfd {
neighbor 12.142.4.193 local 12.142.4.195 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:03:58,405 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 12.142.4.195;
protocol bgp bgp_1{
local as 65000;
neighbor 12.142.4.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.142.4.195;
}
protocol bfd {
neighbor 12.142.4.193 local 12.142.4.195 multihop on;
}
EOS
2025-10-30 04:04:12,466 - DEBUG - None
2025-10-30 04:04:12,467 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 12.142.4.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.142.4.195;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:04:12,467 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 12.142.4.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.142.4.195;
}
EOS
2025-10-30 04:04:13,512 - DEBUG - None
2025-10-30 04:04:13,512 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:04:13,512 - DEBUG - service bird restart
2025-10-30 04:04:16,818 - DEBUG - bird stop/waiting
bird start/running, process 1442
2025-10-30 04:04:16,818 - INFO - Attaching VMI e771e22d-9c70-4ece-a551-005689e20017 to BGPaaS a3fe7488-5d33-4554-b31b-adb131919874
2025-10-30 04:04:16,904 - INFO - Attaching the VMI a1382307-cbd5-4a67-8c61-25357bf28e0d to the BGPaaS a3fe7488-5d33-4554-b31b-adb131919874 object
2025-10-30 04:04:16,905 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 12.142.4.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:04:16,905 - DEBUG - sudo ip addr add 12.142.4.212 dev eth0
2025-10-30 04:04:17,660 - DEBUG - None
2025-10-30 04:04:17,724 - INFO - Creating BGPaaS ctest-TestBGPaasZone-10275657-89522829
2025-10-30 04:04:17,800 - INFO - BGPaaS: ctest-TestBGPaasZone-10275657-89522829(eb2a60bc-789e-42ab-bfae-75f67681d12c)
2025-10-30 04:04:17,801 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/eb2a60bc-789e-42ab-bfae-75f67681d12c
2025-10-30 04:04:17,811 - INFO - verify_in_api_server passed for BGPaaS obj eb2a60bc-789e-42ab-bfae-75f67681d12c
2025-10-30 04:04:17,811 - INFO - BGPaaS(eb2a60bc-789e-42ab-bfae-75f67681d12c): verify_on_setup passed
2025-10-30 04:04:17,811 - INFO - We will configure BGP on the VM
2025-10-30 04:04:18,232 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:04:18,233 - INFO - Configuring BGP on ctest-TestBGPaasZone-10275657-04698185
2025-10-30 04:04:18,233 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 12.142.4.196;
protocol bgp bgp_1{
local as 65000;
neighbor 12.142.4.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.142.4.196;
}
protocol bfd {
neighbor 12.142.4.193 local 12.142.4.196 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:04:18,233 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 12.142.4.196;
protocol bgp bgp_1{
local as 65000;
neighbor 12.142.4.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.142.4.196;
}
protocol bfd {
neighbor 12.142.4.193 local 12.142.4.196 multihop on;
}
EOS
2025-10-30 04:04:23,978 - DEBUG - None
2025-10-30 04:04:23,978 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 12.142.4.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.142.4.196;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:04:23,978 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 12.142.4.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.142.4.196;
}
EOS
2025-10-30 04:04:24,456 - DEBUG - None
2025-10-30 04:04:24,456 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:04:24,456 - DEBUG - service bird restart
2025-10-30 04:04:26,065 - DEBUG - bird stop/waiting
bird start/running, process 1443
2025-10-30 04:04:26,065 - INFO - Attaching VMI 21ff9665-4376-4017-8826-22cd17000f02 to BGPaaS eb2a60bc-789e-42ab-bfae-75f67681d12c
2025-10-30 04:04:26,152 - INFO - Attaching the VMI 6f084fb9-a7ca-40bb-b636-803e2884a74b to the BGPaaS eb2a60bc-789e-42ab-bfae-75f67681d12c object
2025-10-30 04:04:26,153 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 12.142.4.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-10-30 04:04:26,153 - DEBUG - sudo ip addr add 12.142.4.212 dev eth0
2025-10-30 04:04:26,791 - DEBUG - None
2025-10-30 04:04:26,791 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:04:26,808 - INFO - BGPaaS session seen in control-node 10.20.0.131
2025-10-30 04:04:26,808 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:04:26,827 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-30 04:04:26,833 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:04:26,848 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.131']
2025-10-30 04:04:32,868 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.131']
2025-10-30 04:04:38,884 - INFO - BGPaaS session seen in control-node 10.20.0.131
2025-10-30 04:04:38,885 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:04:38,903 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-30 04:04:38,909 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 12.142.4.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:04:38,909 - DEBUG - ping -s 56 -c 3 -W 1 12.142.4.212
2025-10-30 04:04:45,471 - DEBUG - PING 12.142.4.212 (12.142.4.212) 56(84) bytes of data.
64 bytes from 12.142.4.212: icmp_seq=1 ttl=64 time=8.36 ms
64 bytes from 12.142.4.212: icmp_seq=2 ttl=64 time=1.38 ms
64 bytes from 12.142.4.212: icmp_seq=3 ttl=64 time=1.35 ms
--- 12.142.4.212 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.359/3.703/8.363/3.295 ms
2025-10-30 04:04:45,471 - INFO - Ping to IP 12.142.4.212 from VM ctest-TestBGPaasZone-10275657-75005059 passed
2025-10-30 04:04:45,472 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:04:45,485 - INFO - BGPaaS session seen in control-node 10.20.0.131
2025-10-30 04:04:45,486 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:04:45,504 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-30 04:04:45,511 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:04:45,528 - INFO - BGPaaS session seen in control-node 10.20.0.131
2025-10-30 04:04:45,528 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-30 04:04:45,546 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-30 04:04:45,553 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 12.142.4.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2025-10-30 04:04:45,553 - DEBUG - ping -s 56 -c 3 -W 1 12.142.4.212
2025-10-30 04:04:48,103 - DEBUG - PING 12.142.4.212 (12.142.4.212) 56(84) bytes of data.
64 bytes from 12.142.4.212: icmp_seq=1 ttl=64 time=5.20 ms
64 bytes from 12.142.4.212: icmp_seq=2 ttl=64 time=0.804 ms
64 bytes from 12.142.4.212: icmp_seq=3 ttl=64 time=1.19 ms
--- 12.142.4.212 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.804/2.400/5.200/1.986 ms
2025-10-30 04:04:48,103 - INFO - Ping to IP 12.142.4.212 from VM ctest-TestBGPaasZone-10275657-75005059 passed
2025-10-30 04:04:48,104 - INFO - Detaching VMI 21ff9665-4376-4017-8826-22cd17000f02 from BGPaaS eb2a60bc-789e-42ab-bfae-75f67681d12c
2025-10-30 04:04:48,180 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-10275657-89522829(eb2a60bc-789e-42ab-bfae-75f67681d12c)
2025-10-30 04:04:48,255 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/eb2a60bc-789e-42ab-bfae-75f67681d12c
2025-10-30 04:04:48,263 - DEBUG - Response Code: 404
2025-10-30 04:04:48,263 - DEBUG - BGPaaS: eb2a60bc-789e-42ab-bfae-75f67681d12c deleted from api server
2025-10-30 04:04:48,263 - INFO - BGPaaS(eb2a60bc-789e-42ab-bfae-75f67681d12c): verify_on_cleanup passed
2025-10-30 04:04:48,263 - INFO - Detaching VMI e771e22d-9c70-4ece-a551-005689e20017 from BGPaaS a3fe7488-5d33-4554-b31b-adb131919874
2025-10-30 04:04:48,364 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-10275657-14332572(a3fe7488-5d33-4554-b31b-adb131919874)
2025-10-30 04:04:48,436 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/a3fe7488-5d33-4554-b31b-adb131919874
2025-10-30 04:04:48,452 - DEBUG - Response Code: 404
2025-10-30 04:04:48,452 - DEBUG - BGPaaS: a3fe7488-5d33-4554-b31b-adb131919874 deleted from api server
2025-10-30 04:04:48,452 - INFO - BGPaaS(a3fe7488-5d33-4554-b31b-adb131919874): verify_on_cleanup passed
2025-10-30 04:04:48,452 - INFO - Deleting Control node zone ctest-test-zone-00512352(f20986ff-b77c-405d-8f16-c7eb6ecb04d3)
2025-10-30 04:04:48,610 - INFO - Deleting Control node zone ctest-test-zone-56560211(51de316b-626c-4572-97d5-df755007774a)
2025-10-30 04:04:48,761 - INFO - Deleting Control node zone ctest-test-zone-71256264(02da60b4-8a12-434e-833f-19578d4ff966)
2025-10-30 04:04:48,904 - INFO - Deleting VM ctest-TestBGPaasZone-10275657-75005059
2025-10-30 04:04:48,987 - INFO - Deleting VM ctest-TestBGPaasZone-10275657-04698185
2025-10-30 04:04:49,053 - INFO - Deleting VM ctest-TestBGPaasZone-10275657-62302743
2025-10-30 04:04:49,148 - INFO - Deleting VN ctest-cnz_vn-18310608
2025-10-30 04:04:49,195 - DEBUG - VN 1a5ab3e4-eee2-4b92-a064-1f3c65b8a8c3 still in use: Unable to complete operation on network 1a5ab3e4-eee2-4b92-a064-1f3c65b8a8c3. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-fa5d91ff-5606-4bd7-8a50-aa5ae6c12339']
2025-10-30 04:04:49,195 - WARNING - Deleting VN ctest-cnz_vn-18310608 failed..Will retry
2025-10-30 04:04:51,429 - DEBUG - Response for deleting network ()
2025-10-30 04:04:52,706 - DEBUG - Skipping xmpp flap check
2025-10-30 04:04:52,706 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:22]
2025-10-30 04:04:52,706 - INFO - --------------------------------------------------------------------------------
2025-10-30 04:04:53,466 - INFO - Deleted project: ctest-TestBGPaasZone-10275657, ID : 6500ea42-243e-409b-873f-c62e609afe53