2025-10-02 03:31:38,922 - INFO - Domain Default found not creating
2025-10-02 03:31:39,398 - INFO - Project ctest-TestBGPaasZone-83084478 not found, creating it
2025-10-02 03:31:39,903 - INFO - Created Project:ctest-TestBGPaasZone-83084478, ID : c3a5c8a4-e0e8-4c14-8800-c2d93a0d2fff
2025-10-02 03:31:41,452 - DEBUG - Services list from nova: [, , , ]
2025-10-02 03:31:41,452 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4210-2', 'an-jenkins-deploy-platform-ansible-os-4210-1']}
2025-10-02 03:31:41,455 - INFO - ================================================================================
2025-10-02 03:31:41,455 - INFO - STARTING TEST : test_bgp_control_node_zone
2025-10-02 03:31:42,731 - DEBUG - Skipping xmpp flap check
2025-10-02 03:31:42,731 - INFO - Initial checks done. Running the testcase now
2025-10-02 03:31:42,731 - INFO -
2025-10-02 03:31:42,731 - INFO - executing bgp_control_zone test
2025-10-02 03:31:43,351 - DEBUG - Response for create_network : {'network': {'id': '1d6d84e3-5b98-4400-ba67-a3b8dbfb0c1f', 'name': 'ctest-cnz_vn-22567137', 'tenant_id': 'c3a5c8a4e0e84c148800c2d93a0d2fff', 'project_id': 'c3a5c8a4e0e84c148800c2d93a0d2fff', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-83084478', 'ctest-cnz_vn-22567137'], 'port_security_enabled': True, 'description': ''}}
2025-10-02 03:31:43,628 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd4ecd6e4-96a1-454e-b624-edd5ea1b63cd', 'name': '', 'tenant_id': 'c3a5c8a4e0e84c148800c2d93a0d2fff', 'network_id': '1d6d84e3-5b98-4400-ba67-a3b8dbfb0c1f', 'ip_version': 4, 'cidr': '73.178.24.0/26', 'allocation_pools': [{'start': '73.178.24.2', 'end': '73.178.24.62'}], 'gateway_ip': '73.178.24.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '73.178.24.2', 'tags': [], 'project_id': 'c3a5c8a4e0e84c148800c2d93a0d2fff'}}
2025-10-02 03:31:43,648 - INFO - Created VN ctest-cnz_vn-22567137
2025-10-02 03:31:43,662 - DEBUG - VN ctest-cnz_vn-22567137 UUID is 1d6d84e3-5b98-4400-ba67-a3b8dbfb0c1f
2025-10-02 03:31:44,868 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4210-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4210-2)
2025-10-02 03:31:46,328 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4210-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4210-1)
2025-10-02 03:31:47,858 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4210-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4210-2)
2025-10-02 03:31:47,858 - INFO - Waiting for VM ctest-TestBGPaasZone-83084478-35429369 to be up..
2025-10-02 03:31:47,962 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-02 03:31:53,038 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-02 03:31:58,123 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-02 03:32:03,205 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-02 03:32:08,293 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-02 03:32:13,370 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-02 03:32:18,455 - DEBUG - VM is in ACTIVE state now
2025-10-02 03:32:18,455 - INFO - VM name : ctest-TestBGPaasZone-83084478-35429369
2025-10-02 03:32:18,532 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 ID is ed28a33e-7022-4b91-a807-3c103c790611
2025-10-02 03:32:18,557 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 launched on Node an-jenkins-deploy-platform-ansible-os-4210-2
2025-10-02 03:32:18,635 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ed28a33e-7022-4b91-a807-3c103c790611
2025-10-02 03:32:18,930 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ed28a33e-7022-4b91-a807-3c103c790611
2025-10-02 03:32:18,966 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/795abeb6-480f-4d53-b34a-b1c46469fe80
2025-10-02 03:32:22,146 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms')
2025-10-02 03:32:22,146 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:32:22,162 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:32:26,249 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-10-02 03:32:26,249 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:32:26,263 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:32:30,337 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2025-10-02 03:32:30,337 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:32:30,352 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:32:34,445 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms')
2025-10-02 03:32:34,445 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:32:34,459 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:32:38,530 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-10-02 03:32:38,530 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:32:38,545 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:32:42,627 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms')
2025-10-02 03:32:42,628 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:32:42,643 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:32:46,724 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms')
2025-10-02 03:32:46,724 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:32:46,738 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:32:50,823 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms')
2025-10-02 03:32:50,823 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:32:50,840 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:32:54,917 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-10-02 03:32:54,917 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:32:54,932 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:32:59,012 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-02 03:32:59,012 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:32:59,026 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:33:03,106 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2025-10-02 03:33:03,106 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:33:03,122 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:33:07,210 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms')
2025-10-02 03:33:07,210 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:33:07,229 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:33:11,302 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2025-10-02 03:33:11,302 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:33:11,319 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:33:15,392 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-10-02 03:33:15,392 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:33:15,407 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:33:19,493 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms')
2025-10-02 03:33:19,493 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:33:19,507 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:33:23,594 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms')
2025-10-02 03:33:23,594 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:33:23,608 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:33:27,688 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-10-02 03:33:27,688 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:33:27,702 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:33:31,781 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms')
2025-10-02 03:33:31,781 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:33:31,795 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:33:35,876 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms')
2025-10-02 03:33:35,876 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 failed!
2025-10-02 03:33:35,891 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-22567137 is 73.178.24.1 and allocation pool is NOT set
2025-10-02 03:33:37,959 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.02 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.36 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.360/3.689/6.018/2.329 ms')
2025-10-02 03:33:37,959 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-35429369 passed
2025-10-02 03:33:38,031 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:33:38,031 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35429369, IP 73.178.24.3, Port 22
2025-10-02 03:33:38,102 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:33:38,191 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:33:43,191 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:33:43,191 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35429369, IP 73.178.24.3, Port 22
2025-10-02 03:33:43,257 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:33:43,329 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:33:48,329 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:33:48,329 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35429369, IP 73.178.24.3, Port 22
2025-10-02 03:33:48,417 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:33:48,501 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:33:53,502 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:33:53,502 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35429369, IP 73.178.24.3, Port 22
2025-10-02 03:33:53,571 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:33:53,655 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:33:58,656 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:33:58,657 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35429369, IP 73.178.24.3, Port 22
2025-10-02 03:33:58,730 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:33:58,829 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:34:03,830 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:34:03,830 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35429369, IP 73.178.24.3, Port 22
2025-10-02 03:34:03,897 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:34:03,977 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:34:08,978 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:34:08,978 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35429369, IP 73.178.24.3, Port 22
2025-10-02 03:34:09,046 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:34:09,136 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:34:14,137 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:34:14,137 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35429369, IP 73.178.24.3, Port 22
2025-10-02 03:34:14,195 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:34:14,285 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:34:19,286 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:34:19,286 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35429369, IP 73.178.24.3, Port 22
2025-10-02 03:34:19,353 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:34:19,437 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:34:24,438 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:34:24,438 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35429369, IP 73.178.24.3, Port 22
2025-10-02 03:34:24,505 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:34:24,620 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:34:29,621 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:34:29,621 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35429369, IP 73.178.24.3, Port 22
2025-10-02 03:34:29,790 - DEBUG - VM ctest-TestBGPaasZone-83084478-35429369 is ready for SSH connections
2025-10-02 03:34:29,790 - INFO - Waiting for VM ctest-TestBGPaasZone-83084478-21519739 to be up..
2025-10-02 03:34:29,879 - DEBUG - VM is in ACTIVE state now
2025-10-02 03:34:29,879 - INFO - VM name : ctest-TestBGPaasZone-83084478-21519739
2025-10-02 03:34:29,964 - DEBUG - VM ctest-TestBGPaasZone-83084478-21519739 ID is 9887b125-fd70-400e-a816-3b936a98c0a0
2025-10-02 03:34:29,964 - DEBUG - VM ctest-TestBGPaasZone-83084478-21519739 launched on Node an-jenkins-deploy-platform-ansible-os-4210-1
2025-10-02 03:34:30,050 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/9887b125-fd70-400e-a816-3b936a98c0a0
2025-10-02 03:34:30,060 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/a7728dae-7247-4f43-b65b-a060e7970241
2025-10-02 03:34:31,218 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.07 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.435 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.435/1.752/3.070/1.317 ms')
2025-10-02 03:34:31,218 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-21519739 passed
2025-10-02 03:34:31,287 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:34:31,287 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-21519739, IP 73.178.24.4, Port 22
2025-10-02 03:34:31,442 - DEBUG - VM ctest-TestBGPaasZone-83084478-21519739 is ready for SSH connections
2025-10-02 03:34:31,442 - INFO - Waiting for VM ctest-TestBGPaasZone-83084478-35815550 to be up..
2025-10-02 03:34:31,525 - DEBUG - VM is in ACTIVE state now
2025-10-02 03:34:31,525 - INFO - VM name : ctest-TestBGPaasZone-83084478-35815550
2025-10-02 03:34:31,598 - DEBUG - VM ctest-TestBGPaasZone-83084478-35815550 ID is 7042a4ed-47dd-4701-b542-e76ed4e20007
2025-10-02 03:34:31,598 - DEBUG - VM ctest-TestBGPaasZone-83084478-35815550 launched on Node an-jenkins-deploy-platform-ansible-os-4210-2
2025-10-02 03:34:31,671 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/7042a4ed-47dd-4701-b542-e76ed4e20007
2025-10-02 03:34:31,681 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/587f00b5-7745-4e31-9a04-f14d84f42aaa
2025-10-02 03:34:32,845 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.50 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.37 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.367/2.935/4.504/1.568 ms')
2025-10-02 03:34:32,845 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-83084478-35815550 passed
2025-10-02 03:34:32,911 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:34:32,911 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-35815550, IP 73.178.24.5, Port 22
2025-10-02 03:34:33,233 - DEBUG - VM ctest-TestBGPaasZone-83084478-35815550 is ready for SSH connections
2025-10-02 03:34:33,370 - INFO - Created control node zone ctest-test-zone-88306085(9b60eacd-2e5a-4e0c-8f86-c1e4124c19ff)
2025-10-02 03:34:33,722 - INFO - Created control node zone ctest-test-zone-30980802(b7e0e0a2-81c0-4c4f-9493-e3fe37bc17d2)
2025-10-02 03:34:34,067 - INFO - Created control node zone ctest-test-zone-49905267(74c1f677-1f82-4a5b-8ef2-4eb78b4ce4d5)
2025-10-02 03:34:34,358 - INFO - Creating BGPaaS ctest-TestBGPaasZone-83084478-94250547
2025-10-02 03:34:34,442 - INFO - BGPaaS: ctest-TestBGPaasZone-83084478-94250547(474c3af4-bd8c-45e8-a3a1-846db4779361)
2025-10-02 03:34:34,442 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/474c3af4-bd8c-45e8-a3a1-846db4779361
2025-10-02 03:34:34,747 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/474c3af4-bd8c-45e8-a3a1-846db4779361
2025-10-02 03:34:34,775 - INFO - verify_in_api_server passed for BGPaaS obj 474c3af4-bd8c-45e8-a3a1-846db4779361
2025-10-02 03:34:34,775 - INFO - BGPaaS(474c3af4-bd8c-45e8-a3a1-846db4779361): verify_on_setup passed
2025-10-02 03:34:34,775 - INFO - We will configure BGP on the VM
2025-10-02 03:34:35,018 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:34:35,018 - INFO - Configuring BGP on ctest-TestBGPaasZone-83084478-35429369
2025-10-02 03:34:35,018 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.3;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.3;
}
protocol bfd {
neighbor 73.178.24.1 local 73.178.24.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:34:35,019 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.3;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.3;
}
protocol bfd {
neighbor 73.178.24.1 local 73.178.24.3 multihop on;
}
EOS
2025-10-02 03:34:47,366 - DEBUG - None
2025-10-02 03:34:47,366 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.3;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.3;
}
protocol bfd {
neighbor 73.178.24.1 local 73.178.24.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:34:47,366 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.3;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.3;
}
protocol bfd {
neighbor 73.178.24.1 local 73.178.24.3 multihop on;
}
EOS
2025-10-02 03:34:48,357 - DEBUG - None
2025-10-02 03:34:48,357 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:34:48,357 - DEBUG - service bird restart
2025-10-02 03:34:51,632 - DEBUG - bird stop/waiting
bird start/running, process 1430
2025-10-02 03:34:51,632 - INFO - Attaching VMI 795abeb6-480f-4d53-b34a-b1c46469fe80 to BGPaaS 474c3af4-bd8c-45e8-a3a1-846db4779361
2025-10-02 03:34:51,711 - INFO - Attaching the VMI ed28a33e-7022-4b91-a807-3c103c790611 to the BGPaaS 474c3af4-bd8c-45e8-a3a1-846db4779361 object
2025-10-02 03:34:51,711 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 73.178.24.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:34:51,712 - DEBUG - sudo ip addr add 73.178.24.20 dev eth0
2025-10-02 03:34:53,261 - DEBUG - None
2025-10-02 03:34:53,322 - INFO - Creating BGPaaS ctest-TestBGPaasZone-83084478-57423050
2025-10-02 03:34:53,394 - INFO - BGPaaS: ctest-TestBGPaasZone-83084478-57423050(bfafe1a0-66b8-4616-aa6a-5437d5abc13a)
2025-10-02 03:34:53,395 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/bfafe1a0-66b8-4616-aa6a-5437d5abc13a
2025-10-02 03:34:53,405 - INFO - verify_in_api_server passed for BGPaaS obj bfafe1a0-66b8-4616-aa6a-5437d5abc13a
2025-10-02 03:34:53,405 - INFO - BGPaaS(bfafe1a0-66b8-4616-aa6a-5437d5abc13a): verify_on_setup passed
2025-10-02 03:34:53,405 - INFO - We will configure BGP on the VM
2025-10-02 03:34:53,642 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:34:53,642 - INFO - Configuring BGP on ctest-TestBGPaasZone-83084478-21519739
2025-10-02 03:34:53,642 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.4;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.4;
}
protocol bfd {
neighbor 73.178.24.2 local 73.178.24.4 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:34:53,643 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.4;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.4;
}
protocol bfd {
neighbor 73.178.24.2 local 73.178.24.4 multihop on;
}
EOS
2025-10-02 03:34:58,748 - DEBUG - None
2025-10-02 03:34:58,748 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.4;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.4;
}
protocol bfd {
neighbor 73.178.24.2 local 73.178.24.4 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:34:58,748 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.4;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.4;
}
protocol bfd {
neighbor 73.178.24.2 local 73.178.24.4 multihop on;
}
EOS
2025-10-02 03:34:59,225 - DEBUG - None
2025-10-02 03:34:59,225 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:34:59,225 - DEBUG - service bird restart
2025-10-02 03:35:00,916 - DEBUG - bird stop/waiting
bird start/running, process 1441
2025-10-02 03:35:00,916 - INFO - Attaching VMI a7728dae-7247-4f43-b65b-a060e7970241 to BGPaaS bfafe1a0-66b8-4616-aa6a-5437d5abc13a
2025-10-02 03:35:00,998 - INFO - Attaching the VMI 9887b125-fd70-400e-a816-3b936a98c0a0 to the BGPaaS bfafe1a0-66b8-4616-aa6a-5437d5abc13a object
2025-10-02 03:35:00,998 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 73.178.24.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:35:00,998 - DEBUG - sudo ip addr add 73.178.24.20 dev eth0
2025-10-02 03:35:01,622 - DEBUG - None
2025-10-02 03:35:01,622 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:35:01,637 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-10-02 03:35:01,644 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:35:01,645 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-02 03:35:01,666 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2025-10-02 03:35:07,666 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-02 03:35:07,687 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2025-10-02 03:35:13,689 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-02 03:35:13,713 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-02 03:35:13,721 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 73.178.24.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:35:13,722 - DEBUG - ping -s 56 -c 3 -W 1 73.178.24.20
2025-10-02 03:35:20,240 - DEBUG - PING 73.178.24.20 (73.178.24.20) 56(84) bytes of data.
64 bytes from 73.178.24.20: icmp_seq=1 ttl=64 time=9.10 ms
64 bytes from 73.178.24.20: icmp_seq=2 ttl=64 time=1.71 ms
64 bytes from 73.178.24.20: icmp_seq=3 ttl=64 time=1.56 ms
--- 73.178.24.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.562/4.127/9.104/3.519 ms
2025-10-02 03:35:20,240 - INFO - Ping to IP 73.178.24.20 from VM ctest-TestBGPaasZone-83084478-35815550 passed
2025-10-02 03:35:21,054 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:35:21,054 - DEBUG - service bird restart
2025-10-02 03:35:22,729 - DEBUG - bird stop/waiting
bird start/running, process 1466
2025-10-02 03:35:22,729 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:35:22,729 - DEBUG - service bird restart
2025-10-02 03:35:24,289 - DEBUG - bird stop/waiting
bird start/running, process 1468
2025-10-02 03:35:24,290 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:35:24,311 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14']
2025-10-02 03:35:30,330 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-10-02 03:35:30,337 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:35:30,337 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-02 03:35:30,353 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-02 03:35:30,359 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 73.178.24.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:35:30,359 - DEBUG - ping -s 56 -c 3 -W 1 73.178.24.20
2025-10-02 03:35:32,859 - DEBUG - PING 73.178.24.20 (73.178.24.20) 56(84) bytes of data.
64 bytes from 73.178.24.20: icmp_seq=1 ttl=64 time=4.92 ms
64 bytes from 73.178.24.20: icmp_seq=2 ttl=64 time=0.854 ms
64 bytes from 73.178.24.20: icmp_seq=3 ttl=64 time=0.874 ms
--- 73.178.24.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.854/2.218/4.927/1.915 ms
2025-10-02 03:35:32,859 - INFO - Ping to IP 73.178.24.20 from VM ctest-TestBGPaasZone-83084478-35815550 passed
2025-10-02 03:35:33,152 - INFO - We will configure BGP on the VM
2025-10-02 03:35:33,358 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:35:33,358 - INFO - Configuring BGP on ctest-TestBGPaasZone-83084478-35429369
2025-10-02 03:35:33,359 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.3;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.3;
}
protocol bfd {
neighbor 73.178.24.1 local 73.178.24.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:35:33,359 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.3;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.3;
}
protocol bfd {
neighbor 73.178.24.1 local 73.178.24.3 multihop on;
}
EOS
2025-10-02 03:35:33,904 - DEBUG - None
2025-10-02 03:35:33,904 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.3;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.3;
}
protocol bfd {
neighbor 73.178.24.1 local 73.178.24.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:35:33,904 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 73.178.24.3;
protocol bgp bgp_1{
local as 65000;
neighbor 73.178.24.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 73.178.24.3;
}
protocol bfd {
neighbor 73.178.24.1 local 73.178.24.3 multihop on;
}
EOS
2025-10-02 03:35:34,421 - DEBUG - None
2025-10-02 03:35:34,422 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:35:34,422 - DEBUG - service bird restart
2025-10-02 03:35:36,235 - DEBUG - bird stop/waiting
bird start/running, process 1498
2025-10-02 03:35:36,235 - INFO - Attaching VMI 795abeb6-480f-4d53-b34a-b1c46469fe80 to BGPaaS 474c3af4-bd8c-45e8-a3a1-846db4779361
2025-10-02 03:35:36,255 - INFO - Attaching the VMI ed28a33e-7022-4b91-a807-3c103c790611 to the BGPaaS 474c3af4-bd8c-45e8-a3a1-846db4779361 object
2025-10-02 03:35:36,256 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 73.178.24.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:35:36,256 - DEBUG - sudo ip addr add 73.178.24.20 dev eth0
2025-10-02 03:35:36,962 - DEBUG - RTNETLINK answers: File exists
2025-10-02 03:35:36,962 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:35:36,962 - DEBUG - service bird restart
2025-10-02 03:35:38,733 - DEBUG - bird stop/waiting
bird start/running, process 1525
2025-10-02 03:35:38,733 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:35:38,734 - DEBUG - service bird restart
2025-10-02 03:35:40,245 - DEBUG - bird stop/waiting
bird start/running, process 1490
2025-10-02 03:35:40,245 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:35:40,257 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2025-10-02 03:35:46,276 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-10-02 03:35:46,284 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:35:46,284 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-02 03:35:46,305 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2025-10-02 03:35:52,306 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-02 03:35:52,326 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-02 03:35:52,336 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 73.178.24.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:35:52,336 - DEBUG - ping -s 56 -c 3 -W 1 73.178.24.20
2025-10-02 03:35:54,815 - DEBUG - PING 73.178.24.20 (73.178.24.20) 56(84) bytes of data.
64 bytes from 73.178.24.20: icmp_seq=1 ttl=64 time=4.01 ms
64 bytes from 73.178.24.20: icmp_seq=2 ttl=64 time=1.31 ms
64 bytes from 73.178.24.20: icmp_seq=3 ttl=64 time=1.20 ms
--- 73.178.24.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.201/2.174/4.010/1.299 ms
2025-10-02 03:35:54,815 - INFO - Ping to IP 73.178.24.20 from VM ctest-TestBGPaasZone-83084478-35815550 passed
2025-10-02 03:35:54,815 - INFO - Detaching VMI 795abeb6-480f-4d53-b34a-b1c46469fe80 from BGPaaS 474c3af4-bd8c-45e8-a3a1-846db4779361
2025-10-02 03:35:54,890 - INFO - Detaching VMI a7728dae-7247-4f43-b65b-a060e7970241 from BGPaaS bfafe1a0-66b8-4616-aa6a-5437d5abc13a
2025-10-02 03:35:54,966 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-83084478-57423050(bfafe1a0-66b8-4616-aa6a-5437d5abc13a)
2025-10-02 03:35:55,011 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/bfafe1a0-66b8-4616-aa6a-5437d5abc13a
2025-10-02 03:35:55,018 - DEBUG - Response Code: 404
2025-10-02 03:35:55,018 - DEBUG - BGPaaS: bfafe1a0-66b8-4616-aa6a-5437d5abc13a deleted from api server
2025-10-02 03:35:55,018 - INFO - BGPaaS(bfafe1a0-66b8-4616-aa6a-5437d5abc13a): verify_on_cleanup passed
2025-10-02 03:35:55,018 - INFO - Detaching VMI 795abeb6-480f-4d53-b34a-b1c46469fe80 from BGPaaS 474c3af4-bd8c-45e8-a3a1-846db4779361
2025-10-02 03:35:55,033 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-83084478-94250547(474c3af4-bd8c-45e8-a3a1-846db4779361)
2025-10-02 03:35:55,075 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/474c3af4-bd8c-45e8-a3a1-846db4779361
2025-10-02 03:35:55,082 - DEBUG - Response Code: 404
2025-10-02 03:35:55,082 - DEBUG - BGPaaS: 474c3af4-bd8c-45e8-a3a1-846db4779361 deleted from api server
2025-10-02 03:35:55,082 - INFO - BGPaaS(474c3af4-bd8c-45e8-a3a1-846db4779361): verify_on_cleanup passed
2025-10-02 03:35:55,082 - INFO - Deleting Control node zone ctest-test-zone-49905267(74c1f677-1f82-4a5b-8ef2-4eb78b4ce4d5)
2025-10-02 03:35:55,229 - INFO - Deleting Control node zone ctest-test-zone-30980802(b7e0e0a2-81c0-4c4f-9493-e3fe37bc17d2)
2025-10-02 03:35:55,387 - INFO - Deleting Control node zone ctest-test-zone-88306085(9b60eacd-2e5a-4e0c-8f86-c1e4124c19ff)
2025-10-02 03:35:55,485 - INFO - Deleting VM ctest-TestBGPaasZone-83084478-35815550
2025-10-02 03:35:55,598 - INFO - Deleting VM ctest-TestBGPaasZone-83084478-21519739
2025-10-02 03:35:55,689 - INFO - Deleting VM ctest-TestBGPaasZone-83084478-35429369
2025-10-02 03:35:55,756 - INFO - Deleting VN ctest-cnz_vn-22567137
2025-10-02 03:35:55,795 - DEBUG - VN 1d6d84e3-5b98-4400-ba67-a3b8dbfb0c1f still in use: Unable to complete operation on network 1d6d84e3-5b98-4400-ba67-a3b8dbfb0c1f. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-7ca22cca-717c-4641-a4d9-bc47c6163b66']
2025-10-02 03:35:55,795 - WARNING - Deleting VN ctest-cnz_vn-22567137 failed..Will retry
2025-10-02 03:35:58,029 - DEBUG - Response for deleting network ()
2025-10-02 03:35:59,299 - DEBUG - Skipping xmpp flap check
2025-10-02 03:35:59,299 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:18]
2025-10-02 03:35:59,300 - INFO - --------------------------------------------------------------------------------
2025-10-02 03:35:59,304 - INFO - ================================================================================
2025-10-02 03:35:59,304 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf
2025-10-02 03:36:00,578 - DEBUG - Skipping xmpp flap check
2025-10-02 03:36:00,578 - INFO - Initial checks done. Running the testcase now
2025-10-02 03:36:00,579 - INFO -
2025-10-02 03:36:00,579 - INFO - executing bgp_control_zone agent restart test
2025-10-02 03:36:00,903 - DEBUG - Response for create_network : {'network': {'id': '48704fcb-84f5-40df-add5-7f38d4f9555b', 'name': 'ctest-cnz_vn-55951712', 'tenant_id': 'c3a5c8a4e0e84c148800c2d93a0d2fff', 'project_id': 'c3a5c8a4e0e84c148800c2d93a0d2fff', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-83084478', 'ctest-cnz_vn-55951712'], 'port_security_enabled': True, 'description': ''}}
2025-10-02 03:36:01,169 - DEBUG - Response for create_subnet : {'subnet': {'id': '9f1f1cc1-fff0-41af-a793-0e8b2a460067', 'name': '', 'tenant_id': 'c3a5c8a4e0e84c148800c2d93a0d2fff', 'network_id': '48704fcb-84f5-40df-add5-7f38d4f9555b', 'ip_version': 4, 'cidr': '46.195.94.128/26', 'allocation_pools': [{'start': '46.195.94.130', 'end': '46.195.94.190'}], 'gateway_ip': '46.195.94.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '46.195.94.130', 'tags': [], 'project_id': 'c3a5c8a4e0e84c148800c2d93a0d2fff'}}
2025-10-02 03:36:01,191 - INFO - Created VN ctest-cnz_vn-55951712
2025-10-02 03:36:01,206 - DEBUG - VN ctest-cnz_vn-55951712 UUID is 48704fcb-84f5-40df-add5-7f38d4f9555b
2025-10-02 03:36:02,339 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4210-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4210-1)
2025-10-02 03:36:03,580 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4210-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4210-2)
2025-10-02 03:36:04,896 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4210-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4210-1)
2025-10-02 03:36:04,896 - INFO - Waiting for VM ctest-TestBGPaasZone-83084478-54019484 to be up..
2025-10-02 03:36:04,976 - DEBUG - VM is in ACTIVE state now
2025-10-02 03:36:04,976 - INFO - VM name : ctest-TestBGPaasZone-83084478-54019484
2025-10-02 03:36:05,070 - DEBUG - VM ctest-TestBGPaasZone-83084478-54019484 ID is 16cdb51f-e811-4559-812b-10448ef385b0
2025-10-02 03:36:05,070 - DEBUG - VM ctest-TestBGPaasZone-83084478-54019484 launched on Node an-jenkins-deploy-platform-ansible-os-4210-1
2025-10-02 03:36:05,161 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/16cdb51f-e811-4559-812b-10448ef385b0
2025-10-02 03:36:05,177 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/ad593358-2aeb-45f5-8d49-87f0834645bb
2025-10-02 03:36:08,355 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2025-10-02 03:36:08,355 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:08,370 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:12,447 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms')
2025-10-02 03:36:12,447 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:12,462 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:16,547 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms')
2025-10-02 03:36:16,547 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:16,563 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:20,644 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-10-02 03:36:20,644 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:20,660 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:24,738 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-10-02 03:36:24,738 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:24,753 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:28,831 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-10-02 03:36:28,831 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:28,847 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:32,929 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-02 03:36:32,929 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:32,942 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:37,025 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms')
2025-10-02 03:36:37,025 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:37,038 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:41,117 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms')
2025-10-02 03:36:41,117 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:41,129 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:45,214 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms')
2025-10-02 03:36:45,214 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:45,252 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:49,340 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms')
2025-10-02 03:36:49,340 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:49,353 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:53,441 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2025-10-02 03:36:53,441 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:53,456 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:36:57,540 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms')
2025-10-02 03:36:57,541 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:36:57,559 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:37:01,628 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms')
2025-10-02 03:37:01,628 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:37:01,642 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:37:05,723 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-10-02 03:37:05,723 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:37:05,737 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:37:09,828 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2025-10-02 03:37:09,828 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:37:09,841 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:37:13,919 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-10-02 03:37:13,919 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:37:13,933 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:37:18,012 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-10-02 03:37:18,012 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:37:18,026 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:37:22,110 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms')
2025-10-02 03:37:22,110 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 failed!
2025-10-02 03:37:22,125 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-83084478:ctest-cnz_vn-55951712 is 46.195.94.129 and allocation pool is NOT set
2025-10-02 03:37:24,199 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.42 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=9.99 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 4.420/7.203/9.986/2.783 ms')
2025-10-02 03:37:24,199 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-54019484 passed
2025-10-02 03:37:24,271 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:37:24,271 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-54019484, IP 46.195.94.131, Port 22
2025-10-02 03:37:24,335 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:37:24,492 - DEBUG - VM ctest-TestBGPaasZone-83084478-54019484 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:37:29,493 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:37:29,493 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-54019484, IP 46.195.94.131, Port 22
2025-10-02 03:37:29,550 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:37:29,657 - DEBUG - VM ctest-TestBGPaasZone-83084478-54019484 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:37:34,658 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:37:34,658 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-54019484, IP 46.195.94.131, Port 22
2025-10-02 03:37:34,723 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:37:34,801 - DEBUG - VM ctest-TestBGPaasZone-83084478-54019484 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:37:39,801 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:37:39,801 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-54019484, IP 46.195.94.131, Port 22
2025-10-02 03:37:39,862 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:37:39,941 - DEBUG - VM ctest-TestBGPaasZone-83084478-54019484 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:37:44,941 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:37:44,941 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-54019484, IP 46.195.94.131, Port 22
2025-10-02 03:37:45,007 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:37:45,086 - DEBUG - VM ctest-TestBGPaasZone-83084478-54019484 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:37:50,086 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:37:50,087 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-54019484, IP 46.195.94.131, Port 22
2025-10-02 03:37:50,151 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:37:50,228 - DEBUG - VM ctest-TestBGPaasZone-83084478-54019484 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:37:55,229 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:37:55,229 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-54019484, IP 46.195.94.131, Port 22
2025-10-02 03:37:55,296 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:37:55,373 - DEBUG - VM ctest-TestBGPaasZone-83084478-54019484 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:38:00,374 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:00,374 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-54019484, IP 46.195.94.131, Port 22
2025-10-02 03:38:00,429 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-02 03:38:00,511 - DEBUG - VM ctest-TestBGPaasZone-83084478-54019484 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-02 03:38:05,512 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:05,512 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-54019484, IP 46.195.94.131, Port 22
2025-10-02 03:38:05,692 - DEBUG - VM ctest-TestBGPaasZone-83084478-54019484 is ready for SSH connections
2025-10-02 03:38:05,692 - INFO - Waiting for VM ctest-TestBGPaasZone-83084478-32212757 to be up..
2025-10-02 03:38:05,786 - DEBUG - VM is in ACTIVE state now
2025-10-02 03:38:05,786 - INFO - VM name : ctest-TestBGPaasZone-83084478-32212757
2025-10-02 03:38:05,873 - DEBUG - VM ctest-TestBGPaasZone-83084478-32212757 ID is cd6c5e67-12c2-4b60-b278-32dd503b2567
2025-10-02 03:38:05,873 - DEBUG - VM ctest-TestBGPaasZone-83084478-32212757 launched on Node an-jenkins-deploy-platform-ansible-os-4210-2
2025-10-02 03:38:05,950 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/cd6c5e67-12c2-4b60-b278-32dd503b2567
2025-10-02 03:38:05,982 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/83211b9e-e526-48fe-b0b7-b2a907903ab5
2025-10-02 03:38:07,156 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.21 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.654 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.654/4.934/9.214/4.280 ms')
2025-10-02 03:38:07,156 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-83084478-32212757 passed
2025-10-02 03:38:07,227 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:07,227 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-32212757, IP 46.195.94.132, Port 22
2025-10-02 03:38:07,387 - DEBUG - VM ctest-TestBGPaasZone-83084478-32212757 is ready for SSH connections
2025-10-02 03:38:07,387 - INFO - Waiting for VM ctest-TestBGPaasZone-83084478-34779767 to be up..
2025-10-02 03:38:07,489 - DEBUG - VM is in ACTIVE state now
2025-10-02 03:38:07,489 - INFO - VM name : ctest-TestBGPaasZone-83084478-34779767
2025-10-02 03:38:07,578 - DEBUG - VM ctest-TestBGPaasZone-83084478-34779767 ID is a1f4a5de-79ba-4cd6-bf25-fadfe417d050
2025-10-02 03:38:07,578 - DEBUG - VM ctest-TestBGPaasZone-83084478-34779767 launched on Node an-jenkins-deploy-platform-ansible-os-4210-1
2025-10-02 03:38:07,669 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/a1f4a5de-79ba-4cd6-bf25-fadfe417d050
2025-10-02 03:38:07,681 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/fbee9fec-8ff3-476b-9302-7be7869b973c
2025-10-02 03:38:08,850 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.25 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.783 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.783/2.015/3.247/1.232 ms')
2025-10-02 03:38:08,850 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-83084478-34779767 passed
2025-10-02 03:38:08,919 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:08,919 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-83084478-34779767, IP 46.195.94.133, Port 22
2025-10-02 03:38:09,198 - DEBUG - VM ctest-TestBGPaasZone-83084478-34779767 is ready for SSH connections
2025-10-02 03:38:09,334 - INFO - Created control node zone ctest-test-zone-45202178(462d0675-1ac8-4e1d-91e6-a0c1ef21e46e)
2025-10-02 03:38:09,687 - INFO - Created control node zone ctest-test-zone-53719591(eb843210-e00b-4e18-a718-6fcf2a7272ec)
2025-10-02 03:38:10,038 - INFO - Created control node zone ctest-test-zone-03003161(5bb2b555-22f5-4848-b7fb-22326dfeade1)
2025-10-02 03:38:10,322 - INFO - Creating BGPaaS ctest-TestBGPaasZone-83084478-35030579
2025-10-02 03:38:10,394 - INFO - BGPaaS: ctest-TestBGPaasZone-83084478-35030579(02a5bb1d-2587-4014-b8a8-0179cd0f9d56)
2025-10-02 03:38:10,395 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/02a5bb1d-2587-4014-b8a8-0179cd0f9d56
2025-10-02 03:38:10,404 - INFO - verify_in_api_server passed for BGPaaS obj 02a5bb1d-2587-4014-b8a8-0179cd0f9d56
2025-10-02 03:38:10,404 - INFO - BGPaaS(02a5bb1d-2587-4014-b8a8-0179cd0f9d56): verify_on_setup passed
2025-10-02 03:38:10,404 - INFO - We will configure BGP on the VM
2025-10-02 03:38:10,834 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:10,835 - INFO - Configuring BGP on ctest-TestBGPaasZone-83084478-54019484
2025-10-02 03:38:10,835 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 46.195.94.131;
protocol bgp bgp_1{
local as 65000;
neighbor 46.195.94.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.195.94.131;
}
protocol bfd {
neighbor 46.195.94.129 local 46.195.94.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:38:10,835 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 46.195.94.131;
protocol bgp bgp_1{
local as 65000;
neighbor 46.195.94.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.195.94.131;
}
protocol bfd {
neighbor 46.195.94.129 local 46.195.94.131 multihop on;
}
EOS
2025-10-02 03:38:23,327 - DEBUG - None
2025-10-02 03:38:23,328 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 46.195.94.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.195.94.131;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:38:23,328 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 46.195.94.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.195.94.131;
}
EOS
2025-10-02 03:38:24,235 - DEBUG - None
2025-10-02 03:38:24,235 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:38:24,235 - DEBUG - service bird restart
2025-10-02 03:38:27,131 - DEBUG - bird stop/waiting
bird start/running, process 1438
2025-10-02 03:38:27,131 - INFO - Attaching VMI ad593358-2aeb-45f5-8d49-87f0834645bb to BGPaaS 02a5bb1d-2587-4014-b8a8-0179cd0f9d56
2025-10-02 03:38:27,206 - INFO - Attaching the VMI 16cdb51f-e811-4559-812b-10448ef385b0 to the BGPaaS 02a5bb1d-2587-4014-b8a8-0179cd0f9d56 object
2025-10-02 03:38:27,207 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 46.195.94.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:38:27,207 - DEBUG - sudo ip addr add 46.195.94.148 dev eth0
2025-10-02 03:38:28,108 - DEBUG - None
2025-10-02 03:38:28,170 - INFO - Creating BGPaaS ctest-TestBGPaasZone-83084478-01529643
2025-10-02 03:38:28,270 - INFO - BGPaaS: ctest-TestBGPaasZone-83084478-01529643(5971e823-fdaa-4b46-a6a7-758a5b4a571b)
2025-10-02 03:38:28,271 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/5971e823-fdaa-4b46-a6a7-758a5b4a571b
2025-10-02 03:38:28,281 - INFO - verify_in_api_server passed for BGPaaS obj 5971e823-fdaa-4b46-a6a7-758a5b4a571b
2025-10-02 03:38:28,281 - INFO - BGPaaS(5971e823-fdaa-4b46-a6a7-758a5b4a571b): verify_on_setup passed
2025-10-02 03:38:28,281 - INFO - We will configure BGP on the VM
2025-10-02 03:38:28,719 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:28,719 - INFO - Configuring BGP on ctest-TestBGPaasZone-83084478-32212757
2025-10-02 03:38:28,719 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 46.195.94.132;
protocol bgp bgp_1{
local as 65000;
neighbor 46.195.94.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.195.94.132;
}
protocol bfd {
neighbor 46.195.94.129 local 46.195.94.132 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:38:28,719 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 46.195.94.132;
protocol bgp bgp_1{
local as 65000;
neighbor 46.195.94.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.195.94.132;
}
protocol bfd {
neighbor 46.195.94.129 local 46.195.94.132 multihop on;
}
EOS
2025-10-02 03:38:34,228 - DEBUG - None
2025-10-02 03:38:34,229 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 46.195.94.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.195.94.132;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:38:34,229 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 46.195.94.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 46.195.94.132;
}
EOS
2025-10-02 03:38:34,762 - DEBUG - None
2025-10-02 03:38:34,762 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:38:34,763 - DEBUG - service bird restart
2025-10-02 03:38:36,569 - DEBUG - bird stop/waiting
bird start/running, process 1440
2025-10-02 03:38:36,569 - INFO - Attaching VMI 83211b9e-e526-48fe-b0b7-b2a907903ab5 to BGPaaS 5971e823-fdaa-4b46-a6a7-758a5b4a571b
2025-10-02 03:38:36,650 - INFO - Attaching the VMI cd6c5e67-12c2-4b60-b278-32dd503b2567 to the BGPaaS 5971e823-fdaa-4b46-a6a7-758a5b4a571b object
2025-10-02 03:38:36,651 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 46.195.94.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-10-02 03:38:36,651 - DEBUG - sudo ip addr add 46.195.94.148 dev eth0
2025-10-02 03:38:37,353 - DEBUG - None
2025-10-02 03:38:37,353 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:37,369 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-10-02 03:38:37,369 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:37,369 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-02 03:38:37,393 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-02 03:38:37,399 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:37,412 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2025-10-02 03:38:43,431 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2025-10-02 03:38:49,445 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-10-02 03:38:49,446 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:49,446 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-02 03:38:49,466 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-02 03:38:49,473 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 46.195.94.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:38:49,473 - DEBUG - ping -s 56 -c 3 -W 1 46.195.94.148
2025-10-02 03:38:55,239 - DEBUG - PING 46.195.94.148 (46.195.94.148) 56(84) bytes of data.
64 bytes from 46.195.94.148: icmp_seq=1 ttl=64 time=7.75 ms
64 bytes from 46.195.94.148: icmp_seq=2 ttl=64 time=1.12 ms
64 bytes from 46.195.94.148: icmp_seq=3 ttl=64 time=1.20 ms
--- 46.195.94.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.126/3.362/7.752/3.104 ms
2025-10-02 03:38:55,239 - INFO - Ping to IP 46.195.94.148 from VM ctest-TestBGPaasZone-83084478-34779767 passed
2025-10-02 03:38:55,239 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:55,252 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-10-02 03:38:55,252 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:55,252 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-02 03:38:55,270 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-02 03:38:55,275 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:55,287 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-10-02 03:38:55,287 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-02 03:38:55,287 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-02 03:38:55,307 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-10-02 03:38:55,313 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 46.195.94.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.33, gateway password: c0ntrail123
2025-10-02 03:38:55,313 - DEBUG - ping -s 56 -c 3 -W 1 46.195.94.148
2025-10-02 03:38:57,757 - DEBUG - PING 46.195.94.148 (46.195.94.148) 56(84) bytes of data.
64 bytes from 46.195.94.148: icmp_seq=1 ttl=64 time=3.66 ms
64 bytes from 46.195.94.148: icmp_seq=2 ttl=64 time=0.702 ms
64 bytes from 46.195.94.148: icmp_seq=3 ttl=64 time=0.704 ms
--- 46.195.94.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.702/1.691/3.667/1.397 ms
2025-10-02 03:38:57,757 - INFO - Ping to IP 46.195.94.148 from VM ctest-TestBGPaasZone-83084478-34779767 passed
2025-10-02 03:38:57,757 - INFO - Detaching VMI 83211b9e-e526-48fe-b0b7-b2a907903ab5 from BGPaaS 5971e823-fdaa-4b46-a6a7-758a5b4a571b
2025-10-02 03:38:57,838 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-83084478-01529643(5971e823-fdaa-4b46-a6a7-758a5b4a571b)
2025-10-02 03:38:57,908 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/5971e823-fdaa-4b46-a6a7-758a5b4a571b
2025-10-02 03:38:57,926 - DEBUG - Response Code: 404
2025-10-02 03:38:57,927 - DEBUG - BGPaaS: 5971e823-fdaa-4b46-a6a7-758a5b4a571b deleted from api server
2025-10-02 03:38:57,927 - INFO - BGPaaS(5971e823-fdaa-4b46-a6a7-758a5b4a571b): verify_on_cleanup passed
2025-10-02 03:38:57,927 - INFO - Detaching VMI ad593358-2aeb-45f5-8d49-87f0834645bb from BGPaaS 02a5bb1d-2587-4014-b8a8-0179cd0f9d56
2025-10-02 03:38:58,022 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-83084478-35030579(02a5bb1d-2587-4014-b8a8-0179cd0f9d56)
2025-10-02 03:38:58,089 - DEBUG - Requesting: http://10.0.0.56:8082/bgp-as-a-service/02a5bb1d-2587-4014-b8a8-0179cd0f9d56
2025-10-02 03:38:58,099 - DEBUG - Response Code: 404
2025-10-02 03:38:58,099 - DEBUG - BGPaaS: 02a5bb1d-2587-4014-b8a8-0179cd0f9d56 deleted from api server
2025-10-02 03:38:58,099 - INFO - BGPaaS(02a5bb1d-2587-4014-b8a8-0179cd0f9d56): verify_on_cleanup passed
2025-10-02 03:38:58,099 - INFO - Deleting Control node zone ctest-test-zone-03003161(5bb2b555-22f5-4848-b7fb-22326dfeade1)
2025-10-02 03:38:58,251 - INFO - Deleting Control node zone ctest-test-zone-53719591(eb843210-e00b-4e18-a718-6fcf2a7272ec)
2025-10-02 03:38:58,396 - INFO - Deleting Control node zone ctest-test-zone-45202178(462d0675-1ac8-4e1d-91e6-a0c1ef21e46e)
2025-10-02 03:38:58,547 - INFO - Deleting VM ctest-TestBGPaasZone-83084478-34779767
2025-10-02 03:38:58,612 - INFO - Deleting VM ctest-TestBGPaasZone-83084478-32212757
2025-10-02 03:38:58,677 - INFO - Deleting VM ctest-TestBGPaasZone-83084478-54019484
2025-10-02 03:38:58,741 - INFO - Deleting VN ctest-cnz_vn-55951712
2025-10-02 03:38:58,780 - DEBUG - VN 48704fcb-84f5-40df-add5-7f38d4f9555b still in use: Unable to complete operation on network 48704fcb-84f5-40df-add5-7f38d4f9555b. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-10170333-4016-4775-9743-346138683e10']
2025-10-02 03:38:58,781 - WARNING - Deleting VN ctest-cnz_vn-55951712 failed..Will retry
2025-10-02 03:39:00,999 - DEBUG - Response for deleting network ()
2025-10-02 03:39:02,290 - DEBUG - Skipping xmpp flap check
2025-10-02 03:39:02,291 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:03]
2025-10-02 03:39:02,291 - INFO - --------------------------------------------------------------------------------
2025-10-02 03:39:02,997 - INFO - Deleted project: ctest-TestBGPaasZone-83084478, ID : c3a5c8a4-e0e8-4c14-8800-c2d93a0d2fff