2025-10-08 15:08:10,814 - INFO - Domain Default found not creating 2025-10-08 15:08:10,962 - INFO - Project ctest-TestBGPaasZone-16052242 not found, creating it 2025-10-08 15:08:11,504 - INFO - Created Project:ctest-TestBGPaasZone-16052242, ID : eaa6425f-d635-4760-b7ab-06ac990c835a 2025-10-08 15:08:12,971 - DEBUG - Services list from nova: [, , , ] 2025-10-08 15:08:12,971 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4234-2', 'an-jenkins-deploy-platform-ansible-os-4234-1']} 2025-10-08 15:08:12,973 - INFO - ================================================================================ 2025-10-08 15:08:12,973 - INFO - STARTING TEST : test_bgp_control_node_zone 2025-10-08 15:08:14,241 - DEBUG - Skipping xmpp flap check 2025-10-08 15:08:14,241 - INFO - Initial checks done. Running the testcase now 2025-10-08 15:08:14,241 - INFO - 2025-10-08 15:08:14,242 - INFO - executing bgp_control_zone test 2025-10-08 15:08:14,904 - DEBUG - Response for create_network : {'network': {'id': 'c6d3166a-8fb7-403c-ba32-37069bf3a552', 'name': 'ctest-cnz_vn-43603708', 'tenant_id': 'eaa6425fd6354760b7ab06ac990c835a', 'project_id': 'eaa6425fd6354760b7ab06ac990c835a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-16052242', 'ctest-cnz_vn-43603708'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 15:08:15,202 - DEBUG - Response for create_subnet : {'subnet': {'id': '562820a4-7257-4fad-9019-21802938770c', 'name': '', 'tenant_id': 'eaa6425fd6354760b7ab06ac990c835a', 'network_id': 'c6d3166a-8fb7-403c-ba32-37069bf3a552', 'ip_version': 4, 'cidr': '81.166.143.128/26', 'allocation_pools': [{'start': '81.166.143.130', 'end': '81.166.143.190'}], 'gateway_ip': '81.166.143.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '81.166.143.130', 'tags': [], 'project_id': 'eaa6425fd6354760b7ab06ac990c835a'}} 2025-10-08 15:08:15,224 - INFO - Created VN ctest-cnz_vn-43603708 2025-10-08 15:08:15,236 - DEBUG - VN ctest-cnz_vn-43603708 UUID is c6d3166a-8fb7-403c-ba32-37069bf3a552 2025-10-08 15:08:16,363 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4234-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4234-2) 2025-10-08 15:08:17,623 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4234-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4234-1) 2025-10-08 15:08:19,129 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4234-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4234-2) 2025-10-08 15:08:19,129 - INFO - Waiting for VM ctest-TestBGPaasZone-16052242-37575257 to be up.. 2025-10-08 15:08:19,227 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-08 15:08:24,296 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-08 15:08:29,396 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-08 15:08:34,475 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-08 15:08:39,559 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-08 15:08:44,646 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-08 15:08:49,729 - DEBUG - VM is in ACTIVE state now 2025-10-08 15:08:49,729 - INFO - VM name : ctest-TestBGPaasZone-16052242-37575257 2025-10-08 15:08:49,803 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 ID is d0d88c26-579b-40b3-acbf-fd19577cb6fc 2025-10-08 15:08:49,825 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 launched on Node an-jenkins-deploy-platform-ansible-os-4234-2 2025-10-08 15:08:49,895 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/d0d88c26-579b-40b3-acbf-fd19577cb6fc 2025-10-08 15:08:50,184 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/d0d88c26-579b-40b3-acbf-fd19577cb6fc 2025-10-08 15:08:50,215 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/643dc4b8-e5c4-44a0-bd19-d445e0955240 2025-10-08 15:08:53,404 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1033ms') 2025-10-08 15:08:53,404 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:08:53,418 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:08:57,502 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-10-08 15:08:57,502 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:08:57,517 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:01,595 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-08 15:09:01,595 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:01,610 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:05,699 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-08 15:09:05,699 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:05,714 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:09,791 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-10-08 15:09:09,791 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:09,807 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:13,878 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-08 15:09:13,878 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:13,891 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:17,984 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-10-08 15:09:17,984 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:17,997 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:22,074 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-08 15:09:22,075 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:22,090 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:26,174 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-08 15:09:26,174 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:26,190 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:30,272 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-08 15:09:30,272 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:30,288 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:34,365 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-08 15:09:34,365 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:34,379 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:38,464 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-08 15:09:38,464 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:38,479 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:42,557 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-08 15:09:42,557 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:42,571 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:46,650 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-08 15:09:46,651 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:46,666 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:50,750 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-08 15:09:50,750 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:50,766 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:54,843 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-08 15:09:54,843 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:54,856 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:09:58,936 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-10-08 15:09:58,936 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:09:58,951 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:10:03,038 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-10-08 15:10:03,038 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:10:03,051 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:10:07,130 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-08 15:10:07,130 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:10:07,144 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:10:11,230 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-10-08 15:10:11,230 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 failed! 2025-10-08 15:10:11,247 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-43603708 is 81.166.143.129 and allocation pool is NOT set 2025-10-08 15:10:15,324 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=4.11 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1015ms\r\nrtt min/avg/max/mdev = 4.113/4.113/4.113/0.000 ms') 2025-10-08 15:10:15,325 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-37575257 passed 2025-10-08 15:10:15,396 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:10:15,396 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-37575257, IP 81.166.143.131, Port 22 2025-10-08 15:10:15,463 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:10:15,560 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:10:20,562 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:10:20,562 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-37575257, IP 81.166.143.131, Port 22 2025-10-08 15:10:20,628 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:10:20,712 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:10:25,712 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:10:25,712 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-37575257, IP 81.166.143.131, Port 22 2025-10-08 15:10:25,783 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:10:25,879 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:10:30,879 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:10:30,879 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-37575257, IP 81.166.143.131, Port 22 2025-10-08 15:10:30,949 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:10:31,033 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:10:36,034 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:10:36,034 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-37575257, IP 81.166.143.131, Port 22 2025-10-08 15:10:36,103 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:10:36,187 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:10:41,188 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:10:41,188 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-37575257, IP 81.166.143.131, Port 22 2025-10-08 15:10:41,256 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:10:41,334 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:10:46,334 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:10:46,334 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-37575257, IP 81.166.143.131, Port 22 2025-10-08 15:10:46,405 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:10:46,510 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:10:51,511 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:10:51,512 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-37575257, IP 81.166.143.131, Port 22 2025-10-08 15:10:51,579 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:10:51,654 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:10:56,655 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:10:56,655 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-37575257, IP 81.166.143.131, Port 22 2025-10-08 15:10:56,723 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:10:56,797 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:11:01,798 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:11:01,798 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-37575257, IP 81.166.143.131, Port 22 2025-10-08 15:11:01,863 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:11:01,935 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:11:06,937 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:11:06,937 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-37575257, IP 81.166.143.131, Port 22 2025-10-08 15:11:07,107 - DEBUG - VM ctest-TestBGPaasZone-16052242-37575257 is ready for SSH connections 2025-10-08 15:11:07,107 - INFO - Waiting for VM ctest-TestBGPaasZone-16052242-33994091 to be up.. 2025-10-08 15:11:07,190 - DEBUG - VM is in ACTIVE state now 2025-10-08 15:11:07,191 - INFO - VM name : ctest-TestBGPaasZone-16052242-33994091 2025-10-08 15:11:07,266 - DEBUG - VM ctest-TestBGPaasZone-16052242-33994091 ID is 549d2def-e61c-41e1-822d-cdd320c51d4e 2025-10-08 15:11:07,266 - DEBUG - VM ctest-TestBGPaasZone-16052242-33994091 launched on Node an-jenkins-deploy-platform-ansible-os-4234-1 2025-10-08 15:11:07,339 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/549d2def-e61c-41e1-822d-cdd320c51d4e 2025-10-08 15:11:07,348 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/c74b7136-bbe4-4763-b778-0eb27c4e0af5 2025-10-08 15:11:08,511 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.54 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.766 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.766/2.152/3.538/1.386 ms') 2025-10-08 15:11:08,511 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-33994091 passed 2025-10-08 15:11:08,581 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:11:08,581 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-33994091, IP 81.166.143.132, Port 22 2025-10-08 15:11:08,761 - DEBUG - VM ctest-TestBGPaasZone-16052242-33994091 is ready for SSH connections 2025-10-08 15:11:08,761 - INFO - Waiting for VM ctest-TestBGPaasZone-16052242-60604234 to be up.. 2025-10-08 15:11:08,834 - DEBUG - VM is in ACTIVE state now 2025-10-08 15:11:08,835 - INFO - VM name : ctest-TestBGPaasZone-16052242-60604234 2025-10-08 15:11:08,907 - DEBUG - VM ctest-TestBGPaasZone-16052242-60604234 ID is 37b0e863-e6bc-45f6-ae6b-94579beeb392 2025-10-08 15:11:08,907 - DEBUG - VM ctest-TestBGPaasZone-16052242-60604234 launched on Node an-jenkins-deploy-platform-ansible-os-4234-2 2025-10-08 15:11:08,978 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/37b0e863-e6bc-45f6-ae6b-94579beeb392 2025-10-08 15:11:08,989 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/287a818e-30a8-424e-814c-88ec6d2c65e2 2025-10-08 15:11:10,144 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.20 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.656 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.656/1.925/3.195/1.269 ms') 2025-10-08 15:11:10,144 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-16052242-60604234 passed 2025-10-08 15:11:10,217 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:11:10,217 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-60604234, IP 81.166.143.133, Port 22 2025-10-08 15:11:10,376 - DEBUG - VM ctest-TestBGPaasZone-16052242-60604234 is ready for SSH connections 2025-10-08 15:11:10,511 - INFO - Created control node zone ctest-test-zone-31437692(12cae637-de2c-47d3-96e0-b63a5caf7153) 2025-10-08 15:11:10,851 - INFO - Created control node zone ctest-test-zone-16245318(6637b2cb-ae85-45b1-8dc7-6ed51b7c9131) 2025-10-08 15:11:11,199 - INFO - Created control node zone ctest-test-zone-08859097(701da727-a3fc-49b7-af78-3508abf7e451) 2025-10-08 15:11:11,479 - INFO - Creating BGPaaS ctest-TestBGPaasZone-16052242-30401619 2025-10-08 15:11:11,555 - INFO - BGPaaS: ctest-TestBGPaasZone-16052242-30401619(b0c76ae5-dd92-491f-a3d9-4be8e7608ea4) 2025-10-08 15:11:11,555 - DEBUG - Requesting: http://10.0.0.33:8082/bgp-as-a-service/b0c76ae5-dd92-491f-a3d9-4be8e7608ea4 2025-10-08 15:11:11,855 - DEBUG - Requesting: http://10.0.0.33:8082/bgp-as-a-service/b0c76ae5-dd92-491f-a3d9-4be8e7608ea4 2025-10-08 15:11:11,883 - INFO - verify_in_api_server passed for BGPaaS obj b0c76ae5-dd92-491f-a3d9-4be8e7608ea4 2025-10-08 15:11:11,883 - INFO - BGPaaS(b0c76ae5-dd92-491f-a3d9-4be8e7608ea4): verify_on_setup passed 2025-10-08 15:11:11,883 - INFO - We will configure BGP on the VM 2025-10-08 15:11:12,127 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:11:12,127 - INFO - Configuring BGP on ctest-TestBGPaasZone-16052242-37575257 2025-10-08 15:11:12,127 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.131; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.131; } protocol bfd { neighbor 81.166.143.129 local 81.166.143.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:11:12,128 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.131; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.131; } protocol bfd { neighbor 81.166.143.129 local 81.166.143.131 multihop on; } EOS 2025-10-08 15:11:26,627 - DEBUG - None 2025-10-08 15:11:26,628 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.131; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.131; } protocol bfd { neighbor 81.166.143.129 local 81.166.143.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:11:26,628 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.131; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.131; } protocol bfd { neighbor 81.166.143.129 local 81.166.143.131 multihop on; } EOS 2025-10-08 15:11:28,180 - DEBUG - None 2025-10-08 15:11:28,180 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:11:28,180 - DEBUG - service bird restart 2025-10-08 15:11:31,696 - DEBUG - bird stop/waiting bird start/running, process 1429 2025-10-08 15:11:31,696 - INFO - Attaching VMI 643dc4b8-e5c4-44a0-bd19-d445e0955240 to BGPaaS b0c76ae5-dd92-491f-a3d9-4be8e7608ea4 2025-10-08 15:11:31,767 - INFO - Attaching the VMI d0d88c26-579b-40b3-acbf-fd19577cb6fc to the BGPaaS b0c76ae5-dd92-491f-a3d9-4be8e7608ea4 object 2025-10-08 15:11:31,767 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 81.166.143.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:11:31,767 - DEBUG - sudo ip addr add 81.166.143.148 dev eth0 2025-10-08 15:11:33,292 - DEBUG - None 2025-10-08 15:11:33,351 - INFO - Creating BGPaaS ctest-TestBGPaasZone-16052242-22585938 2025-10-08 15:11:33,427 - INFO - BGPaaS: ctest-TestBGPaasZone-16052242-22585938(ccd1f249-61ef-476d-ae8e-767326ffaeaf) 2025-10-08 15:11:33,428 - DEBUG - Requesting: http://10.0.0.33:8082/bgp-as-a-service/ccd1f249-61ef-476d-ae8e-767326ffaeaf 2025-10-08 15:11:33,438 - INFO - verify_in_api_server passed for BGPaaS obj ccd1f249-61ef-476d-ae8e-767326ffaeaf 2025-10-08 15:11:33,438 - INFO - BGPaaS(ccd1f249-61ef-476d-ae8e-767326ffaeaf): verify_on_setup passed 2025-10-08 15:11:33,438 - INFO - We will configure BGP on the VM 2025-10-08 15:11:33,687 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:11:33,687 - INFO - Configuring BGP on ctest-TestBGPaasZone-16052242-33994091 2025-10-08 15:11:33,687 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.132; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.132; } protocol bfd { neighbor 81.166.143.130 local 81.166.143.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:11:33,688 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.132; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.132; } protocol bfd { neighbor 81.166.143.130 local 81.166.143.132 multihop on; } EOS 2025-10-08 15:11:40,631 - DEBUG - None 2025-10-08 15:11:40,631 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.132; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.132; } protocol bfd { neighbor 81.166.143.130 local 81.166.143.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:11:40,631 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.132; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.132; } protocol bfd { neighbor 81.166.143.130 local 81.166.143.132 multihop on; } EOS 2025-10-08 15:11:41,207 - DEBUG - None 2025-10-08 15:11:41,208 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:11:41,208 - DEBUG - service bird restart 2025-10-08 15:11:43,247 - DEBUG - bird stop/waiting bird start/running, process 1441 2025-10-08 15:11:43,247 - INFO - Attaching VMI c74b7136-bbe4-4763-b778-0eb27c4e0af5 to BGPaaS ccd1f249-61ef-476d-ae8e-767326ffaeaf 2025-10-08 15:11:43,319 - INFO - Attaching the VMI 549d2def-e61c-41e1-822d-cdd320c51d4e to the BGPaaS ccd1f249-61ef-476d-ae8e-767326ffaeaf object 2025-10-08 15:11:43,319 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 81.166.143.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:11:43,320 - DEBUG - sudo ip addr add 81.166.143.148 dev eth0 2025-10-08 15:11:44,112 - DEBUG - None 2025-10-08 15:11:44,112 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:11:44,112 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-08 15:11:44,126 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-10-08 15:11:44,131 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:11:44,144 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-10-08 15:11:50,161 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14'] 2025-10-08 15:11:56,180 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-08 15:11:56,187 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 81.166.143.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:11:56,187 - DEBUG - ping -s 56 -c 3 -W 1 81.166.143.148 2025-10-08 15:12:03,057 - DEBUG - PING 81.166.143.148 (81.166.143.148) 56(84) bytes of data. 64 bytes from 81.166.143.148: icmp_seq=1 ttl=64 time=11.9 ms 64 bytes from 81.166.143.148: icmp_seq=2 ttl=64 time=1.65 ms 64 bytes from 81.166.143.148: icmp_seq=3 ttl=64 time=2.02 ms --- 81.166.143.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.656/5.200/11.922/4.755 ms 2025-10-08 15:12:03,057 - INFO - Ping to IP 81.166.143.148 from VM ctest-TestBGPaasZone-16052242-60604234 passed 2025-10-08 15:12:03,952 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:12:03,952 - DEBUG - service bird restart 2025-10-08 15:12:05,758 - DEBUG - bird stop/waiting bird start/running, process 1465 2025-10-08 15:12:05,758 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:12:05,758 - DEBUG - service bird restart 2025-10-08 15:12:07,857 - DEBUG - bird stop/waiting bird start/running, process 1468 2025-10-08 15:12:07,857 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:12:07,875 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25'] 2025-10-08 15:12:13,892 - INFO - BGPaaS session seen in control-node 10.20.0.25 2025-10-08 15:12:13,898 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:12:13,912 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-08 15:12:13,918 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 81.166.143.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:12:13,918 - DEBUG - ping -s 56 -c 3 -W 1 81.166.143.148 2025-10-08 15:12:16,454 - DEBUG - PING 81.166.143.148 (81.166.143.148) 56(84) bytes of data. 64 bytes from 81.166.143.148: icmp_seq=1 ttl=64 time=4.05 ms 64 bytes from 81.166.143.148: icmp_seq=2 ttl=64 time=0.930 ms 64 bytes from 81.166.143.148: icmp_seq=3 ttl=64 time=1.03 ms --- 81.166.143.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 0.930/2.008/4.057/1.449 ms 2025-10-08 15:12:16,454 - INFO - Ping to IP 81.166.143.148 from VM ctest-TestBGPaasZone-16052242-60604234 passed 2025-10-08 15:12:16,748 - INFO - We will configure BGP on the VM 2025-10-08 15:12:16,959 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:12:16,959 - INFO - Configuring BGP on ctest-TestBGPaasZone-16052242-37575257 2025-10-08 15:12:16,960 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.131; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.131; } protocol bfd { neighbor 81.166.143.129 local 81.166.143.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:12:16,960 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.131; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.131; } protocol bfd { neighbor 81.166.143.129 local 81.166.143.131 multihop on; } EOS 2025-10-08 15:12:17,491 - DEBUG - None 2025-10-08 15:12:17,492 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.131; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.131; } protocol bfd { neighbor 81.166.143.129 local 81.166.143.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:12:17,492 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 81.166.143.131; protocol bgp bgp_1{ local as 65000; neighbor 81.166.143.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 81.166.143.131; } protocol bfd { neighbor 81.166.143.129 local 81.166.143.131 multihop on; } EOS 2025-10-08 15:12:18,075 - DEBUG - None 2025-10-08 15:12:18,075 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:12:18,075 - DEBUG - service bird restart 2025-10-08 15:12:19,912 - DEBUG - bird stop/waiting bird start/running, process 1497 2025-10-08 15:12:19,912 - INFO - Attaching VMI 643dc4b8-e5c4-44a0-bd19-d445e0955240 to BGPaaS b0c76ae5-dd92-491f-a3d9-4be8e7608ea4 2025-10-08 15:12:19,929 - INFO - Attaching the VMI d0d88c26-579b-40b3-acbf-fd19577cb6fc to the BGPaaS b0c76ae5-dd92-491f-a3d9-4be8e7608ea4 object 2025-10-08 15:12:19,929 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 81.166.143.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:12:19,930 - DEBUG - sudo ip addr add 81.166.143.148 dev eth0 2025-10-08 15:12:20,770 - DEBUG - RTNETLINK answers: File exists 2025-10-08 15:12:20,771 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:12:20,771 - DEBUG - service bird restart 2025-10-08 15:12:22,613 - DEBUG - bird stop/waiting bird start/running, process 1524 2025-10-08 15:12:22,613 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:12:22,613 - DEBUG - service bird restart 2025-10-08 15:12:24,633 - DEBUG - bird stop/waiting bird start/running, process 1490 2025-10-08 15:12:24,633 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:12:24,633 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-08 15:12:24,646 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-10-08 15:12:30,648 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-08 15:12:30,663 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-10-08 15:12:30,668 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:12:30,685 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-08 15:12:30,692 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 81.166.143.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:12:30,692 - DEBUG - ping -s 56 -c 3 -W 1 81.166.143.148 2025-10-08 15:12:33,229 - DEBUG - PING 81.166.143.148 (81.166.143.148) 56(84) bytes of data. 64 bytes from 81.166.143.148: icmp_seq=1 ttl=64 time=3.30 ms 64 bytes from 81.166.143.148: icmp_seq=2 ttl=64 time=1.57 ms 64 bytes from 81.166.143.148: icmp_seq=3 ttl=64 time=1.26 ms --- 81.166.143.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.264/2.048/3.301/0.895 ms 2025-10-08 15:12:33,229 - INFO - Ping to IP 81.166.143.148 from VM ctest-TestBGPaasZone-16052242-60604234 passed 2025-10-08 15:12:33,229 - INFO - Detaching VMI 643dc4b8-e5c4-44a0-bd19-d445e0955240 from BGPaaS b0c76ae5-dd92-491f-a3d9-4be8e7608ea4 2025-10-08 15:12:33,303 - INFO - Detaching VMI c74b7136-bbe4-4763-b778-0eb27c4e0af5 from BGPaaS ccd1f249-61ef-476d-ae8e-767326ffaeaf 2025-10-08 15:12:33,379 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-16052242-22585938(ccd1f249-61ef-476d-ae8e-767326ffaeaf) 2025-10-08 15:12:33,461 - DEBUG - Requesting: http://10.0.0.33:8082/bgp-as-a-service/ccd1f249-61ef-476d-ae8e-767326ffaeaf 2025-10-08 15:12:33,472 - DEBUG - Response Code: 404 2025-10-08 15:12:33,472 - DEBUG - BGPaaS: ccd1f249-61ef-476d-ae8e-767326ffaeaf deleted from api server 2025-10-08 15:12:33,472 - INFO - BGPaaS(ccd1f249-61ef-476d-ae8e-767326ffaeaf): verify_on_cleanup passed 2025-10-08 15:12:33,472 - INFO - Detaching VMI 643dc4b8-e5c4-44a0-bd19-d445e0955240 from BGPaaS b0c76ae5-dd92-491f-a3d9-4be8e7608ea4 2025-10-08 15:12:33,512 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-16052242-30401619(b0c76ae5-dd92-491f-a3d9-4be8e7608ea4) 2025-10-08 15:12:33,592 - DEBUG - Requesting: http://10.0.0.33:8082/bgp-as-a-service/b0c76ae5-dd92-491f-a3d9-4be8e7608ea4 2025-10-08 15:12:33,601 - DEBUG - Response Code: 404 2025-10-08 15:12:33,601 - DEBUG - BGPaaS: b0c76ae5-dd92-491f-a3d9-4be8e7608ea4 deleted from api server 2025-10-08 15:12:33,601 - INFO - BGPaaS(b0c76ae5-dd92-491f-a3d9-4be8e7608ea4): verify_on_cleanup passed 2025-10-08 15:12:33,601 - INFO - Deleting Control node zone ctest-test-zone-08859097(701da727-a3fc-49b7-af78-3508abf7e451) 2025-10-08 15:12:33,751 - INFO - Deleting Control node zone ctest-test-zone-16245318(6637b2cb-ae85-45b1-8dc7-6ed51b7c9131) 2025-10-08 15:12:33,897 - INFO - Deleting Control node zone ctest-test-zone-31437692(12cae637-de2c-47d3-96e0-b63a5caf7153) 2025-10-08 15:12:33,978 - INFO - Deleting VM ctest-TestBGPaasZone-16052242-60604234 2025-10-08 15:12:34,050 - INFO - Deleting VM ctest-TestBGPaasZone-16052242-33994091 2025-10-08 15:12:34,115 - INFO - Deleting VM ctest-TestBGPaasZone-16052242-37575257 2025-10-08 15:12:34,180 - INFO - Deleting VN ctest-cnz_vn-43603708 2025-10-08 15:12:34,219 - DEBUG - VN c6d3166a-8fb7-403c-ba32-37069bf3a552 still in use: Unable to complete operation on network c6d3166a-8fb7-403c-ba32-37069bf3a552. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-9d563577-74ba-4181-8aca-524ccdb05988'] 2025-10-08 15:12:34,219 - WARNING - Deleting VN ctest-cnz_vn-43603708 failed..Will retry 2025-10-08 15:12:36,511 - DEBUG - Response for deleting network () 2025-10-08 15:12:37,787 - DEBUG - Skipping xmpp flap check 2025-10-08 15:12:37,787 - INFO - END TEST : test_bgp_control_node_zone : PASSED[0:04:25] 2025-10-08 15:12:37,787 - INFO - -------------------------------------------------------------------------------- 2025-10-08 15:12:37,790 - INFO - ================================================================================ 2025-10-08 15:12:37,790 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2025-10-08 15:12:39,080 - DEBUG - Skipping xmpp flap check 2025-10-08 15:12:39,080 - INFO - Initial checks done. Running the testcase now 2025-10-08 15:12:39,080 - INFO - 2025-10-08 15:12:39,080 - INFO - executing bgp_control_zone agent restart test 2025-10-08 15:12:39,419 - DEBUG - Response for create_network : {'network': {'id': '269b9a73-4449-4ad7-bb2a-242771a225f6', 'name': 'ctest-cnz_vn-08707068', 'tenant_id': 'eaa6425fd6354760b7ab06ac990c835a', 'project_id': 'eaa6425fd6354760b7ab06ac990c835a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-16052242', 'ctest-cnz_vn-08707068'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 15:12:39,644 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cf454947-16e5-406e-980c-b6009375adb1', 'name': '', 'tenant_id': 'eaa6425fd6354760b7ab06ac990c835a', 'network_id': '269b9a73-4449-4ad7-bb2a-242771a225f6', 'ip_version': 4, 'cidr': '67.176.220.128/26', 'allocation_pools': [{'start': '67.176.220.130', 'end': '67.176.220.190'}], 'gateway_ip': '67.176.220.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '67.176.220.130', 'tags': [], 'project_id': 'eaa6425fd6354760b7ab06ac990c835a'}} 2025-10-08 15:12:39,670 - INFO - Created VN ctest-cnz_vn-08707068 2025-10-08 15:12:39,681 - DEBUG - VN ctest-cnz_vn-08707068 UUID is 269b9a73-4449-4ad7-bb2a-242771a225f6 2025-10-08 15:12:40,787 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4234-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4234-1) 2025-10-08 15:12:41,993 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4234-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4234-2) 2025-10-08 15:12:43,480 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4234-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4234-1) 2025-10-08 15:12:43,481 - INFO - Waiting for VM ctest-TestBGPaasZone-16052242-80167586 to be up.. 2025-10-08 15:12:43,579 - DEBUG - VM is in ACTIVE state now 2025-10-08 15:12:43,579 - INFO - VM name : ctest-TestBGPaasZone-16052242-80167586 2025-10-08 15:12:43,702 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 ID is d186677f-bf0c-4b58-9749-72f8971b40c9 2025-10-08 15:12:43,702 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 launched on Node an-jenkins-deploy-platform-ansible-os-4234-1 2025-10-08 15:12:43,806 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/d186677f-bf0c-4b58-9749-72f8971b40c9 2025-10-08 15:12:43,818 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/ce308989-8afe-42dc-ae92-ae0386b49209 2025-10-08 15:12:46,992 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-08 15:12:46,992 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:12:47,007 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:12:51,093 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-08 15:12:51,093 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:12:51,113 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:12:55,191 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2025-10-08 15:12:55,191 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:12:55,206 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:12:59,286 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-10-08 15:12:59,286 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:12:59,299 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:03,381 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-10-08 15:13:03,381 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:03,399 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:07,482 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-10-08 15:13:07,482 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:07,497 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:11,571 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-10-08 15:13:11,571 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:11,587 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:15,670 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-08 15:13:15,671 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:15,714 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:19,793 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-08 15:13:19,793 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:19,806 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:23,896 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-08 15:13:23,897 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:23,910 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:27,983 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-10-08 15:13:27,984 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:27,996 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:32,093 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-10-08 15:13:32,093 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:32,113 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:36,176 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-10-08 15:13:36,176 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:36,190 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:40,279 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-10-08 15:13:40,279 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:40,292 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:44,375 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-08 15:13:44,375 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:44,388 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:48,474 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-08 15:13:48,474 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:48,488 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:52,563 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-10-08 15:13:52,563 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:52,576 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:13:56,661 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-08 15:13:56,661 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:13:56,674 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:14:00,763 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-10-08 15:14:00,763 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:14:00,781 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:14:04,849 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms') 2025-10-08 15:14:04,849 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:14:04,872 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:14:08,948 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-10-08 15:14:08,949 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:14:08,963 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:14:13,040 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-08 15:14:13,040 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 failed! 2025-10-08 15:14:13,055 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-16052242:ctest-cnz_vn-08707068 is 67.176.220.129 and allocation pool is NOT set 2025-10-08 15:14:15,125 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.20 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.29 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.292/3.748/5.204/1.456 ms') 2025-10-08 15:14:15,126 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-80167586 passed 2025-10-08 15:14:15,191 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:14:15,191 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:14:15,257 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:14:15,397 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:14:20,398 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:14:20,398 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:14:20,475 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:14:20,576 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:14:25,580 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:14:25,580 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:14:25,648 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:14:25,749 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:14:30,750 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:14:30,750 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:14:30,816 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:14:30,897 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:14:35,897 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:14:35,897 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:14:35,965 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:14:36,048 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:14:41,049 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:14:41,049 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:14:41,116 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:14:41,198 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:14:46,199 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:14:46,199 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:14:46,272 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:14:46,353 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:14:51,353 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:14:51,354 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:14:51,421 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:14:51,504 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:14:56,505 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:14:56,505 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:14:56,573 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:14:56,650 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:15:01,651 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:01,651 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:15:01,717 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:15:01,794 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:15:06,794 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:06,795 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:15:06,861 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:15:06,943 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:15:11,944 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:11,944 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-80167586, IP 67.176.220.131, Port 22 2025-10-08 15:15:12,117 - DEBUG - VM ctest-TestBGPaasZone-16052242-80167586 is ready for SSH connections 2025-10-08 15:15:12,117 - INFO - Waiting for VM ctest-TestBGPaasZone-16052242-44615792 to be up.. 2025-10-08 15:15:12,194 - DEBUG - VM is in ACTIVE state now 2025-10-08 15:15:12,194 - INFO - VM name : ctest-TestBGPaasZone-16052242-44615792 2025-10-08 15:15:12,269 - DEBUG - VM ctest-TestBGPaasZone-16052242-44615792 ID is 8253e0c3-088b-4813-a96c-bf914daf973b 2025-10-08 15:15:12,269 - DEBUG - VM ctest-TestBGPaasZone-16052242-44615792 launched on Node an-jenkins-deploy-platform-ansible-os-4234-2 2025-10-08 15:15:12,343 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/8253e0c3-088b-4813-a96c-bf914daf973b 2025-10-08 15:15:12,375 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/7a6ff9a9-366a-4c17-bba9-3035a34fcb98 2025-10-08 15:15:13,525 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.25 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.482 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.482/2.368/4.254/1.886 ms') 2025-10-08 15:15:13,526 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-16052242-44615792 passed 2025-10-08 15:15:13,595 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:13,595 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-44615792, IP 67.176.220.132, Port 22 2025-10-08 15:15:13,763 - DEBUG - VM ctest-TestBGPaasZone-16052242-44615792 is ready for SSH connections 2025-10-08 15:15:13,763 - INFO - Waiting for VM ctest-TestBGPaasZone-16052242-35071814 to be up.. 2025-10-08 15:15:13,840 - DEBUG - VM is in ACTIVE state now 2025-10-08 15:15:13,840 - INFO - VM name : ctest-TestBGPaasZone-16052242-35071814 2025-10-08 15:15:13,917 - DEBUG - VM ctest-TestBGPaasZone-16052242-35071814 ID is a10e91de-d804-40b4-8338-7085a5990167 2025-10-08 15:15:13,917 - DEBUG - VM ctest-TestBGPaasZone-16052242-35071814 launched on Node an-jenkins-deploy-platform-ansible-os-4234-1 2025-10-08 15:15:13,993 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/a10e91de-d804-40b4-8338-7085a5990167 2025-10-08 15:15:14,003 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/9c7c426f-1873-4f56-a675-a5d78d075d3f 2025-10-08 15:15:15,161 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.52 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.23 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.225/2.870/4.515/1.645 ms') 2025-10-08 15:15:15,161 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-16052242-35071814 passed 2025-10-08 15:15:15,228 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:15,228 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-35071814, IP 67.176.220.133, Port 22 2025-10-08 15:15:15,296 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:15:15,386 - DEBUG - VM ctest-TestBGPaasZone-16052242-35071814 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:15:20,387 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:20,387 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-35071814, IP 67.176.220.133, Port 22 2025-10-08 15:15:20,457 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:15:20,535 - DEBUG - VM ctest-TestBGPaasZone-16052242-35071814 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:15:25,536 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:25,536 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-16052242-35071814, IP 67.176.220.133, Port 22 2025-10-08 15:15:25,705 - DEBUG - VM ctest-TestBGPaasZone-16052242-35071814 is ready for SSH connections 2025-10-08 15:15:25,831 - INFO - Created control node zone ctest-test-zone-02858068(d31c5e90-84c6-42a3-94d8-0741d3509ee8) 2025-10-08 15:15:26,171 - INFO - Created control node zone ctest-test-zone-81673484(d33b0301-fa91-4c4a-b576-b7314b6f47c3) 2025-10-08 15:15:26,515 - INFO - Created control node zone ctest-test-zone-34607011(23a4ab3a-d98d-4428-b940-d51c454cef48) 2025-10-08 15:15:26,799 - INFO - Creating BGPaaS ctest-TestBGPaasZone-16052242-31941940 2025-10-08 15:15:26,875 - INFO - BGPaaS: ctest-TestBGPaasZone-16052242-31941940(a561e478-228b-4c4d-b976-4a62e3392c6b) 2025-10-08 15:15:26,876 - DEBUG - Requesting: http://10.0.0.33:8082/bgp-as-a-service/a561e478-228b-4c4d-b976-4a62e3392c6b 2025-10-08 15:15:26,885 - INFO - verify_in_api_server passed for BGPaaS obj a561e478-228b-4c4d-b976-4a62e3392c6b 2025-10-08 15:15:26,885 - INFO - BGPaaS(a561e478-228b-4c4d-b976-4a62e3392c6b): verify_on_setup passed 2025-10-08 15:15:26,885 - INFO - We will configure BGP on the VM 2025-10-08 15:15:27,291 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:27,291 - INFO - Configuring BGP on ctest-TestBGPaasZone-16052242-80167586 2025-10-08 15:15:27,291 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 67.176.220.131; protocol bgp bgp_1{ local as 65000; neighbor 67.176.220.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.176.220.131; } protocol bfd { neighbor 67.176.220.129 local 67.176.220.131 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:15:27,292 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 67.176.220.131; protocol bgp bgp_1{ local as 65000; neighbor 67.176.220.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.176.220.131; } protocol bfd { neighbor 67.176.220.129 local 67.176.220.131 multihop on; } EOS 2025-10-08 15:15:43,179 - DEBUG - None 2025-10-08 15:15:43,179 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 67.176.220.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.176.220.131; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:15:43,179 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 67.176.220.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.176.220.131; } EOS 2025-10-08 15:15:44,305 - DEBUG - None 2025-10-08 15:15:44,306 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:15:44,306 - DEBUG - service bird restart 2025-10-08 15:15:46,489 - DEBUG - bird stop/waiting bird start/running, process 1433 2025-10-08 15:15:46,489 - INFO - Attaching VMI ce308989-8afe-42dc-ae92-ae0386b49209 to BGPaaS a561e478-228b-4c4d-b976-4a62e3392c6b 2025-10-08 15:15:46,559 - INFO - Attaching the VMI d186677f-bf0c-4b58-9749-72f8971b40c9 to the BGPaaS a561e478-228b-4c4d-b976-4a62e3392c6b object 2025-10-08 15:15:46,560 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 67.176.220.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:15:46,560 - DEBUG - sudo ip addr add 67.176.220.148 dev eth0 2025-10-08 15:15:47,359 - DEBUG - None 2025-10-08 15:15:47,419 - INFO - Creating BGPaaS ctest-TestBGPaasZone-16052242-48436169 2025-10-08 15:15:47,499 - INFO - BGPaaS: ctest-TestBGPaasZone-16052242-48436169(0ee9fc89-5c22-47c0-96a3-7d836b92af3a) 2025-10-08 15:15:47,499 - DEBUG - Requesting: http://10.0.0.33:8082/bgp-as-a-service/0ee9fc89-5c22-47c0-96a3-7d836b92af3a 2025-10-08 15:15:47,508 - INFO - verify_in_api_server passed for BGPaaS obj 0ee9fc89-5c22-47c0-96a3-7d836b92af3a 2025-10-08 15:15:47,508 - INFO - BGPaaS(0ee9fc89-5c22-47c0-96a3-7d836b92af3a): verify_on_setup passed 2025-10-08 15:15:47,508 - INFO - We will configure BGP on the VM 2025-10-08 15:15:47,911 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:47,911 - INFO - Configuring BGP on ctest-TestBGPaasZone-16052242-44615792 2025-10-08 15:15:47,911 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 67.176.220.132; protocol bgp bgp_1{ local as 65000; neighbor 67.176.220.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.176.220.132; } protocol bfd { neighbor 67.176.220.129 local 67.176.220.132 multihop on; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:15:47,912 - DEBUG - cat > /etc/bird/bird.conf << EOS protocol device { scan time 10; # Scan interfaces every 10 seconds } protocol kernel { persist; # Don't remove routes on bird shutdown scan time 20; # Scan kernel routing table every 20 seconds import all; # Default is import all #export all; # Default is export none } protocol direct { interface "eth*"; } router id 67.176.220.132; protocol bgp bgp_1{ local as 65000; neighbor 67.176.220.129 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.176.220.132; } protocol bfd { neighbor 67.176.220.129 local 67.176.220.132 multihop on; } EOS 2025-10-08 15:15:55,675 - DEBUG - None 2025-10-08 15:15:55,675 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 67.176.220.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.176.220.132; } EOS , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:15:55,675 - DEBUG - cat >> /etc/bird/bird.conf << EOS protocol bgp bgp_2{ local as 65000; neighbor 67.176.220.130 as 64512; export where source = RTS_STATIC; export all; multihop; #export all; hold time 90; bfd on; source address 67.176.220.132; } EOS 2025-10-08 15:15:56,279 - DEBUG - None 2025-10-08 15:15:56,280 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:15:56,280 - DEBUG - service bird restart 2025-10-08 15:15:58,122 - DEBUG - bird stop/waiting bird start/running, process 1442 2025-10-08 15:15:58,122 - INFO - Attaching VMI 7a6ff9a9-366a-4c17-bba9-3035a34fcb98 to BGPaaS 0ee9fc89-5c22-47c0-96a3-7d836b92af3a 2025-10-08 15:15:58,195 - INFO - Attaching the VMI 8253e0c3-088b-4813-a96c-bf914daf973b to the BGPaaS 0ee9fc89-5c22-47c0-96a3-7d836b92af3a object 2025-10-08 15:15:58,195 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 67.176.220.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:15:58,195 - DEBUG - sudo ip addr add 67.176.220.148 dev eth0 2025-10-08 15:15:58,950 - DEBUG - None 2025-10-08 15:15:58,950 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:58,951 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-08 15:15:58,961 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-10-08 15:15:58,961 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:58,977 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-08 15:15:58,983 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:15:58,983 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-08 15:15:58,993 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-10-08 15:16:04,995 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-08 15:16:05,005 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254'] 2025-10-08 15:16:11,005 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-08 15:16:11,017 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-10-08 15:16:11,019 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:16:11,036 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-08 15:16:11,041 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 67.176.220.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:16:11,041 - DEBUG - ping -s 56 -c 3 -W 1 67.176.220.148 2025-10-08 15:16:18,360 - DEBUG - PING 67.176.220.148 (67.176.220.148) 56(84) bytes of data. 64 bytes from 67.176.220.148: icmp_seq=1 ttl=64 time=9.54 ms 64 bytes from 67.176.220.148: icmp_seq=2 ttl=64 time=1.15 ms 64 bytes from 67.176.220.148: icmp_seq=3 ttl=64 time=1.45 ms --- 67.176.220.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.155/4.053/9.547/3.886 ms 2025-10-08 15:16:18,360 - INFO - Ping to IP 67.176.220.148 from VM ctest-TestBGPaasZone-16052242-35071814 passed 2025-10-08 15:16:18,360 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:16:18,360 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-08 15:16:18,370 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-10-08 15:16:18,370 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:16:18,384 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-08 15:16:18,391 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:16:18,391 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address= 2025-10-08 15:16:18,404 - INFO - BGPaaS session seen in control-node 10.20.0.254 2025-10-08 15:16:18,404 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:16:18,417 - INFO - BGPaaS session seen in control-node 10.20.0.14 2025-10-08 15:16:18,423 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 67.176.220.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-08 15:16:18,424 - DEBUG - ping -s 56 -c 3 -W 1 67.176.220.148 2025-10-08 15:16:21,024 - DEBUG - PING 67.176.220.148 (67.176.220.148) 56(84) bytes of data. 64 bytes from 67.176.220.148: icmp_seq=1 ttl=64 time=5.97 ms 64 bytes from 67.176.220.148: icmp_seq=2 ttl=64 time=1.05 ms 64 bytes from 67.176.220.148: icmp_seq=3 ttl=64 time=1.04 ms --- 67.176.220.148 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.044/2.689/5.973/2.322 ms 2025-10-08 15:16:21,024 - INFO - Ping to IP 67.176.220.148 from VM ctest-TestBGPaasZone-16052242-35071814 passed 2025-10-08 15:16:21,024 - INFO - Detaching VMI 7a6ff9a9-366a-4c17-bba9-3035a34fcb98 from BGPaaS 0ee9fc89-5c22-47c0-96a3-7d836b92af3a 2025-10-08 15:16:21,100 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-16052242-48436169(0ee9fc89-5c22-47c0-96a3-7d836b92af3a) 2025-10-08 15:16:21,177 - DEBUG - Requesting: http://10.0.0.33:8082/bgp-as-a-service/0ee9fc89-5c22-47c0-96a3-7d836b92af3a 2025-10-08 15:16:21,224 - DEBUG - Response Code: 404 2025-10-08 15:16:21,224 - DEBUG - BGPaaS: 0ee9fc89-5c22-47c0-96a3-7d836b92af3a deleted from api server 2025-10-08 15:16:21,224 - INFO - BGPaaS(0ee9fc89-5c22-47c0-96a3-7d836b92af3a): verify_on_cleanup passed 2025-10-08 15:16:21,224 - INFO - Detaching VMI ce308989-8afe-42dc-ae92-ae0386b49209 from BGPaaS a561e478-228b-4c4d-b976-4a62e3392c6b 2025-10-08 15:16:21,307 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-16052242-31941940(a561e478-228b-4c4d-b976-4a62e3392c6b) 2025-10-08 15:16:21,394 - DEBUG - Requesting: http://10.0.0.33:8082/bgp-as-a-service/a561e478-228b-4c4d-b976-4a62e3392c6b 2025-10-08 15:16:21,400 - DEBUG - Response Code: 404 2025-10-08 15:16:21,400 - DEBUG - BGPaaS: a561e478-228b-4c4d-b976-4a62e3392c6b deleted from api server 2025-10-08 15:16:21,400 - INFO - BGPaaS(a561e478-228b-4c4d-b976-4a62e3392c6b): verify_on_cleanup passed 2025-10-08 15:16:21,401 - INFO - Deleting Control node zone ctest-test-zone-34607011(23a4ab3a-d98d-4428-b940-d51c454cef48) 2025-10-08 15:16:21,544 - INFO - Deleting Control node zone ctest-test-zone-81673484(d33b0301-fa91-4c4a-b576-b7314b6f47c3) 2025-10-08 15:16:21,686 - INFO - Deleting Control node zone ctest-test-zone-02858068(d31c5e90-84c6-42a3-94d8-0741d3509ee8) 2025-10-08 15:16:21,838 - INFO - Deleting VM ctest-TestBGPaasZone-16052242-35071814 2025-10-08 15:16:21,904 - INFO - Deleting VM ctest-TestBGPaasZone-16052242-44615792 2025-10-08 15:16:21,968 - INFO - Deleting VM ctest-TestBGPaasZone-16052242-80167586 2025-10-08 15:16:22,023 - INFO - Deleting VN ctest-cnz_vn-08707068 2025-10-08 15:16:22,061 - DEBUG - VN 269b9a73-4449-4ad7-bb2a-242771a225f6 still in use: Unable to complete operation on network 269b9a73-4449-4ad7-bb2a-242771a225f6. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-4f665108-c624-41ce-b36c-a56042b32bd2'] 2025-10-08 15:16:22,061 - WARNING - Deleting VN ctest-cnz_vn-08707068 failed..Will retry 2025-10-08 15:16:24,230 - DEBUG - Response for deleting network () 2025-10-08 15:16:25,484 - DEBUG - Skipping xmpp flap check 2025-10-08 15:16:25,484 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:48] 2025-10-08 15:16:25,484 - INFO - -------------------------------------------------------------------------------- 2025-10-08 15:16:26,215 - INFO - Deleted project: ctest-TestBGPaasZone-16052242, ID : eaa6425f-d635-4760-b7ab-06ac990c835a