is in ACTIVE state now
2026-05-28 04:12:51,746 - INFO - VM name : ctest-TestBGPaasZone-55289303-39396935
2026-05-28 04:12:51,860 - DEBUG - VM ctest-TestBGPaasZone-55289303-39396935 ID is 0a00821f-40ac-45af-8a33-946e0f1074b3
2026-05-28 04:12:51,861 - DEBUG - VM ctest-TestBGPaasZone-55289303-39396935 launched on Node an-jenkins-deploy-platform-ansible-os-5841-2
2026-05-28 04:12:51,985 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/0a00821f-40ac-45af-8a33-946e0f1074b3
2026-05-28 04:12:51,999 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/b5fb16c2-7ce1-4958-ab15-5587dc3dbbd7
2026-05-28 04:12:53,203 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=2.59 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=1.89 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.893/2.239/2.586/0.346 ms')
2026-05-28 04:12:53,203 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-TestBGPaasZone-55289303-39396935 passed
2026-05-28 04:12:53,284 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:12:53,284 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-55289303-39396935, IP 170.96.214.5, Port 22
2026-05-28 04:12:53,353 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-05-28 04:12:53,480 - DEBUG - VM ctest-TestBGPaasZone-55289303-39396935 is NOT ready for SSH connections, VM status: ACTIVE
2026-05-28 04:12:58,482 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:12:58,482 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-55289303-39396935, IP 170.96.214.5, Port 22
2026-05-28 04:12:58,552 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-05-28 04:12:58,677 - DEBUG - VM ctest-TestBGPaasZone-55289303-39396935 is NOT ready for SSH connections, VM status: ACTIVE
2026-05-28 04:13:03,678 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:13:03,678 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-55289303-39396935, IP 170.96.214.5, Port 22
2026-05-28 04:13:03,853 - DEBUG - VM ctest-TestBGPaasZone-55289303-39396935 is ready for SSH connections
2026-05-28 04:13:04,035 - INFO - Created control node zone ctest-test-zone-64159118(d303c947-8aed-4b67-aec7-ff2e0c338418)
2026-05-28 04:13:04,437 - INFO - Created control node zone ctest-test-zone-68944122(3db08775-85e7-44c9-a18b-a28abda54d27)
2026-05-28 04:13:04,817 - INFO - Created control node zone ctest-test-zone-48502131(f1e0eb9d-b581-4b20-8c01-47dcd07f5dfa)
2026-05-28 04:13:05,129 - INFO - Creating BGPaaS ctest-TestBGPaasZone-55289303-28762600
2026-05-28 04:13:05,217 - INFO - BGPaaS: ctest-TestBGPaasZone-55289303-28762600(da925bdf-f12c-4d6d-8273-537d226c0c37)
2026-05-28 04:13:05,217 - DEBUG - Requesting: http://10.0.0.133:8082/bgp-as-a-service/da925bdf-f12c-4d6d-8273-537d226c0c37
2026-05-28 04:13:05,234 - INFO - verify_in_api_server passed for BGPaaS obj da925bdf-f12c-4d6d-8273-537d226c0c37
2026-05-28 04:13:05,235 - INFO - BGPaaS(da925bdf-f12c-4d6d-8273-537d226c0c37): verify_on_setup passed
2026-05-28 04:13:05,235 - INFO - We will configure BGP on the VM
2026-05-28 04:13:05,717 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:13:05,717 - INFO - Configuring BGP on ctest-TestBGPaasZone-55289303-00227543
2026-05-28 04:13:05,717 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 170.96.214.3;
protocol bgp bgp_1{
local as 65000;
neighbor 170.96.214.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.96.214.3;
}
protocol bfd {
neighbor 170.96.214.1 local 170.96.214.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2026-05-28 04:13:05,717 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 170.96.214.3;
protocol bgp bgp_1{
local as 65000;
neighbor 170.96.214.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.96.214.3;
}
protocol bfd {
neighbor 170.96.214.1 local 170.96.214.3 multihop on;
}
EOS
2026-05-28 04:13:23,312 - DEBUG - None
2026-05-28 04:13:23,312 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 170.96.214.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.96.214.3;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2026-05-28 04:13:23,313 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 170.96.214.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.96.214.3;
}
EOS
2026-05-28 04:13:23,927 - DEBUG - None
2026-05-28 04:13:23,927 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2026-05-28 04:13:23,927 - DEBUG - service bird restart
2026-05-28 04:13:25,941 - DEBUG - bird stop/waiting
bird start/running, process 1435
2026-05-28 04:13:25,942 - INFO - Attaching VMI fd8c7520-2757-4ac5-9f52-068667804d64 to BGPaaS da925bdf-f12c-4d6d-8273-537d226c0c37
2026-05-28 04:13:26,029 - INFO - Attaching the VMI 95193511-614c-488a-a832-be7bce4110be to the BGPaaS da925bdf-f12c-4d6d-8273-537d226c0c37 object
2026-05-28 04:13:26,029 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 170.96.214.20 dev eth0, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2026-05-28 04:13:26,029 - DEBUG - sudo ip addr add 170.96.214.20 dev eth0
2026-05-28 04:13:26,897 - DEBUG - None
2026-05-28 04:13:26,969 - INFO - Creating BGPaaS ctest-TestBGPaasZone-55289303-69706684
2026-05-28 04:13:27,078 - INFO - BGPaaS: ctest-TestBGPaasZone-55289303-69706684(26741814-4ab7-4d3e-aada-3978b2ecda43)
2026-05-28 04:13:27,078 - DEBUG - Requesting: http://10.0.0.133:8082/bgp-as-a-service/26741814-4ab7-4d3e-aada-3978b2ecda43
2026-05-28 04:13:27,105 - INFO - verify_in_api_server passed for BGPaaS obj 26741814-4ab7-4d3e-aada-3978b2ecda43
2026-05-28 04:13:27,105 - INFO - BGPaaS(26741814-4ab7-4d3e-aada-3978b2ecda43): verify_on_setup passed
2026-05-28 04:13:27,106 - INFO - We will configure BGP on the VM
2026-05-28 04:13:27,677 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:13:27,677 - INFO - Configuring BGP on ctest-TestBGPaasZone-55289303-24640309
2026-05-28 04:13:27,678 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 170.96.214.4;
protocol bgp bgp_1{
local as 65000;
neighbor 170.96.214.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.96.214.4;
}
protocol bfd {
neighbor 170.96.214.1 local 170.96.214.4 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2026-05-28 04:13:27,678 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 170.96.214.4;
protocol bgp bgp_1{
local as 65000;
neighbor 170.96.214.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.96.214.4;
}
protocol bfd {
neighbor 170.96.214.1 local 170.96.214.4 multihop on;
}
EOS
2026-05-28 04:13:41,726 - DEBUG - None
2026-05-28 04:13:41,726 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 170.96.214.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.96.214.4;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2026-05-28 04:13:41,727 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 170.96.214.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 170.96.214.4;
}
EOS
2026-05-28 04:13:42,282 - DEBUG - None
2026-05-28 04:13:42,282 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2026-05-28 04:13:42,282 - DEBUG - service bird restart
2026-05-28 04:13:44,284 - DEBUG - bird stop/waiting
bird start/running, process 1440
2026-05-28 04:13:44,285 - INFO - Attaching VMI a9774c1b-d8f2-46d1-9058-265135f2fa65 to BGPaaS 26741814-4ab7-4d3e-aada-3978b2ecda43
2026-05-28 04:13:44,373 - INFO - Attaching the VMI dabb7438-057c-4dfa-b5a8-097f708b66d8 to the BGPaaS 26741814-4ab7-4d3e-aada-3978b2ecda43 object
2026-05-28 04:13:44,373 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 170.96.214.20 dev eth0, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123
2026-05-28 04:13:44,374 - DEBUG - sudo ip addr add 170.96.214.20 dev eth0
2026-05-28 04:13:45,088 - DEBUG - None
2026-05-28 04:13:45,088 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:13:45,088 - DEBUG - Requesting: http://10.20.0.252:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-05-28 04:13:45,106 - INFO - BGPaaS session seen in control-node 10.20.0.252
2026-05-28 04:13:45,107 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:13:45,131 - INFO - BGPaaS session seen in control-node 10.20.0.249
2026-05-28 04:13:45,141 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:13:45,141 - DEBUG - Requesting: http://10.20.0.252:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-05-28 04:13:45,159 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.252']
2026-05-28 04:13:51,160 - DEBUG - Requesting: http://10.20.0.252:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-05-28 04:13:51,174 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.252']
2026-05-28 04:13:57,175 - DEBUG - Requesting: http://10.20.0.252:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-05-28 04:13:57,193 - INFO - BGPaaS session seen in control-node 10.20.0.252
2026-05-28 04:13:57,194 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:13:57,216 - INFO - BGPaaS session seen in control-node 10.20.0.249
2026-05-28 04:13:57,224 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 170.96.214.20, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2026-05-28 04:13:57,224 - DEBUG - ping -s 56 -c 3 -W 1 170.96.214.20
2026-05-28 04:14:14,507 - DEBUG - PING 170.96.214.20 (170.96.214.20) 56(84) bytes of data.
64 bytes from 170.96.214.20: icmp_seq=1 ttl=64 time=9.58 ms
64 bytes from 170.96.214.20: icmp_seq=2 ttl=64 time=1.59 ms
64 bytes from 170.96.214.20: icmp_seq=3 ttl=64 time=1.28 ms
--- 170.96.214.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.287/4.154/9.585/3.842 ms
2026-05-28 04:14:14,507 - INFO - Ping to IP 170.96.214.20 from VM ctest-TestBGPaasZone-55289303-39396935 passed
2026-05-28 04:14:14,508 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:14:14,508 - DEBUG - Requesting: http://10.20.0.252:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-05-28 04:14:14,532 - INFO - BGPaaS session seen in control-node 10.20.0.252
2026-05-28 04:14:14,534 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:14:14,557 - INFO - BGPaaS session seen in control-node 10.20.0.249
2026-05-28 04:14:14,564 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:14:14,564 - DEBUG - Requesting: http://10.20.0.252:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-05-28 04:14:14,582 - INFO - BGPaaS session seen in control-node 10.20.0.252
2026-05-28 04:14:14,582 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-28 04:14:14,602 - INFO - BGPaaS session seen in control-node 10.20.0.249
2026-05-28 04:14:14,611 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 170.96.214.20, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2026-05-28 04:14:14,611 - DEBUG - ping -s 56 -c 3 -W 1 170.96.214.20
2026-05-28 04:14:17,243 - DEBUG - PING 170.96.214.20 (170.96.214.20) 56(84) bytes of data.
64 bytes from 170.96.214.20: icmp_seq=1 ttl=64 time=5.63 ms
64 bytes from 170.96.214.20: icmp_seq=2 ttl=64 time=0.966 ms
64 bytes from 170.96.214.20: icmp_seq=3 ttl=64 time=0.851 ms
--- 170.96.214.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.851/2.484/5.636/2.229 ms
2026-05-28 04:14:17,243 - INFO - Ping to IP 170.96.214.20 from VM ctest-TestBGPaasZone-55289303-39396935 passed
2026-05-28 04:14:17,243 - INFO - Detaching VMI a9774c1b-d8f2-46d1-9058-265135f2fa65 from BGPaaS 26741814-4ab7-4d3e-aada-3978b2ecda43
2026-05-28 04:14:17,329 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-55289303-69706684(26741814-4ab7-4d3e-aada-3978b2ecda43)
2026-05-28 04:14:17,402 - DEBUG - Requesting: http://10.0.0.133:8082/bgp-as-a-service/26741814-4ab7-4d3e-aada-3978b2ecda43
2026-05-28 04:14:17,477 - DEBUG - Response Code: 404
2026-05-28 04:14:17,477 - DEBUG - BGPaaS: 26741814-4ab7-4d3e-aada-3978b2ecda43 deleted from api server
2026-05-28 04:14:17,477 - INFO - BGPaaS(26741814-4ab7-4d3e-aada-3978b2ecda43): verify_on_cleanup passed
2026-05-28 04:14:17,478 - INFO - Detaching VMI fd8c7520-2757-4ac5-9f52-068667804d64 from BGPaaS da925bdf-f12c-4d6d-8273-537d226c0c37
2026-05-28 04:14:17,579 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-55289303-28762600(da925bdf-f12c-4d6d-8273-537d226c0c37)
2026-05-28 04:14:17,641 - DEBUG - Requesting: http://10.0.0.133:8082/bgp-as-a-service/da925bdf-f12c-4d6d-8273-537d226c0c37
2026-05-28 04:14:17,652 - DEBUG - Response Code: 404
2026-05-28 04:14:17,652 - DEBUG - BGPaaS: da925bdf-f12c-4d6d-8273-537d226c0c37 deleted from api server
2026-05-28 04:14:17,652 - INFO - BGPaaS(da925bdf-f12c-4d6d-8273-537d226c0c37): verify_on_cleanup passed
2026-05-28 04:14:17,653 - INFO - Deleting Control node zone ctest-test-zone-48502131(f1e0eb9d-b581-4b20-8c01-47dcd07f5dfa)
2026-05-28 04:14:17,813 - INFO - Deleting Control node zone ctest-test-zone-68944122(3db08775-85e7-44c9-a18b-a28abda54d27)
2026-05-28 04:14:18,000 - INFO - Deleting Control node zone ctest-test-zone-64159118(d303c947-8aed-4b67-aec7-ff2e0c338418)
2026-05-28 04:14:18,175 - INFO - Deleting VM ctest-TestBGPaasZone-55289303-39396935
2026-05-28 04:14:18,315 - INFO - Deleting VM ctest-TestBGPaasZone-55289303-24640309
2026-05-28 04:14:18,447 - INFO - Deleting VM ctest-TestBGPaasZone-55289303-00227543
2026-05-28 04:14:18,559 - INFO - Deleting VN ctest-cnz_vn-66415872
2026-05-28 04:14:18,625 - DEBUG - VN 8632f59a-5391-43cd-9e4a-e22f9ef3cf26 still in use: Unable to complete operation on network 8632f59a-5391-43cd-9e4a-e22f9ef3cf26. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-0efd2973-6142-4fab-8933-32c1097ad3cb']
2026-05-28 04:14:18,625 - WARNING - Deleting VN ctest-cnz_vn-66415872 failed..Will retry
2026-05-28 04:14:20,872 - DEBUG - Response for deleting network ()
2026-05-28 04:14:22,220 - DEBUG - Skipping xmpp flap check
2026-05-28 04:14:22,220 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:51]
2026-05-28 04:14:22,220 - INFO - --------------------------------------------------------------------------------
2026-05-28 04:14:23,193 - INFO - Deleted project: ctest-TestBGPaasZone-55289303, ID : 6bbe60b6-978c-4ba6-924a-f54e83d51a57