is in ACTIVE state now
2026-02-09 03:55:49,127 - INFO - VM name : ctest-TestBGPaasZone-89788229-40069303
2026-02-09 03:55:49,220 - DEBUG - VM ctest-TestBGPaasZone-89788229-40069303 ID is 8575062f-bc58-43b8-9392-fde9c08976b6
2026-02-09 03:55:49,220 - DEBUG - VM ctest-TestBGPaasZone-89788229-40069303 launched on Node an-jenkins-deploy-platform-ansible-os-5238-2
2026-02-09 03:55:49,305 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/8575062f-bc58-43b8-9392-fde9c08976b6
2026-02-09 03:55:49,316 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/ea9e74e4-9808-4c96-b15f-c7e30d1cf460
2026-02-09 03:55:50,474 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.52 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.567 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.567/1.545/2.524/0.978 ms')
2026-02-09 03:55:50,474 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-89788229-40069303 passed
2026-02-09 03:55:50,544 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:55:50,544 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-89788229-40069303, IP 57.94.140.69, Port 22
2026-02-09 03:55:50,615 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-02-09 03:55:50,697 - DEBUG - VM ctest-TestBGPaasZone-89788229-40069303 is NOT ready for SSH connections, VM status: ACTIVE
2026-02-09 03:55:55,698 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:55:55,699 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-89788229-40069303, IP 57.94.140.69, Port 22
2026-02-09 03:55:55,880 - DEBUG - VM ctest-TestBGPaasZone-89788229-40069303 is ready for SSH connections
2026-02-09 03:55:56,018 - INFO - Created control node zone ctest-test-zone-37203129(04fcd4dc-9904-4d2e-9b59-fec8a6b27e44)
2026-02-09 03:55:56,378 - INFO - Created control node zone ctest-test-zone-40705929(7c9ac580-176b-4ad4-82f9-1a4c4abd2589)
2026-02-09 03:55:56,727 - INFO - Created control node zone ctest-test-zone-79559166(954c2622-ed4d-4bde-8f76-bc1ffba74964)
2026-02-09 03:55:57,006 - INFO - Creating BGPaaS ctest-TestBGPaasZone-89788229-47212301
2026-02-09 03:55:57,086 - INFO - BGPaaS: ctest-TestBGPaasZone-89788229-47212301(337921c9-a616-4331-819c-7283f82ebb66)
2026-02-09 03:55:57,087 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/337921c9-a616-4331-819c-7283f82ebb66
2026-02-09 03:55:57,099 - INFO - verify_in_api_server passed for BGPaaS obj 337921c9-a616-4331-819c-7283f82ebb66
2026-02-09 03:55:57,099 - INFO - BGPaaS(337921c9-a616-4331-819c-7283f82ebb66): verify_on_setup passed
2026-02-09 03:55:57,099 - INFO - We will configure BGP on the VM
2026-02-09 03:55:57,518 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:55:57,519 - INFO - Configuring BGP on ctest-TestBGPaasZone-89788229-59184126
2026-02-09 03:55:57,519 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 57.94.140.67;
protocol bgp bgp_1{
local as 65000;
neighbor 57.94.140.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 57.94.140.67;
}
protocol bfd {
neighbor 57.94.140.65 local 57.94.140.67 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2026-02-09 03:55:57,519 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 57.94.140.67;
protocol bgp bgp_1{
local as 65000;
neighbor 57.94.140.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 57.94.140.67;
}
protocol bfd {
neighbor 57.94.140.65 local 57.94.140.67 multihop on;
}
EOS
2026-02-09 03:56:06,719 - DEBUG - None
2026-02-09 03:56:06,719 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 57.94.140.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 57.94.140.67;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2026-02-09 03:56:06,719 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 57.94.140.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 57.94.140.67;
}
EOS
2026-02-09 03:56:07,271 - DEBUG - None
2026-02-09 03:56:07,271 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2026-02-09 03:56:07,272 - DEBUG - service bird restart
2026-02-09 03:56:09,185 - DEBUG - bird stop/waiting
bird start/running, process 1440
2026-02-09 03:56:09,185 - INFO - Attaching VMI 363ee2d7-b750-4b3e-bb49-59f24473e2e9 to BGPaaS 337921c9-a616-4331-819c-7283f82ebb66
2026-02-09 03:56:09,267 - INFO - Attaching the VMI 60faf9e0-321c-4f2d-9668-9b9e14a90eef to the BGPaaS 337921c9-a616-4331-819c-7283f82ebb66 object
2026-02-09 03:56:09,267 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 57.94.140.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2026-02-09 03:56:09,267 - DEBUG - sudo ip addr add 57.94.140.84 dev eth0
2026-02-09 03:56:10,018 - DEBUG - None
2026-02-09 03:56:10,086 - INFO - Creating BGPaaS ctest-TestBGPaasZone-89788229-79079998
2026-02-09 03:56:10,182 - INFO - BGPaaS: ctest-TestBGPaasZone-89788229-79079998(410a936e-0015-463e-a636-bbd63ea30828)
2026-02-09 03:56:10,183 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/410a936e-0015-463e-a636-bbd63ea30828
2026-02-09 03:56:10,193 - INFO - verify_in_api_server passed for BGPaaS obj 410a936e-0015-463e-a636-bbd63ea30828
2026-02-09 03:56:10,193 - INFO - BGPaaS(410a936e-0015-463e-a636-bbd63ea30828): verify_on_setup passed
2026-02-09 03:56:10,193 - INFO - We will configure BGP on the VM
2026-02-09 03:56:10,647 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:56:10,647 - INFO - Configuring BGP on ctest-TestBGPaasZone-89788229-93907717
2026-02-09 03:56:10,647 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 57.94.140.68;
protocol bgp bgp_1{
local as 65000;
neighbor 57.94.140.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 57.94.140.68;
}
protocol bfd {
neighbor 57.94.140.65 local 57.94.140.68 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2026-02-09 03:56:10,647 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 57.94.140.68;
protocol bgp bgp_1{
local as 65000;
neighbor 57.94.140.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 57.94.140.68;
}
protocol bfd {
neighbor 57.94.140.65 local 57.94.140.68 multihop on;
}
EOS
2026-02-09 03:56:16,062 - DEBUG - None
2026-02-09 03:56:16,062 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 57.94.140.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 57.94.140.68;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2026-02-09 03:56:16,062 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 57.94.140.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 57.94.140.68;
}
EOS
2026-02-09 03:56:16,597 - DEBUG - None
2026-02-09 03:56:16,598 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2026-02-09 03:56:16,598 - DEBUG - service bird restart
2026-02-09 03:56:18,320 - DEBUG - bird stop/waiting
bird start/running, process 1441
2026-02-09 03:56:18,320 - INFO - Attaching VMI 20a9fbeb-137c-4ee5-9987-c8ba65ca222a to BGPaaS 410a936e-0015-463e-a636-bbd63ea30828
2026-02-09 03:56:18,403 - INFO - Attaching the VMI dfe0690a-eab5-4683-b73a-b7a2209c4877 to the BGPaaS 410a936e-0015-463e-a636-bbd63ea30828 object
2026-02-09 03:56:18,403 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 57.94.140.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2026-02-09 03:56:18,403 - DEBUG - sudo ip addr add 57.94.140.84 dev eth0
2026-02-09 03:56:19,143 - DEBUG - None
2026-02-09 03:56:19,143 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:56:19,159 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-02-09 03:56:19,159 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:56:19,159 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-02-09 03:56:19,176 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-02-09 03:56:19,182 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:56:19,195 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2026-02-09 03:56:25,210 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2026-02-09 03:56:31,229 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-02-09 03:56:31,229 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:56:31,230 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-02-09 03:56:31,248 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-02-09 03:56:31,256 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 57.94.140.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2026-02-09 03:56:31,256 - DEBUG - ping -s 56 -c 3 -W 1 57.94.140.84
2026-02-09 03:56:37,903 - DEBUG - PING 57.94.140.84 (57.94.140.84) 56(84) bytes of data.
64 bytes from 57.94.140.84: icmp_seq=1 ttl=64 time=8.94 ms
64 bytes from 57.94.140.84: icmp_seq=2 ttl=64 time=1.36 ms
64 bytes from 57.94.140.84: icmp_seq=3 ttl=64 time=1.33 ms
--- 57.94.140.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.330/3.879/8.942/3.580 ms
2026-02-09 03:56:37,903 - INFO - Ping to IP 57.94.140.84 from VM ctest-TestBGPaasZone-89788229-40069303 passed
2026-02-09 03:56:37,903 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:56:37,917 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-02-09 03:56:37,918 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:56:37,918 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-02-09 03:56:37,942 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-02-09 03:56:37,952 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:56:37,969 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-02-09 03:56:37,969 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-02-09 03:56:37,969 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-02-09 03:56:37,985 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-02-09 03:56:37,991 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 57.94.140.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2026-02-09 03:56:37,991 - DEBUG - ping -s 56 -c 3 -W 1 57.94.140.84
2026-02-09 03:56:40,513 - DEBUG - PING 57.94.140.84 (57.94.140.84) 56(84) bytes of data.
64 bytes from 57.94.140.84: icmp_seq=1 ttl=64 time=2.63 ms
64 bytes from 57.94.140.84: icmp_seq=2 ttl=64 time=1.53 ms
64 bytes from 57.94.140.84: icmp_seq=3 ttl=64 time=1.92 ms
--- 57.94.140.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.536/2.030/2.633/0.454 ms
2026-02-09 03:56:40,513 - INFO - Ping to IP 57.94.140.84 from VM ctest-TestBGPaasZone-89788229-40069303 passed
2026-02-09 03:56:40,513 - INFO - Detaching VMI 20a9fbeb-137c-4ee5-9987-c8ba65ca222a from BGPaaS 410a936e-0015-463e-a636-bbd63ea30828
2026-02-09 03:56:40,596 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-89788229-79079998(410a936e-0015-463e-a636-bbd63ea30828)
2026-02-09 03:56:40,674 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/410a936e-0015-463e-a636-bbd63ea30828
2026-02-09 03:56:40,687 - DEBUG - Response Code: 404
2026-02-09 03:56:40,687 - DEBUG - BGPaaS: 410a936e-0015-463e-a636-bbd63ea30828 deleted from api server
2026-02-09 03:56:40,687 - INFO - BGPaaS(410a936e-0015-463e-a636-bbd63ea30828): verify_on_cleanup passed
2026-02-09 03:56:40,687 - INFO - Detaching VMI 363ee2d7-b750-4b3e-bb49-59f24473e2e9 from BGPaaS 337921c9-a616-4331-819c-7283f82ebb66
2026-02-09 03:56:40,766 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-89788229-47212301(337921c9-a616-4331-819c-7283f82ebb66)
2026-02-09 03:56:40,839 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/337921c9-a616-4331-819c-7283f82ebb66
2026-02-09 03:56:40,860 - DEBUG - Response Code: 404
2026-02-09 03:56:40,860 - DEBUG - BGPaaS: 337921c9-a616-4331-819c-7283f82ebb66 deleted from api server
2026-02-09 03:56:40,860 - INFO - BGPaaS(337921c9-a616-4331-819c-7283f82ebb66): verify_on_cleanup passed
2026-02-09 03:56:40,860 - INFO - Deleting Control node zone ctest-test-zone-79559166(954c2622-ed4d-4bde-8f76-bc1ffba74964)
2026-02-09 03:56:41,025 - INFO - Deleting Control node zone ctest-test-zone-40705929(7c9ac580-176b-4ad4-82f9-1a4c4abd2589)
2026-02-09 03:56:41,196 - INFO - Deleting Control node zone ctest-test-zone-37203129(04fcd4dc-9904-4d2e-9b59-fec8a6b27e44)
2026-02-09 03:56:41,342 - INFO - Deleting VM ctest-TestBGPaasZone-89788229-40069303
2026-02-09 03:56:41,417 - INFO - Deleting VM ctest-TestBGPaasZone-89788229-93907717
2026-02-09 03:56:41,479 - INFO - Deleting VM ctest-TestBGPaasZone-89788229-59184126
2026-02-09 03:56:41,550 - INFO - Deleting VN ctest-cnz_vn-25713112
2026-02-09 03:56:41,591 - DEBUG - VN 687413d6-0627-4b5d-9391-4322d5a5b9f3 still in use: Unable to complete operation on network 687413d6-0627-4b5d-9391-4322d5a5b9f3. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-8d23fc1a-0906-4da6-a43f-38a8cc7d0db5']
2026-02-09 03:56:41,591 - WARNING - Deleting VN ctest-cnz_vn-25713112 failed..Will retry
2026-02-09 03:56:43,820 - DEBUG - Response for deleting network ()
2026-02-09 03:56:45,073 - DEBUG - Skipping xmpp flap check
2026-02-09 03:56:45,073 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:10]
2026-02-09 03:56:45,073 - INFO - --------------------------------------------------------------------------------
2026-02-09 03:56:45,827 - INFO - Deleted project: ctest-TestBGPaasZone-89788229, ID : 80e1ef16-7037-403b-b3db-f394a191df02