is in ACTIVE state now
2026-05-04 04:27:41,139 - INFO - VM name : ctest-TestBGPaasZone-69645158-37354166
2026-05-04 04:27:41,251 - DEBUG - VM ctest-TestBGPaasZone-69645158-37354166 ID is 663d0195-331d-43b9-8d76-2f4095a832ac
2026-05-04 04:27:41,251 - DEBUG - VM ctest-TestBGPaasZone-69645158-37354166 launched on Node an-jenkins-deploy-platform-ansible-os-5740-2
2026-05-04 04:27:41,353 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/663d0195-331d-43b9-8d76-2f4095a832ac
2026-05-04 04:27:41,366 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/680aed0a-2d70-4f43-bca9-ae5a7a944cf0
2026-05-04 04:27:42,571 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=13.3 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=1.70 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.700/7.509/13.319/5.809 ms')
2026-05-04 04:27:42,571 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-TestBGPaasZone-69645158-37354166 passed
2026-05-04 04:27:42,649 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:27:42,649 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-69645158-37354166, IP 175.190.151.69, Port 22
2026-05-04 04:27:42,719 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-05-04 04:27:42,819 - DEBUG - VM ctest-TestBGPaasZone-69645158-37354166 is NOT ready for SSH connections, VM status: ACTIVE
2026-05-04 04:27:47,819 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:27:47,820 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-69645158-37354166, IP 175.190.151.69, Port 22
2026-05-04 04:27:47,990 - DEBUG - VM ctest-TestBGPaasZone-69645158-37354166 is ready for SSH connections
2026-05-04 04:27:48,149 - INFO - Created control node zone ctest-test-zone-71181789(442f864b-f8cc-447d-97b9-f8315a5750f2)
2026-05-04 04:27:48,529 - INFO - Created control node zone ctest-test-zone-72108507(1cea34d1-527e-469a-ad8a-5da9f05a2efd)
2026-05-04 04:27:48,929 - INFO - Created control node zone ctest-test-zone-39914699(1bd43e01-718c-4dda-bb35-688ae10ca272)
2026-05-04 04:27:49,245 - INFO - Creating BGPaaS ctest-TestBGPaasZone-69645158-37069565
2026-05-04 04:27:49,329 - INFO - BGPaaS: ctest-TestBGPaasZone-69645158-37069565(f9e38575-c722-48f9-94ac-5afbbd31c808)
2026-05-04 04:27:49,329 - DEBUG - Requesting: http://10.0.0.129:8082/bgp-as-a-service/f9e38575-c722-48f9-94ac-5afbbd31c808
2026-05-04 04:27:49,342 - INFO - verify_in_api_server passed for BGPaaS obj f9e38575-c722-48f9-94ac-5afbbd31c808
2026-05-04 04:27:49,343 - INFO - BGPaaS(f9e38575-c722-48f9-94ac-5afbbd31c808): verify_on_setup passed
2026-05-04 04:27:49,343 - INFO - We will configure BGP on the VM
2026-05-04 04:27:49,793 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:27:49,793 - INFO - Configuring BGP on ctest-TestBGPaasZone-69645158-36266572
2026-05-04 04:27:49,793 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 175.190.151.67;
protocol bgp bgp_1{
local as 65000;
neighbor 175.190.151.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 175.190.151.67;
}
protocol bfd {
neighbor 175.190.151.65 local 175.190.151.67 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-05-04 04:27:49,794 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 175.190.151.67;
protocol bgp bgp_1{
local as 65000;
neighbor 175.190.151.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 175.190.151.67;
}
protocol bfd {
neighbor 175.190.151.65 local 175.190.151.67 multihop on;
}
EOS
2026-05-04 04:28:06,182 - DEBUG - None
2026-05-04 04:28:06,183 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 175.190.151.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 175.190.151.67;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-05-04 04:28:06,183 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 175.190.151.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 175.190.151.67;
}
EOS
2026-05-04 04:28:07,624 - DEBUG - None
2026-05-04 04:28:07,624 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-05-04 04:28:07,624 - DEBUG - service bird restart
2026-05-04 04:28:11,342 - DEBUG - bird stop/waiting
bird start/running, process 1434
2026-05-04 04:28:11,343 - INFO - Attaching VMI e69b9410-b563-4c43-9855-a84b68609382 to BGPaaS f9e38575-c722-48f9-94ac-5afbbd31c808
2026-05-04 04:28:11,429 - INFO - Attaching the VMI 5800ad44-03e1-4791-9ce2-6ff309e79f7a to the BGPaaS f9e38575-c722-48f9-94ac-5afbbd31c808 object
2026-05-04 04:28:11,429 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 175.190.151.84 dev eth0, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-05-04 04:28:11,429 - DEBUG - sudo ip addr add 175.190.151.84 dev eth0
2026-05-04 04:28:12,446 - DEBUG - None
2026-05-04 04:28:12,513 - INFO - Creating BGPaaS ctest-TestBGPaasZone-69645158-47271046
2026-05-04 04:28:12,601 - INFO - BGPaaS: ctest-TestBGPaasZone-69645158-47271046(c79ab99a-6e3d-453a-83a0-d5be170dc97c)
2026-05-04 04:28:12,601 - DEBUG - Requesting: http://10.0.0.129:8082/bgp-as-a-service/c79ab99a-6e3d-453a-83a0-d5be170dc97c
2026-05-04 04:28:12,614 - INFO - verify_in_api_server passed for BGPaaS obj c79ab99a-6e3d-453a-83a0-d5be170dc97c
2026-05-04 04:28:12,614 - INFO - BGPaaS(c79ab99a-6e3d-453a-83a0-d5be170dc97c): verify_on_setup passed
2026-05-04 04:28:12,614 - INFO - We will configure BGP on the VM
2026-05-04 04:28:13,083 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:28:13,083 - INFO - Configuring BGP on ctest-TestBGPaasZone-69645158-01958907
2026-05-04 04:28:13,083 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 175.190.151.68;
protocol bgp bgp_1{
local as 65000;
neighbor 175.190.151.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 175.190.151.68;
}
protocol bfd {
neighbor 175.190.151.65 local 175.190.151.68 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-05-04 04:28:13,083 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 175.190.151.68;
protocol bgp bgp_1{
local as 65000;
neighbor 175.190.151.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 175.190.151.68;
}
protocol bfd {
neighbor 175.190.151.65 local 175.190.151.68 multihop on;
}
EOS
2026-05-04 04:28:19,476 - DEBUG - None
2026-05-04 04:28:19,476 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 175.190.151.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 175.190.151.68;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-05-04 04:28:19,477 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 175.190.151.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 175.190.151.68;
}
EOS
2026-05-04 04:28:20,080 - DEBUG - None
2026-05-04 04:28:20,080 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-05-04 04:28:20,080 - DEBUG - service bird restart
2026-05-04 04:28:22,146 - DEBUG - bird stop/waiting
bird start/running, process 1432
2026-05-04 04:28:22,147 - INFO - Attaching VMI ceace2d1-ffbb-4cb0-b354-86b9e8bb37a8 to BGPaaS c79ab99a-6e3d-453a-83a0-d5be170dc97c
2026-05-04 04:28:22,237 - INFO - Attaching the VMI 1ac566a2-0555-4461-8e4c-8d7aadf8e968 to the BGPaaS c79ab99a-6e3d-453a-83a0-d5be170dc97c object
2026-05-04 04:28:22,237 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 175.190.151.84 dev eth0, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-05-04 04:28:22,238 - DEBUG - sudo ip addr add 175.190.151.84 dev eth0
2026-05-04 04:28:23,039 - DEBUG - None
2026-05-04 04:28:23,039 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:28:23,055 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-05-04 04:28:23,055 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:28:23,055 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-05-04 04:28:23,080 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-05-04 04:28:23,087 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:28:23,103 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193']
2026-05-04 04:28:29,123 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193']
2026-05-04 04:28:35,144 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-05-04 04:28:35,145 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:28:35,145 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-05-04 04:28:35,164 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-05-04 04:28:35,172 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 175.190.151.84, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-05-04 04:28:35,172 - DEBUG - ping -s 56 -c 3 -W 1 175.190.151.84
2026-05-04 04:28:42,881 - DEBUG - PING 175.190.151.84 (175.190.151.84) 56(84) bytes of data.
64 bytes from 175.190.151.84: icmp_seq=1 ttl=64 time=11.0 ms
64 bytes from 175.190.151.84: icmp_seq=2 ttl=64 time=2.05 ms
64 bytes from 175.190.151.84: icmp_seq=3 ttl=64 time=1.90 ms
--- 175.190.151.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.900/5.013/11.086/4.294 ms
2026-05-04 04:28:42,881 - INFO - Ping to IP 175.190.151.84 from VM ctest-TestBGPaasZone-69645158-37354166 passed
2026-05-04 04:28:42,881 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:28:42,903 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-05-04 04:28:42,903 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:28:42,904 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-05-04 04:28:42,923 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-05-04 04:28:42,931 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:28:42,944 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-05-04 04:28:42,944 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-04 04:28:42,944 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-05-04 04:28:42,961 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-05-04 04:28:42,969 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 175.190.151.84, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-05-04 04:28:42,969 - DEBUG - ping -s 56 -c 3 -W 1 175.190.151.84
2026-05-04 04:28:45,496 - DEBUG - PING 175.190.151.84 (175.190.151.84) 56(84) bytes of data.
64 bytes from 175.190.151.84: icmp_seq=1 ttl=64 time=4.64 ms
64 bytes from 175.190.151.84: icmp_seq=2 ttl=64 time=1.15 ms
64 bytes from 175.190.151.84: icmp_seq=3 ttl=64 time=0.913 ms
--- 175.190.151.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.913/2.235/4.642/1.705 ms
2026-05-04 04:28:45,496 - INFO - Ping to IP 175.190.151.84 from VM ctest-TestBGPaasZone-69645158-37354166 passed
2026-05-04 04:28:45,496 - INFO - Detaching VMI ceace2d1-ffbb-4cb0-b354-86b9e8bb37a8 from BGPaaS c79ab99a-6e3d-453a-83a0-d5be170dc97c
2026-05-04 04:28:45,582 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-69645158-47271046(c79ab99a-6e3d-453a-83a0-d5be170dc97c)
2026-05-04 04:28:45,679 - DEBUG - Requesting: http://10.0.0.129:8082/bgp-as-a-service/c79ab99a-6e3d-453a-83a0-d5be170dc97c
2026-05-04 04:28:45,815 - DEBUG - Response Code: 404
2026-05-04 04:28:45,815 - DEBUG - BGPaaS: c79ab99a-6e3d-453a-83a0-d5be170dc97c deleted from api server
2026-05-04 04:28:45,815 - INFO - BGPaaS(c79ab99a-6e3d-453a-83a0-d5be170dc97c): verify_on_cleanup passed
2026-05-04 04:28:45,815 - INFO - Detaching VMI e69b9410-b563-4c43-9855-a84b68609382 from BGPaaS f9e38575-c722-48f9-94ac-5afbbd31c808
2026-05-04 04:28:45,914 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-69645158-37069565(f9e38575-c722-48f9-94ac-5afbbd31c808)
2026-05-04 04:28:46,036 - DEBUG - Requesting: http://10.0.0.129:8082/bgp-as-a-service/f9e38575-c722-48f9-94ac-5afbbd31c808
2026-05-04 04:28:46,043 - DEBUG - Response Code: 404
2026-05-04 04:28:46,043 - DEBUG - BGPaaS: f9e38575-c722-48f9-94ac-5afbbd31c808 deleted from api server
2026-05-04 04:28:46,043 - INFO - BGPaaS(f9e38575-c722-48f9-94ac-5afbbd31c808): verify_on_cleanup passed
2026-05-04 04:28:46,043 - INFO - Deleting Control node zone ctest-test-zone-39914699(1bd43e01-718c-4dda-bb35-688ae10ca272)
2026-05-04 04:28:46,244 - INFO - Deleting Control node zone ctest-test-zone-72108507(1cea34d1-527e-469a-ad8a-5da9f05a2efd)
2026-05-04 04:28:46,435 - INFO - Deleting Control node zone ctest-test-zone-71181789(442f864b-f8cc-447d-97b9-f8315a5750f2)
2026-05-04 04:28:46,607 - INFO - Deleting VM ctest-TestBGPaasZone-69645158-37354166
2026-05-04 04:28:46,703 - INFO - Deleting VM ctest-TestBGPaasZone-69645158-01958907
2026-05-04 04:28:46,792 - INFO - Deleting VM ctest-TestBGPaasZone-69645158-36266572
2026-05-04 04:28:46,873 - INFO - Deleting VN ctest-cnz_vn-32640777
2026-05-04 04:28:46,929 - DEBUG - VN f3e4ac51-29d4-4637-9b98-4ab150a6edda still in use: Unable to complete operation on network f3e4ac51-29d4-4637-9b98-4ab150a6edda. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-3a6d1bf7-dcb8-431f-b497-a83c34fc5717']
2026-05-04 04:28:46,929 - WARNING - Deleting VN ctest-cnz_vn-32640777 failed..Will retry
2026-05-04 04:28:49,229 - DEBUG - Response for deleting network ()
2026-05-04 04:28:50,536 - DEBUG - Skipping xmpp flap check
2026-05-04 04:28:50,536 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:51]
2026-05-04 04:28:50,537 - INFO - --------------------------------------------------------------------------------
2026-05-04 04:28:51,391 - INFO - Deleted project: ctest-TestBGPaasZone-69645158, ID : d7b5de43-ee3f-4f02-b224-9a7fe7dafdbf