is in ACTIVE state now
2026-06-08 12:29:56,921 - INFO - VM name : ctest-TestBGPaasZone-94988652-76647467
2026-06-08 12:29:57,018 - DEBUG - VM ctest-TestBGPaasZone-94988652-76647467 ID is 02e672d8-08ef-4f4b-8c5c-e2f8c13e9f0e
2026-06-08 12:29:57,018 - DEBUG - VM ctest-TestBGPaasZone-94988652-76647467 launched on Node an-jenkins-deploy-platform-ansible-os-5904-1
2026-06-08 12:29:57,112 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/02e672d8-08ef-4f4b-8c5c-e2f8c13e9f0e
2026-06-08 12:29:57,124 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/b287c9c3-453b-4ee5-925f-abe9667358b6
2026-06-08 12:29:58,300 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=1.98 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.410 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.410/1.196/1.982/0.786 ms')
2026-06-08 12:29:58,300 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-94988652-76647467 passed
2026-06-08 12:29:58,383 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:29:58,383 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-94988652-76647467, IP 12.111.200.197, Port 22
2026-06-08 12:29:58,442 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-08 12:29:58,564 - DEBUG - VM ctest-TestBGPaasZone-94988652-76647467 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-08 12:30:03,565 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:03,566 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-94988652-76647467, IP 12.111.200.197, Port 22
2026-06-08 12:30:03,632 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-08 12:30:03,713 - DEBUG - VM ctest-TestBGPaasZone-94988652-76647467 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-08 12:30:08,714 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:08,714 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-94988652-76647467, IP 12.111.200.197, Port 22
2026-06-08 12:30:08,884 - DEBUG - VM ctest-TestBGPaasZone-94988652-76647467 is ready for SSH connections
2026-06-08 12:30:09,023 - INFO - Created control node zone ctest-test-zone-34021385(578573a4-3532-4e7d-9f31-449443e5d5a5)
2026-06-08 12:30:09,375 - INFO - Created control node zone ctest-test-zone-44523932(c7baf6f3-fa11-4cef-97a1-086e196dda7a)
2026-06-08 12:30:09,731 - INFO - Created control node zone ctest-test-zone-88956431(ff467b95-5150-483a-a51b-7b921d8bcbdf)
2026-06-08 12:30:10,007 - INFO - Creating BGPaaS ctest-TestBGPaasZone-94988652-39824304
2026-06-08 12:30:10,103 - INFO - BGPaaS: ctest-TestBGPaasZone-94988652-39824304(40a83513-d5be-48c8-964d-ae0d18b3fa8a)
2026-06-08 12:30:10,103 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/40a83513-d5be-48c8-964d-ae0d18b3fa8a
2026-06-08 12:30:10,113 - INFO - verify_in_api_server passed for BGPaaS obj 40a83513-d5be-48c8-964d-ae0d18b3fa8a
2026-06-08 12:30:10,113 - INFO - BGPaaS(40a83513-d5be-48c8-964d-ae0d18b3fa8a): verify_on_setup passed
2026-06-08 12:30:10,113 - INFO - We will configure BGP on the VM
2026-06-08 12:30:10,539 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:10,539 - INFO - Configuring BGP on ctest-TestBGPaasZone-94988652-50017093
2026-06-08 12:30:10,539 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 12.111.200.195;
protocol bgp bgp_1{
local as 65000;
neighbor 12.111.200.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.111.200.195;
}
protocol bfd {
neighbor 12.111.200.193 local 12.111.200.195 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-08 12:30:10,540 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 12.111.200.195;
protocol bgp bgp_1{
local as 65000;
neighbor 12.111.200.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.111.200.195;
}
protocol bfd {
neighbor 12.111.200.193 local 12.111.200.195 multihop on;
}
EOS
2026-06-08 12:30:17,251 - DEBUG - None
2026-06-08 12:30:17,251 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 12.111.200.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.111.200.195;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-08 12:30:17,251 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 12.111.200.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.111.200.195;
}
EOS
2026-06-08 12:30:17,749 - DEBUG - None
2026-06-08 12:30:17,749 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-08 12:30:17,749 - DEBUG - service bird restart
2026-06-08 12:30:19,520 - DEBUG - bird stop/waiting
bird start/running, process 1435
2026-06-08 12:30:19,520 - INFO - Attaching VMI 02847cf4-4ee4-451f-8f23-a7facdca8976 to BGPaaS 40a83513-d5be-48c8-964d-ae0d18b3fa8a
2026-06-08 12:30:19,595 - INFO - Attaching the VMI 8e2cdbeb-25d3-48cb-9079-419aca441ae5 to the BGPaaS 40a83513-d5be-48c8-964d-ae0d18b3fa8a object
2026-06-08 12:30:19,596 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 12.111.200.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-08 12:30:19,596 - DEBUG - sudo ip addr add 12.111.200.212 dev eth0
2026-06-08 12:30:20,301 - DEBUG - None
2026-06-08 12:30:20,363 - INFO - Creating BGPaaS ctest-TestBGPaasZone-94988652-45586498
2026-06-08 12:30:20,439 - INFO - BGPaaS: ctest-TestBGPaasZone-94988652-45586498(5ddd002b-be55-4aa1-a3a4-5716af2a4ea1)
2026-06-08 12:30:20,439 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/5ddd002b-be55-4aa1-a3a4-5716af2a4ea1
2026-06-08 12:30:20,449 - INFO - verify_in_api_server passed for BGPaaS obj 5ddd002b-be55-4aa1-a3a4-5716af2a4ea1
2026-06-08 12:30:20,449 - INFO - BGPaaS(5ddd002b-be55-4aa1-a3a4-5716af2a4ea1): verify_on_setup passed
2026-06-08 12:30:20,449 - INFO - We will configure BGP on the VM
2026-06-08 12:30:20,859 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:20,859 - INFO - Configuring BGP on ctest-TestBGPaasZone-94988652-93945542
2026-06-08 12:30:20,859 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 12.111.200.196;
protocol bgp bgp_1{
local as 65000;
neighbor 12.111.200.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.111.200.196;
}
protocol bfd {
neighbor 12.111.200.193 local 12.111.200.196 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-06-08 12:30:20,859 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 12.111.200.196;
protocol bgp bgp_1{
local as 65000;
neighbor 12.111.200.193 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.111.200.196;
}
protocol bfd {
neighbor 12.111.200.193 local 12.111.200.196 multihop on;
}
EOS
2026-06-08 12:30:26,250 - DEBUG - None
2026-06-08 12:30:26,250 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 12.111.200.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.111.200.196;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-06-08 12:30:26,250 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 12.111.200.194 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 12.111.200.196;
}
EOS
2026-06-08 12:30:26,766 - DEBUG - None
2026-06-08 12:30:26,766 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-06-08 12:30:26,766 - DEBUG - service bird restart
2026-06-08 12:30:28,457 - DEBUG - bird stop/waiting
bird start/running, process 1439
2026-06-08 12:30:28,457 - INFO - Attaching VMI f4f4b135-be47-43b6-b6e2-a2214e3a6f62 to BGPaaS 5ddd002b-be55-4aa1-a3a4-5716af2a4ea1
2026-06-08 12:30:28,535 - INFO - Attaching the VMI aaeee417-43bf-4fee-980d-b9f9369c98c8 to the BGPaaS 5ddd002b-be55-4aa1-a3a4-5716af2a4ea1 object
2026-06-08 12:30:28,535 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 12.111.200.212 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-06-08 12:30:28,535 - DEBUG - sudo ip addr add 12.111.200.212 dev eth0
2026-06-08 12:30:29,231 - DEBUG - None
2026-06-08 12:30:29,231 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:29,231 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-06-08 12:30:29,243 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-06-08 12:30:29,243 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:29,263 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-06-08 12:30:29,269 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:29,269 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-06-08 12:30:29,283 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2026-06-08 12:30:35,284 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-06-08 12:30:35,295 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2026-06-08 12:30:41,296 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-06-08 12:30:41,310 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-06-08 12:30:41,311 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:41,330 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-06-08 12:30:41,336 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 12.111.200.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-08 12:30:41,336 - DEBUG - ping -s 56 -c 3 -W 1 12.111.200.212
2026-06-08 12:30:47,624 - DEBUG - PING 12.111.200.212 (12.111.200.212) 56(84) bytes of data.
64 bytes from 12.111.200.212: icmp_seq=1 ttl=64 time=10.0 ms
64 bytes from 12.111.200.212: icmp_seq=2 ttl=64 time=1.34 ms
64 bytes from 12.111.200.212: icmp_seq=3 ttl=64 time=1.92 ms
--- 12.111.200.212 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.341/4.431/10.031/3.967 ms
2026-06-08 12:30:47,624 - INFO - Ping to IP 12.111.200.212 from VM ctest-TestBGPaasZone-94988652-76647467 passed
2026-06-08 12:30:47,624 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:47,625 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-06-08 12:30:47,639 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-06-08 12:30:47,639 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:47,657 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-06-08 12:30:47,662 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:47,662 - DEBUG - Requesting: http://10.20.0.254:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-06-08 12:30:47,675 - INFO - BGPaaS session seen in control-node 10.20.0.254
2026-06-08 12:30:47,675 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 12:30:47,693 - INFO - BGPaaS session seen in control-node 10.20.0.14
2026-06-08 12:30:47,698 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 12.111.200.212, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-08 12:30:47,698 - DEBUG - ping -s 56 -c 3 -W 1 12.111.200.212
2026-06-08 12:30:50,163 - DEBUG - PING 12.111.200.212 (12.111.200.212) 56(84) bytes of data.
64 bytes from 12.111.200.212: icmp_seq=1 ttl=64 time=3.30 ms
64 bytes from 12.111.200.212: icmp_seq=2 ttl=64 time=1.85 ms
64 bytes from 12.111.200.212: icmp_seq=3 ttl=64 time=1.25 ms
--- 12.111.200.212 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.259/2.139/3.307/0.860 ms
2026-06-08 12:30:50,163 - INFO - Ping to IP 12.111.200.212 from VM ctest-TestBGPaasZone-94988652-76647467 passed
2026-06-08 12:30:50,163 - INFO - Detaching VMI f4f4b135-be47-43b6-b6e2-a2214e3a6f62 from BGPaaS 5ddd002b-be55-4aa1-a3a4-5716af2a4ea1
2026-06-08 12:30:50,239 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-94988652-45586498(5ddd002b-be55-4aa1-a3a4-5716af2a4ea1)
2026-06-08 12:30:50,323 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/5ddd002b-be55-4aa1-a3a4-5716af2a4ea1
2026-06-08 12:30:50,330 - DEBUG - Response Code: 404
2026-06-08 12:30:50,330 - DEBUG - BGPaaS: 5ddd002b-be55-4aa1-a3a4-5716af2a4ea1 deleted from api server
2026-06-08 12:30:50,330 - INFO - BGPaaS(5ddd002b-be55-4aa1-a3a4-5716af2a4ea1): verify_on_cleanup passed
2026-06-08 12:30:50,330 - INFO - Detaching VMI 02847cf4-4ee4-451f-8f23-a7facdca8976 from BGPaaS 40a83513-d5be-48c8-964d-ae0d18b3fa8a
2026-06-08 12:30:50,443 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-94988652-39824304(40a83513-d5be-48c8-964d-ae0d18b3fa8a)
2026-06-08 12:30:50,504 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/40a83513-d5be-48c8-964d-ae0d18b3fa8a
2026-06-08 12:30:50,509 - DEBUG - Response Code: 404
2026-06-08 12:30:50,509 - DEBUG - BGPaaS: 40a83513-d5be-48c8-964d-ae0d18b3fa8a deleted from api server
2026-06-08 12:30:50,509 - INFO - BGPaaS(40a83513-d5be-48c8-964d-ae0d18b3fa8a): verify_on_cleanup passed
2026-06-08 12:30:50,509 - INFO - Deleting Control node zone ctest-test-zone-88956431(ff467b95-5150-483a-a51b-7b921d8bcbdf)
2026-06-08 12:30:50,665 - INFO - Deleting Control node zone ctest-test-zone-44523932(c7baf6f3-fa11-4cef-97a1-086e196dda7a)
2026-06-08 12:30:50,812 - INFO - Deleting Control node zone ctest-test-zone-34021385(578573a4-3532-4e7d-9f31-449443e5d5a5)
2026-06-08 12:30:50,963 - INFO - Deleting VM ctest-TestBGPaasZone-94988652-76647467
2026-06-08 12:30:51,048 - INFO - Deleting VM ctest-TestBGPaasZone-94988652-93945542
2026-06-08 12:30:51,125 - INFO - Deleting VM ctest-TestBGPaasZone-94988652-50017093
2026-06-08 12:30:51,205 - INFO - Deleting VN ctest-cnz_vn-72175056
2026-06-08 12:30:51,256 - DEBUG - VN 305edfc6-ee36-4d8e-8ec1-23983a0010ff still in use: Unable to complete operation on network 305edfc6-ee36-4d8e-8ec1-23983a0010ff. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-e3ccfafb-b54c-4b2c-b223-fb253dd46103']
2026-06-08 12:30:51,256 - WARNING - Deleting VN ctest-cnz_vn-72175056 failed..Will retry
2026-06-08 12:30:53,446 - DEBUG - Response for deleting network ()
2026-06-08 12:30:54,732 - DEBUG - Skipping xmpp flap check
2026-06-08 12:30:54,732 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:02:58]
2026-06-08 12:30:54,732 - INFO - --------------------------------------------------------------------------------
2026-06-08 12:30:55,554 - INFO - Deleted project: ctest-TestBGPaasZone-94988652, ID : 15fd8b50-94ad-4cf6-8992-64b12a906e77