is in ACTIVE state now
2026-01-08 03:57:39,748 - INFO - VM name : ctest-TestBGPaasZone-66405291-42221422
2026-01-08 03:57:39,832 - DEBUG - VM ctest-TestBGPaasZone-66405291-42221422 ID is d515547d-d2d7-484f-9155-13e22e4af891
2026-01-08 03:57:39,832 - DEBUG - VM ctest-TestBGPaasZone-66405291-42221422 launched on Node an-jenkins-deploy-platform-ansible-os-4976-1
2026-01-08 03:57:39,918 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/d515547d-d2d7-484f-9155-13e22e4af891
2026-01-08 03:57:39,930 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/7baac302-dc5d-4ab6-b1b8-9aa95b8fcf52
2026-01-08 03:57:41,097 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.74 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.474 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.474/2.105/3.737/1.631 ms')
2026-01-08 03:57:41,098 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-66405291-42221422 passed
2026-01-08 03:57:41,174 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:57:41,175 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-66405291-42221422, IP 112.61.210.69, Port 22
2026-01-08 03:57:41,246 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-01-08 03:57:41,332 - DEBUG - VM ctest-TestBGPaasZone-66405291-42221422 is NOT ready for SSH connections, VM status: ACTIVE
2026-01-08 03:57:46,333 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:57:46,333 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-66405291-42221422, IP 112.61.210.69, Port 22
2026-01-08 03:57:46,388 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-01-08 03:57:46,484 - DEBUG - VM ctest-TestBGPaasZone-66405291-42221422 is NOT ready for SSH connections, VM status: ACTIVE
2026-01-08 03:57:51,485 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:57:51,485 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-66405291-42221422, IP 112.61.210.69, Port 22
2026-01-08 03:57:51,649 - DEBUG - VM ctest-TestBGPaasZone-66405291-42221422 is ready for SSH connections
2026-01-08 03:57:51,787 - INFO - Created control node zone ctest-test-zone-06047557(ac4574fd-ec20-4db6-ad2d-993548ddf34c)
2026-01-08 03:57:52,147 - INFO - Created control node zone ctest-test-zone-45633271(48d73e7f-4308-4518-bb00-53d402dbcd28)
2026-01-08 03:57:52,511 - INFO - Created control node zone ctest-test-zone-32173528(291438eb-4d3b-40a2-a0e8-a1814967b0fb)
2026-01-08 03:57:52,799 - INFO - Creating BGPaaS ctest-TestBGPaasZone-66405291-06076778
2026-01-08 03:57:52,879 - INFO - BGPaaS: ctest-TestBGPaasZone-66405291-06076778(cc902202-83c5-4de4-b52d-e657998e4763)
2026-01-08 03:57:52,880 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/cc902202-83c5-4de4-b52d-e657998e4763
2026-01-08 03:57:52,894 - INFO - verify_in_api_server passed for BGPaaS obj cc902202-83c5-4de4-b52d-e657998e4763
2026-01-08 03:57:52,895 - INFO - BGPaaS(cc902202-83c5-4de4-b52d-e657998e4763): verify_on_setup passed
2026-01-08 03:57:52,895 - INFO - We will configure BGP on the VM
2026-01-08 03:57:53,323 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:57:53,323 - INFO - Configuring BGP on ctest-TestBGPaasZone-66405291-86282085
2026-01-08 03:57:53,323 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 112.61.210.67;
protocol bgp bgp_1{
local as 65000;
neighbor 112.61.210.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 112.61.210.67;
}
protocol bfd {
neighbor 112.61.210.65 local 112.61.210.67 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 03:57:53,323 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 112.61.210.67;
protocol bgp bgp_1{
local as 65000;
neighbor 112.61.210.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 112.61.210.67;
}
protocol bfd {
neighbor 112.61.210.65 local 112.61.210.67 multihop on;
}
EOS
2026-01-08 03:58:09,797 - DEBUG - None
2026-01-08 03:58:09,797 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 112.61.210.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 112.61.210.67;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 03:58:09,797 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 112.61.210.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 112.61.210.67;
}
EOS
2026-01-08 03:58:10,460 - DEBUG - None
2026-01-08 03:58:10,460 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 03:58:10,460 - DEBUG - service bird restart
2026-01-08 03:58:12,455 - DEBUG - bird stop/waiting
bird start/running, process 1442
2026-01-08 03:58:12,455 - INFO - Attaching VMI f6fb3f86-dbef-4611-b6ae-b094f9820c35 to BGPaaS cc902202-83c5-4de4-b52d-e657998e4763
2026-01-08 03:58:12,531 - INFO - Attaching the VMI 30aa63c9-35d9-417d-8e23-4ff2f61d9696 to the BGPaaS cc902202-83c5-4de4-b52d-e657998e4763 object
2026-01-08 03:58:12,531 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 112.61.210.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 03:58:12,531 - DEBUG - sudo ip addr add 112.61.210.84 dev eth0
2026-01-08 03:58:13,307 - DEBUG - None
2026-01-08 03:58:13,371 - INFO - Creating BGPaaS ctest-TestBGPaasZone-66405291-90852702
2026-01-08 03:58:13,447 - INFO - BGPaaS: ctest-TestBGPaasZone-66405291-90852702(f4a7c04c-6a1d-4fcf-8b6a-cc275af4c552)
2026-01-08 03:58:13,447 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/f4a7c04c-6a1d-4fcf-8b6a-cc275af4c552
2026-01-08 03:58:13,456 - INFO - verify_in_api_server passed for BGPaaS obj f4a7c04c-6a1d-4fcf-8b6a-cc275af4c552
2026-01-08 03:58:13,457 - INFO - BGPaaS(f4a7c04c-6a1d-4fcf-8b6a-cc275af4c552): verify_on_setup passed
2026-01-08 03:58:13,457 - INFO - We will configure BGP on the VM
2026-01-08 03:58:13,871 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:58:13,871 - INFO - Configuring BGP on ctest-TestBGPaasZone-66405291-65191752
2026-01-08 03:58:13,871 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 112.61.210.68;
protocol bgp bgp_1{
local as 65000;
neighbor 112.61.210.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 112.61.210.68;
}
protocol bfd {
neighbor 112.61.210.65 local 112.61.210.68 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2026-01-08 03:58:13,871 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 112.61.210.68;
protocol bgp bgp_1{
local as 65000;
neighbor 112.61.210.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 112.61.210.68;
}
protocol bfd {
neighbor 112.61.210.65 local 112.61.210.68 multihop on;
}
EOS
2026-01-08 03:58:24,514 - DEBUG - None
2026-01-08 03:58:24,514 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 112.61.210.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 112.61.210.68;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2026-01-08 03:58:24,514 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 112.61.210.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 112.61.210.68;
}
EOS
2026-01-08 03:58:25,035 - DEBUG - None
2026-01-08 03:58:25,036 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2026-01-08 03:58:25,036 - DEBUG - service bird restart
2026-01-08 03:58:26,798 - DEBUG - bird stop/waiting
bird start/running, process 1443
2026-01-08 03:58:26,798 - INFO - Attaching VMI 376ab6c1-c49f-4f00-bffb-8a50307a5ecc to BGPaaS f4a7c04c-6a1d-4fcf-8b6a-cc275af4c552
2026-01-08 03:58:26,875 - INFO - Attaching the VMI 3d6bf021-58fc-4696-a2a6-61db052cf3d4 to the BGPaaS f4a7c04c-6a1d-4fcf-8b6a-cc275af4c552 object
2026-01-08 03:58:26,875 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 112.61.210.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2026-01-08 03:58:26,875 - DEBUG - sudo ip addr add 112.61.210.84 dev eth0
2026-01-08 03:58:27,548 - DEBUG - None
2026-01-08 03:58:27,548 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:58:27,560 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-01-08 03:58:27,560 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:58:27,577 - INFO - BGPaaS session seen in control-node 10.20.0.17
2026-01-08 03:58:27,599 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:58:27,614 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2026-01-08 03:58:33,631 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2026-01-08 03:58:39,649 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-01-08 03:58:39,650 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:58:39,666 - INFO - BGPaaS session seen in control-node 10.20.0.17
2026-01-08 03:58:39,672 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 112.61.210.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 03:58:39,672 - DEBUG - ping -s 56 -c 3 -W 1 112.61.210.84
2026-01-08 03:58:51,808 - DEBUG - PING 112.61.210.84 (112.61.210.84) 56(84) bytes of data.
64 bytes from 112.61.210.84: icmp_seq=1 ttl=64 time=8.55 ms
64 bytes from 112.61.210.84: icmp_seq=2 ttl=64 time=1.49 ms
64 bytes from 112.61.210.84: icmp_seq=3 ttl=64 time=1.28 ms
--- 112.61.210.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.288/3.780/8.555/3.377 ms
2026-01-08 03:58:51,808 - INFO - Ping to IP 112.61.210.84 from VM ctest-TestBGPaasZone-66405291-42221422 passed
2026-01-08 03:58:51,809 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:58:51,826 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-01-08 03:58:51,827 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:58:51,844 - INFO - BGPaaS session seen in control-node 10.20.0.17
2026-01-08 03:58:51,852 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:58:51,868 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-01-08 03:58:51,869 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 03:58:51,884 - INFO - BGPaaS session seen in control-node 10.20.0.17
2026-01-08 03:58:51,890 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 112.61.210.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 03:58:51,891 - DEBUG - ping -s 56 -c 3 -W 1 112.61.210.84
2026-01-08 03:58:54,449 - DEBUG - PING 112.61.210.84 (112.61.210.84) 56(84) bytes of data.
64 bytes from 112.61.210.84: icmp_seq=1 ttl=64 time=3.62 ms
64 bytes from 112.61.210.84: icmp_seq=2 ttl=64 time=1.53 ms
64 bytes from 112.61.210.84: icmp_seq=3 ttl=64 time=1.58 ms
--- 112.61.210.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 1.535/2.245/3.620/0.972 ms
2026-01-08 03:58:54,449 - INFO - Ping to IP 112.61.210.84 from VM ctest-TestBGPaasZone-66405291-42221422 passed
2026-01-08 03:58:54,450 - INFO - Detaching VMI 376ab6c1-c49f-4f00-bffb-8a50307a5ecc from BGPaaS f4a7c04c-6a1d-4fcf-8b6a-cc275af4c552
2026-01-08 03:58:54,543 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-66405291-90852702(f4a7c04c-6a1d-4fcf-8b6a-cc275af4c552)
2026-01-08 03:58:54,604 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/f4a7c04c-6a1d-4fcf-8b6a-cc275af4c552
2026-01-08 03:58:54,647 - DEBUG - Response Code: 404
2026-01-08 03:58:54,648 - DEBUG - BGPaaS: f4a7c04c-6a1d-4fcf-8b6a-cc275af4c552 deleted from api server
2026-01-08 03:58:54,648 - INFO - BGPaaS(f4a7c04c-6a1d-4fcf-8b6a-cc275af4c552): verify_on_cleanup passed
2026-01-08 03:58:54,648 - INFO - Detaching VMI f6fb3f86-dbef-4611-b6ae-b094f9820c35 from BGPaaS cc902202-83c5-4de4-b52d-e657998e4763
2026-01-08 03:58:54,727 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-66405291-06076778(cc902202-83c5-4de4-b52d-e657998e4763)
2026-01-08 03:58:54,787 - DEBUG - Requesting: http://10.0.0.242:8082/bgp-as-a-service/cc902202-83c5-4de4-b52d-e657998e4763
2026-01-08 03:58:54,798 - DEBUG - Response Code: 404
2026-01-08 03:58:54,798 - DEBUG - BGPaaS: cc902202-83c5-4de4-b52d-e657998e4763 deleted from api server
2026-01-08 03:58:54,798 - INFO - BGPaaS(cc902202-83c5-4de4-b52d-e657998e4763): verify_on_cleanup passed
2026-01-08 03:58:54,798 - INFO - Deleting Control node zone ctest-test-zone-32173528(291438eb-4d3b-40a2-a0e8-a1814967b0fb)
2026-01-08 03:58:54,961 - INFO - Deleting Control node zone ctest-test-zone-45633271(48d73e7f-4308-4518-bb00-53d402dbcd28)
2026-01-08 03:58:55,154 - INFO - Deleting Control node zone ctest-test-zone-06047557(ac4574fd-ec20-4db6-ad2d-993548ddf34c)
2026-01-08 03:58:55,372 - INFO - Deleting VM ctest-TestBGPaasZone-66405291-42221422
2026-01-08 03:58:55,570 - INFO - Deleting VM ctest-TestBGPaasZone-66405291-65191752
2026-01-08 03:58:55,647 - INFO - Deleting VM ctest-TestBGPaasZone-66405291-86282085
2026-01-08 03:58:55,751 - INFO - Deleting VN ctest-cnz_vn-18184833
2026-01-08 03:58:55,843 - DEBUG - VN 748bf75e-88b7-4068-a43f-ecf1249a89ec still in use: Unable to complete operation on network 748bf75e-88b7-4068-a43f-ecf1249a89ec. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-de8a68ea-f336-43bd-9574-5d0b240be727']
2026-01-08 03:58:55,843 - WARNING - Deleting VN ctest-cnz_vn-18184833 failed..Will retry
2026-01-08 03:58:58,074 - DEBUG - Response for deleting network ()
2026-01-08 03:58:59,360 - DEBUG - Skipping xmpp flap check
2026-01-08 03:58:59,360 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:41]
2026-01-08 03:58:59,360 - INFO - --------------------------------------------------------------------------------
2026-01-08 03:59:00,188 - INFO - Deleted project: ctest-TestBGPaasZone-66405291, ID : 179519cb-dcad-4e21-a7ab-62a1f92fa9c9