is in ACTIVE state now
2026-03-09 03:46:19,685 - INFO - VM name : ctest-TestBGPaasZone-64246962-99394388
2026-03-09 03:46:19,769 - DEBUG - VM ctest-TestBGPaasZone-64246962-99394388 ID is c63d5936-7d7e-46e6-a062-f098d1371f67
2026-03-09 03:46:19,769 - DEBUG - VM ctest-TestBGPaasZone-64246962-99394388 launched on Node an-jenkins-deploy-platform-ansible-os-5454-2
2026-03-09 03:46:19,847 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c63d5936-7d7e-46e6-a062-f098d1371f67
2026-03-09 03:46:19,856 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/09225f2a-5553-43cc-b9a6-cbf4548c15b3
2026-03-09 03:46:21,013 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.08 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.39 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.394/2.737/4.081/1.343 ms')
2026-03-09 03:46:21,013 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-64246962-99394388 passed
2026-03-09 03:46:21,080 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:46:21,080 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64246962-99394388, IP 58.45.220.69, Port 22
2026-03-09 03:46:21,148 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-09 03:46:21,232 - DEBUG - VM ctest-TestBGPaasZone-64246962-99394388 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-09 03:46:26,232 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:46:26,232 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64246962-99394388, IP 58.45.220.69, Port 22
2026-03-09 03:46:26,300 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-09 03:46:26,383 - DEBUG - VM ctest-TestBGPaasZone-64246962-99394388 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-09 03:46:31,384 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:46:31,384 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-64246962-99394388, IP 58.45.220.69, Port 22
2026-03-09 03:46:31,543 - DEBUG - VM ctest-TestBGPaasZone-64246962-99394388 is ready for SSH connections
2026-03-09 03:46:31,676 - INFO - Created control node zone ctest-test-zone-07750003(f570bc0b-f0a4-4a68-add0-75083e96b746)
2026-03-09 03:46:32,028 - INFO - Created control node zone ctest-test-zone-36771624(af62cae3-4059-4307-a9f5-2bd5e16c4c7c)
2026-03-09 03:46:32,380 - INFO - Created control node zone ctest-test-zone-14756300(c82617c9-9b9a-4eb2-8b4a-139c028ed41f)
2026-03-09 03:46:32,655 - INFO - Creating BGPaaS ctest-TestBGPaasZone-64246962-49566267
2026-03-09 03:46:32,728 - INFO - BGPaaS: ctest-TestBGPaasZone-64246962-49566267(71eed667-ac6c-4406-b03e-595259379a8a)
2026-03-09 03:46:32,728 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/71eed667-ac6c-4406-b03e-595259379a8a
2026-03-09 03:46:32,737 - INFO - verify_in_api_server passed for BGPaaS obj 71eed667-ac6c-4406-b03e-595259379a8a
2026-03-09 03:46:32,737 - INFO - BGPaaS(71eed667-ac6c-4406-b03e-595259379a8a): verify_on_setup passed
2026-03-09 03:46:32,737 - INFO - We will configure BGP on the VM
2026-03-09 03:46:33,144 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:46:33,144 - INFO - Configuring BGP on ctest-TestBGPaasZone-64246962-83530548
2026-03-09 03:46:33,144 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 58.45.220.67;
protocol bgp bgp_1{
local as 65000;
neighbor 58.45.220.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 58.45.220.67;
}
protocol bfd {
neighbor 58.45.220.65 local 58.45.220.67 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2026-03-09 03:46:33,144 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 58.45.220.67;
protocol bgp bgp_1{
local as 65000;
neighbor 58.45.220.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 58.45.220.67;
}
protocol bfd {
neighbor 58.45.220.65 local 58.45.220.67 multihop on;
}
EOS
2026-03-09 03:46:38,859 - DEBUG - None
2026-03-09 03:46:38,859 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 58.45.220.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 58.45.220.67;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2026-03-09 03:46:38,859 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 58.45.220.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 58.45.220.67;
}
EOS
2026-03-09 03:46:39,402 - DEBUG - None
2026-03-09 03:46:39,402 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2026-03-09 03:46:39,402 - DEBUG - service bird restart
2026-03-09 03:46:41,128 - DEBUG - bird stop/waiting
bird start/running, process 1437
2026-03-09 03:46:41,128 - INFO - Attaching VMI 490342ed-654f-4f10-9a4f-00dc185990b1 to BGPaaS 71eed667-ac6c-4406-b03e-595259379a8a
2026-03-09 03:46:41,208 - INFO - Attaching the VMI 94a0763a-4e28-4782-b6ef-e334cb739f88 to the BGPaaS 71eed667-ac6c-4406-b03e-595259379a8a object
2026-03-09 03:46:41,208 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 58.45.220.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2026-03-09 03:46:41,208 - DEBUG - sudo ip addr add 58.45.220.84 dev eth0
2026-03-09 03:46:41,862 - DEBUG - None
2026-03-09 03:46:41,924 - INFO - Creating BGPaaS ctest-TestBGPaasZone-64246962-06311746
2026-03-09 03:46:42,000 - INFO - BGPaaS: ctest-TestBGPaasZone-64246962-06311746(9a0679e6-ab73-4856-917a-07b0430aa425)
2026-03-09 03:46:42,000 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/9a0679e6-ab73-4856-917a-07b0430aa425
2026-03-09 03:46:42,013 - INFO - verify_in_api_server passed for BGPaaS obj 9a0679e6-ab73-4856-917a-07b0430aa425
2026-03-09 03:46:42,014 - INFO - BGPaaS(9a0679e6-ab73-4856-917a-07b0430aa425): verify_on_setup passed
2026-03-09 03:46:42,015 - INFO - We will configure BGP on the VM
2026-03-09 03:46:42,428 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:46:42,428 - INFO - Configuring BGP on ctest-TestBGPaasZone-64246962-16251343
2026-03-09 03:46:42,428 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 58.45.220.68;
protocol bgp bgp_1{
local as 65000;
neighbor 58.45.220.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 58.45.220.68;
}
protocol bfd {
neighbor 58.45.220.65 local 58.45.220.68 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-03-09 03:46:42,428 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 58.45.220.68;
protocol bgp bgp_1{
local as 65000;
neighbor 58.45.220.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 58.45.220.68;
}
protocol bfd {
neighbor 58.45.220.65 local 58.45.220.68 multihop on;
}
EOS
2026-03-09 03:46:47,690 - DEBUG - None
2026-03-09 03:46:47,691 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 58.45.220.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 58.45.220.68;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-03-09 03:46:47,691 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 58.45.220.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 58.45.220.68;
}
EOS
2026-03-09 03:46:48,172 - DEBUG - None
2026-03-09 03:46:48,172 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-03-09 03:46:48,172 - DEBUG - service bird restart
2026-03-09 03:46:49,769 - DEBUG - bird stop/waiting
bird start/running, process 1439
2026-03-09 03:46:49,769 - INFO - Attaching VMI 7eca6d88-73df-4cf2-859d-41e6978e41a9 to BGPaaS 9a0679e6-ab73-4856-917a-07b0430aa425
2026-03-09 03:46:49,840 - INFO - Attaching the VMI a45d8a58-d4dd-445e-8e69-9e030f2ae8b4 to the BGPaaS 9a0679e6-ab73-4856-917a-07b0430aa425 object
2026-03-09 03:46:49,840 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 58.45.220.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-03-09 03:46:49,840 - DEBUG - sudo ip addr add 58.45.220.84 dev eth0
2026-03-09 03:46:50,460 - DEBUG - None
2026-03-09 03:46:50,460 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:46:50,474 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-03-09 03:46:50,474 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:46:50,487 - INFO - BGPaaS session seen in control-node 10.20.0.17
2026-03-09 03:46:50,493 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:46:50,506 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2026-03-09 03:46:56,521 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2026-03-09 03:47:02,536 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-03-09 03:47:02,537 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:47:02,551 - INFO - BGPaaS session seen in control-node 10.20.0.17
2026-03-09 03:47:02,557 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 58.45.220.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2026-03-09 03:47:02,557 - DEBUG - ping -s 56 -c 3 -W 1 58.45.220.84
2026-03-09 03:47:08,498 - DEBUG - PING 58.45.220.84 (58.45.220.84) 56(84) bytes of data.
64 bytes from 58.45.220.84: icmp_seq=1 ttl=64 time=6.85 ms
64 bytes from 58.45.220.84: icmp_seq=2 ttl=64 time=0.779 ms
64 bytes from 58.45.220.84: icmp_seq=3 ttl=64 time=0.806 ms
--- 58.45.220.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.779/2.814/6.859/2.860 ms
2026-03-09 03:47:08,498 - INFO - Ping to IP 58.45.220.84 from VM ctest-TestBGPaasZone-64246962-99394388 passed
2026-03-09 03:47:08,498 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:47:08,515 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-03-09 03:47:08,515 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:47:08,529 - INFO - BGPaaS session seen in control-node 10.20.0.17
2026-03-09 03:47:08,535 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:47:08,548 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-03-09 03:47:08,548 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-09 03:47:08,563 - INFO - BGPaaS session seen in control-node 10.20.0.17
2026-03-09 03:47:08,569 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 58.45.220.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2026-03-09 03:47:08,569 - DEBUG - ping -s 56 -c 3 -W 1 58.45.220.84
2026-03-09 03:47:11,044 - DEBUG - PING 58.45.220.84 (58.45.220.84) 56(84) bytes of data.
64 bytes from 58.45.220.84: icmp_seq=1 ttl=64 time=1.57 ms
64 bytes from 58.45.220.84: icmp_seq=2 ttl=64 time=0.928 ms
64 bytes from 58.45.220.84: icmp_seq=3 ttl=64 time=1.08 ms
--- 58.45.220.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.928/1.196/1.579/0.279 ms
2026-03-09 03:47:11,044 - INFO - Ping to IP 58.45.220.84 from VM ctest-TestBGPaasZone-64246962-99394388 passed
2026-03-09 03:47:11,044 - INFO - Detaching VMI 7eca6d88-73df-4cf2-859d-41e6978e41a9 from BGPaaS 9a0679e6-ab73-4856-917a-07b0430aa425
2026-03-09 03:47:11,116 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-64246962-06311746(9a0679e6-ab73-4856-917a-07b0430aa425)
2026-03-09 03:47:11,180 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/9a0679e6-ab73-4856-917a-07b0430aa425
2026-03-09 03:47:11,193 - DEBUG - Response Code: 404
2026-03-09 03:47:11,193 - DEBUG - BGPaaS: 9a0679e6-ab73-4856-917a-07b0430aa425 deleted from api server
2026-03-09 03:47:11,193 - INFO - BGPaaS(9a0679e6-ab73-4856-917a-07b0430aa425): verify_on_cleanup passed
2026-03-09 03:47:11,193 - INFO - Detaching VMI 490342ed-654f-4f10-9a4f-00dc185990b1 from BGPaaS 71eed667-ac6c-4406-b03e-595259379a8a
2026-03-09 03:47:11,268 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-64246962-49566267(71eed667-ac6c-4406-b03e-595259379a8a)
2026-03-09 03:47:11,331 - DEBUG - Requesting: http://10.0.0.22:8082/bgp-as-a-service/71eed667-ac6c-4406-b03e-595259379a8a
2026-03-09 03:47:11,340 - DEBUG - Response Code: 404
2026-03-09 03:47:11,340 - DEBUG - BGPaaS: 71eed667-ac6c-4406-b03e-595259379a8a deleted from api server
2026-03-09 03:47:11,340 - INFO - BGPaaS(71eed667-ac6c-4406-b03e-595259379a8a): verify_on_cleanup passed
2026-03-09 03:47:11,341 - INFO - Deleting Control node zone ctest-test-zone-14756300(c82617c9-9b9a-4eb2-8b4a-139c028ed41f)
2026-03-09 03:47:11,482 - INFO - Deleting Control node zone ctest-test-zone-36771624(af62cae3-4059-4307-a9f5-2bd5e16c4c7c)
2026-03-09 03:47:11,626 - INFO - Deleting Control node zone ctest-test-zone-07750003(f570bc0b-f0a4-4a68-add0-75083e96b746)
2026-03-09 03:47:11,761 - INFO - Deleting VM ctest-TestBGPaasZone-64246962-99394388
2026-03-09 03:47:11,834 - INFO - Deleting VM ctest-TestBGPaasZone-64246962-16251343
2026-03-09 03:47:11,933 - INFO - Deleting VM ctest-TestBGPaasZone-64246962-83530548
2026-03-09 03:47:12,024 - INFO - Deleting VN ctest-cnz_vn-89557156
2026-03-09 03:47:12,071 - DEBUG - VN 74659e4c-bf19-4143-8aea-e304087ce82b still in use: Unable to complete operation on network 74659e4c-bf19-4143-8aea-e304087ce82b. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-dad57a82-2800-425b-8dfa-33a8b6fce4f0']
2026-03-09 03:47:12,071 - WARNING - Deleting VN ctest-cnz_vn-89557156 failed..Will retry
2026-03-09 03:47:14,321 - DEBUG - Response for deleting network ()
2026-03-09 03:47:15,584 - DEBUG - Skipping xmpp flap check
2026-03-09 03:47:15,584 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:02:55]
2026-03-09 03:47:15,584 - INFO - --------------------------------------------------------------------------------
2026-03-09 03:47:16,391 - INFO - Deleted project: ctest-TestBGPaasZone-64246962, ID : 792e326b-d9cd-448d-a57a-17c6bcce2857