is in ACTIVE state now
2026-05-07 04:40:34,871 - INFO - VM name : ctest-TestBGPaasZone-43480905-84799526
2026-05-07 04:40:34,993 - DEBUG - VM ctest-TestBGPaasZone-43480905-84799526 ID is 112304e2-8098-4ef3-85c1-0afe7a20bdbd
2026-05-07 04:40:34,994 - DEBUG - VM ctest-TestBGPaasZone-43480905-84799526 launched on Node an-jenkins-deploy-platform-ansible-os-5754-1
2026-05-07 04:40:35,117 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/112304e2-8098-4ef3-85c1-0afe7a20bdbd
2026-05-07 04:40:35,129 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/3317b37f-a6d1-4b65-bd59-bf6cb9d3c0f2
2026-05-07 04:40:36,313 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=4.00 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=2.39 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.390/3.193/3.996/0.803 ms')
2026-05-07 04:40:36,313 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-TestBGPaasZone-43480905-84799526 passed
2026-05-07 04:40:36,388 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:40:36,388 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-43480905-84799526, IP 35.54.44.69, Port 22
2026-05-07 04:40:36,456 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-05-07 04:40:36,577 - DEBUG - VM ctest-TestBGPaasZone-43480905-84799526 is NOT ready for SSH connections, VM status: ACTIVE
2026-05-07 04:40:41,577 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:40:41,577 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-43480905-84799526, IP 35.54.44.69, Port 22
2026-05-07 04:40:41,752 - DEBUG - VM ctest-TestBGPaasZone-43480905-84799526 is ready for SSH connections
2026-05-07 04:40:41,906 - INFO - Created control node zone ctest-test-zone-26288650(fba85b6a-8a50-47b1-8a76-f0068ae898f7)
2026-05-07 04:40:42,294 - INFO - Created control node zone ctest-test-zone-01439006(d691e8fa-bf0f-490a-9cc4-ef9380af1c95)
2026-05-07 04:40:42,695 - INFO - Created control node zone ctest-test-zone-17060308(c9c05c07-506e-42d1-b265-918f50906ec1)
2026-05-07 04:40:43,015 - INFO - Creating BGPaaS ctest-TestBGPaasZone-43480905-81337948
2026-05-07 04:40:43,111 - INFO - BGPaaS: ctest-TestBGPaasZone-43480905-81337948(2b6167bf-cb83-4f82-9cc5-51b6ba0a3d5f)
2026-05-07 04:40:43,111 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/2b6167bf-cb83-4f82-9cc5-51b6ba0a3d5f
2026-05-07 04:40:43,126 - INFO - verify_in_api_server passed for BGPaaS obj 2b6167bf-cb83-4f82-9cc5-51b6ba0a3d5f
2026-05-07 04:40:43,126 - INFO - BGPaaS(2b6167bf-cb83-4f82-9cc5-51b6ba0a3d5f): verify_on_setup passed
2026-05-07 04:40:43,126 - INFO - We will configure BGP on the VM
2026-05-07 04:40:43,618 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:40:43,618 - INFO - Configuring BGP on ctest-TestBGPaasZone-43480905-15214383
2026-05-07 04:40:43,619 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 35.54.44.67;
protocol bgp bgp_1{
local as 65000;
neighbor 35.54.44.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 35.54.44.67;
}
protocol bfd {
neighbor 35.54.44.65 local 35.54.44.67 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-05-07 04:40:43,619 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 35.54.44.67;
protocol bgp bgp_1{
local as 65000;
neighbor 35.54.44.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 35.54.44.67;
}
protocol bfd {
neighbor 35.54.44.65 local 35.54.44.67 multihop on;
}
EOS
2026-05-07 04:40:58,267 - DEBUG - None
2026-05-07 04:40:58,268 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 35.54.44.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 35.54.44.67;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-05-07 04:40:58,268 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 35.54.44.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 35.54.44.67;
}
EOS
2026-05-07 04:40:59,458 - DEBUG - None
2026-05-07 04:40:59,458 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-05-07 04:40:59,458 - DEBUG - service bird restart
2026-05-07 04:41:03,108 - DEBUG - bird stop/waiting
bird start/running, process 1437
2026-05-07 04:41:03,108 - INFO - Attaching VMI 6409db35-dbaa-4dac-9f9a-097746d27b41 to BGPaaS 2b6167bf-cb83-4f82-9cc5-51b6ba0a3d5f
2026-05-07 04:41:03,194 - INFO - Attaching the VMI 9a33fafb-262c-40c0-8e7d-8accadfe2bdd to the BGPaaS 2b6167bf-cb83-4f82-9cc5-51b6ba0a3d5f object
2026-05-07 04:41:03,195 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 35.54.44.84 dev eth0, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-05-07 04:41:03,195 - DEBUG - sudo ip addr add 35.54.44.84 dev eth0
2026-05-07 04:41:04,057 - DEBUG - None
2026-05-07 04:41:04,132 - INFO - Creating BGPaaS ctest-TestBGPaasZone-43480905-85959235
2026-05-07 04:41:04,227 - INFO - BGPaaS: ctest-TestBGPaasZone-43480905-85959235(a95b2208-2ab6-4732-9c1f-d077e65bf561)
2026-05-07 04:41:04,227 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/a95b2208-2ab6-4732-9c1f-d077e65bf561
2026-05-07 04:41:04,243 - INFO - verify_in_api_server passed for BGPaaS obj a95b2208-2ab6-4732-9c1f-d077e65bf561
2026-05-07 04:41:04,243 - INFO - BGPaaS(a95b2208-2ab6-4732-9c1f-d077e65bf561): verify_on_setup passed
2026-05-07 04:41:04,243 - INFO - We will configure BGP on the VM
2026-05-07 04:41:04,734 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:41:04,734 - INFO - Configuring BGP on ctest-TestBGPaasZone-43480905-44339497
2026-05-07 04:41:04,735 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 35.54.44.68;
protocol bgp bgp_1{
local as 65000;
neighbor 35.54.44.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 35.54.44.68;
}
protocol bfd {
neighbor 35.54.44.65 local 35.54.44.68 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-05-07 04:41:04,735 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 35.54.44.68;
protocol bgp bgp_1{
local as 65000;
neighbor 35.54.44.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 35.54.44.68;
}
protocol bfd {
neighbor 35.54.44.65 local 35.54.44.68 multihop on;
}
EOS
2026-05-07 04:41:10,946 - DEBUG - None
2026-05-07 04:41:10,946 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 35.54.44.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 35.54.44.68;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-05-07 04:41:10,946 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 35.54.44.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 35.54.44.68;
}
EOS
2026-05-07 04:41:11,586 - DEBUG - None
2026-05-07 04:41:11,586 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-05-07 04:41:11,586 - DEBUG - service bird restart
2026-05-07 04:41:13,921 - DEBUG - bird stop/waiting
bird start/running, process 1443
2026-05-07 04:41:13,921 - INFO - Attaching VMI 2d54b350-5904-4952-9c46-510e8f6cf84a to BGPaaS a95b2208-2ab6-4732-9c1f-d077e65bf561
2026-05-07 04:41:14,012 - INFO - Attaching the VMI ae782be6-c5bd-4642-89bd-b8b71f8427e6 to the BGPaaS a95b2208-2ab6-4732-9c1f-d077e65bf561 object
2026-05-07 04:41:14,013 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 35.54.44.84 dev eth0, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-05-07 04:41:14,013 - DEBUG - sudo ip addr add 35.54.44.84 dev eth0
2026-05-07 04:41:14,943 - DEBUG - None
2026-05-07 04:41:14,944 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:41:14,964 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-05-07 04:41:14,964 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:41:14,988 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-05-07 04:41:14,996 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:41:15,013 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193']
2026-05-07 04:41:21,031 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193']
2026-05-07 04:41:27,066 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-05-07 04:41:27,067 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:41:27,094 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-05-07 04:41:27,111 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 35.54.44.84, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-05-07 04:41:27,111 - DEBUG - ping -s 56 -c 3 -W 1 35.54.44.84
2026-05-07 04:41:34,599 - DEBUG - PING 35.54.44.84 (35.54.44.84) 56(84) bytes of data.
64 bytes from 35.54.44.84: icmp_seq=1 ttl=64 time=10.4 ms
64 bytes from 35.54.44.84: icmp_seq=2 ttl=64 time=1.47 ms
64 bytes from 35.54.44.84: icmp_seq=3 ttl=64 time=2.05 ms
--- 35.54.44.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.471/4.666/10.471/4.111 ms
2026-05-07 04:41:34,599 - INFO - Ping to IP 35.54.44.84 from VM ctest-TestBGPaasZone-43480905-84799526 passed
2026-05-07 04:41:34,599 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:41:34,619 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-05-07 04:41:34,620 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:41:34,643 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-05-07 04:41:34,651 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:41:34,672 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-05-07 04:41:34,672 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-07 04:41:34,699 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-05-07 04:41:34,706 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 35.54.44.84, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2026-05-07 04:41:34,707 - DEBUG - ping -s 56 -c 3 -W 1 35.54.44.84
2026-05-07 04:41:37,269 - DEBUG - PING 35.54.44.84 (35.54.44.84) 56(84) bytes of data.
64 bytes from 35.54.44.84: icmp_seq=1 ttl=64 time=8.00 ms
64 bytes from 35.54.44.84: icmp_seq=2 ttl=64 time=1.61 ms
64 bytes from 35.54.44.84: icmp_seq=3 ttl=64 time=2.07 ms
--- 35.54.44.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.614/3.898/8.001/2.907 ms
2026-05-07 04:41:37,269 - INFO - Ping to IP 35.54.44.84 from VM ctest-TestBGPaasZone-43480905-84799526 passed
2026-05-07 04:41:37,269 - INFO - Detaching VMI 2d54b350-5904-4952-9c46-510e8f6cf84a from BGPaaS a95b2208-2ab6-4732-9c1f-d077e65bf561
2026-05-07 04:41:37,362 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-43480905-85959235(a95b2208-2ab6-4732-9c1f-d077e65bf561)
2026-05-07 04:41:37,453 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/a95b2208-2ab6-4732-9c1f-d077e65bf561
2026-05-07 04:41:37,571 - DEBUG - Response Code: 404
2026-05-07 04:41:37,571 - DEBUG - BGPaaS: a95b2208-2ab6-4732-9c1f-d077e65bf561 deleted from api server
2026-05-07 04:41:37,571 - INFO - BGPaaS(a95b2208-2ab6-4732-9c1f-d077e65bf561): verify_on_cleanup passed
2026-05-07 04:41:37,572 - INFO - Detaching VMI 6409db35-dbaa-4dac-9f9a-097746d27b41 from BGPaaS 2b6167bf-cb83-4f82-9cc5-51b6ba0a3d5f
2026-05-07 04:41:37,675 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-43480905-81337948(2b6167bf-cb83-4f82-9cc5-51b6ba0a3d5f)
2026-05-07 04:41:37,795 - DEBUG - Requesting: http://10.0.0.141:8082/bgp-as-a-service/2b6167bf-cb83-4f82-9cc5-51b6ba0a3d5f
2026-05-07 04:41:37,808 - DEBUG - Response Code: 404
2026-05-07 04:41:37,809 - DEBUG - BGPaaS: 2b6167bf-cb83-4f82-9cc5-51b6ba0a3d5f deleted from api server
2026-05-07 04:41:37,809 - INFO - BGPaaS(2b6167bf-cb83-4f82-9cc5-51b6ba0a3d5f): verify_on_cleanup passed
2026-05-07 04:41:37,809 - INFO - Deleting Control node zone ctest-test-zone-17060308(c9c05c07-506e-42d1-b265-918f50906ec1)
2026-05-07 04:41:38,039 - INFO - Deleting Control node zone ctest-test-zone-01439006(d691e8fa-bf0f-490a-9cc4-ef9380af1c95)
2026-05-07 04:41:38,215 - INFO - Deleting Control node zone ctest-test-zone-26288650(fba85b6a-8a50-47b1-8a76-f0068ae898f7)
2026-05-07 04:41:38,383 - INFO - Deleting VM ctest-TestBGPaasZone-43480905-84799526
2026-05-07 04:41:38,719 - INFO - Deleting VM ctest-TestBGPaasZone-43480905-44339497
2026-05-07 04:41:38,827 - INFO - Deleting VM ctest-TestBGPaasZone-43480905-15214383
2026-05-07 04:41:38,935 - INFO - Deleting VN ctest-cnz_vn-82624447
2026-05-07 04:41:39,000 - DEBUG - VN 91fcf5c5-deab-4e69-9c24-6e5902aa1fbc still in use: Unable to complete operation on network 91fcf5c5-deab-4e69-9c24-6e5902aa1fbc. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-a5743c65-bcd6-40af-8f76-201311c0d5a1']
2026-05-07 04:41:39,000 - WARNING - Deleting VN ctest-cnz_vn-82624447 failed..Will retry
2026-05-07 04:41:41,286 - DEBUG - Response for deleting network ()
2026-05-07 04:41:42,612 - DEBUG - Skipping xmpp flap check
2026-05-07 04:41:42,613 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:42]
2026-05-07 04:41:42,613 - INFO - --------------------------------------------------------------------------------
2026-05-07 04:41:43,603 - INFO - Deleted project: ctest-TestBGPaasZone-43480905, ID : 512bff99-7c35-4c06-8db2-070dbc7bd4b6