is in ACTIVE state now
2026-03-16 03:56:24,401 - INFO - VM name : ctest-TestBGPaasZone-27147164-59770633
2026-03-16 03:56:24,532 - DEBUG - VM ctest-TestBGPaasZone-27147164-59770633 ID is d124856e-2176-48ec-9359-8ac6f453934f
2026-03-16 03:56:24,532 - DEBUG - VM ctest-TestBGPaasZone-27147164-59770633 launched on Node an-jenkins-deploy-platform-ansible-os-5469-2
2026-03-16 03:56:24,631 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/d124856e-2176-48ec-9359-8ac6f453934f
2026-03-16 03:56:24,643 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ab3c1a5d-4ef6-43ff-b5bc-d2b90eb97fd2
2026-03-16 03:56:25,815 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.86 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=5.36 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.860/4.612/5.364/0.752 ms')
2026-03-16 03:56:25,815 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-27147164-59770633 passed
2026-03-16 03:56:25,899 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:56:25,899 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-27147164-59770633, IP 138.19.128.133, Port 22
2026-03-16 03:56:25,978 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-16 03:56:26,079 - DEBUG - VM ctest-TestBGPaasZone-27147164-59770633 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-16 03:56:31,079 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:56:31,080 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-27147164-59770633, IP 138.19.128.133, Port 22
2026-03-16 03:56:31,263 - DEBUG - VM ctest-TestBGPaasZone-27147164-59770633 is ready for SSH connections
2026-03-16 03:56:31,409 - INFO - Created control node zone ctest-test-zone-55269106(682cf95b-a064-4473-8744-edc59be9802e)
2026-03-16 03:56:31,785 - INFO - Created control node zone ctest-test-zone-54468068(bb93d968-6296-4d71-9ef4-4d94e229e15c)
2026-03-16 03:56:32,157 - INFO - Created control node zone ctest-test-zone-69699836(2c1a76a3-7e9a-4ced-84a3-97ada185a4c3)
2026-03-16 03:56:32,445 - INFO - Creating BGPaaS ctest-TestBGPaasZone-27147164-57800311
2026-03-16 03:56:32,529 - INFO - BGPaaS: ctest-TestBGPaasZone-27147164-57800311(742798cb-89fd-4152-9064-ac82dd6e56bf)
2026-03-16 03:56:32,529 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/742798cb-89fd-4152-9064-ac82dd6e56bf
2026-03-16 03:56:32,541 - INFO - verify_in_api_server passed for BGPaaS obj 742798cb-89fd-4152-9064-ac82dd6e56bf
2026-03-16 03:56:32,541 - INFO - BGPaaS(742798cb-89fd-4152-9064-ac82dd6e56bf): verify_on_setup passed
2026-03-16 03:56:32,541 - INFO - We will configure BGP on the VM
2026-03-16 03:56:33,009 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:56:33,009 - INFO - Configuring BGP on ctest-TestBGPaasZone-27147164-30121912
2026-03-16 03:56:33,010 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 138.19.128.131;
protocol bgp bgp_1{
local as 65000;
neighbor 138.19.128.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 138.19.128.131;
}
protocol bfd {
neighbor 138.19.128.129 local 138.19.128.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-16 03:56:33,010 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 138.19.128.131;
protocol bgp bgp_1{
local as 65000;
neighbor 138.19.128.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 138.19.128.131;
}
protocol bfd {
neighbor 138.19.128.129 local 138.19.128.131 multihop on;
}
EOS
2026-03-16 03:56:43,070 - DEBUG - None
2026-03-16 03:56:43,070 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 138.19.128.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 138.19.128.131;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-16 03:56:43,070 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 138.19.128.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 138.19.128.131;
}
EOS
2026-03-16 03:56:43,602 - DEBUG - None
2026-03-16 03:56:43,602 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-16 03:56:43,602 - DEBUG - service bird restart
2026-03-16 03:56:45,547 - DEBUG - bird stop/waiting
bird start/running, process 1439
2026-03-16 03:56:45,547 - INFO - Attaching VMI 32bf902b-4f4a-466e-98cf-05b88081f93e to BGPaaS 742798cb-89fd-4152-9064-ac82dd6e56bf
2026-03-16 03:56:45,633 - INFO - Attaching the VMI 75ecd2d6-59db-45ff-8fc4-b9bde717d86c to the BGPaaS 742798cb-89fd-4152-9064-ac82dd6e56bf object
2026-03-16 03:56:45,633 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 138.19.128.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-16 03:56:45,633 - DEBUG - sudo ip addr add 138.19.128.148 dev eth0
2026-03-16 03:56:46,459 - DEBUG - None
2026-03-16 03:56:46,533 - INFO - Creating BGPaaS ctest-TestBGPaasZone-27147164-66913381
2026-03-16 03:56:46,635 - INFO - BGPaaS: ctest-TestBGPaasZone-27147164-66913381(5f04c489-fcd4-437a-bca6-6366220c6d98)
2026-03-16 03:56:46,635 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/5f04c489-fcd4-437a-bca6-6366220c6d98
2026-03-16 03:56:46,663 - INFO - verify_in_api_server passed for BGPaaS obj 5f04c489-fcd4-437a-bca6-6366220c6d98
2026-03-16 03:56:46,663 - INFO - BGPaaS(5f04c489-fcd4-437a-bca6-6366220c6d98): verify_on_setup passed
2026-03-16 03:56:46,664 - INFO - We will configure BGP on the VM
2026-03-16 03:56:47,121 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:56:47,121 - INFO - Configuring BGP on ctest-TestBGPaasZone-27147164-05923963
2026-03-16 03:56:47,121 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 138.19.128.132;
protocol bgp bgp_1{
local as 65000;
neighbor 138.19.128.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 138.19.128.132;
}
protocol bfd {
neighbor 138.19.128.129 local 138.19.128.132 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-03-16 03:56:47,121 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 138.19.128.132;
protocol bgp bgp_1{
local as 65000;
neighbor 138.19.128.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 138.19.128.132;
}
protocol bfd {
neighbor 138.19.128.129 local 138.19.128.132 multihop on;
}
EOS
2026-03-16 03:56:52,757 - DEBUG - None
2026-03-16 03:56:52,758 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 138.19.128.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 138.19.128.132;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-03-16 03:56:52,758 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 138.19.128.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 138.19.128.132;
}
EOS
2026-03-16 03:56:53,285 - DEBUG - None
2026-03-16 03:56:53,285 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-03-16 03:56:53,285 - DEBUG - service bird restart
2026-03-16 03:56:55,067 - DEBUG - bird stop/waiting
bird start/running, process 1439
2026-03-16 03:56:55,067 - INFO - Attaching VMI 40a1935f-7eab-4337-bd56-e9077e7df923 to BGPaaS 5f04c489-fcd4-437a-bca6-6366220c6d98
2026-03-16 03:56:55,153 - INFO - Attaching the VMI b213ae00-989c-4afa-9f2c-c0bbf7d7a827 to the BGPaaS 5f04c489-fcd4-437a-bca6-6366220c6d98 object
2026-03-16 03:56:55,153 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 138.19.128.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2026-03-16 03:56:55,153 - DEBUG - sudo ip addr add 138.19.128.148 dev eth0
2026-03-16 03:56:55,876 - DEBUG - None
2026-03-16 03:56:55,877 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:56:55,877 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-16 03:56:55,887 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-03-16 03:56:55,888 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:56:55,909 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-03-16 03:56:55,920 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:56:55,920 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-16 03:56:55,935 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2026-03-16 03:57:01,936 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-16 03:57:01,949 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2026-03-16 03:57:07,950 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-16 03:57:07,962 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-03-16 03:57:07,962 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:57:07,979 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-03-16 03:57:07,986 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 138.19.128.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-16 03:57:07,986 - DEBUG - ping -s 56 -c 3 -W 1 138.19.128.148
2026-03-16 03:57:14,884 - DEBUG - PING 138.19.128.148 (138.19.128.148) 56(84) bytes of data.
64 bytes from 138.19.128.148: icmp_seq=1 ttl=64 time=9.25 ms
64 bytes from 138.19.128.148: icmp_seq=2 ttl=64 time=0.990 ms
64 bytes from 138.19.128.148: icmp_seq=3 ttl=64 time=1.21 ms
--- 138.19.128.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 0.990/3.821/9.256/3.844 ms
2026-03-16 03:57:14,884 - INFO - Ping to IP 138.19.128.148 from VM ctest-TestBGPaasZone-27147164-59770633 passed
2026-03-16 03:57:14,884 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:57:14,884 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-16 03:57:14,901 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-03-16 03:57:14,902 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:57:14,921 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-03-16 03:57:14,932 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:57:14,932 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2026-03-16 03:57:14,946 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-03-16 03:57:14,947 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-16 03:57:14,961 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-03-16 03:57:14,967 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 138.19.128.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2026-03-16 03:57:14,967 - DEBUG - ping -s 56 -c 3 -W 1 138.19.128.148
2026-03-16 03:57:17,483 - DEBUG - PING 138.19.128.148 (138.19.128.148) 56(84) bytes of data.
64 bytes from 138.19.128.148: icmp_seq=1 ttl=64 time=2.92 ms
64 bytes from 138.19.128.148: icmp_seq=2 ttl=64 time=1.10 ms
64 bytes from 138.19.128.148: icmp_seq=3 ttl=64 time=1.02 ms
--- 138.19.128.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.021/1.682/2.925/0.879 ms
2026-03-16 03:57:17,483 - INFO - Ping to IP 138.19.128.148 from VM ctest-TestBGPaasZone-27147164-59770633 passed
2026-03-16 03:57:17,483 - INFO - Detaching VMI 40a1935f-7eab-4337-bd56-e9077e7df923 from BGPaaS 5f04c489-fcd4-437a-bca6-6366220c6d98
2026-03-16 03:57:17,585 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-27147164-66913381(5f04c489-fcd4-437a-bca6-6366220c6d98)
2026-03-16 03:57:17,662 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/5f04c489-fcd4-437a-bca6-6366220c6d98
2026-03-16 03:57:17,674 - DEBUG - Response Code: 404
2026-03-16 03:57:17,674 - DEBUG - BGPaaS: 5f04c489-fcd4-437a-bca6-6366220c6d98 deleted from api server
2026-03-16 03:57:17,674 - INFO - BGPaaS(5f04c489-fcd4-437a-bca6-6366220c6d98): verify_on_cleanup passed
2026-03-16 03:57:17,674 - INFO - Detaching VMI 32bf902b-4f4a-466e-98cf-05b88081f93e from BGPaaS 742798cb-89fd-4152-9064-ac82dd6e56bf
2026-03-16 03:57:17,789 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-27147164-57800311(742798cb-89fd-4152-9064-ac82dd6e56bf)
2026-03-16 03:57:17,883 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/742798cb-89fd-4152-9064-ac82dd6e56bf
2026-03-16 03:57:17,895 - DEBUG - Response Code: 404
2026-03-16 03:57:17,895 - DEBUG - BGPaaS: 742798cb-89fd-4152-9064-ac82dd6e56bf deleted from api server
2026-03-16 03:57:17,895 - INFO - BGPaaS(742798cb-89fd-4152-9064-ac82dd6e56bf): verify_on_cleanup passed
2026-03-16 03:57:17,895 - INFO - Deleting Control node zone ctest-test-zone-69699836(2c1a76a3-7e9a-4ced-84a3-97ada185a4c3)
2026-03-16 03:57:18,058 - INFO - Deleting Control node zone ctest-test-zone-54468068(bb93d968-6296-4d71-9ef4-4d94e229e15c)
2026-03-16 03:57:18,230 - INFO - Deleting Control node zone ctest-test-zone-55269106(682cf95b-a064-4473-8744-edc59be9802e)
2026-03-16 03:57:18,389 - INFO - Deleting VM ctest-TestBGPaasZone-27147164-59770633
2026-03-16 03:57:18,476 - INFO - Deleting VM ctest-TestBGPaasZone-27147164-05923963
2026-03-16 03:57:18,549 - INFO - Deleting VM ctest-TestBGPaasZone-27147164-30121912
2026-03-16 03:57:18,629 - INFO - Deleting VN ctest-cnz_vn-75848210
2026-03-16 03:57:18,683 - DEBUG - VN 3f0788ee-f88e-42c0-8ef3-722d3bfad66f still in use: Unable to complete operation on network 3f0788ee-f88e-42c0-8ef3-722d3bfad66f. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-1a44ae4d-198e-47f6-8d05-27537f1e526d']
2026-03-16 03:57:18,683 - WARNING - Deleting VN ctest-cnz_vn-75848210 failed..Will retry
2026-03-16 03:57:20,876 - DEBUG - Response for deleting network ()
2026-03-16 03:57:22,152 - DEBUG - Skipping xmpp flap check
2026-03-16 03:57:22,152 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:14]
2026-03-16 03:57:22,152 - INFO - --------------------------------------------------------------------------------
2026-03-16 03:57:22,982 - INFO - Deleted project: ctest-TestBGPaasZone-27147164, ID : af8f6b6b-c5f6-4385-90db-d060e8557c05