is in ACTIVE state now
2025-08-06 16:54:10,160 - INFO - VM name : ctest-TestBGPaasZone-37387971-11634384
2025-08-06 16:54:10,246 - DEBUG - VM ctest-TestBGPaasZone-37387971-11634384 ID is e35a2439-c4c4-4f34-b20b-fbf710039bab
2025-08-06 16:54:10,246 - DEBUG - VM ctest-TestBGPaasZone-37387971-11634384 launched on Node an-jenkins-deploy-platform-ansible-os-3763-2
2025-08-06 16:54:10,330 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/e35a2439-c4c4-4f34-b20b-fbf710039bab
2025-08-06 16:54:10,340 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/36540f77-1a04-4c3e-b3be-bbad923017b8
2025-08-06 16:54:11,570 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.96 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.68 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 1.678/2.321/2.964/0.643 ms')
2025-08-06 16:54:11,570 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-37387971-11634384 passed
2025-08-06 16:54:11,684 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 16:54:11,684 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-37387971-11634384, IP 23.90.111.69, Port 22
2025-08-06 16:54:11,859 - DEBUG - VM ctest-TestBGPaasZone-37387971-11634384 is ready for SSH connections
2025-08-06 16:54:11,998 - INFO - Created control node zone ctest-test-zone-52965217(7af222a8-8c66-4652-9958-8ba5bc247505)
2025-08-06 16:54:12,350 - INFO - Created control node zone ctest-test-zone-70941132(05b254ac-c6f0-458d-9416-edcddc4ebd68)
2025-08-06 16:54:12,702 - INFO - Created control node zone ctest-test-zone-21928799(64f07cc8-aab8-4a28-8e2e-1d155065d323)
2025-08-06 16:54:12,979 - INFO - Creating BGPaaS ctest-TestBGPaasZone-37387971-57931357
2025-08-06 16:54:13,054 - INFO - BGPaaS: ctest-TestBGPaasZone-37387971-57931357(b5517538-221f-4e2f-860a-b706ecdc689f)
2025-08-06 16:54:13,054 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/b5517538-221f-4e2f-860a-b706ecdc689f
2025-08-06 16:54:13,065 - INFO - verify_in_api_server passed for BGPaaS obj b5517538-221f-4e2f-860a-b706ecdc689f
2025-08-06 16:54:13,065 - INFO - BGPaaS(b5517538-221f-4e2f-860a-b706ecdc689f): verify_on_setup passed
2025-08-06 16:54:13,065 - INFO - We will configure BGP on the VM
2025-08-06 16:54:13,486 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 16:54:13,486 - INFO - Configuring BGP on ctest-TestBGPaasZone-37387971-95034135
2025-08-06 16:54:13,486 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 23.90.111.67;
protocol bgp bgp_1{
local as 65000;
neighbor 23.90.111.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 23.90.111.67;
}
protocol bfd {
neighbor 23.90.111.65 local 23.90.111.67 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-06 16:54:13,487 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 23.90.111.67;
protocol bgp bgp_1{
local as 65000;
neighbor 23.90.111.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 23.90.111.67;
}
protocol bfd {
neighbor 23.90.111.65 local 23.90.111.67 multihop on;
}
EOS
2025-08-06 16:54:30,389 - DEBUG - None
2025-08-06 16:54:30,389 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 23.90.111.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 23.90.111.67;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-06 16:54:30,389 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 23.90.111.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 23.90.111.67;
}
EOS
2025-08-06 16:54:31,598 - DEBUG - None
2025-08-06 16:54:31,599 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-06 16:54:31,599 - DEBUG - service bird restart
2025-08-06 16:54:35,363 - DEBUG - bird stop/waiting
bird start/running, process 1433
2025-08-06 16:54:35,363 - INFO - Attaching VMI f60e2a05-786b-4bcf-97ff-c3007e397f0a to BGPaaS b5517538-221f-4e2f-860a-b706ecdc689f
2025-08-06 16:54:35,435 - INFO - Attaching the VMI b75ae9e6-ec99-4ea7-9c43-74c2d373f3df to the BGPaaS b5517538-221f-4e2f-860a-b706ecdc689f object
2025-08-06 16:54:35,435 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 23.90.111.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-06 16:54:35,435 - DEBUG - sudo ip addr add 23.90.111.84 dev eth0
2025-08-06 16:54:37,228 - DEBUG - None
2025-08-06 16:54:37,290 - INFO - Creating BGPaaS ctest-TestBGPaasZone-37387971-64249834
2025-08-06 16:54:37,362 - INFO - BGPaaS: ctest-TestBGPaasZone-37387971-64249834(269295bd-e989-4163-b493-fe6c649554de)
2025-08-06 16:54:37,362 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/269295bd-e989-4163-b493-fe6c649554de
2025-08-06 16:54:37,373 - INFO - verify_in_api_server passed for BGPaaS obj 269295bd-e989-4163-b493-fe6c649554de
2025-08-06 16:54:37,373 - INFO - BGPaaS(269295bd-e989-4163-b493-fe6c649554de): verify_on_setup passed
2025-08-06 16:54:37,373 - INFO - We will configure BGP on the VM
2025-08-06 16:54:37,786 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 16:54:37,786 - INFO - Configuring BGP on ctest-TestBGPaasZone-37387971-07821914
2025-08-06 16:54:37,786 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 23.90.111.68;
protocol bgp bgp_1{
local as 65000;
neighbor 23.90.111.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 23.90.111.68;
}
protocol bfd {
neighbor 23.90.111.65 local 23.90.111.68 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-06 16:54:37,787 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 23.90.111.68;
protocol bgp bgp_1{
local as 65000;
neighbor 23.90.111.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 23.90.111.68;
}
protocol bfd {
neighbor 23.90.111.65 local 23.90.111.68 multihop on;
}
EOS
2025-08-06 16:54:44,212 - DEBUG - None
2025-08-06 16:54:44,213 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 23.90.111.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 23.90.111.68;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-06 16:54:44,213 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 23.90.111.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 23.90.111.68;
}
EOS
2025-08-06 16:54:44,795 - DEBUG - None
2025-08-06 16:54:44,795 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-06 16:54:44,795 - DEBUG - service bird restart
2025-08-06 16:54:46,633 - DEBUG - bird stop/waiting
bird start/running, process 1441
2025-08-06 16:54:46,633 - INFO - Attaching VMI 5128e52c-897e-484d-b2d2-35b223a5c095 to BGPaaS 269295bd-e989-4163-b493-fe6c649554de
2025-08-06 16:54:46,714 - INFO - Attaching the VMI 4925c041-2fca-4f7a-a732-8f5f2e035d21 to the BGPaaS 269295bd-e989-4163-b493-fe6c649554de object
2025-08-06 16:54:46,714 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 23.90.111.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-06 16:54:46,714 - DEBUG - sudo ip addr add 23.90.111.84 dev eth0
2025-08-06 16:54:47,484 - DEBUG - None
2025-08-06 16:54:47,484 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 16:54:47,500 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-08-06 16:54:47,500 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 16:54:47,501 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-08-06 16:54:47,519 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-08-06 16:54:47,527 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 16:54:47,544 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2025-08-06 16:54:53,562 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.254']
2025-08-06 16:54:59,579 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-08-06 16:54:59,579 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 16:54:59,579 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-08-06 16:54:59,597 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-08-06 16:54:59,604 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 23.90.111.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-06 16:54:59,604 - DEBUG - ping -s 56 -c 3 -W 1 23.90.111.84
2025-08-06 16:55:06,567 - DEBUG - PING 23.90.111.84 (23.90.111.84) 56(84) bytes of data.
64 bytes from 23.90.111.84: icmp_seq=1 ttl=64 time=9.76 ms
64 bytes from 23.90.111.84: icmp_seq=2 ttl=64 time=1.09 ms
64 bytes from 23.90.111.84: icmp_seq=3 ttl=64 time=1.56 ms
--- 23.90.111.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.096/4.144/9.768/3.981 ms
2025-08-06 16:55:06,567 - INFO - Ping to IP 23.90.111.84 from VM ctest-TestBGPaasZone-37387971-11634384 passed
2025-08-06 16:55:06,568 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 16:55:06,589 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-08-06 16:55:06,589 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 16:55:06,589 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-08-06 16:55:06,606 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-08-06 16:55:06,614 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 16:55:06,629 - INFO - BGPaaS session seen in control-node 10.20.0.254
2025-08-06 16:55:06,629 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 16:55:06,629 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-08-06 16:55:06,646 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-08-06 16:55:06,653 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 23.90.111.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-06 16:55:06,653 - DEBUG - ping -s 56 -c 3 -W 1 23.90.111.84
2025-08-06 16:55:09,233 - DEBUG - PING 23.90.111.84 (23.90.111.84) 56(84) bytes of data.
64 bytes from 23.90.111.84: icmp_seq=1 ttl=64 time=2.69 ms
64 bytes from 23.90.111.84: icmp_seq=2 ttl=64 time=0.955 ms
64 bytes from 23.90.111.84: icmp_seq=3 ttl=64 time=1.60 ms
--- 23.90.111.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.955/1.750/2.694/0.719 ms
2025-08-06 16:55:09,233 - INFO - Ping to IP 23.90.111.84 from VM ctest-TestBGPaasZone-37387971-11634384 passed
2025-08-06 16:55:09,234 - INFO - Detaching VMI 5128e52c-897e-484d-b2d2-35b223a5c095 from BGPaaS 269295bd-e989-4163-b493-fe6c649554de
2025-08-06 16:55:09,310 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-37387971-64249834(269295bd-e989-4163-b493-fe6c649554de)
2025-08-06 16:55:09,446 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/269295bd-e989-4163-b493-fe6c649554de
2025-08-06 16:55:09,476 - DEBUG - Response Code: 404
2025-08-06 16:55:09,476 - DEBUG - BGPaaS: 269295bd-e989-4163-b493-fe6c649554de deleted from api server
2025-08-06 16:55:09,476 - INFO - BGPaaS(269295bd-e989-4163-b493-fe6c649554de): verify_on_cleanup passed
2025-08-06 16:55:09,476 - INFO - Detaching VMI f60e2a05-786b-4bcf-97ff-c3007e397f0a from BGPaaS b5517538-221f-4e2f-860a-b706ecdc689f
2025-08-06 16:55:09,554 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-37387971-57931357(b5517538-221f-4e2f-860a-b706ecdc689f)
2025-08-06 16:55:09,663 - DEBUG - Requesting: http://10.0.0.254:8082/bgp-as-a-service/b5517538-221f-4e2f-860a-b706ecdc689f
2025-08-06 16:55:09,699 - DEBUG - Response Code: 404
2025-08-06 16:55:09,699 - DEBUG - BGPaaS: b5517538-221f-4e2f-860a-b706ecdc689f deleted from api server
2025-08-06 16:55:09,699 - INFO - BGPaaS(b5517538-221f-4e2f-860a-b706ecdc689f): verify_on_cleanup passed
2025-08-06 16:55:09,699 - INFO - Deleting Control node zone ctest-test-zone-21928799(64f07cc8-aab8-4a28-8e2e-1d155065d323)
2025-08-06 16:55:09,855 - INFO - Deleting Control node zone ctest-test-zone-70941132(05b254ac-c6f0-458d-9416-edcddc4ebd68)
2025-08-06 16:55:09,995 - INFO - Deleting Control node zone ctest-test-zone-52965217(7af222a8-8c66-4652-9958-8ba5bc247505)
2025-08-06 16:55:10,148 - INFO - Deleting VM ctest-TestBGPaasZone-37387971-11634384
2025-08-06 16:55:10,215 - INFO - Deleting VM ctest-TestBGPaasZone-37387971-07821914
2025-08-06 16:55:10,276 - INFO - Deleting VM ctest-TestBGPaasZone-37387971-95034135
2025-08-06 16:55:10,336 - INFO - Deleting VN ctest-cnz_vn-67418750
2025-08-06 16:55:10,378 - DEBUG - VN dc44cc4a-9bb4-4ff7-b669-c57f3c6d1722 still in use: Unable to complete operation on network dc44cc4a-9bb4-4ff7-b669-c57f3c6d1722. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-c24b202c-ad0a-4564-b504-b084d056025a']
2025-08-06 16:55:10,378 - WARNING - Deleting VN ctest-cnz_vn-67418750 failed..Will retry
2025-08-06 16:55:12,585 - DEBUG - Response for deleting network ()
2025-08-06 16:55:13,843 - DEBUG - Skipping xmpp flap check
2025-08-06 16:55:13,843 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:45]
2025-08-06 16:55:13,843 - INFO - --------------------------------------------------------------------------------
2025-08-06 16:55:14,807 - INFO - Deleted project: ctest-TestBGPaasZone-37387971, ID : 74a0570a-13a6-4c3d-ab48-3d92fd4cd4ed