is in ACTIVE state now
2025-12-29 04:05:05,272 - INFO - VM name : ctest-TestBGPaasZone-37707920-72874753
2025-12-29 04:05:05,358 - DEBUG - VM ctest-TestBGPaasZone-37707920-72874753 ID is c72accdc-de35-48d7-a518-3eae50f9b8bd
2025-12-29 04:05:05,359 - DEBUG - VM ctest-TestBGPaasZone-37707920-72874753 launched on Node an-jenkins-deploy-platform-ansible-os-4934-2
2025-12-29 04:05:05,451 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/c72accdc-de35-48d7-a518-3eae50f9b8bd
2025-12-29 04:05:05,463 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/abe144db-0548-4e6e-a752-660dc82e5fbe
2025-12-29 04:05:06,632 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.92 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.94 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.938/2.927/3.917/0.989 ms')
2025-12-29 04:05:06,632 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-37707920-72874753 passed
2025-12-29 04:05:06,705 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-12-29 04:05:06,705 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-37707920-72874753, IP 151.35.159.133, Port 22
2025-12-29 04:05:06,876 - DEBUG - VM ctest-TestBGPaasZone-37707920-72874753 is ready for SSH connections
2025-12-29 04:05:07,008 - INFO - Created control node zone ctest-test-zone-93209781(3f4fd296-2064-4469-a2bd-fd2599e905bb)
2025-12-29 04:05:07,360 - INFO - Created control node zone ctest-test-zone-54048504(75bac196-cdd0-4a8f-bb2c-f46645bd1729)
2025-12-29 04:05:07,716 - INFO - Created control node zone ctest-test-zone-80449212(f8a83ff3-dc69-4f52-afce-10f847e56924)
2025-12-29 04:05:07,988 - INFO - Creating BGPaaS ctest-TestBGPaasZone-37707920-27506240
2025-12-29 04:05:08,068 - INFO - BGPaaS: ctest-TestBGPaasZone-37707920-27506240(0d0b766f-f9ef-4ac8-ad8f-8a9552c839d0)
2025-12-29 04:05:08,068 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/0d0b766f-f9ef-4ac8-ad8f-8a9552c839d0
2025-12-29 04:05:08,079 - INFO - verify_in_api_server passed for BGPaaS obj 0d0b766f-f9ef-4ac8-ad8f-8a9552c839d0
2025-12-29 04:05:08,079 - INFO - BGPaaS(0d0b766f-f9ef-4ac8-ad8f-8a9552c839d0): verify_on_setup passed
2025-12-29 04:05:08,079 - INFO - We will configure BGP on the VM
2025-12-29 04:05:08,512 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-12-29 04:05:08,512 - INFO - Configuring BGP on ctest-TestBGPaasZone-37707920-75253571
2025-12-29 04:05:08,513 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 151.35.159.131;
protocol bgp bgp_1{
local as 65000;
neighbor 151.35.159.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 151.35.159.131;
}
protocol bfd {
neighbor 151.35.159.129 local 151.35.159.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2025-12-29 04:05:08,513 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 151.35.159.131;
protocol bgp bgp_1{
local as 65000;
neighbor 151.35.159.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 151.35.159.131;
}
protocol bfd {
neighbor 151.35.159.129 local 151.35.159.131 multihop on;
}
EOS
2025-12-29 04:05:14,265 - DEBUG - None
2025-12-29 04:05:14,265 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 151.35.159.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 151.35.159.131;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2025-12-29 04:05:14,265 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 151.35.159.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 151.35.159.131;
}
EOS
2025-12-29 04:05:14,744 - DEBUG - None
2025-12-29 04:05:14,744 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2025-12-29 04:05:14,744 - DEBUG - service bird restart
2025-12-29 04:05:16,410 - DEBUG - bird stop/waiting
bird start/running, process 1439
2025-12-29 04:05:16,410 - INFO - Attaching VMI d2f589a3-4211-41db-96de-594e9c581aeb to BGPaaS 0d0b766f-f9ef-4ac8-ad8f-8a9552c839d0
2025-12-29 04:05:16,485 - INFO - Attaching the VMI 12b0b3f1-4ddb-4734-850e-ae610f57eaed to the BGPaaS 0d0b766f-f9ef-4ac8-ad8f-8a9552c839d0 object
2025-12-29 04:05:16,485 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 151.35.159.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2025-12-29 04:05:16,485 - DEBUG - sudo ip addr add 151.35.159.148 dev eth0
2025-12-29 04:05:17,148 - DEBUG - None
2025-12-29 04:05:17,212 - INFO - Creating BGPaaS ctest-TestBGPaasZone-37707920-09957523
2025-12-29 04:05:17,288 - INFO - BGPaaS: ctest-TestBGPaasZone-37707920-09957523(12e2291b-a565-4832-87c7-60cc4b3cb58a)
2025-12-29 04:05:17,289 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/12e2291b-a565-4832-87c7-60cc4b3cb58a
2025-12-29 04:05:17,299 - INFO - verify_in_api_server passed for BGPaaS obj 12e2291b-a565-4832-87c7-60cc4b3cb58a
2025-12-29 04:05:17,299 - INFO - BGPaaS(12e2291b-a565-4832-87c7-60cc4b3cb58a): verify_on_setup passed
2025-12-29 04:05:17,299 - INFO - We will configure BGP on the VM
2025-12-29 04:05:17,748 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-12-29 04:05:17,749 - INFO - Configuring BGP on ctest-TestBGPaasZone-37707920-38831183
2025-12-29 04:05:17,749 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 151.35.159.132;
protocol bgp bgp_1{
local as 65000;
neighbor 151.35.159.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 151.35.159.132;
}
protocol bfd {
neighbor 151.35.159.129 local 151.35.159.132 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2025-12-29 04:05:17,749 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 151.35.159.132;
protocol bgp bgp_1{
local as 65000;
neighbor 151.35.159.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 151.35.159.132;
}
protocol bfd {
neighbor 151.35.159.129 local 151.35.159.132 multihop on;
}
EOS
2025-12-29 04:05:25,204 - DEBUG - None
2025-12-29 04:05:25,205 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 151.35.159.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 151.35.159.132;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2025-12-29 04:05:25,205 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 151.35.159.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 151.35.159.132;
}
EOS
2025-12-29 04:05:25,801 - DEBUG - None
2025-12-29 04:05:25,801 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2025-12-29 04:05:25,802 - DEBUG - service bird restart
2025-12-29 04:05:27,790 - DEBUG - bird stop/waiting
bird start/running, process 1441
2025-12-29 04:05:27,790 - INFO - Attaching VMI 459997bf-bb5f-463c-b1f8-d0c4441bb949 to BGPaaS 12e2291b-a565-4832-87c7-60cc4b3cb58a
2025-12-29 04:05:27,864 - INFO - Attaching the VMI 70d9d07e-5d86-45c5-8206-6e9bc5aba552 to the BGPaaS 12e2291b-a565-4832-87c7-60cc4b3cb58a object
2025-12-29 04:05:27,864 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 151.35.159.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2025-12-29 04:05:27,864 - DEBUG - sudo ip addr add 151.35.159.148 dev eth0
2025-12-29 04:05:28,691 - DEBUG - None
2025-12-29 04:05:28,691 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-12-29 04:05:28,705 - INFO - BGPaaS session seen in control-node 10.20.0.18
2025-12-29 04:05:28,705 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-12-29 04:05:28,706 - DEBUG - Requesting: http://10.20.0.145:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-12-29 04:05:28,719 - INFO - BGPaaS session seen in control-node 10.20.0.145
2025-12-29 04:05:28,728 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-12-29 04:05:28,741 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18']
2025-12-29 04:05:34,756 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.18']
2025-12-29 04:05:40,769 - INFO - BGPaaS session seen in control-node 10.20.0.18
2025-12-29 04:05:40,769 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-12-29 04:05:40,770 - DEBUG - Requesting: http://10.20.0.145:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-12-29 04:05:40,783 - INFO - BGPaaS session seen in control-node 10.20.0.145
2025-12-29 04:05:40,790 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 151.35.159.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2025-12-29 04:05:40,790 - DEBUG - ping -s 56 -c 3 -W 1 151.35.159.148
2025-12-29 04:05:46,697 - DEBUG - PING 151.35.159.148 (151.35.159.148) 56(84) bytes of data.
64 bytes from 151.35.159.148: icmp_seq=1 ttl=64 time=8.35 ms
64 bytes from 151.35.159.148: icmp_seq=2 ttl=64 time=1.45 ms
64 bytes from 151.35.159.148: icmp_seq=3 ttl=64 time=2.78 ms
--- 151.35.159.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.451/4.194/8.352/2.990 ms
2025-12-29 04:05:46,697 - INFO - Ping to IP 151.35.159.148 from VM ctest-TestBGPaasZone-37707920-72874753 passed
2025-12-29 04:05:46,697 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-12-29 04:05:46,714 - INFO - BGPaaS session seen in control-node 10.20.0.18
2025-12-29 04:05:46,715 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-12-29 04:05:46,715 - DEBUG - Requesting: http://10.20.0.145:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-12-29 04:05:46,727 - INFO - BGPaaS session seen in control-node 10.20.0.145
2025-12-29 04:05:46,733 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-12-29 04:05:46,747 - INFO - BGPaaS session seen in control-node 10.20.0.18
2025-12-29 04:05:46,748 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-12-29 04:05:46,748 - DEBUG - Requesting: http://10.20.0.145:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-12-29 04:05:46,761 - INFO - BGPaaS session seen in control-node 10.20.0.145
2025-12-29 04:05:46,766 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 151.35.159.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.240, gateway password: c0ntrail123
2025-12-29 04:05:46,767 - DEBUG - ping -s 56 -c 3 -W 1 151.35.159.148
2025-12-29 04:05:49,247 - DEBUG - PING 151.35.159.148 (151.35.159.148) 56(84) bytes of data.
64 bytes from 151.35.159.148: icmp_seq=1 ttl=64 time=1.96 ms
64 bytes from 151.35.159.148: icmp_seq=2 ttl=64 time=1.14 ms
64 bytes from 151.35.159.148: icmp_seq=3 ttl=64 time=1.94 ms
--- 151.35.159.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 1.149/1.688/1.969/0.382 ms
2025-12-29 04:05:49,247 - INFO - Ping to IP 151.35.159.148 from VM ctest-TestBGPaasZone-37707920-72874753 passed
2025-12-29 04:05:49,248 - INFO - Detaching VMI 459997bf-bb5f-463c-b1f8-d0c4441bb949 from BGPaaS 12e2291b-a565-4832-87c7-60cc4b3cb58a
2025-12-29 04:05:49,320 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-37707920-09957523(12e2291b-a565-4832-87c7-60cc4b3cb58a)
2025-12-29 04:05:49,471 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/12e2291b-a565-4832-87c7-60cc4b3cb58a
2025-12-29 04:05:49,480 - DEBUG - Response Code: 404
2025-12-29 04:05:49,480 - DEBUG - BGPaaS: 12e2291b-a565-4832-87c7-60cc4b3cb58a deleted from api server
2025-12-29 04:05:49,480 - INFO - BGPaaS(12e2291b-a565-4832-87c7-60cc4b3cb58a): verify_on_cleanup passed
2025-12-29 04:05:49,481 - INFO - Detaching VMI d2f589a3-4211-41db-96de-594e9c581aeb from BGPaaS 0d0b766f-f9ef-4ac8-ad8f-8a9552c839d0
2025-12-29 04:05:49,561 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-37707920-27506240(0d0b766f-f9ef-4ac8-ad8f-8a9552c839d0)
2025-12-29 04:05:49,652 - DEBUG - Requesting: http://10.0.0.61:8082/bgp-as-a-service/0d0b766f-f9ef-4ac8-ad8f-8a9552c839d0
2025-12-29 04:05:49,659 - DEBUG - Response Code: 404
2025-12-29 04:05:49,659 - DEBUG - BGPaaS: 0d0b766f-f9ef-4ac8-ad8f-8a9552c839d0 deleted from api server
2025-12-29 04:05:49,659 - INFO - BGPaaS(0d0b766f-f9ef-4ac8-ad8f-8a9552c839d0): verify_on_cleanup passed
2025-12-29 04:05:49,659 - INFO - Deleting Control node zone ctest-test-zone-80449212(f8a83ff3-dc69-4f52-afce-10f847e56924)
2025-12-29 04:05:49,820 - INFO - Deleting Control node zone ctest-test-zone-54048504(75bac196-cdd0-4a8f-bb2c-f46645bd1729)
2025-12-29 04:05:49,969 - INFO - Deleting Control node zone ctest-test-zone-93209781(3f4fd296-2064-4469-a2bd-fd2599e905bb)
2025-12-29 04:05:50,133 - INFO - Deleting VM ctest-TestBGPaasZone-37707920-72874753
2025-12-29 04:05:50,217 - INFO - Deleting VM ctest-TestBGPaasZone-37707920-38831183
2025-12-29 04:05:50,293 - INFO - Deleting VM ctest-TestBGPaasZone-37707920-75253571
2025-12-29 04:05:50,369 - INFO - Deleting VN ctest-cnz_vn-66226062
2025-12-29 04:05:50,413 - DEBUG - VN 7c08f9e3-8e7b-4730-bfd0-6faae6cd80e9 still in use: Unable to complete operation on network 7c08f9e3-8e7b-4730-bfd0-6faae6cd80e9. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-76c816ac-ac7f-47ee-ad86-fda2f6291976']
2025-12-29 04:05:50,413 - WARNING - Deleting VN ctest-cnz_vn-66226062 failed..Will retry
2025-12-29 04:05:52,587 - DEBUG - Response for deleting network ()
2025-12-29 04:05:53,850 - DEBUG - Skipping xmpp flap check
2025-12-29 04:05:53,850 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:09]
2025-12-29 04:05:53,851 - INFO - --------------------------------------------------------------------------------
2025-12-29 04:05:54,599 - INFO - Deleted project: ctest-TestBGPaasZone-37707920, ID : ba6acc4a-8252-4904-920f-e93139610b78