is in ACTIVE state now
2025-08-18 03:50:48,343 - INFO - VM name : ctest-TestBGPaasZone-08622215-68212899
2025-08-18 03:50:48,417 - DEBUG - VM ctest-TestBGPaasZone-08622215-68212899 ID is 4bd66aa8-1f32-4768-b447-738990b34e35
2025-08-18 03:50:48,418 - DEBUG - VM ctest-TestBGPaasZone-08622215-68212899 launched on Node an-jenkins-deploy-platform-ansible-os-3870-2
2025-08-18 03:50:48,486 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/4bd66aa8-1f32-4768-b447-738990b34e35
2025-08-18 03:50:48,494 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/280db017-e288-405d-9956-e0f533c05b41
2025-08-18 03:50:49,642 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=1.70 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.54 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.542/1.618/1.695/0.076 ms')
2025-08-18 03:50:49,642 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-08622215-68212899 passed
2025-08-18 03:50:49,710 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:50:49,710 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-08622215-68212899, IP 49.87.79.69, Port 22
2025-08-18 03:50:49,879 - DEBUG - VM ctest-TestBGPaasZone-08622215-68212899 is ready for SSH connections
2025-08-18 03:50:50,010 - INFO - Created control node zone ctest-test-zone-00445929(bf064774-85f3-49c8-ab89-48c2c0945431)
2025-08-18 03:50:50,350 - INFO - Created control node zone ctest-test-zone-58246578(f4683b78-213a-4aac-b303-9b7200d7da66)
2025-08-18 03:50:50,698 - INFO - Created control node zone ctest-test-zone-47227348(c22da9b9-45e1-45eb-93d1-c0fe0c490a65)
2025-08-18 03:50:50,966 - INFO - Creating BGPaaS ctest-TestBGPaasZone-08622215-69674317
2025-08-18 03:50:51,034 - INFO - BGPaaS: ctest-TestBGPaasZone-08622215-69674317(9ad4cd86-813a-4b45-9570-fcb18f8a9b35)
2025-08-18 03:50:51,034 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/9ad4cd86-813a-4b45-9570-fcb18f8a9b35
2025-08-18 03:50:51,044 - INFO - verify_in_api_server passed for BGPaaS obj 9ad4cd86-813a-4b45-9570-fcb18f8a9b35
2025-08-18 03:50:51,044 - INFO - BGPaaS(9ad4cd86-813a-4b45-9570-fcb18f8a9b35): verify_on_setup passed
2025-08-18 03:50:51,044 - INFO - We will configure BGP on the VM
2025-08-18 03:50:51,434 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:50:51,434 - INFO - Configuring BGP on ctest-TestBGPaasZone-08622215-75356967
2025-08-18 03:50:51,434 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 49.87.79.67;
protocol bgp bgp_1{
local as 65000;
neighbor 49.87.79.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 49.87.79.67;
}
protocol bfd {
neighbor 49.87.79.65 local 49.87.79.67 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-18 03:50:51,434 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 49.87.79.67;
protocol bgp bgp_1{
local as 65000;
neighbor 49.87.79.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 49.87.79.67;
}
protocol bfd {
neighbor 49.87.79.65 local 49.87.79.67 multihop on;
}
EOS
2025-08-18 03:51:05,329 - DEBUG - None
2025-08-18 03:51:05,329 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 49.87.79.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 49.87.79.67;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-18 03:51:05,330 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 49.87.79.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 49.87.79.67;
}
EOS
2025-08-18 03:51:06,220 - DEBUG - None
2025-08-18 03:51:06,220 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-18 03:51:06,220 - DEBUG - service bird restart
2025-08-18 03:51:09,041 - DEBUG - bird stop/waiting
bird start/running, process 1434
2025-08-18 03:51:09,041 - INFO - Attaching VMI fcb9d102-82e2-42ae-b9c3-d0969172613a to BGPaaS 9ad4cd86-813a-4b45-9570-fcb18f8a9b35
2025-08-18 03:51:09,114 - INFO - Attaching the VMI fcce5ac6-7e0f-4cb5-a2e9-eefd2c9fde12 to the BGPaaS 9ad4cd86-813a-4b45-9570-fcb18f8a9b35 object
2025-08-18 03:51:09,114 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 49.87.79.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-18 03:51:09,114 - DEBUG - sudo ip addr add 49.87.79.84 dev eth0
2025-08-18 03:51:10,378 - DEBUG - None
2025-08-18 03:51:10,438 - INFO - Creating BGPaaS ctest-TestBGPaasZone-08622215-20084626
2025-08-18 03:51:10,510 - INFO - BGPaaS: ctest-TestBGPaasZone-08622215-20084626(416c0da0-adb7-4a52-a453-c8b2ba257289)
2025-08-18 03:51:10,510 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/416c0da0-adb7-4a52-a453-c8b2ba257289
2025-08-18 03:51:10,520 - INFO - verify_in_api_server passed for BGPaaS obj 416c0da0-adb7-4a52-a453-c8b2ba257289
2025-08-18 03:51:10,521 - INFO - BGPaaS(416c0da0-adb7-4a52-a453-c8b2ba257289): verify_on_setup passed
2025-08-18 03:51:10,521 - INFO - We will configure BGP on the VM
2025-08-18 03:51:10,930 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:51:10,930 - INFO - Configuring BGP on ctest-TestBGPaasZone-08622215-21643504
2025-08-18 03:51:10,930 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 49.87.79.68;
protocol bgp bgp_1{
local as 65000;
neighbor 49.87.79.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 49.87.79.68;
}
protocol bfd {
neighbor 49.87.79.65 local 49.87.79.68 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2025-08-18 03:51:10,930 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 49.87.79.68;
protocol bgp bgp_1{
local as 65000;
neighbor 49.87.79.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 49.87.79.68;
}
protocol bfd {
neighbor 49.87.79.65 local 49.87.79.68 multihop on;
}
EOS
2025-08-18 03:51:16,295 - DEBUG - None
2025-08-18 03:51:16,296 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 49.87.79.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 49.87.79.68;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2025-08-18 03:51:16,296 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 49.87.79.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 49.87.79.68;
}
EOS
2025-08-18 03:51:16,772 - DEBUG - None
2025-08-18 03:51:16,772 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2025-08-18 03:51:16,772 - DEBUG - service bird restart
2025-08-18 03:51:18,353 - DEBUG - bird stop/waiting
bird start/running, process 1480
2025-08-18 03:51:18,353 - INFO - Attaching VMI e40d4305-949a-42d3-97aa-499d42031a4f to BGPaaS 416c0da0-adb7-4a52-a453-c8b2ba257289
2025-08-18 03:51:18,430 - INFO - Attaching the VMI e7478031-12a2-4a62-9194-1fea91f99415 to the BGPaaS 416c0da0-adb7-4a52-a453-c8b2ba257289 object
2025-08-18 03:51:18,430 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 49.87.79.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2025-08-18 03:51:18,430 - DEBUG - sudo ip addr add 49.87.79.84 dev eth0
2025-08-18 03:51:19,048 - DEBUG - None
2025-08-18 03:51:19,048 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:51:19,062 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-08-18 03:51:19,063 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:51:19,063 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-08-18 03:51:19,076 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-08-18 03:51:19,083 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:51:19,097 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2025-08-18 03:51:25,111 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2025-08-18 03:51:31,126 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-08-18 03:51:31,127 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:51:31,127 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-08-18 03:51:31,141 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-08-18 03:51:31,147 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 49.87.79.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-18 03:51:31,147 - DEBUG - ping -s 56 -c 3 -W 1 49.87.79.84
2025-08-18 03:51:37,463 - DEBUG - PING 49.87.79.84 (49.87.79.84) 56(84) bytes of data.
64 bytes from 49.87.79.84: icmp_seq=1 ttl=64 time=9.58 ms
64 bytes from 49.87.79.84: icmp_seq=2 ttl=64 time=1.32 ms
64 bytes from 49.87.79.84: icmp_seq=3 ttl=64 time=1.26 ms
--- 49.87.79.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.261/4.056/9.587/3.911 ms
2025-08-18 03:51:37,463 - INFO - Ping to IP 49.87.79.84 from VM ctest-TestBGPaasZone-08622215-68212899 passed
2025-08-18 03:51:37,463 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:51:37,477 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-08-18 03:51:37,478 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:51:37,478 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-08-18 03:51:37,494 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-08-18 03:51:37,505 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:51:37,519 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-08-18 03:51:37,519 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-18 03:51:37,519 - DEBUG - Requesting: http://10.20.0.193:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-08-18 03:51:37,532 - INFO - BGPaaS session seen in control-node 10.20.0.193
2025-08-18 03:51:37,538 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 49.87.79.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-18 03:51:37,538 - DEBUG - ping -s 56 -c 3 -W 1 49.87.79.84
2025-08-18 03:51:40,013 - DEBUG - PING 49.87.79.84 (49.87.79.84) 56(84) bytes of data.
64 bytes from 49.87.79.84: icmp_seq=1 ttl=64 time=2.75 ms
64 bytes from 49.87.79.84: icmp_seq=2 ttl=64 time=1.43 ms
64 bytes from 49.87.79.84: icmp_seq=3 ttl=64 time=1.27 ms
--- 49.87.79.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.277/1.820/2.750/0.662 ms
2025-08-18 03:51:40,013 - INFO - Ping to IP 49.87.79.84 from VM ctest-TestBGPaasZone-08622215-68212899 passed
2025-08-18 03:51:40,013 - INFO - Detaching VMI e40d4305-949a-42d3-97aa-499d42031a4f from BGPaaS 416c0da0-adb7-4a52-a453-c8b2ba257289
2025-08-18 03:51:40,082 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-08622215-20084626(416c0da0-adb7-4a52-a453-c8b2ba257289)
2025-08-18 03:51:40,143 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/416c0da0-adb7-4a52-a453-c8b2ba257289
2025-08-18 03:51:40,157 - DEBUG - Response Code: 404
2025-08-18 03:51:40,157 - DEBUG - BGPaaS: 416c0da0-adb7-4a52-a453-c8b2ba257289 deleted from api server
2025-08-18 03:51:40,158 - INFO - BGPaaS(416c0da0-adb7-4a52-a453-c8b2ba257289): verify_on_cleanup passed
2025-08-18 03:51:40,158 - INFO - Detaching VMI fcb9d102-82e2-42ae-b9c3-d0969172613a from BGPaaS 9ad4cd86-813a-4b45-9570-fcb18f8a9b35
2025-08-18 03:51:40,254 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-08622215-69674317(9ad4cd86-813a-4b45-9570-fcb18f8a9b35)
2025-08-18 03:51:40,320 - DEBUG - Requesting: http://10.0.0.27:8082/bgp-as-a-service/9ad4cd86-813a-4b45-9570-fcb18f8a9b35
2025-08-18 03:51:40,327 - DEBUG - Response Code: 404
2025-08-18 03:51:40,327 - DEBUG - BGPaaS: 9ad4cd86-813a-4b45-9570-fcb18f8a9b35 deleted from api server
2025-08-18 03:51:40,327 - INFO - BGPaaS(9ad4cd86-813a-4b45-9570-fcb18f8a9b35): verify_on_cleanup passed
2025-08-18 03:51:40,327 - INFO - Deleting Control node zone ctest-test-zone-47227348(c22da9b9-45e1-45eb-93d1-c0fe0c490a65)
2025-08-18 03:51:40,467 - INFO - Deleting Control node zone ctest-test-zone-58246578(f4683b78-213a-4aac-b303-9b7200d7da66)
2025-08-18 03:51:40,603 - INFO - Deleting Control node zone ctest-test-zone-00445929(bf064774-85f3-49c8-ab89-48c2c0945431)
2025-08-18 03:51:40,748 - INFO - Deleting VM ctest-TestBGPaasZone-08622215-68212899
2025-08-18 03:51:40,831 - INFO - Deleting VM ctest-TestBGPaasZone-08622215-21643504
2025-08-18 03:51:40,897 - INFO - Deleting VM ctest-TestBGPaasZone-08622215-75356967
2025-08-18 03:51:40,970 - INFO - Deleting VN ctest-cnz_vn-23798457
2025-08-18 03:51:41,012 - DEBUG - VN 0ae64763-42de-4c6c-be1c-d3e73a678125 still in use: Unable to complete operation on network 0ae64763-42de-4c6c-be1c-d3e73a678125. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-2a2b8bda-e45a-429c-b1e2-664330435f96']
2025-08-18 03:51:41,012 - WARNING - Deleting VN ctest-cnz_vn-23798457 failed..Will retry
2025-08-18 03:51:43,160 - DEBUG - Response for deleting network ()
2025-08-18 03:51:44,413 - DEBUG - Skipping xmpp flap check
2025-08-18 03:51:44,413 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:02:59]
2025-08-18 03:51:44,413 - INFO - --------------------------------------------------------------------------------
2025-08-18 03:51:45,086 - INFO - Deleted project: ctest-TestBGPaasZone-08622215, ID : 40102d60-3b6c-418f-a49b-bfc655bc1af7