is in ACTIVE state now
2025-09-29 03:42:15,406 - INFO - VM name : ctest-TestBGPaasZone-79939880-51171100
2025-09-29 03:42:15,493 - DEBUG - VM ctest-TestBGPaasZone-79939880-51171100 ID is ab0a48f5-06b8-44fd-8344-ece410eb01b8
2025-09-29 03:42:15,493 - DEBUG - VM ctest-TestBGPaasZone-79939880-51171100 launched on Node an-jenkins-deploy-platform-ansible-os-4203-1
2025-09-29 03:42:15,597 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/ab0a48f5-06b8-44fd-8344-ece410eb01b8
2025-09-29 03:42:15,609 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/c424d931-9e25-4886-82bf-835806dc2770
2025-09-29 03:42:16,808 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.09 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.18 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.182/2.636/3.090/0.454 ms')
2025-09-29 03:42:16,808 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-79939880-51171100 passed
2025-09-29 03:42:16,893 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:42:16,893 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-79939880-51171100, IP 216.207.132.5, Port 22
2025-09-29 03:42:16,960 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-09-29 03:42:17,054 - DEBUG - VM ctest-TestBGPaasZone-79939880-51171100 is NOT ready for SSH connections, VM status: ACTIVE
2025-09-29 03:42:22,055 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:42:22,055 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-79939880-51171100, IP 216.207.132.5, Port 22
2025-09-29 03:42:22,231 - DEBUG - VM ctest-TestBGPaasZone-79939880-51171100 is ready for SSH connections
2025-09-29 03:42:22,383 - INFO - Created control node zone ctest-test-zone-07875640(e0ce5223-7e30-4290-8e19-1e0acd2b4a05)
2025-09-29 03:42:22,759 - INFO - Created control node zone ctest-test-zone-72576545(19102956-51dc-477d-b19d-5cfe538b4b66)
2025-09-29 03:42:23,147 - INFO - Created control node zone ctest-test-zone-92072304(448f7d2e-71aa-42f8-9234-cbce0cfdc187)
2025-09-29 03:42:23,471 - INFO - Creating BGPaaS ctest-TestBGPaasZone-79939880-61286343
2025-09-29 03:42:23,575 - INFO - BGPaaS: ctest-TestBGPaasZone-79939880-61286343(5f9bf773-9eaa-475f-83bc-ab1d7019a5cf)
2025-09-29 03:42:23,575 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/5f9bf773-9eaa-475f-83bc-ab1d7019a5cf
2025-09-29 03:42:23,585 - INFO - verify_in_api_server passed for BGPaaS obj 5f9bf773-9eaa-475f-83bc-ab1d7019a5cf
2025-09-29 03:42:23,585 - INFO - BGPaaS(5f9bf773-9eaa-475f-83bc-ab1d7019a5cf): verify_on_setup passed
2025-09-29 03:42:23,585 - INFO - We will configure BGP on the VM
2025-09-29 03:42:24,059 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:42:24,059 - INFO - Configuring BGP on ctest-TestBGPaasZone-79939880-99623331
2025-09-29 03:42:24,059 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 216.207.132.3;
protocol bgp bgp_1{
local as 65000;
neighbor 216.207.132.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 216.207.132.3;
}
protocol bfd {
neighbor 216.207.132.1 local 216.207.132.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-09-29 03:42:24,060 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 216.207.132.3;
protocol bgp bgp_1{
local as 65000;
neighbor 216.207.132.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 216.207.132.3;
}
protocol bfd {
neighbor 216.207.132.1 local 216.207.132.3 multihop on;
}
EOS
2025-09-29 03:42:34,852 - DEBUG - None
2025-09-29 03:42:34,852 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 216.207.132.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 216.207.132.3;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-09-29 03:42:34,852 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 216.207.132.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 216.207.132.3;
}
EOS
2025-09-29 03:42:35,341 - DEBUG - None
2025-09-29 03:42:35,341 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-09-29 03:42:35,341 - DEBUG - service bird restart
2025-09-29 03:42:37,031 - DEBUG - bird stop/waiting
bird start/running, process 1434
2025-09-29 03:42:37,031 - INFO - Attaching VMI 6cd9f5eb-76eb-44ff-9d91-4c0132bb0805 to BGPaaS 5f9bf773-9eaa-475f-83bc-ab1d7019a5cf
2025-09-29 03:42:37,127 - INFO - Attaching the VMI 026fdc7f-2eb5-47ba-960b-27c2c6090458 to the BGPaaS 5f9bf773-9eaa-475f-83bc-ab1d7019a5cf object
2025-09-29 03:42:37,127 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 216.207.132.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-09-29 03:42:37,128 - DEBUG - sudo ip addr add 216.207.132.20 dev eth0
2025-09-29 03:42:37,773 - DEBUG - None
2025-09-29 03:42:37,859 - INFO - Creating BGPaaS ctest-TestBGPaasZone-79939880-82050026
2025-09-29 03:42:37,991 - INFO - BGPaaS: ctest-TestBGPaasZone-79939880-82050026(a609c74d-49ba-4f1a-8cf2-5c6e6016473c)
2025-09-29 03:42:37,991 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/a609c74d-49ba-4f1a-8cf2-5c6e6016473c
2025-09-29 03:42:38,000 - INFO - verify_in_api_server passed for BGPaaS obj a609c74d-49ba-4f1a-8cf2-5c6e6016473c
2025-09-29 03:42:38,000 - INFO - BGPaaS(a609c74d-49ba-4f1a-8cf2-5c6e6016473c): verify_on_setup passed
2025-09-29 03:42:38,001 - INFO - We will configure BGP on the VM
2025-09-29 03:42:38,431 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:42:38,431 - INFO - Configuring BGP on ctest-TestBGPaasZone-79939880-26605614
2025-09-29 03:42:38,431 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 216.207.132.4;
protocol bgp bgp_1{
local as 65000;
neighbor 216.207.132.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 216.207.132.4;
}
protocol bfd {
neighbor 216.207.132.1 local 216.207.132.4 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2025-09-29 03:42:38,432 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 216.207.132.4;
protocol bgp bgp_1{
local as 65000;
neighbor 216.207.132.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 216.207.132.4;
}
protocol bfd {
neighbor 216.207.132.1 local 216.207.132.4 multihop on;
}
EOS
2025-09-29 03:42:44,525 - DEBUG - None
2025-09-29 03:42:44,525 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 216.207.132.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 216.207.132.4;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2025-09-29 03:42:44,525 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 216.207.132.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 216.207.132.4;
}
EOS
2025-09-29 03:42:45,038 - DEBUG - None
2025-09-29 03:42:45,038 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2025-09-29 03:42:45,038 - DEBUG - service bird restart
2025-09-29 03:42:46,825 - DEBUG - bird stop/waiting
bird start/running, process 1435
2025-09-29 03:42:46,825 - INFO - Attaching VMI cd0b1508-a448-4c44-b83b-93d657e29546 to BGPaaS a609c74d-49ba-4f1a-8cf2-5c6e6016473c
2025-09-29 03:42:46,939 - INFO - Attaching the VMI 20c40a52-d26c-4e9e-b43b-3be506871e12 to the BGPaaS a609c74d-49ba-4f1a-8cf2-5c6e6016473c object
2025-09-29 03:42:46,939 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 216.207.132.20 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2025-09-29 03:42:46,939 - DEBUG - sudo ip addr add 216.207.132.20 dev eth0
2025-09-29 03:42:47,627 - DEBUG - None
2025-09-29 03:42:47,628 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:42:47,644 - INFO - BGPaaS session seen in control-node 10.20.0.17
2025-09-29 03:42:47,644 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:42:47,645 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-09-29 03:42:47,662 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-09-29 03:42:47,668 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:42:47,688 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17']
2025-09-29 03:42:53,704 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.17']
2025-09-29 03:42:59,720 - INFO - BGPaaS session seen in control-node 10.20.0.17
2025-09-29 03:42:59,720 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:42:59,720 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-09-29 03:42:59,734 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-09-29 03:42:59,739 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 216.207.132.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-09-29 03:42:59,739 - DEBUG - ping -s 56 -c 3 -W 1 216.207.132.20
2025-09-29 03:43:05,688 - DEBUG - PING 216.207.132.20 (216.207.132.20) 56(84) bytes of data.
64 bytes from 216.207.132.20: icmp_seq=1 ttl=64 time=10.9 ms
64 bytes from 216.207.132.20: icmp_seq=2 ttl=64 time=1.05 ms
64 bytes from 216.207.132.20: icmp_seq=3 ttl=64 time=1.57 ms
--- 216.207.132.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.055/4.522/10.935/4.539 ms
2025-09-29 03:43:05,688 - INFO - Ping to IP 216.207.132.20 from VM ctest-TestBGPaasZone-79939880-51171100 passed
2025-09-29 03:43:05,688 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:43:05,705 - INFO - BGPaaS session seen in control-node 10.20.0.17
2025-09-29 03:43:05,706 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:43:05,706 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-09-29 03:43:05,724 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-09-29 03:43:05,729 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:43:05,742 - INFO - BGPaaS session seen in control-node 10.20.0.17
2025-09-29 03:43:05,743 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-09-29 03:43:05,743 - DEBUG - Requesting: http://10.20.0.25:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-09-29 03:43:05,757 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-09-29 03:43:05,763 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 216.207.132.20, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-09-29 03:43:05,763 - DEBUG - ping -s 56 -c 3 -W 1 216.207.132.20
2025-09-29 03:43:08,227 - DEBUG - PING 216.207.132.20 (216.207.132.20) 56(84) bytes of data.
64 bytes from 216.207.132.20: icmp_seq=1 ttl=64 time=2.87 ms
64 bytes from 216.207.132.20: icmp_seq=2 ttl=64 time=1.66 ms
64 bytes from 216.207.132.20: icmp_seq=3 ttl=64 time=1.13 ms
--- 216.207.132.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.131/1.891/2.876/0.729 ms
2025-09-29 03:43:08,227 - INFO - Ping to IP 216.207.132.20 from VM ctest-TestBGPaasZone-79939880-51171100 passed
2025-09-29 03:43:08,227 - INFO - Detaching VMI cd0b1508-a448-4c44-b83b-93d657e29546 from BGPaaS a609c74d-49ba-4f1a-8cf2-5c6e6016473c
2025-09-29 03:43:08,331 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-79939880-82050026(a609c74d-49ba-4f1a-8cf2-5c6e6016473c)
2025-09-29 03:43:08,412 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/a609c74d-49ba-4f1a-8cf2-5c6e6016473c
2025-09-29 03:43:08,417 - DEBUG - Response Code: 404
2025-09-29 03:43:08,418 - DEBUG - BGPaaS: a609c74d-49ba-4f1a-8cf2-5c6e6016473c deleted from api server
2025-09-29 03:43:08,418 - INFO - BGPaaS(a609c74d-49ba-4f1a-8cf2-5c6e6016473c): verify_on_cleanup passed
2025-09-29 03:43:08,418 - INFO - Detaching VMI 6cd9f5eb-76eb-44ff-9d91-4c0132bb0805 from BGPaaS 5f9bf773-9eaa-475f-83bc-ab1d7019a5cf
2025-09-29 03:43:08,515 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-79939880-61286343(5f9bf773-9eaa-475f-83bc-ab1d7019a5cf)
2025-09-29 03:43:08,593 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/5f9bf773-9eaa-475f-83bc-ab1d7019a5cf
2025-09-29 03:43:08,602 - DEBUG - Response Code: 404
2025-09-29 03:43:08,602 - DEBUG - BGPaaS: 5f9bf773-9eaa-475f-83bc-ab1d7019a5cf deleted from api server
2025-09-29 03:43:08,602 - INFO - BGPaaS(5f9bf773-9eaa-475f-83bc-ab1d7019a5cf): verify_on_cleanup passed
2025-09-29 03:43:08,602 - INFO - Deleting Control node zone ctest-test-zone-92072304(448f7d2e-71aa-42f8-9234-cbce0cfdc187)
2025-09-29 03:43:08,752 - INFO - Deleting Control node zone ctest-test-zone-72576545(19102956-51dc-477d-b19d-5cfe538b4b66)
2025-09-29 03:43:08,910 - INFO - Deleting Control node zone ctest-test-zone-07875640(e0ce5223-7e30-4290-8e19-1e0acd2b4a05)
2025-09-29 03:43:09,056 - INFO - Deleting VM ctest-TestBGPaasZone-79939880-51171100
2025-09-29 03:43:09,142 - INFO - Deleting VM ctest-TestBGPaasZone-79939880-26605614
2025-09-29 03:43:09,208 - INFO - Deleting VM ctest-TestBGPaasZone-79939880-99623331
2025-09-29 03:43:09,276 - INFO - Deleting VN ctest-cnz_vn-80328492
2025-09-29 03:43:09,332 - DEBUG - VN 7f8be8df-c7e5-474f-a22b-f2b8a1f5a779 still in use: Unable to complete operation on network 7f8be8df-c7e5-474f-a22b-f2b8a1f5a779. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-669d7247-6ce3-4dfa-92cd-b466bc54643e']
2025-09-29 03:43:09,332 - WARNING - Deleting VN ctest-cnz_vn-80328492 failed..Will retry
2025-09-29 03:43:11,582 - DEBUG - Response for deleting network ()
2025-09-29 03:43:12,875 - DEBUG - Skipping xmpp flap check
2025-09-29 03:43:12,876 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:02:58]
2025-09-29 03:43:12,876 - INFO - --------------------------------------------------------------------------------
2025-09-29 03:43:13,648 - INFO - Deleted project: ctest-TestBGPaasZone-79939880, ID : c2a17075-f012-4246-95f2-7f9fd4b93fd9