is in ACTIVE state now
2026-04-23 04:18:01,075 - INFO - VM name : ctest-TestBGPaasZone-72935328-05445362
2026-04-23 04:18:01,174 - DEBUG - VM ctest-TestBGPaasZone-72935328-05445362 ID is 478b2ed0-4df9-4bd2-ac40-7a355558f304
2026-04-23 04:18:01,175 - DEBUG - VM ctest-TestBGPaasZone-72935328-05445362 launched on Node an-jenkins-deploy-platform-ansible-os-5672-1
2026-04-23 04:18:01,256 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/478b2ed0-4df9-4bd2-ac40-7a355558f304
2026-04-23 04:18:01,268 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/ffc6f918-a141-42b8-a9d4-45e68863ce99
2026-04-23 04:18:02,465 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=18.0 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=1.28 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.284/9.661/18.038/8.377 ms')
2026-04-23 04:18:02,465 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-TestBGPaasZone-72935328-05445362 passed
2026-04-23 04:18:02,539 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:18:02,539 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-72935328-05445362, IP 103.118.139.5, Port 22
2026-04-23 04:18:02,605 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-04-23 04:18:02,693 - DEBUG - VM ctest-TestBGPaasZone-72935328-05445362 is NOT ready for SSH connections, VM status: ACTIVE
2026-04-23 04:18:07,693 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:18:07,694 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-72935328-05445362, IP 103.118.139.5, Port 22
2026-04-23 04:18:07,762 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-04-23 04:18:07,851 - DEBUG - VM ctest-TestBGPaasZone-72935328-05445362 is NOT ready for SSH connections, VM status: ACTIVE
2026-04-23 04:18:12,852 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:18:12,853 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-72935328-05445362, IP 103.118.139.5, Port 22
2026-04-23 04:18:13,030 - DEBUG - VM ctest-TestBGPaasZone-72935328-05445362 is ready for SSH connections
2026-04-23 04:18:13,173 - INFO - Created control node zone ctest-test-zone-21151473(50b92abd-5280-421b-bf0a-65702dcc4088)
2026-04-23 04:18:13,529 - INFO - Created control node zone ctest-test-zone-04416502(8b05ffda-eb56-48bb-88d6-cb65ea4962c3)
2026-04-23 04:18:13,889 - INFO - Created control node zone ctest-test-zone-67233792(b87fbc17-e049-4d86-bad8-7f166a29a9bc)
2026-04-23 04:18:14,173 - INFO - Creating BGPaaS ctest-TestBGPaasZone-72935328-09447024
2026-04-23 04:18:14,250 - INFO - BGPaaS: ctest-TestBGPaasZone-72935328-09447024(7370580f-87d5-4404-bed8-92b15f6a8664)
2026-04-23 04:18:14,250 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/7370580f-87d5-4404-bed8-92b15f6a8664
2026-04-23 04:18:14,289 - INFO - verify_in_api_server passed for BGPaaS obj 7370580f-87d5-4404-bed8-92b15f6a8664
2026-04-23 04:18:14,290 - INFO - BGPaaS(7370580f-87d5-4404-bed8-92b15f6a8664): verify_on_setup passed
2026-04-23 04:18:14,290 - INFO - We will configure BGP on the VM
2026-04-23 04:18:14,734 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:18:14,734 - INFO - Configuring BGP on ctest-TestBGPaasZone-72935328-50256107
2026-04-23 04:18:14,734 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 103.118.139.3;
protocol bgp bgp_1{
local as 65000;
neighbor 103.118.139.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 103.118.139.3;
}
protocol bfd {
neighbor 103.118.139.1 local 103.118.139.3 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2026-04-23 04:18:14,734 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 103.118.139.3;
protocol bgp bgp_1{
local as 65000;
neighbor 103.118.139.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 103.118.139.3;
}
protocol bfd {
neighbor 103.118.139.1 local 103.118.139.3 multihop on;
}
EOS
2026-04-23 04:18:28,428 - DEBUG - None
2026-04-23 04:18:28,428 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 103.118.139.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 103.118.139.3;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2026-04-23 04:18:28,428 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 103.118.139.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 103.118.139.3;
}
EOS
2026-04-23 04:18:29,163 - DEBUG - None
2026-04-23 04:18:29,164 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2026-04-23 04:18:29,164 - DEBUG - service bird restart
2026-04-23 04:18:31,151 - DEBUG - bird stop/waiting
bird start/running, process 1434
2026-04-23 04:18:31,152 - INFO - Attaching VMI ec5c8923-67ab-4040-bc80-38c4188dc94c to BGPaaS 7370580f-87d5-4404-bed8-92b15f6a8664
2026-04-23 04:18:31,245 - INFO - Attaching the VMI fbab479f-21af-4e26-9b59-20ad1e62311e to the BGPaaS 7370580f-87d5-4404-bed8-92b15f6a8664 object
2026-04-23 04:18:31,246 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 103.118.139.20 dev eth0, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2026-04-23 04:18:31,246 - DEBUG - sudo ip addr add 103.118.139.20 dev eth0
2026-04-23 04:18:32,373 - DEBUG - None
2026-04-23 04:18:32,445 - INFO - Creating BGPaaS ctest-TestBGPaasZone-72935328-28713015
2026-04-23 04:18:32,529 - INFO - BGPaaS: ctest-TestBGPaasZone-72935328-28713015(06c64a2b-83f2-4cbb-8640-009d06b42b2f)
2026-04-23 04:18:32,529 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/06c64a2b-83f2-4cbb-8640-009d06b42b2f
2026-04-23 04:18:32,541 - INFO - verify_in_api_server passed for BGPaaS obj 06c64a2b-83f2-4cbb-8640-009d06b42b2f
2026-04-23 04:18:32,541 - INFO - BGPaaS(06c64a2b-83f2-4cbb-8640-009d06b42b2f): verify_on_setup passed
2026-04-23 04:18:32,541 - INFO - We will configure BGP on the VM
2026-04-23 04:18:32,993 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:18:32,993 - INFO - Configuring BGP on ctest-TestBGPaasZone-72935328-62285760
2026-04-23 04:18:32,993 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 103.118.139.4;
protocol bgp bgp_1{
local as 65000;
neighbor 103.118.139.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 103.118.139.4;
}
protocol bfd {
neighbor 103.118.139.1 local 103.118.139.4 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2026-04-23 04:18:32,993 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 103.118.139.4;
protocol bgp bgp_1{
local as 65000;
neighbor 103.118.139.1 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 103.118.139.4;
}
protocol bfd {
neighbor 103.118.139.1 local 103.118.139.4 multihop on;
}
EOS
2026-04-23 04:18:46,751 - DEBUG - None
2026-04-23 04:18:46,752 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 103.118.139.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 103.118.139.4;
}
EOS
, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2026-04-23 04:18:46,752 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 103.118.139.2 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 103.118.139.4;
}
EOS
2026-04-23 04:18:47,313 - DEBUG - None
2026-04-23 04:18:47,313 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2026-04-23 04:18:47,313 - DEBUG - service bird restart
2026-04-23 04:18:49,247 - DEBUG - bird stop/waiting
bird start/running, process 1444
2026-04-23 04:18:49,247 - INFO - Attaching VMI d716d1c6-7ab8-4b42-a5ec-de84ce57d8a6 to BGPaaS 06c64a2b-83f2-4cbb-8640-009d06b42b2f
2026-04-23 04:18:49,325 - INFO - Attaching the VMI b32fc700-5645-4e42-a0b4-2873438c1fc4 to the BGPaaS 06c64a2b-83f2-4cbb-8640-009d06b42b2f object
2026-04-23 04:18:49,326 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 103.118.139.20 dev eth0, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.131, gateway password: c0ntrail123
2026-04-23 04:18:49,326 - DEBUG - sudo ip addr add 103.118.139.20 dev eth0
2026-04-23 04:18:50,201 - DEBUG - None
2026-04-23 04:18:50,201 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:18:50,219 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-04-23 04:18:50,220 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:18:50,238 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-04-23 04:18:50,251 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:18:50,266 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2026-04-23 04:18:56,285 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.25']
2026-04-23 04:19:02,307 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-04-23 04:19:02,307 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:19:02,323 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-04-23 04:19:02,331 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 103.118.139.20, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2026-04-23 04:19:02,331 - DEBUG - ping -s 56 -c 3 -W 1 103.118.139.20
2026-04-23 04:19:14,584 - DEBUG - PING 103.118.139.20 (103.118.139.20) 56(84) bytes of data.
64 bytes from 103.118.139.20: icmp_seq=1 ttl=64 time=8.63 ms
64 bytes from 103.118.139.20: icmp_seq=2 ttl=64 time=1.27 ms
64 bytes from 103.118.139.20: icmp_seq=3 ttl=64 time=1.21 ms
--- 103.118.139.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.218/3.709/8.639/3.486 ms
2026-04-23 04:19:14,584 - INFO - Ping to IP 103.118.139.20 from VM ctest-TestBGPaasZone-72935328-05445362 passed
2026-04-23 04:19:14,584 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:19:14,606 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-04-23 04:19:14,607 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:19:14,625 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-04-23 04:19:14,632 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:19:14,647 - INFO - BGPaaS session seen in control-node 10.20.0.25
2026-04-23 04:19:14,647 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-23 04:19:14,664 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-04-23 04:19:14,670 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 103.118.139.20, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2026-04-23 04:19:14,670 - DEBUG - ping -s 56 -c 3 -W 1 103.118.139.20
2026-04-23 04:19:17,206 - DEBUG - PING 103.118.139.20 (103.118.139.20) 56(84) bytes of data.
64 bytes from 103.118.139.20: icmp_seq=1 ttl=64 time=5.60 ms
64 bytes from 103.118.139.20: icmp_seq=2 ttl=64 time=1.38 ms
64 bytes from 103.118.139.20: icmp_seq=3 ttl=64 time=1.73 ms
--- 103.118.139.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.386/2.909/5.606/1.912 ms
2026-04-23 04:19:17,206 - INFO - Ping to IP 103.118.139.20 from VM ctest-TestBGPaasZone-72935328-05445362 passed
2026-04-23 04:19:17,207 - INFO - Detaching VMI d716d1c6-7ab8-4b42-a5ec-de84ce57d8a6 from BGPaaS 06c64a2b-83f2-4cbb-8640-009d06b42b2f
2026-04-23 04:19:17,365 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-72935328-28713015(06c64a2b-83f2-4cbb-8640-009d06b42b2f)
2026-04-23 04:19:17,418 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/06c64a2b-83f2-4cbb-8640-009d06b42b2f
2026-04-23 04:19:17,424 - DEBUG - Response Code: 404
2026-04-23 04:19:17,424 - DEBUG - BGPaaS: 06c64a2b-83f2-4cbb-8640-009d06b42b2f deleted from api server
2026-04-23 04:19:17,424 - INFO - BGPaaS(06c64a2b-83f2-4cbb-8640-009d06b42b2f): verify_on_cleanup passed
2026-04-23 04:19:17,425 - INFO - Detaching VMI ec5c8923-67ab-4040-bc80-38c4188dc94c from BGPaaS 7370580f-87d5-4404-bed8-92b15f6a8664
2026-04-23 04:19:17,509 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-72935328-09447024(7370580f-87d5-4404-bed8-92b15f6a8664)
2026-04-23 04:19:17,566 - DEBUG - Requesting: http://10.0.0.23:8082/bgp-as-a-service/7370580f-87d5-4404-bed8-92b15f6a8664
2026-04-23 04:19:17,572 - DEBUG - Response Code: 404
2026-04-23 04:19:17,572 - DEBUG - BGPaaS: 7370580f-87d5-4404-bed8-92b15f6a8664 deleted from api server
2026-04-23 04:19:17,572 - INFO - BGPaaS(7370580f-87d5-4404-bed8-92b15f6a8664): verify_on_cleanup passed
2026-04-23 04:19:17,572 - INFO - Deleting Control node zone ctest-test-zone-67233792(b87fbc17-e049-4d86-bad8-7f166a29a9bc)
2026-04-23 04:19:17,728 - INFO - Deleting Control node zone ctest-test-zone-04416502(8b05ffda-eb56-48bb-88d6-cb65ea4962c3)
2026-04-23 04:19:17,891 - INFO - Deleting Control node zone ctest-test-zone-21151473(50b92abd-5280-421b-bf0a-65702dcc4088)
2026-04-23 04:19:18,085 - INFO - Deleting VM ctest-TestBGPaasZone-72935328-05445362
2026-04-23 04:19:18,225 - INFO - Deleting VM ctest-TestBGPaasZone-72935328-62285760
2026-04-23 04:19:18,298 - INFO - Deleting VM ctest-TestBGPaasZone-72935328-50256107
2026-04-23 04:19:18,369 - INFO - Deleting VN ctest-cnz_vn-51451416
2026-04-23 04:19:18,464 - DEBUG - VN 8f0b540d-d293-4130-ab48-e6d392baaeeb still in use: Unable to complete operation on network 8f0b540d-d293-4130-ab48-e6d392baaeeb. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-114b1e5e-e5a4-42b2-873f-bba6a4948df2']
2026-04-23 04:19:18,464 - WARNING - Deleting VN ctest-cnz_vn-51451416 failed..Will retry
2026-04-23 04:19:20,688 - DEBUG - Response for deleting network ()
2026-04-23 04:19:21,957 - DEBUG - Skipping xmpp flap check
2026-04-23 04:19:21,957 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:05:28]
2026-04-23 04:19:21,957 - INFO - --------------------------------------------------------------------------------
2026-04-23 04:19:22,781 - INFO - Deleted project: ctest-TestBGPaasZone-72935328, ID : 0db53dc5-468e-4bf0-9da5-e4c4e85d7a86