is in ACTIVE state now
2026-06-22 04:15:25,130 - INFO - VM name : ctest-TestBGPaasZone-37519611-40711216
2026-06-22 04:15:25,206 - DEBUG - VM ctest-TestBGPaasZone-37519611-40711216 ID is 3594b2ea-fe4e-4f12-80bc-8f9f2640079e
2026-06-22 04:15:25,206 - DEBUG - VM ctest-TestBGPaasZone-37519611-40711216 launched on Node an-jenkins-deploy-platform-ansible-os-6014-2
2026-06-22 04:15:25,282 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/3594b2ea-fe4e-4f12-80bc-8f9f2640079e
2026-06-22 04:15:25,294 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/2c20c22e-eb2c-4b9b-90b6-654ae8b95a95
2026-06-22 04:15:26,453 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.83 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.522 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.522/2.175/3.829/1.653 ms')
2026-06-22 04:15:26,453 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-37519611-40711216 passed
2026-06-22 04:15:26,520 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:26,520 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-37519611-40711216, IP 100.204.133.69, Port 22
2026-06-22 04:15:26,590 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-22 04:15:26,666 - DEBUG - VM ctest-TestBGPaasZone-37519611-40711216 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-22 04:15:31,667 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:31,667 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-37519611-40711216, IP 100.204.133.69, Port 22
2026-06-22 04:15:31,744 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-22 04:15:31,817 - DEBUG - VM ctest-TestBGPaasZone-37519611-40711216 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-22 04:15:36,818 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:36,818 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-37519611-40711216, IP 100.204.133.69, Port 22
2026-06-22 04:15:36,989 - DEBUG - VM ctest-TestBGPaasZone-37519611-40711216 is ready for SSH connections
2026-06-22 04:15:37,123 - INFO - Created control node zone ctest-test-zone-78015912(33f51203-aebd-4756-b8e8-e55b13ab0852)
2026-06-22 04:15:37,483 - INFO - Created control node zone ctest-test-zone-18775925(45ce7c38-1df7-4031-a211-2d7174307355)
2026-06-22 04:15:37,843 - INFO - Created control node zone ctest-test-zone-69124979(4cadb28c-971e-4dc9-a778-bf0fc8ad894c)
2026-06-22 04:15:38,119 - INFO - Creating BGPaaS ctest-TestBGPaasZone-37519611-58388952
2026-06-22 04:15:38,199 - INFO - BGPaaS: ctest-TestBGPaasZone-37519611-58388952(09fc7030-aa39-458f-b626-ddd9cc6a967e)
2026-06-22 04:15:38,199 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/09fc7030-aa39-458f-b626-ddd9cc6a967e
2026-06-22 04:15:38,209 - INFO - verify_in_api_server passed for BGPaaS obj 09fc7030-aa39-458f-b626-ddd9cc6a967e
2026-06-22 04:15:38,209 - INFO - BGPaaS(09fc7030-aa39-458f-b626-ddd9cc6a967e): verify_on_setup passed
2026-06-22 04:15:38,209 - INFO - We will configure BGP on the VM
2026-06-22 04:15:38,623 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:38,624 - INFO - Configuring BGP on ctest-TestBGPaasZone-37519611-00519558
2026-06-22 04:15:38,624 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 100.204.133.67;
protocol bgp bgp_1{
local as 65000;
neighbor 100.204.133.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 100.204.133.67;
}
protocol bfd {
neighbor 100.204.133.65 local 100.204.133.67 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:15:38,624 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 100.204.133.67;
protocol bgp bgp_1{
local as 65000;
neighbor 100.204.133.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 100.204.133.67;
}
protocol bfd {
neighbor 100.204.133.65 local 100.204.133.67 multihop on;
}
EOS
2026-06-22 04:15:41,809 - DEBUG - None
2026-06-22 04:15:41,809 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 100.204.133.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 100.204.133.67;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:15:41,810 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 100.204.133.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 100.204.133.67;
}
EOS
2026-06-22 04:15:42,090 - DEBUG - None
2026-06-22 04:15:42,090 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:15:42,090 - DEBUG - service bird restart
2026-06-22 04:15:43,002 - DEBUG - bird stop/waiting
bird start/running, process 1441
2026-06-22 04:15:43,002 - INFO - Attaching VMI b365f1dd-ac2b-4705-8004-8f815384f1ff to BGPaaS 09fc7030-aa39-458f-b626-ddd9cc6a967e
2026-06-22 04:15:43,079 - INFO - Attaching the VMI 7f77f3c8-19b3-44d0-a84c-012890444e5d to the BGPaaS 09fc7030-aa39-458f-b626-ddd9cc6a967e object
2026-06-22 04:15:43,080 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 100.204.133.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:15:43,080 - DEBUG - sudo ip addr add 100.204.133.84 dev eth0
2026-06-22 04:15:43,372 - DEBUG - None
2026-06-22 04:15:43,443 - INFO - Creating BGPaaS ctest-TestBGPaasZone-37519611-18205791
2026-06-22 04:15:43,519 - INFO - BGPaaS: ctest-TestBGPaasZone-37519611-18205791(df1973d2-57f5-496d-9c6a-6ce32a50f148)
2026-06-22 04:15:43,520 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/df1973d2-57f5-496d-9c6a-6ce32a50f148
2026-06-22 04:15:43,532 - INFO - verify_in_api_server passed for BGPaaS obj df1973d2-57f5-496d-9c6a-6ce32a50f148
2026-06-22 04:15:43,532 - INFO - BGPaaS(df1973d2-57f5-496d-9c6a-6ce32a50f148): verify_on_setup passed
2026-06-22 04:15:43,532 - INFO - We will configure BGP on the VM
2026-06-22 04:15:43,951 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:43,952 - INFO - Configuring BGP on ctest-TestBGPaasZone-37519611-74672135
2026-06-22 04:15:43,952 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 100.204.133.68;
protocol bgp bgp_1{
local as 65000;
neighbor 100.204.133.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 100.204.133.68;
}
protocol bfd {
neighbor 100.204.133.65 local 100.204.133.68 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 04:15:43,952 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 100.204.133.68;
protocol bgp bgp_1{
local as 65000;
neighbor 100.204.133.65 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 100.204.133.68;
}
protocol bfd {
neighbor 100.204.133.65 local 100.204.133.68 multihop on;
}
EOS
2026-06-22 04:15:47,030 - DEBUG - None
2026-06-22 04:15:47,031 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 100.204.133.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 100.204.133.68;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 04:15:47,031 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 100.204.133.66 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 100.204.133.68;
}
EOS
2026-06-22 04:15:47,289 - DEBUG - None
2026-06-22 04:15:47,289 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 04:15:47,289 - DEBUG - service bird restart
2026-06-22 04:15:48,057 - DEBUG - bird stop/waiting
bird start/running, process 1480
2026-06-22 04:15:48,057 - INFO - Attaching VMI 6d46ac12-f86a-41f5-9569-ca87b136199e to BGPaaS df1973d2-57f5-496d-9c6a-6ce32a50f148
2026-06-22 04:15:48,139 - INFO - Attaching the VMI 6f6a9445-3606-4dc5-a0ec-ff39a7b9c10b to the BGPaaS df1973d2-57f5-496d-9c6a-6ce32a50f148 object
2026-06-22 04:15:48,139 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 100.204.133.84 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 04:15:48,140 - DEBUG - sudo ip addr add 100.204.133.84 dev eth0
2026-06-22 04:15:48,402 - DEBUG - None
2026-06-22 04:15:48,402 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:48,414 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.193']
2026-06-22 04:15:54,427 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-06-22 04:15:54,428 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:54,446 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-06-22 04:15:54,452 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:54,463 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-06-22 04:15:54,464 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:54,479 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-06-22 04:15:54,490 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 100.204.133.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:15:54,490 - DEBUG - ping -s 56 -c 3 -W 1 100.204.133.84
2026-06-22 04:15:58,644 - DEBUG - PING 100.204.133.84 (100.204.133.84) 56(84) bytes of data.
64 bytes from 100.204.133.84: icmp_seq=1 ttl=64 time=4.88 ms
64 bytes from 100.204.133.84: icmp_seq=2 ttl=64 time=1.21 ms
64 bytes from 100.204.133.84: icmp_seq=3 ttl=64 time=1.49 ms
--- 100.204.133.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.215/2.533/4.888/1.669 ms
2026-06-22 04:15:58,644 - INFO - Ping to IP 100.204.133.84 from VM ctest-TestBGPaasZone-37519611-40711216 passed
2026-06-22 04:15:58,644 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:58,661 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-06-22 04:15:58,662 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:58,680 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-06-22 04:15:58,686 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:58,699 - INFO - BGPaaS session seen in control-node 10.20.0.193
2026-06-22 04:15:58,699 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:15:58,714 - INFO - BGPaaS session seen in control-node 10.20.0.129
2026-06-22 04:15:58,719 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 100.204.133.84, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:15:58,719 - DEBUG - ping -s 56 -c 3 -W 1 100.204.133.84
2026-06-22 04:16:00,963 - DEBUG - PING 100.204.133.84 (100.204.133.84) 56(84) bytes of data.
64 bytes from 100.204.133.84: icmp_seq=1 ttl=64 time=2.14 ms
64 bytes from 100.204.133.84: icmp_seq=2 ttl=64 time=0.942 ms
64 bytes from 100.204.133.84: icmp_seq=3 ttl=64 time=0.855 ms
--- 100.204.133.84 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 0.855/1.312/2.141/0.588 ms
2026-06-22 04:16:00,963 - INFO - Ping to IP 100.204.133.84 from VM ctest-TestBGPaasZone-37519611-40711216 passed
2026-06-22 04:16:00,964 - INFO - Detaching VMI 6d46ac12-f86a-41f5-9569-ca87b136199e from BGPaaS df1973d2-57f5-496d-9c6a-6ce32a50f148
2026-06-22 04:16:01,043 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-37519611-18205791(df1973d2-57f5-496d-9c6a-6ce32a50f148)
2026-06-22 04:16:01,108 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/df1973d2-57f5-496d-9c6a-6ce32a50f148
2026-06-22 04:16:01,124 - DEBUG - Response Code: 404
2026-06-22 04:16:01,124 - DEBUG - BGPaaS: df1973d2-57f5-496d-9c6a-6ce32a50f148 deleted from api server
2026-06-22 04:16:01,124 - INFO - BGPaaS(df1973d2-57f5-496d-9c6a-6ce32a50f148): verify_on_cleanup passed
2026-06-22 04:16:01,124 - INFO - Detaching VMI b365f1dd-ac2b-4705-8004-8f815384f1ff from BGPaaS 09fc7030-aa39-458f-b626-ddd9cc6a967e
2026-06-22 04:16:01,233 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-37519611-58388952(09fc7030-aa39-458f-b626-ddd9cc6a967e)
2026-06-22 04:16:01,315 - DEBUG - Requesting: http://10.0.0.19:8082/bgp-as-a-service/09fc7030-aa39-458f-b626-ddd9cc6a967e
2026-06-22 04:16:01,323 - DEBUG - Response Code: 404
2026-06-22 04:16:01,323 - DEBUG - BGPaaS: 09fc7030-aa39-458f-b626-ddd9cc6a967e deleted from api server
2026-06-22 04:16:01,323 - INFO - BGPaaS(09fc7030-aa39-458f-b626-ddd9cc6a967e): verify_on_cleanup passed
2026-06-22 04:16:01,323 - INFO - Deleting Control node zone ctest-test-zone-69124979(4cadb28c-971e-4dc9-a778-bf0fc8ad894c)
2026-06-22 04:16:01,488 - INFO - Deleting Control node zone ctest-test-zone-18775925(45ce7c38-1df7-4031-a211-2d7174307355)
2026-06-22 04:16:01,630 - INFO - Deleting Control node zone ctest-test-zone-78015912(33f51203-aebd-4756-b8e8-e55b13ab0852)
2026-06-22 04:16:01,776 - INFO - Deleting VM ctest-TestBGPaasZone-37519611-40711216
2026-06-22 04:16:01,853 - INFO - Deleting VM ctest-TestBGPaasZone-37519611-74672135
2026-06-22 04:16:01,926 - INFO - Deleting VM ctest-TestBGPaasZone-37519611-00519558
2026-06-22 04:16:02,000 - INFO - Deleting VN ctest-cnz_vn-07614893
2026-06-22 04:16:02,045 - DEBUG - VN e373933f-6242-43cf-b985-d805f0bfdcc8 still in use: Unable to complete operation on network e373933f-6242-43cf-b985-d805f0bfdcc8. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-e6e1be6c-941c-4924-aa82-971de59be2c6']
2026-06-22 04:16:02,045 - WARNING - Deleting VN ctest-cnz_vn-07614893 failed..Will retry
2026-06-22 04:16:04,098 - DEBUG - VN e373933f-6242-43cf-b985-d805f0bfdcc8 still in use: Unable to complete operation on network e373933f-6242-43cf-b985-d805f0bfdcc8. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-0d0c2367-3531-4901-b398-9733d967f8f0']
2026-06-22 04:16:04,098 - WARNING - Deleting VN ctest-cnz_vn-07614893 failed..Will retry
2026-06-22 04:16:06,290 - DEBUG - Response for deleting network ()
2026-06-22 04:16:07,535 - DEBUG - Skipping xmpp flap check
2026-06-22 04:16:07,535 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:02:17]
2026-06-22 04:16:07,535 - INFO - --------------------------------------------------------------------------------
2026-06-22 04:16:08,343 - INFO - Deleted project: ctest-TestBGPaasZone-37519611, ID : e0cf0185-0ba7-46bd-887d-96a464ae81b4