is in ACTIVE state now
2025-10-31 16:38:28,785 - INFO - VM name : ctest-TestBGPaasZone-37720055-54680098
2025-10-31 16:38:28,869 - DEBUG - VM ctest-TestBGPaasZone-37720055-54680098 ID is 3ad783ce-2e2e-4e06-ad83-8d81d0b5f7b7
2025-10-31 16:38:28,869 - DEBUG - VM ctest-TestBGPaasZone-37720055-54680098 launched on Node an-jenkins-deploy-platform-ansible-os-4577-2
2025-10-31 16:38:28,950 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/3ad783ce-2e2e-4e06-ad83-8d81d0b5f7b7
2025-10-31 16:38:28,961 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/3cc67357-cfdd-45ce-86de-a291d1d59cac
2025-10-31 16:38:30,132 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.20 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.610 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.610/2.403/4.197/1.793 ms')
2025-10-31 16:38:30,132 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBGPaasZone-37720055-54680098 passed
2025-10-31 16:38:30,199 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:38:30,199 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-37720055-54680098, IP 75.224.82.133, Port 22
2025-10-31 16:38:30,265 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-31 16:38:30,344 - DEBUG - VM ctest-TestBGPaasZone-37720055-54680098 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-31 16:38:35,345 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:38:35,345 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-37720055-54680098, IP 75.224.82.133, Port 22
2025-10-31 16:38:35,413 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-31 16:38:35,497 - DEBUG - VM ctest-TestBGPaasZone-37720055-54680098 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-31 16:38:40,498 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:38:40,498 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-37720055-54680098, IP 75.224.82.133, Port 22
2025-10-31 16:38:40,669 - DEBUG - VM ctest-TestBGPaasZone-37720055-54680098 is ready for SSH connections
2025-10-31 16:38:40,806 - INFO - Created control node zone ctest-test-zone-17178710(cab0c2e5-6704-4974-a834-243cbb600d5a)
2025-10-31 16:38:41,163 - INFO - Created control node zone ctest-test-zone-02098958(0d054fa2-61de-4d05-b224-0bbf9f0afc51)
2025-10-31 16:38:41,518 - INFO - Created control node zone ctest-test-zone-60291515(70f689c7-3cf2-4206-b597-0f2716aa027c)
2025-10-31 16:38:41,798 - INFO - Creating BGPaaS ctest-TestBGPaasZone-37720055-01852727
2025-10-31 16:38:41,878 - INFO - BGPaaS: ctest-TestBGPaasZone-37720055-01852727(abe5d9ad-5b43-4c56-a30b-f8f27342430a)
2025-10-31 16:38:41,879 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/abe5d9ad-5b43-4c56-a30b-f8f27342430a
2025-10-31 16:38:41,890 - INFO - verify_in_api_server passed for BGPaaS obj abe5d9ad-5b43-4c56-a30b-f8f27342430a
2025-10-31 16:38:41,890 - INFO - BGPaaS(abe5d9ad-5b43-4c56-a30b-f8f27342430a): verify_on_setup passed
2025-10-31 16:38:41,890 - INFO - We will configure BGP on the VM
2025-10-31 16:38:42,315 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:38:42,315 - INFO - Configuring BGP on ctest-TestBGPaasZone-37720055-34692812
2025-10-31 16:38:42,315 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 75.224.82.131;
protocol bgp bgp_1{
local as 65000;
neighbor 75.224.82.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 75.224.82.131;
}
protocol bfd {
neighbor 75.224.82.129 local 75.224.82.131 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2025-10-31 16:38:42,316 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 75.224.82.131;
protocol bgp bgp_1{
local as 65000;
neighbor 75.224.82.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 75.224.82.131;
}
protocol bfd {
neighbor 75.224.82.129 local 75.224.82.131 multihop on;
}
EOS
2025-10-31 16:38:58,257 - DEBUG - None
2025-10-31 16:38:58,258 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 75.224.82.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 75.224.82.131;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2025-10-31 16:38:58,258 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 75.224.82.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 75.224.82.131;
}
EOS
2025-10-31 16:38:59,692 - DEBUG - None
2025-10-31 16:38:59,692 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2025-10-31 16:38:59,692 - DEBUG - service bird restart
2025-10-31 16:39:02,225 - DEBUG - bird stop/waiting
bird start/running, process 1434
2025-10-31 16:39:02,225 - INFO - Attaching VMI ae37d647-f8e5-4da0-a9f0-3c62def6eb11 to BGPaaS abe5d9ad-5b43-4c56-a30b-f8f27342430a
2025-10-31 16:39:02,298 - INFO - Attaching the VMI 8b7a8daa-d4d9-4208-9cba-26a6d3fd901a to the BGPaaS abe5d9ad-5b43-4c56-a30b-f8f27342430a object
2025-10-31 16:39:02,299 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 75.224.82.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2025-10-31 16:39:02,299 - DEBUG - sudo ip addr add 75.224.82.148 dev eth0
2025-10-31 16:39:03,379 - DEBUG - None
2025-10-31 16:39:03,442 - INFO - Creating BGPaaS ctest-TestBGPaasZone-37720055-16187002
2025-10-31 16:39:03,522 - INFO - BGPaaS: ctest-TestBGPaasZone-37720055-16187002(88e2efb5-46cb-4920-a78f-d8dd2e978964)
2025-10-31 16:39:03,523 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/88e2efb5-46cb-4920-a78f-d8dd2e978964
2025-10-31 16:39:03,532 - INFO - verify_in_api_server passed for BGPaaS obj 88e2efb5-46cb-4920-a78f-d8dd2e978964
2025-10-31 16:39:03,532 - INFO - BGPaaS(88e2efb5-46cb-4920-a78f-d8dd2e978964): verify_on_setup passed
2025-10-31 16:39:03,532 - INFO - We will configure BGP on the VM
2025-10-31 16:39:03,954 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:39:03,954 - INFO - Configuring BGP on ctest-TestBGPaasZone-37720055-83410891
2025-10-31 16:39:03,955 - DEBUG - Running remote_cmd, Cmd : cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 75.224.82.132;
protocol bgp bgp_1{
local as 65000;
neighbor 75.224.82.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 75.224.82.132;
}
protocol bfd {
neighbor 75.224.82.129 local 75.224.82.132 multihop on;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2025-10-31 16:39:03,955 - DEBUG - cat > /etc/bird/bird.conf << EOS
protocol device {
scan time 10; # Scan interfaces every 10 seconds
}
protocol kernel {
persist; # Don't remove routes on bird shutdown
scan time 20; # Scan kernel routing table every 20 seconds
import all; # Default is import all
#export all; # Default is export none
}
protocol direct {
interface "eth*";
}
router id 75.224.82.132;
protocol bgp bgp_1{
local as 65000;
neighbor 75.224.82.129 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 75.224.82.132;
}
protocol bfd {
neighbor 75.224.82.129 local 75.224.82.132 multihop on;
}
EOS
2025-10-31 16:39:08,801 - DEBUG - None
2025-10-31 16:39:08,801 - DEBUG - Running remote_cmd, Cmd : cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 75.224.82.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 75.224.82.132;
}
EOS
, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2025-10-31 16:39:08,801 - DEBUG - cat >> /etc/bird/bird.conf << EOS
protocol bgp bgp_2{
local as 65000;
neighbor 75.224.82.130 as 64512;
export where source = RTS_STATIC;
export all;
multihop;
#export all;
hold time 90;
bfd on;
source address 75.224.82.132;
}
EOS
2025-10-31 16:39:09,272 - DEBUG - None
2025-10-31 16:39:09,272 - DEBUG - Running remote_cmd, Cmd : service bird restart, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2025-10-31 16:39:09,272 - DEBUG - service bird restart
2025-10-31 16:39:10,787 - DEBUG - bird stop/waiting
bird start/running, process 1483
2025-10-31 16:39:10,788 - INFO - Attaching VMI 5e3d8b37-a154-4279-975d-99286b8b874f to BGPaaS 88e2efb5-46cb-4920-a78f-d8dd2e978964
2025-10-31 16:39:10,862 - INFO - Attaching the VMI 0685afbf-55b9-4078-9fd9-04e675790c4a to the BGPaaS 88e2efb5-46cb-4920-a78f-d8dd2e978964 object
2025-10-31 16:39:10,863 - DEBUG - Running remote_cmd, Cmd : sudo ip addr add 75.224.82.148 dev eth0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2025-10-31 16:39:10,863 - DEBUG - sudo ip addr add 75.224.82.148 dev eth0
2025-10-31 16:39:11,467 - DEBUG - None
2025-10-31 16:39:11,467 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:39:11,467 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-31 16:39:11,479 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-10-31 16:39:11,479 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:39:11,501 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-10-31 16:39:11,507 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:39:11,507 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-31 16:39:11,522 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14']
2025-10-31 16:39:17,524 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-31 16:39:17,537 - ERROR - Not enough BGPaaS sessions seen in control-nodes ['10.20.0.14']
2025-10-31 16:39:23,538 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-31 16:39:23,549 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-10-31 16:39:23,550 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:39:23,569 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-10-31 16:39:23,575 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 75.224.82.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2025-10-31 16:39:23,576 - DEBUG - ping -s 56 -c 3 -W 1 75.224.82.148
2025-10-31 16:39:30,454 - DEBUG - PING 75.224.82.148 (75.224.82.148) 56(84) bytes of data.
64 bytes from 75.224.82.148: icmp_seq=1 ttl=64 time=10.0 ms
64 bytes from 75.224.82.148: icmp_seq=2 ttl=64 time=1.56 ms
64 bytes from 75.224.82.148: icmp_seq=3 ttl=64 time=1.68 ms
--- 75.224.82.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.568/4.440/10.074/3.984 ms
2025-10-31 16:39:30,454 - INFO - Ping to IP 75.224.82.148 from VM ctest-TestBGPaasZone-37720055-54680098 passed
2025-10-31 16:39:30,454 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:39:30,455 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-31 16:39:30,478 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-10-31 16:39:30,479 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:39:30,500 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-10-31 16:39:30,506 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:39:30,507 - DEBUG - Requesting: http://10.20.0.14:8083/Snh_BgpNeighborReq?domain=&ip_address=
2025-10-31 16:39:30,517 - INFO - BGPaaS session seen in control-node 10.20.0.14
2025-10-31 16:39:30,517 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-31 16:39:30,538 - INFO - BGPaaS session seen in control-node 10.20.0.25
2025-10-31 16:39:30,544 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 75.224.82.148, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2025-10-31 16:39:30,544 - DEBUG - ping -s 56 -c 3 -W 1 75.224.82.148
2025-10-31 16:39:33,156 - DEBUG - PING 75.224.82.148 (75.224.82.148) 56(84) bytes of data.
64 bytes from 75.224.82.148: icmp_seq=1 ttl=64 time=3.03 ms
64 bytes from 75.224.82.148: icmp_seq=2 ttl=64 time=1.69 ms
64 bytes from 75.224.82.148: icmp_seq=3 ttl=64 time=1.62 ms
--- 75.224.82.148 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.625/2.116/3.034/0.650 ms
2025-10-31 16:39:33,156 - INFO - Ping to IP 75.224.82.148 from VM ctest-TestBGPaasZone-37720055-54680098 passed
2025-10-31 16:39:33,157 - INFO - Detaching VMI 5e3d8b37-a154-4279-975d-99286b8b874f from BGPaaS 88e2efb5-46cb-4920-a78f-d8dd2e978964
2025-10-31 16:39:33,234 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-37720055-16187002(88e2efb5-46cb-4920-a78f-d8dd2e978964)
2025-10-31 16:39:33,341 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/88e2efb5-46cb-4920-a78f-d8dd2e978964
2025-10-31 16:39:33,458 - DEBUG - Response Code: 404
2025-10-31 16:39:33,458 - DEBUG - BGPaaS: 88e2efb5-46cb-4920-a78f-d8dd2e978964 deleted from api server
2025-10-31 16:39:33,458 - INFO - BGPaaS(88e2efb5-46cb-4920-a78f-d8dd2e978964): verify_on_cleanup passed
2025-10-31 16:39:33,459 - INFO - Detaching VMI ae37d647-f8e5-4da0-a9f0-3c62def6eb11 from BGPaaS abe5d9ad-5b43-4c56-a30b-f8f27342430a
2025-10-31 16:39:33,538 - INFO - Deleting BGPaaS ctest-TestBGPaasZone-37720055-01852727(abe5d9ad-5b43-4c56-a30b-f8f27342430a)
2025-10-31 16:39:33,616 - DEBUG - Requesting: http://10.0.0.38:8082/bgp-as-a-service/abe5d9ad-5b43-4c56-a30b-f8f27342430a
2025-10-31 16:39:33,623 - DEBUG - Response Code: 404
2025-10-31 16:39:33,623 - DEBUG - BGPaaS: abe5d9ad-5b43-4c56-a30b-f8f27342430a deleted from api server
2025-10-31 16:39:33,623 - INFO - BGPaaS(abe5d9ad-5b43-4c56-a30b-f8f27342430a): verify_on_cleanup passed
2025-10-31 16:39:33,624 - INFO - Deleting Control node zone ctest-test-zone-60291515(70f689c7-3cf2-4206-b597-0f2716aa027c)
2025-10-31 16:39:33,795 - INFO - Deleting Control node zone ctest-test-zone-02098958(0d054fa2-61de-4d05-b224-0bbf9f0afc51)
2025-10-31 16:39:33,953 - INFO - Deleting Control node zone ctest-test-zone-17178710(cab0c2e5-6704-4974-a834-243cbb600d5a)
2025-10-31 16:39:34,101 - INFO - Deleting VM ctest-TestBGPaasZone-37720055-54680098
2025-10-31 16:39:34,174 - INFO - Deleting VM ctest-TestBGPaasZone-37720055-83410891
2025-10-31 16:39:34,239 - INFO - Deleting VM ctest-TestBGPaasZone-37720055-34692812
2025-10-31 16:39:34,313 - INFO - Deleting VN ctest-cnz_vn-96860556
2025-10-31 16:39:34,356 - DEBUG - VN 286b0a07-f1e2-4211-8bb9-246c0d524b99 still in use: Unable to complete operation on network 286b0a07-f1e2-4211-8bb9-246c0d524b99. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-e4270f22-dc22-4f75-a9d0-8c07b957daee']
2025-10-31 16:39:34,356 - WARNING - Deleting VN ctest-cnz_vn-96860556 failed..Will retry
2025-10-31 16:39:36,552 - DEBUG - Response for deleting network ()
2025-10-31 16:39:37,827 - DEBUG - Skipping xmpp flap check
2025-10-31 16:39:37,827 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : PASSED[0:03:49]
2025-10-31 16:39:37,827 - INFO - --------------------------------------------------------------------------------
2025-10-31 16:39:38,563 - INFO - Deleted project: ctest-TestBGPaasZone-37720055, ID : 58378888-c93a-4ffd-a2d4-0445c0ef954c