2025-10-08 14:58:25,819 - INFO - Domain Default found not creating 2025-10-08 14:58:25,987 - INFO - Project ctest-AnalyticsTestSanityWithResource-46419938 not found, creating it 2025-10-08 14:58:26,554 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-46419938, ID : 89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 14:58:28,689 - DEBUG - Response for create_network : {'network': {'id': '9e6f9390-2754-45e9-b1fa-48592195375e', 'name': 'ctest-vn1-00720843', 'tenant_id': '89d996e7aa19429aa46ca7a1404c7655', 'project_id': '89d996e7aa19429aa46ca7a1404c7655', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-46419938', 'ctest-vn1-00720843'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 14:58:29,009 - DEBUG - Response for create_subnet : {'subnet': {'id': '2fb591a5-d7c2-4251-9d28-2e218a824181', 'name': '', 'tenant_id': '89d996e7aa19429aa46ca7a1404c7655', 'network_id': '9e6f9390-2754-45e9-b1fa-48592195375e', 'ip_version': 4, 'cidr': '50.152.19.128/26', 'allocation_pools': [{'start': '50.152.19.130', 'end': '50.152.19.190'}], 'gateway_ip': '50.152.19.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '50.152.19.130', 'tags': [], 'project_id': '89d996e7aa19429aa46ca7a1404c7655'}} 2025-10-08 14:58:29,032 - INFO - Created VN ctest-vn1-00720843 2025-10-08 14:58:29,044 - DEBUG - VN ctest-vn1-00720843 UUID is 9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:58:29,145 - DEBUG - Services list from nova: [, , , ] 2025-10-08 14:58:29,145 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4234-2', 'an-jenkins-deploy-platform-ansible-os-4234-1']} 2025-10-08 14:58:30,180 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4234-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4234-2) 2025-10-08 14:58:31,730 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4234-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4234-2) 2025-10-08 14:58:31,730 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 14:58:32,043 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 14:58:32,076 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 14:58:32,110 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 14:58:32,202 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:58:32,246 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:58:32,261 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 14:58:32,274 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 14:58:32,289 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/584e6cfc-ad7a-43fb-bb20-ec0578fb5602 2025-10-08 14:58:32,297 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 14:58:32,297 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:58:32,306 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 14:58:32,329 - INFO - Verified VN network id 14 for VN 9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:58:32,329 - INFO - Verifications in API Server for VN ctest-vn1-00720843 passed 2025-10-08 14:58:32,329 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:58:32,353 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 14:58:32,366 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 14:58:32,376 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/584e6cfc-ad7a-43fb-bb20-ec0578fb5602 2025-10-08 14:58:32,389 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T14:58:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.439926'} 2025-10-08 14:58:32,395 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 14:58:32,400 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T14:58:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.457341'} 2025-10-08 14:58:32,417 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 14:58:32,427 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T14:58:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.493791'} 2025-10-08 14:58:32,449 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 14:58:32,450 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-00720843 passed 2025-10-08 14:58:32,451 - DEBUG - ====Verifying policy data for ctest-vn1-00720843 in API_Server ====== 2025-10-08 14:58:32,451 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 14:58:32,465 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 14:58:32,494 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 14:58:32,659 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:58:32,673 - DEBUG - =>VN ctest-vn1-00720843 has no policy to be verified 2025-10-08 14:58:32,673 - DEBUG - Verifying the vn in opserver 2025-10-08 14:58:32,673 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.33 2025-10-08 14:58:32,673 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-08 14:58:32,995 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-08 14:58:33,049 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 14:58:33,049 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.19 2025-10-08 14:58:33,049 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-08 14:58:33,341 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-08 14:58:33,393 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 14:58:33,393 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.129 2025-10-08 14:58:33,393 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2025-10-08 14:58:33,694 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2025-10-08 14:58:33,750 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 14:58:33,750 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 is found in opserver 2025-10-08 14:58:33,767 - DEBUG - VRF ids for VN ctest-vn1-00720843: {'10.0.0.131': '2'} 2025-10-08 14:58:33,767 - INFO - Waiting for VM ctest-vn1_vm1-10042171 to be up.. 2025-10-08 14:58:33,859 - DEBUG - VM is in ACTIVE state now 2025-10-08 14:58:33,859 - INFO - VM name : ctest-vn1_vm1-10042171 2025-10-08 14:58:33,933 - DEBUG - VM ctest-vn1_vm1-10042171 ID is 92232385-bdd3-499f-8ba8-58f26a6e118c 2025-10-08 14:58:33,960 - DEBUG - VM ctest-vn1_vm1-10042171 launched on Node an-jenkins-deploy-platform-ansible-os-4234-2 2025-10-08 14:58:34,041 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/92232385-bdd3-499f-8ba8-58f26a6e118c 2025-10-08 14:58:34,347 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/92232385-bdd3-499f-8ba8-58f26a6e118c 2025-10-08 14:58:34,379 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/35181cbc-2909-4c0c-a4ec-9f95623a2e86 2025-10-08 14:58:37,559 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-08 14:58:37,559 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-10042171 failed! 2025-10-08 14:58:37,574 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 is 50.152.19.129 and allocation pool is NOT set 2025-10-08 14:58:41,659 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-10-08 14:58:41,659 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-10042171 failed! 2025-10-08 14:58:41,673 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 is 50.152.19.129 and allocation pool is NOT set 2025-10-08 14:58:45,759 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-10-08 14:58:45,759 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-10042171 failed! 2025-10-08 14:58:45,773 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 is 50.152.19.129 and allocation pool is NOT set 2025-10-08 14:58:49,859 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-08 14:58:49,860 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-10042171 failed! 2025-10-08 14:58:49,876 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 is 50.152.19.129 and allocation pool is NOT set 2025-10-08 14:58:53,948 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-10-08 14:58:53,948 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-10042171 failed! 2025-10-08 14:58:53,960 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 is 50.152.19.129 and allocation pool is NOT set 2025-10-08 14:58:56,022 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.65 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.11 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.106/4.377/5.649/1.271 ms') 2025-10-08 14:58:56,022 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-10042171 passed 2025-10-08 14:58:56,089 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 14:58:56,089 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-10042171, IP 50.152.19.131, Port 22 2025-10-08 14:58:56,155 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 14:58:56,234 - DEBUG - VM ctest-vn1_vm1-10042171 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 14:59:01,235 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 14:59:01,235 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-10042171, IP 50.152.19.131, Port 22 2025-10-08 14:59:01,293 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 14:59:01,371 - DEBUG - VM ctest-vn1_vm1-10042171 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 14:59:06,371 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 14:59:06,372 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-10042171, IP 50.152.19.131, Port 22 2025-10-08 14:59:06,439 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 14:59:06,517 - DEBUG - VM ctest-vn1_vm1-10042171 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 14:59:11,519 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 14:59:11,519 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-10042171, IP 50.152.19.131, Port 22 2025-10-08 14:59:11,577 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 14:59:11,651 - DEBUG - VM ctest-vn1_vm1-10042171 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 14:59:16,652 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 14:59:16,652 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-10042171, IP 50.152.19.131, Port 22 2025-10-08 14:59:16,824 - DEBUG - VM ctest-vn1_vm1-10042171 is ready for SSH connections 2025-10-08 14:59:16,824 - INFO - Waiting for VM ctest-vn1_vm2-25500360 to be up.. 2025-10-08 14:59:16,899 - DEBUG - VM is in ACTIVE state now 2025-10-08 14:59:16,899 - INFO - VM name : ctest-vn1_vm2-25500360 2025-10-08 14:59:16,975 - DEBUG - VM ctest-vn1_vm2-25500360 ID is 87b05548-cd89-4f9f-a462-d67e60316999 2025-10-08 14:59:16,976 - DEBUG - VM ctest-vn1_vm2-25500360 launched on Node an-jenkins-deploy-platform-ansible-os-4234-2 2025-10-08 14:59:17,048 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/87b05548-cd89-4f9f-a462-d67e60316999 2025-10-08 14:59:17,058 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/a40837e8-a634-41e5-94e9-508397af8a8c 2025-10-08 14:59:18,215 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=1.85 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.456 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.456/1.151/1.846/0.695 ms') 2025-10-08 14:59:18,215 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn1_vm2-25500360 passed 2025-10-08 14:59:18,286 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 14:59:18,286 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-25500360, IP 50.152.19.132, Port 22 2025-10-08 14:59:18,455 - DEBUG - VM ctest-vn1_vm2-25500360 is ready for SSH connections 2025-10-08 14:59:18,748 - DEBUG - Response for create_network : {'network': {'id': 'df3341ce-0057-4e1f-9b26-a723377fa0ba', 'name': 'ctest-vn2-57623849', 'tenant_id': '89d996e7aa19429aa46ca7a1404c7655', 'project_id': '89d996e7aa19429aa46ca7a1404c7655', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-46419938', 'ctest-vn2-57623849'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 14:59:18,947 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e4fc8de4-6df1-4a77-8737-22a09f50ce59', 'name': '', 'tenant_id': '89d996e7aa19429aa46ca7a1404c7655', 'network_id': 'df3341ce-0057-4e1f-9b26-a723377fa0ba', 'ip_version': 4, 'cidr': '126.80.86.0/26', 'allocation_pools': [{'start': '126.80.86.2', 'end': '126.80.86.62'}], 'gateway_ip': '126.80.86.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '126.80.86.2', 'tags': [], 'project_id': '89d996e7aa19429aa46ca7a1404c7655'}} 2025-10-08 14:59:18,967 - INFO - Created VN ctest-vn2-57623849 2025-10-08 14:59:18,980 - DEBUG - VN ctest-vn2-57623849 UUID is df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 14:59:19,312 - DEBUG - Response for create_network : {'network': {'id': '46a4c759-059e-496e-a02b-41c7c59f4fb6', 'name': 'ctest-fip_vn-50310290', 'tenant_id': '89d996e7aa19429aa46ca7a1404c7655', 'project_id': '89d996e7aa19429aa46ca7a1404c7655', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-46419938', 'ctest-fip_vn-50310290'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 14:59:19,551 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f43af4cb-46b0-4d9c-ba8a-b156c3c8cf4e', 'name': '', 'tenant_id': '89d996e7aa19429aa46ca7a1404c7655', 'network_id': '46a4c759-059e-496e-a02b-41c7c59f4fb6', 'ip_version': 4, 'cidr': '27.46.213.0/26', 'allocation_pools': [{'start': '27.46.213.2', 'end': '27.46.213.62'}], 'gateway_ip': '27.46.213.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '27.46.213.2', 'tags': [], 'project_id': '89d996e7aa19429aa46ca7a1404c7655'}} 2025-10-08 14:59:19,572 - INFO - Created VN ctest-fip_vn-50310290 2025-10-08 14:59:19,582 - DEBUG - VN ctest-fip_vn-50310290 UUID is 46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 14:59:19,645 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4234-2', 'an-jenkins-deploy-platform-ansible-os-4234-1']} 2025-10-08 14:59:20,808 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4234-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4234-1) 2025-10-08 14:59:22,073 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4234-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4234-1) 2025-10-08 14:59:23,415 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4234-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4234-2) 2025-10-08 14:59:23,415 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 14:59:23,430 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 14:59:23,465 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 14:59:23,550 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:59:23,574 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:59:23,583 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 14:59:23,591 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 14:59:23,599 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/584e6cfc-ad7a-43fb-bb20-ec0578fb5602 2025-10-08 14:59:23,605 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 14:59:23,605 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:59:23,623 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 14:59:23,637 - INFO - Verified VN network id 14 for VN 9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:59:23,637 - INFO - Verifications in API Server for VN ctest-vn1-00720843 passed 2025-10-08 14:59:23,638 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:59:23,655 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 14:59:23,665 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 14:59:23,675 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/584e6cfc-ad7a-43fb-bb20-ec0578fb5602 2025-10-08 14:59:23,689 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T14:58:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:54.739569'} 2025-10-08 14:59:23,694 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 14:59:23,701 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T14:58:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:54.757382'} 2025-10-08 14:59:23,708 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 14:59:23,714 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T14:58:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:54.783003'} 2025-10-08 14:59:23,720 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 14:59:23,721 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-00720843 passed 2025-10-08 14:59:23,722 - DEBUG - ====Verifying policy data for ctest-vn1-00720843 in API_Server ====== 2025-10-08 14:59:23,722 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 14:59:23,727 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 14:59:23,741 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 14:59:23,847 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 14:59:23,859 - DEBUG - =>VN ctest-vn1-00720843 has no policy to be verified 2025-10-08 14:59:23,859 - DEBUG - Verifying the vn in opserver 2025-10-08 14:59:23,860 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.33 2025-10-08 14:59:23,860 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-08 14:59:23,962 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 14:59:23,962 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.19 2025-10-08 14:59:23,962 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-08 14:59:24,083 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 14:59:24,083 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.129 2025-10-08 14:59:24,083 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2025-10-08 14:59:24,156 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 14:59:24,156 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 is found in opserver 2025-10-08 14:59:24,182 - DEBUG - VRF ids for VN ctest-vn1-00720843: {'10.0.0.131': '2'} 2025-10-08 14:59:24,182 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 14:59:24,188 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 14:59:24,204 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 14:59:24,328 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 14:59:24,376 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 14:59:24,386 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 14:59:24,394 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 14:59:24,401 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/35ebd8b4-9c8e-4ce0-8a10-ec2125454476 2025-10-08 14:59:24,426 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 14:59:24,427 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 14:59:24,442 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 14:59:24,467 - INFO - Verified VN network id 15 for VN df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 14:59:24,467 - INFO - Verifications in API Server for VN ctest-vn2-57623849 passed 2025-10-08 14:59:24,467 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 14:59:24,478 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 14:59:24,487 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 14:59:24,496 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/35ebd8b4-9c8e-4ce0-8a10-ec2125454476 2025-10-08 14:59:24,511 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16083271047294963231', 'uuid-lslong': '11179806894690640058'}, 'enable': 'true', 'created': '2025-10-08T14:59:18', 'last-modified': '2025-10-08T14:59:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.624646'} 2025-10-08 14:59:24,517 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 14:59:24,524 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16083271047294963231', 'uuid-lslong': '11179806894690640058'}, 'enable': 'true', 'created': '2025-10-08T14:59:18', 'last-modified': '2025-10-08T14:59:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.632803'} 2025-10-08 14:59:24,531 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 14:59:24,536 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16083271047294963231', 'uuid-lslong': '11179806894690640058'}, 'enable': 'true', 'created': '2025-10-08T14:59:18', 'last-modified': '2025-10-08T14:59:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.647358'} 2025-10-08 14:59:24,542 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 14:59:24,542 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-57623849 passed 2025-10-08 14:59:24,542 - DEBUG - ====Verifying policy data for ctest-vn2-57623849 in API_Server ====== 2025-10-08 14:59:24,542 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 14:59:24,548 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 14:59:24,557 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 14:59:24,671 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 14:59:24,691 - DEBUG - =>VN ctest-vn2-57623849 has no policy to be verified 2025-10-08 14:59:24,691 - DEBUG - Verifying the vn in opserver 2025-10-08 14:59:24,691 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 virtual network link through opserver 10.0.0.33 2025-10-08 14:59:24,691 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-08 14:59:24,706 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849?flat'} 2025-10-08 14:59:24,706 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 virtual network link through opserver 10.0.0.19 2025-10-08 14:59:24,706 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-08 14:59:24,722 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849?flat'} 2025-10-08 14:59:24,722 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 virtual network link through opserver 10.0.0.129 2025-10-08 14:59:24,722 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2025-10-08 14:59:24,802 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849?flat'} 2025-10-08 14:59:24,802 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 is found in opserver 2025-10-08 14:59:24,820 - DEBUG - VRF ids for VN ctest-vn2-57623849: {'10.0.0.130': '2'} 2025-10-08 14:59:24,820 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 14:59:24,834 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 14:59:24,847 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 14:59:24,950 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 14:59:24,963 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 14:59:24,973 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/551f1498-eee3-4e98-a575-fbbed5ac8937 2025-10-08 14:59:24,981 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/551f1498-eee3-4e98-a575-fbbed5ac8937 2025-10-08 14:59:24,987 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/7c052689-7c5c-484f-9c18-6e7be39ad93d 2025-10-08 14:59:24,994 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 14:59:24,994 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 14:59:25,002 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/551f1498-eee3-4e98-a575-fbbed5ac8937 2025-10-08 14:59:25,016 - INFO - Verified VN network id 16 for VN 46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 14:59:25,016 - INFO - Verifications in API Server for VN ctest-fip_vn-50310290 passed 2025-10-08 14:59:25,016 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 14:59:25,025 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/551f1498-eee3-4e98-a575-fbbed5ac8937 2025-10-08 14:59:25,031 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/551f1498-eee3-4e98-a575-fbbed5ac8937 2025-10-08 14:59:25,038 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/7c052689-7c5c-484f-9c18-6e7be39ad93d 2025-10-08 14:59:25,050 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5090412663995779438', 'uuid-lslong': '11541390796336877494'}, 'enable': 'true', 'created': '2025-10-08T14:59:19', 'last-modified': '2025-10-08T14:59:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.566637'} 2025-10-08 14:59:25,055 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 14:59:25,060 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5090412663995779438', 'uuid-lslong': '11541390796336877494'}, 'enable': 'true', 'created': '2025-10-08T14:59:19', 'last-modified': '2025-10-08T14:59:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.578630'} 2025-10-08 14:59:25,067 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 14:59:25,072 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5090412663995779438', 'uuid-lslong': '11541390796336877494'}, 'enable': 'true', 'created': '2025-10-08T14:59:19', 'last-modified': '2025-10-08T14:59:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.588791'} 2025-10-08 14:59:25,078 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 14:59:25,078 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-50310290 passed 2025-10-08 14:59:25,078 - DEBUG - ====Verifying policy data for ctest-fip_vn-50310290 in API_Server ====== 2025-10-08 14:59:25,078 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 14:59:25,084 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 14:59:25,118 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 14:59:25,228 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 14:59:25,239 - DEBUG - =>VN ctest-fip_vn-50310290 has no policy to be verified 2025-10-08 14:59:25,239 - DEBUG - Verifying the vn in opserver 2025-10-08 14:59:25,239 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 virtual network link through opserver 10.0.0.33 2025-10-08 14:59:25,239 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-08 14:59:25,294 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290?flat'} 2025-10-08 14:59:25,294 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 virtual network link through opserver 10.0.0.19 2025-10-08 14:59:25,294 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-08 14:59:25,355 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290?flat'} 2025-10-08 14:59:25,355 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 virtual network link through opserver 10.0.0.129 2025-10-08 14:59:25,355 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2025-10-08 14:59:25,368 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290?flat'} 2025-10-08 14:59:25,368 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 is found in opserver 2025-10-08 14:59:25,386 - DEBUG - VRF ids for VN ctest-fip_vn-50310290: {'10.0.0.130': '3'} 2025-10-08 14:59:25,386 - INFO - Waiting for VM ctest-fvn_vm1-50281161 to be up.. 2025-10-08 14:59:25,457 - DEBUG - VM is in ACTIVE state now 2025-10-08 14:59:25,457 - INFO - VM name : ctest-fvn_vm1-50281161 2025-10-08 14:59:25,529 - DEBUG - VM ctest-fvn_vm1-50281161 ID is d5475054-d4e7-429a-b4fd-8b5a1cded8f4 2025-10-08 14:59:25,529 - DEBUG - VM ctest-fvn_vm1-50281161 launched on Node an-jenkins-deploy-platform-ansible-os-4234-1 2025-10-08 14:59:25,609 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/d5475054-d4e7-429a-b4fd-8b5a1cded8f4 2025-10-08 14:59:25,619 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/c409ad71-4008-4c66-9648-448d6de63e38 2025-10-08 14:59:28,826 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-10-08 14:59:28,826 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-50281161 failed! 2025-10-08 14:59:28,842 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 is 27.46.213.1 and allocation pool is NOT set 2025-10-08 14:59:32,918 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-10-08 14:59:32,918 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-50281161 failed! 2025-10-08 14:59:32,935 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 is 27.46.213.1 and allocation pool is NOT set 2025-10-08 14:59:37,014 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-10-08 14:59:37,014 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-50281161 failed! 2025-10-08 14:59:37,028 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 is 27.46.213.1 and allocation pool is NOT set 2025-10-08 14:59:41,107 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-10-08 14:59:41,107 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-50281161 failed! 2025-10-08 14:59:41,121 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 is 27.46.213.1 and allocation pool is NOT set 2025-10-08 14:59:45,202 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-10-08 14:59:45,202 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-50281161 failed! 2025-10-08 14:59:45,219 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 is 27.46.213.1 and allocation pool is NOT set 2025-10-08 14:59:49,302 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-10-08 14:59:49,302 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-50281161 failed! 2025-10-08 14:59:49,315 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 is 27.46.213.1 and allocation pool is NOT set 2025-10-08 14:59:51,390 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=5.54 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=3.91 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.909/4.726/5.543/0.817 ms') 2025-10-08 14:59:51,390 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-50281161 passed 2025-10-08 14:59:51,461 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 14:59:51,461 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-50281161, IP 27.46.213.3, Port 22 2025-10-08 14:59:51,528 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 14:59:51,607 - DEBUG - VM ctest-fvn_vm1-50281161 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 14:59:56,608 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 14:59:56,608 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-50281161, IP 27.46.213.3, Port 22 2025-10-08 14:59:56,677 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 14:59:56,776 - DEBUG - VM ctest-fvn_vm1-50281161 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:00:01,777 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:00:01,777 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-50281161, IP 27.46.213.3, Port 22 2025-10-08 15:00:01,846 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-08 15:00:01,940 - DEBUG - VM ctest-fvn_vm1-50281161 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-08 15:00:06,941 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:00:06,942 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-50281161, IP 27.46.213.3, Port 22 2025-10-08 15:00:07,117 - DEBUG - VM ctest-fvn_vm1-50281161 is ready for SSH connections 2025-10-08 15:00:07,117 - INFO - Waiting for VM ctest-vn2_vm2-72611944 to be up.. 2025-10-08 15:00:07,198 - DEBUG - VM is in ACTIVE state now 2025-10-08 15:00:07,198 - INFO - VM name : ctest-vn2_vm2-72611944 2025-10-08 15:00:07,278 - DEBUG - VM ctest-vn2_vm2-72611944 ID is a041e613-9e3d-457b-9d4f-abe7d37c1314 2025-10-08 15:00:07,278 - DEBUG - VM ctest-vn2_vm2-72611944 launched on Node an-jenkins-deploy-platform-ansible-os-4234-1 2025-10-08 15:00:07,360 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/a041e613-9e3d-457b-9d4f-abe7d37c1314 2025-10-08 15:00:07,373 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/367ff8a7-5e0f-41ea-b3d4-2e5c944029eb 2025-10-08 15:00:08,542 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.42 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.521 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.521/1.968/3.415/1.447 ms') 2025-10-08 15:00:08,542 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2_vm2-72611944 passed 2025-10-08 15:00:08,613 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:00:08,613 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-72611944, IP 126.80.86.3, Port 22 2025-10-08 15:00:08,793 - DEBUG - VM ctest-vn2_vm2-72611944 is ready for SSH connections 2025-10-08 15:00:08,793 - INFO - Waiting for VM mltf_vm to be up.. 2025-10-08 15:00:08,894 - DEBUG - VM is in ACTIVE state now 2025-10-08 15:00:08,894 - INFO - VM name : mltf_vm 2025-10-08 15:00:08,985 - DEBUG - VM mltf_vm ID is c2e5c81b-64ee-48a9-b16e-9343cbcc90fd 2025-10-08 15:00:08,985 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-4234-2 2025-10-08 15:00:09,186 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/c2e5c81b-64ee-48a9-b16e-9343cbcc90fd 2025-10-08 15:00:09,197 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/3a225f6c-7cd8-4edc-9e19-3c4db7ff1ec9 2025-10-08 15:00:09,207 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/cc85f9e8-367e-4b04-820a-d9085bace25a 2025-10-08 15:00:10,386 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=1.71 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.551 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.551/1.130/1.709/0.579 ms') 2025-10-08 15:00:10,386 - INFO - Ping to Metadata IP 169.254.0.5 of VM mltf_vm passed 2025-10-08 15:00:10,459 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:00:10,459 - DEBUG - Waiting to SSH to VM mltf_vm, IP 50.152.19.133, Port 22 2025-10-08 15:00:10,631 - DEBUG - VM mltf_vm is ready for SSH connections 2025-10-08 15:00:10,702 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-08 15:00:10,702 - DEBUG - Waiting to SSH to VM mltf_vm, IP 50.152.19.133, Port 22 2025-10-08 15:00:10,867 - DEBUG - VM mltf_vm is ready for SSH connections 2025-10-08 15:00:10,869 - INFO - ================================================================================ 2025-10-08 15:00:10,869 - INFO - STARTING TEST : test_verify_session_sampling_teardown 2025-10-08 15:00:10,869 - INFO - TEST DESCRIPTION : 1.query client session samples 2.query server session samples 3.query client session to get number of sessions exported 4.query session record table for teardown bytes/pkts 5.query sample count after teardown on server side 2025-10-08 15:00:12,149 - DEBUG - Skipping xmpp flap check 2025-10-08 15:00:12,149 - INFO - Initial checks done. Running the testcase now 2025-10-08 15:00:12,149 - INFO - 2025-10-08 15:00:12,275 - INFO - Setting flow export rate: 100 2025-10-08 15:00:12,323 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-08 15:00:12,689 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '9e6f9390-2754-45e9-b1fa-48592195375e', 'name': 'ctest-vn1-00720843', 'tenant_id': '89d996e7aa19429aa46ca7a1404c7655', 'project_id': '89d996e7aa19429aa46ca7a1404c7655', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['2fb591a5-d7c2-4251-9d28-2e218a824181'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-46419938', 'ctest-vn1-00720843'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-46419938', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '50.152.19.128/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-10-08 15:00:12,947 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'df3341ce-0057-4e1f-9b26-a723377fa0ba', 'name': 'ctest-vn2-57623849', 'tenant_id': '89d996e7aa19429aa46ca7a1404c7655', 'project_id': '89d996e7aa19429aa46ca7a1404c7655', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['e4fc8de4-6df1-4a77-8737-22a09f50ce59'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-46419938', 'ctest-vn2-57623849'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-46419938', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '126.80.86.0/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-10-08 15:00:13,049 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:00:13,057 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:00:13,069 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:00:13,175 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:13,217 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:13,231 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 15:00:13,244 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 15:00:13,255 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/584e6cfc-ad7a-43fb-bb20-ec0578fb5602 2025-10-08 15:00:13,263 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 15:00:13,263 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:13,273 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 15:00:13,289 - INFO - Verified VN network id 14 for VN 9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:13,289 - INFO - Verifications in API Server for VN ctest-vn1-00720843 passed 2025-10-08 15:00:13,289 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:13,309 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 15:00:13,318 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 15:00:13,326 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/584e6cfc-ad7a-43fb-bb20-ec0578fb5602 2025-10-08 15:00:13,339 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.702029'} 2025-10-08 15:00:13,348 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 15:00:13,355 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.720211'} 2025-10-08 15:00:13,360 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 15:00:13,365 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.720910'} 2025-10-08 15:00:13,370 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 15:00:13,371 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-00720843 passed 2025-10-08 15:00:13,371 - DEBUG - ====Verifying policy data for ctest-vn1-00720843 in API_Server ====== 2025-10-08 15:00:13,371 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:00:13,378 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:00:13,389 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:00:13,475 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:13,485 - DEBUG - ==>Verifying data for policy with id: 8fff52a3-587b-434f-bba4-2829e4f84b67, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-46419938', 'policy1'] 2025-10-08 15:00:13,485 - INFO - VN ctest-vn1-00720843 Policy verification: verify_vn_policy_in_api_server, status: True 2025-10-08 15:00:13,486 - DEBUG - Verifying the vn in opserver 2025-10-08 15:00:13,486 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.33 2025-10-08 15:00:13,486 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-08 15:00:13,497 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 15:00:13,497 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.19 2025-10-08 15:00:13,497 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-08 15:00:13,511 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 15:00:13,511 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.129 2025-10-08 15:00:13,511 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2025-10-08 15:00:13,522 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 15:00:13,522 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 is found in opserver 2025-10-08 15:00:13,532 - DEBUG - VRF ids for VN ctest-vn1-00720843: {'10.0.0.131': '2'} 2025-10-08 15:00:13,532 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:00:13,537 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:00:13,564 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:00:13,660 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:13,677 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:13,688 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 15:00:13,700 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 15:00:13,708 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/35ebd8b4-9c8e-4ce0-8a10-ec2125454476 2025-10-08 15:00:13,715 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 15:00:13,715 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:13,727 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 15:00:13,744 - INFO - Verified VN network id 15 for VN df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:13,744 - INFO - Verifications in API Server for VN ctest-vn2-57623849 passed 2025-10-08 15:00:13,744 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:13,755 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 15:00:13,761 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 15:00:13,769 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/35ebd8b4-9c8e-4ce0-8a10-ec2125454476 2025-10-08 15:00:13,780 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16083271047294963231', 'uuid-lslong': '11179806894690640058'}, 'enable': 'true', 'created': '2025-10-08T14:59:18', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.880862'} 2025-10-08 15:00:13,789 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 15:00:13,797 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16083271047294963231', 'uuid-lslong': '11179806894690640058'}, 'enable': 'true', 'created': '2025-10-08T14:59:18', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.886503'} 2025-10-08 15:00:13,805 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 15:00:13,811 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16083271047294963231', 'uuid-lslong': '11179806894690640058'}, 'enable': 'true', 'created': '2025-10-08T14:59:18', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.903405'} 2025-10-08 15:00:13,816 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 15:00:13,816 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-57623849 passed 2025-10-08 15:00:13,817 - DEBUG - ====Verifying policy data for ctest-vn2-57623849 in API_Server ====== 2025-10-08 15:00:13,817 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:00:13,823 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:00:13,833 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:00:13,924 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:13,934 - DEBUG - ==>Verifying data for policy with id: 8fff52a3-587b-434f-bba4-2829e4f84b67, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-46419938', 'policy1'] 2025-10-08 15:00:13,934 - INFO - VN ctest-vn2-57623849 Policy verification: verify_vn_policy_in_api_server, status: True 2025-10-08 15:00:13,934 - DEBUG - Verifying the vn in opserver 2025-10-08 15:00:13,934 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 virtual network link through opserver 10.0.0.33 2025-10-08 15:00:13,934 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-08 15:00:13,946 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849?flat'} 2025-10-08 15:00:13,946 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 virtual network link through opserver 10.0.0.19 2025-10-08 15:00:13,947 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-08 15:00:13,961 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849?flat'} 2025-10-08 15:00:13,961 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 virtual network link through opserver 10.0.0.129 2025-10-08 15:00:13,961 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2025-10-08 15:00:13,975 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849?flat'} 2025-10-08 15:00:13,975 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 is found in opserver 2025-10-08 15:00:13,986 - DEBUG - VRF ids for VN ctest-vn2-57623849: {'10.0.0.130': '2', '10.0.0.131': '3'} 2025-10-08 15:00:13,986 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:00:13,995 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:00:14,009 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:00:14,117 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:14,128 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:14,143 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 15:00:14,151 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 15:00:14,159 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/584e6cfc-ad7a-43fb-bb20-ec0578fb5602 2025-10-08 15:00:14,166 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 15:00:14,166 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:14,177 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 15:00:14,195 - INFO - Verified VN network id 14 for VN 9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:14,195 - INFO - Verifications in API Server for VN ctest-vn1-00720843 passed 2025-10-08 15:00:14,195 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:14,212 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 15:00:14,220 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 15:00:14,230 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/584e6cfc-ad7a-43fb-bb20-ec0578fb5602 2025-10-08 15:00:14,251 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.611260'} 2025-10-08 15:00:14,257 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 15:00:14,264 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.628312'} 2025-10-08 15:00:14,270 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 15:00:14,276 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11416505827751904745', 'uuid-lslong': '12824642436543625054'}, 'enable': 'true', 'created': '2025-10-08T14:58:28', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.630804'} 2025-10-08 15:00:14,282 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 15:00:14,282 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-00720843 passed 2025-10-08 15:00:14,282 - DEBUG - ====Verifying policy data for ctest-vn1-00720843 in API_Server ====== 2025-10-08 15:00:14,282 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:00:14,288 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:00:14,306 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:00:14,405 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/9e6f9390-2754-45e9-b1fa-48592195375e 2025-10-08 15:00:14,416 - DEBUG - ==>Verifying data for policy with id: 8fff52a3-587b-434f-bba4-2829e4f84b67, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-46419938', 'policy1'] 2025-10-08 15:00:14,416 - INFO - VN ctest-vn1-00720843 Policy verification: verify_vn_policy_in_api_server, status: True 2025-10-08 15:00:14,416 - DEBUG - Verifying the vn in opserver 2025-10-08 15:00:14,417 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.33 2025-10-08 15:00:14,417 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-08 15:00:14,428 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 15:00:14,428 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.19 2025-10-08 15:00:14,428 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-08 15:00:14,442 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 15:00:14,442 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 virtual network link through opserver 10.0.0.129 2025-10-08 15:00:14,442 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2025-10-08 15:00:14,455 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843?flat'} 2025-10-08 15:00:14,455 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 is found in opserver 2025-10-08 15:00:14,467 - DEBUG - VRF ids for VN ctest-vn1-00720843: {'10.0.0.131': '2'} 2025-10-08 15:00:14,467 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:00:14,473 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:00:14,484 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:00:14,588 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:14,602 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:14,612 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 15:00:14,620 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 15:00:14,627 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/35ebd8b4-9c8e-4ce0-8a10-ec2125454476 2025-10-08 15:00:14,633 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 15:00:14,633 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:14,643 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 15:00:14,660 - INFO - Verified VN network id 15 for VN df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:14,660 - INFO - Verifications in API Server for VN ctest-vn2-57623849 passed 2025-10-08 15:00:14,660 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:14,671 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 15:00:14,678 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 15:00:14,687 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/35ebd8b4-9c8e-4ce0-8a10-ec2125454476 2025-10-08 15:00:14,711 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16083271047294963231', 'uuid-lslong': '11179806894690640058'}, 'enable': 'true', 'created': '2025-10-08T14:59:18', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.808785'} 2025-10-08 15:00:14,721 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 15:00:14,728 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16083271047294963231', 'uuid-lslong': '11179806894690640058'}, 'enable': 'true', 'created': '2025-10-08T14:59:18', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.819949'} 2025-10-08 15:00:14,734 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 15:00:14,739 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16083271047294963231', 'uuid-lslong': '11179806894690640058'}, 'enable': 'true', 'created': '2025-10-08T14:59:18', 'last-modified': '2025-10-08T15:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.831889'} 2025-10-08 15:00:14,747 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 15:00:14,747 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-57623849 passed 2025-10-08 15:00:14,747 - DEBUG - ====Verifying policy data for ctest-vn2-57623849 in API_Server ====== 2025-10-08 15:00:14,747 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:00:14,755 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:00:14,770 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:00:14,878 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/df3341ce-0057-4e1f-9b26-a723377fa0ba 2025-10-08 15:00:14,888 - DEBUG - ==>Verifying data for policy with id: 8fff52a3-587b-434f-bba4-2829e4f84b67, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-46419938', 'policy1'] 2025-10-08 15:00:14,888 - INFO - VN ctest-vn2-57623849 Policy verification: verify_vn_policy_in_api_server, status: True 2025-10-08 15:00:14,889 - DEBUG - Verifying the vn in opserver 2025-10-08 15:00:14,889 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 virtual network link through opserver 10.0.0.33 2025-10-08 15:00:14,889 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-08 15:00:14,902 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849?flat'} 2025-10-08 15:00:14,902 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 virtual network link through opserver 10.0.0.19 2025-10-08 15:00:14,902 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-08 15:00:14,916 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849?flat'} 2025-10-08 15:00:14,916 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 virtual network link through opserver 10.0.0.129 2025-10-08 15:00:14,916 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2025-10-08 15:00:14,928 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849?flat'} 2025-10-08 15:00:14,928 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 is found in opserver 2025-10-08 15:00:14,939 - DEBUG - VRF ids for VN ctest-vn2-57623849: {'10.0.0.130': '2', '10.0.0.131': '3'} 2025-10-08 15:00:14,939 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:00:14,945 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:00:14,956 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:00:15,044 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 15:00:15,055 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 15:00:15,064 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/551f1498-eee3-4e98-a575-fbbed5ac8937 2025-10-08 15:00:15,071 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/551f1498-eee3-4e98-a575-fbbed5ac8937 2025-10-08 15:00:15,079 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/7c052689-7c5c-484f-9c18-6e7be39ad93d 2025-10-08 15:00:15,085 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 15:00:15,085 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 15:00:15,093 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/551f1498-eee3-4e98-a575-fbbed5ac8937 2025-10-08 15:00:15,111 - INFO - Verified VN network id 16 for VN 46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 15:00:15,111 - INFO - Verifications in API Server for VN ctest-fip_vn-50310290 passed 2025-10-08 15:00:15,111 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 15:00:15,120 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/551f1498-eee3-4e98-a575-fbbed5ac8937 2025-10-08 15:00:15,127 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/551f1498-eee3-4e98-a575-fbbed5ac8937 2025-10-08 15:00:15,135 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/7c052689-7c5c-484f-9c18-6e7be39ad93d 2025-10-08 15:00:15,150 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5090412663995779438', 'uuid-lslong': '11541390796336877494'}, 'enable': 'true', 'created': '2025-10-08T14:59:19', 'last-modified': '2025-10-08T14:59:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:55.665623'} 2025-10-08 15:00:15,157 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 15:00:15,162 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5090412663995779438', 'uuid-lslong': '11541390796336877494'}, 'enable': 'true', 'created': '2025-10-08T14:59:19', 'last-modified': '2025-10-08T14:59:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:55.679862'} 2025-10-08 15:00:15,168 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 15:00:15,173 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-46419938', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5090412663995779438', 'uuid-lslong': '11541390796336877494'}, 'enable': 'true', 'created': '2025-10-08T14:59:19', 'last-modified': '2025-10-08T14:59:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:55.689617'} 2025-10-08 15:00:15,179 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 15:00:15,180 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-50310290 passed 2025-10-08 15:00:15,180 - DEBUG - ====Verifying policy data for ctest-fip_vn-50310290 in API_Server ====== 2025-10-08 15:00:15,180 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:00:15,186 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:00:15,198 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:00:15,297 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46a4c759-059e-496e-a02b-41c7c59f4fb6 2025-10-08 15:00:15,308 - DEBUG - =>VN ctest-fip_vn-50310290 has no policy to be verified 2025-10-08 15:00:15,308 - DEBUG - Verifying the vn in opserver 2025-10-08 15:00:15,308 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 virtual network link through opserver 10.0.0.33 2025-10-08 15:00:15,308 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-08 15:00:15,319 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290?flat'} 2025-10-08 15:00:15,319 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 virtual network link through opserver 10.0.0.19 2025-10-08 15:00:15,319 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-08 15:00:15,331 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290?flat'} 2025-10-08 15:00:15,331 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 virtual network link through opserver 10.0.0.129 2025-10-08 15:00:15,331 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2025-10-08 15:00:15,343 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290?flat'} 2025-10-08 15:00:15,343 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 is found in opserver 2025-10-08 15:00:15,354 - DEBUG - VRF ids for VN ctest-fip_vn-50310290: {'10.0.0.130': '3'} 2025-10-08 15:00:15,354 - INFO - start time= 1759935615354874 2025-10-08 15:00:15,355 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 126.80.86.3, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.131, gateway password: c0ntrail123 2025-10-08 15:00:15,355 - DEBUG - ping -s 56 -c 3 -W 1 126.80.86.3 2025-10-08 15:00:19,045 - DEBUG - PING 126.80.86.3 (126.80.86.3): 56 data bytes 64 bytes from 126.80.86.3: seq=0 ttl=63 time=5.041 ms 64 bytes from 126.80.86.3: seq=1 ttl=63 time=1.861 ms 64 bytes from 126.80.86.3: seq=2 ttl=63 time=1.767 ms --- 126.80.86.3 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.767/2.889/5.041 ms 2025-10-08 15:00:19,045 - INFO - Ping to IP 126.80.86.3 from VM ctest-vn1_vm1-10042171 passed 2025-10-08 15:00:29,046 - INFO - Verify session samples and teardown pkts 2025-10-08 15:00:29,047 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.33 2025-10-08 15:00:29,051 - DEBUG - Posting: http://10.0.0.33:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1759935615354874, 'end_time': 1759935629051274, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-10-08 15:00:30,073 - DEBUG - [{'T': 1759935617168472}, {'T': 1759935618168574}, {'T': 1759935619168663}] 2025-10-08 15:00:30,073 - DEBUG - Posting: http://10.0.0.33:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1759935615354874, 'end_time': 1759935630073528, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2025-10-08 15:00:31,094 - DEBUG - [{'T': 1759935617863593}, {'T': 1759935618863663}, {'T': 1759935619863756}] 2025-10-08 15:00:31,094 - DEBUG - Posting: http://10.0.0.33:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1759935615354874, 'end_time': 1759935631094547, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-10-08 15:00:32,117 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'sample_count': 3}] 2025-10-08 15:00:32,117 - INFO - wait for the flows to get expire 2025-10-08 15:03:52,118 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4234-2:Compute:contrail-vrouter-agent:0?flat 2025-10-08 15:03:52,155 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4234-2?flat 2025-10-08 15:03:52,186 - DEBUG - Posting: http://10.0.0.33:8081/analytics/query, payload {'table': 'SessionRecordTable', 'start_time': 1759935615354874, 'end_time': 1759935832185963, 'select_fields': ['vn', 'remote_vn', 'forward_teardown_pkts', 'reverse_teardown_pkts'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-10-08 15:03:53,246 - DEBUG - [{'forward_flow_uuid': '2fe81c3f-d016-4d6e-a95a-ae80e712161c', 'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'reverse_flow_uuid': '5786c0bb-bb8d-46df-8b56-8264d857ec5b', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'forward_teardown_pkts': 3, 'reverse_teardown_pkts': 3}] 2025-10-08 15:03:53,247 - DEBUG - Posting: http://10.0.0.33:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1759935615354874, 'end_time': 1759935833247105, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-10-08 15:03:54,267 - DEBUG - Posting: http://10.0.0.33:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1759935615354874, 'end_time': 1759935834266971, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2025-10-08 15:03:55,286 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849', 'sample_count': 4}] 2025-10-08 15:03:55,779 - INFO - Deleted policy policy1 2025-10-08 15:03:55,895 - INFO - Setting flow export rate: None 2025-10-08 15:03:57,217 - DEBUG - Skipping xmpp flap check 2025-10-08 15:03:57,217 - INFO - END TEST : test_verify_session_sampling_teardown : PASSED[0:03:47] 2025-10-08 15:03:57,217 - INFO - -------------------------------------------------------------------------------- 2025-10-08 15:03:57,218 - INFO - Deleting VM mltf_vm 2025-10-08 15:03:57,286 - INFO - Deleting VM ctest-fvn_vm1-50281161 2025-10-08 15:03:57,344 - INFO - Deleting VM ctest-vn2_vm2-72611944 2025-10-08 15:03:57,407 - INFO - Deleting VN ctest-fip_vn-50310290 2025-10-08 15:03:57,444 - DEBUG - VN 46a4c759-059e-496e-a02b-41c7c59f4fb6 still in use: Unable to complete operation on network 46a4c759-059e-496e-a02b-41c7c59f4fb6. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-8de3f096-7e96-4c64-b335-173b3cabfae0'] 2025-10-08 15:03:57,444 - WARNING - Deleting VN ctest-fip_vn-50310290 failed..Will retry 2025-10-08 15:03:59,594 - DEBUG - Response for deleting network () 2025-10-08 15:03:59,594 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/551f1498-eee3-4e98-a575-fbbed5ac8937 2025-10-08 15:03:59,630 - DEBUG - Response Code: 404 2025-10-08 15:03:59,631 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:03:59,639 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:03:59,654 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:03:59,739 - INFO - Validated that VN ctest-fip_vn-50310290 is not found in API Server 2025-10-08 15:03:59,751 - DEBUG - VN ctest-fip_vn-50310290 is not present in Agent 10.0.0.130 2025-10-08 15:03:59,763 - DEBUG - VN ctest-fip_vn-50310290 is not present in Agent 10.0.0.131 2025-10-08 15:03:59,763 - INFO - Validated that VN ctest-fip_vn-50310290 is not in any agent 2025-10-08 15:03:59,768 - DEBUG - VRF 3 is not seen in agent 10.0.0.130 2025-10-08 15:03:59,773 - DEBUG - Vrouter 10.0.0.130 does not have vrf 3 for VN ctest-fip_vn-50310290 2025-10-08 15:03:59,773 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-fip_vn-50310290 2025-10-08 15:03:59,794 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-50310290 info 2025-10-08 15:03:59,794 - INFO - Deleting VN ctest-vn2-57623849 2025-10-08 15:04:00,010 - DEBUG - Response for deleting network () 2025-10-08 15:04:00,010 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/826209e1-a684-46c4-82b3-0a03948158f9 2025-10-08 15:04:00,017 - DEBUG - Response Code: 404 2025-10-08 15:04:00,017 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:04:00,023 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:04:00,036 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:04:00,128 - INFO - Validated that VN ctest-vn2-57623849 is not found in API Server 2025-10-08 15:04:00,141 - DEBUG - VN ctest-vn2-57623849 is not present in Agent 10.0.0.130 2025-10-08 15:04:00,154 - DEBUG - VN ctest-vn2-57623849 is not present in Agent 10.0.0.131 2025-10-08 15:04:00,154 - INFO - Validated that VN ctest-vn2-57623849 is not in any agent 2025-10-08 15:04:00,159 - DEBUG - VRF 2 is not seen in agent 10.0.0.130 2025-10-08 15:04:00,164 - DEBUG - Vrouter 10.0.0.130 does not have vrf 2 for VN ctest-vn2-57623849 2025-10-08 15:04:00,170 - DEBUG - VRF 3 is not seen in agent 10.0.0.131 2025-10-08 15:04:00,177 - DEBUG - Vrouter 10.0.0.131 does not have vrf 3 for VN ctest-vn2-57623849 2025-10-08 15:04:00,177 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn2-57623849 2025-10-08 15:04:00,197 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-57623849 info 2025-10-08 15:04:00,197 - INFO - Deleting VM ctest-vn1_vm2-25500360 2025-10-08 15:04:00,259 - INFO - Deleting VM ctest-vn1_vm1-10042171 2025-10-08 15:04:00,321 - INFO - Deleting VN ctest-vn1-00720843 2025-10-08 15:04:00,362 - DEBUG - VN 9e6f9390-2754-45e9-b1fa-48592195375e still in use: Unable to complete operation on network 9e6f9390-2754-45e9-b1fa-48592195375e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-72d20ed1-a9be-4792-a94d-16a474ce0484'] 2025-10-08 15:04:00,362 - WARNING - Deleting VN ctest-vn1-00720843 failed..Will retry 2025-10-08 15:04:02,523 - DEBUG - Response for deleting network () 2025-10-08 15:04:02,523 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/9a50195c-f1a9-43ab-9723-4a688b3b79be 2025-10-08 15:04:02,539 - DEBUG - Response Code: 404 2025-10-08 15:04:02,539 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-08 15:04:02,551 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e655d23d-1695-42cd-a914-8836b4a49568 2025-10-08 15:04:02,565 - DEBUG - Requesting: http://10.0.0.33:8082/project/89d996e7-aa19-429a-a46c-a7a1404c7655 2025-10-08 15:04:02,662 - INFO - Validated that VN ctest-vn1-00720843 is not found in API Server 2025-10-08 15:04:02,674 - DEBUG - VN ctest-vn1-00720843 is not present in Agent 10.0.0.130 2025-10-08 15:04:02,685 - DEBUG - VN ctest-vn1-00720843 is not present in Agent 10.0.0.131 2025-10-08 15:04:02,685 - INFO - Validated that VN ctest-vn1-00720843 is not in any agent 2025-10-08 15:04:02,690 - DEBUG - VRF 2 is not seen in agent 10.0.0.131 2025-10-08 15:04:02,695 - DEBUG - Vrouter 10.0.0.131 does not have vrf 2 for VN ctest-vn1-00720843 2025-10-08 15:04:02,695 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-46419938:ctest-vn1-00720843 2025-10-08 15:04:02,716 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-00720843 info 2025-10-08 15:04:03,426 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-46419938, ID : 89d996e7-aa19-429a-a46c-a7a1404c7655