2025-11-20 03:29:23,454 - INFO - Domain Default found not creating 2025-11-20 03:29:23,635 - INFO - Project ctest-AnalyticsTestSanityWithResource-53324127 not found, creating it 2025-11-20 03:29:24,152 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-53324127, ID : 2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:29:26,350 - DEBUG - Response for create_network : {'network': {'id': '5ce4daef-e537-4f7c-851d-4627ce1686c5', 'name': 'ctest-vn1-62464585', 'tenant_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'project_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-53324127', 'ctest-vn1-62464585'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 03:29:26,652 - DEBUG - Response for create_subnet : {'subnet': {'id': '3048ad5d-4b18-438e-9784-024c0739bfa0', 'name': '', 'tenant_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'network_id': '5ce4daef-e537-4f7c-851d-4627ce1686c5', 'ip_version': 4, 'cidr': '13.224.93.192/26', 'allocation_pools': [{'start': '13.224.93.194', 'end': '13.224.93.254'}], 'gateway_ip': '13.224.93.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '13.224.93.194', 'tags': [], 'project_id': '2f977d2ef78f4d60b06bbbb3363b4147'}} 2025-11-20 03:29:26,675 - INFO - Created VN ctest-vn1-62464585 2025-11-20 03:29:26,687 - DEBUG - VN ctest-vn1-62464585 UUID is 5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:29:26,789 - DEBUG - Services list from nova: [, , , ] 2025-11-20 03:29:26,789 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4768-2', 'an-jenkins-deploy-platform-ansible-os-4768-1']} 2025-11-20 03:29:27,886 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-2) 2025-11-20 03:29:29,178 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-2) 2025-11-20 03:29:29,178 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:29:29,491 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:29:29,532 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:29:29,550 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:29:29,677 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:29:29,702 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:29:29,714 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:29:29,723 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:29:29,737 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/74c1b0fd-3d41-4ae8-9de2-949ee0203390 2025-11-20 03:29:29,747 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:29:29,747 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:29:29,788 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:29:29,815 - INFO - Verified VN network id 15 for VN 5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:29:29,816 - INFO - Verifications in API Server for VN ctest-vn1-62464585 passed 2025-11-20 03:29:29,816 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:29:29,845 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:29:29,858 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:29:29,867 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/74c1b0fd-3d41-4ae8-9de2-949ee0203390 2025-11-20 03:29:29,902 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:29:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.300765'} 2025-11-20 03:29:29,910 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:29:29,915 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:29:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.310066'} 2025-11-20 03:29:29,921 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:29:29,926 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:29:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.320419'} 2025-11-20 03:29:29,932 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:29:29,932 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-62464585 passed 2025-11-20 03:29:29,932 - DEBUG - ====Verifying policy data for ctest-vn1-62464585 in API_Server ====== 2025-11-20 03:29:29,932 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:29:29,941 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:29:29,955 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:29:30,055 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:29:30,090 - DEBUG - =>VN ctest-vn1-62464585 has no policy to be verified 2025-11-20 03:29:30,091 - DEBUG - Verifying the vn in opserver 2025-11-20 03:29:30,091 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.23 2025-11-20 03:29:30,091 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 03:29:30,452 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 03:29:30,513 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:29:30,513 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.50 2025-11-20 03:29:30,513 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 03:29:30,810 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 03:29:30,875 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:29:30,875 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.22 2025-11-20 03:29:30,875 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 03:29:31,170 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 03:29:31,229 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:29:31,229 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 is found in opserver 2025-11-20 03:29:31,242 - DEBUG - VRF ids for VN ctest-vn1-62464585: {'10.0.0.48': '2'} 2025-11-20 03:29:31,242 - INFO - Waiting for VM ctest-vn1_vm1-92143198 to be up.. 2025-11-20 03:29:31,321 - DEBUG - VM is in ACTIVE state now 2025-11-20 03:29:31,321 - INFO - VM name : ctest-vn1_vm1-92143198 2025-11-20 03:29:31,398 - DEBUG - VM ctest-vn1_vm1-92143198 ID is 78872482-0493-44b1-b750-46fca1ed92a8 2025-11-20 03:29:31,423 - DEBUG - VM ctest-vn1_vm1-92143198 launched on Node an-jenkins-deploy-platform-ansible-os-4768-2 2025-11-20 03:29:31,500 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/78872482-0493-44b1-b750-46fca1ed92a8 2025-11-20 03:29:31,804 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/78872482-0493-44b1-b750-46fca1ed92a8 2025-11-20 03:29:31,840 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/a367bfdf-d47d-491f-86bb-b57115b62afd 2025-11-20 03:29:35,038 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-11-20 03:29:35,038 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-92143198 failed! 2025-11-20 03:29:35,053 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 is 13.224.93.193 and allocation pool is NOT set 2025-11-20 03:29:39,135 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-20 03:29:39,135 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-92143198 failed! 2025-11-20 03:29:39,150 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 is 13.224.93.193 and allocation pool is NOT set 2025-11-20 03:29:43,234 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-20 03:29:43,234 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-92143198 failed! 2025-11-20 03:29:43,249 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 is 13.224.93.193 and allocation pool is NOT set 2025-11-20 03:29:47,330 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-20 03:29:47,330 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-92143198 failed! 2025-11-20 03:29:47,345 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 is 13.224.93.193 and allocation pool is NOT set 2025-11-20 03:29:51,425 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=9.41 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1013ms\r\nrtt min/avg/max/mdev = 9.412/9.412/9.412/0.000 ms') 2025-11-20 03:29:51,425 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-92143198 passed 2025-11-20 03:29:51,492 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:29:51,492 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-92143198, IP 13.224.93.195, Port 22 2025-11-20 03:29:51,548 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:29:51,633 - DEBUG - VM ctest-vn1_vm1-92143198 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:29:56,634 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:29:56,634 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-92143198, IP 13.224.93.195, Port 22 2025-11-20 03:29:56,807 - DEBUG - VM ctest-vn1_vm1-92143198 is ready for SSH connections 2025-11-20 03:29:56,807 - INFO - Waiting for VM ctest-vn1_vm2-09809764 to be up.. 2025-11-20 03:29:56,899 - DEBUG - VM is in ACTIVE state now 2025-11-20 03:29:56,899 - INFO - VM name : ctest-vn1_vm2-09809764 2025-11-20 03:29:56,985 - DEBUG - VM ctest-vn1_vm2-09809764 ID is aaedc7bf-a06a-418b-8296-418b324e0a61 2025-11-20 03:29:56,985 - DEBUG - VM ctest-vn1_vm2-09809764 launched on Node an-jenkins-deploy-platform-ansible-os-4768-2 2025-11-20 03:29:57,063 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/aaedc7bf-a06a-418b-8296-418b324e0a61 2025-11-20 03:29:57,076 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/1980b96a-f02e-4f03-a10a-6b22d100170f 2025-11-20 03:29:58,230 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=1.98 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.535 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.535/1.256/1.978/0.721 ms') 2025-11-20 03:29:58,230 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn1_vm2-09809764 passed 2025-11-20 03:29:58,297 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:29:58,297 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-09809764, IP 13.224.93.196, Port 22 2025-11-20 03:29:58,471 - DEBUG - VM ctest-vn1_vm2-09809764 is ready for SSH connections 2025-11-20 03:29:58,824 - DEBUG - Response for create_network : {'network': {'id': '38eeaae6-30cc-4980-a4e0-f50e6347251b', 'name': 'ctest-vn2-96953272', 'tenant_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'project_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-53324127', 'ctest-vn2-96953272'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 03:29:59,073 - DEBUG - Response for create_subnet : {'subnet': {'id': '0487a45f-1284-4542-97c8-84e3821a86ab', 'name': '', 'tenant_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'network_id': '38eeaae6-30cc-4980-a4e0-f50e6347251b', 'ip_version': 4, 'cidr': '89.124.78.192/26', 'allocation_pools': [{'start': '89.124.78.194', 'end': '89.124.78.254'}], 'gateway_ip': '89.124.78.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '89.124.78.194', 'tags': [], 'project_id': '2f977d2ef78f4d60b06bbbb3363b4147'}} 2025-11-20 03:29:59,093 - INFO - Created VN ctest-vn2-96953272 2025-11-20 03:29:59,105 - DEBUG - VN ctest-vn2-96953272 UUID is 38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:29:59,468 - DEBUG - Response for create_network : {'network': {'id': 'a99071ec-80aa-4a22-ba91-b95a0a3e8177', 'name': 'ctest-fip_vn-59231750', 'tenant_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'project_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-53324127', 'ctest-fip_vn-59231750'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 03:29:59,780 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a71b99fa-4442-41c3-83d8-79d3068c198f', 'name': '', 'tenant_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'network_id': 'a99071ec-80aa-4a22-ba91-b95a0a3e8177', 'ip_version': 4, 'cidr': '214.211.78.64/26', 'allocation_pools': [{'start': '214.211.78.66', 'end': '214.211.78.126'}], 'gateway_ip': '214.211.78.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '214.211.78.66', 'tags': [], 'project_id': '2f977d2ef78f4d60b06bbbb3363b4147'}} 2025-11-20 03:29:59,800 - INFO - Created VN ctest-fip_vn-59231750 2025-11-20 03:29:59,814 - DEBUG - VN ctest-fip_vn-59231750 UUID is a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:29:59,889 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4768-2', 'an-jenkins-deploy-platform-ansible-os-4768-1']} 2025-11-20 03:30:01,282 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-1) 2025-11-20 03:30:02,723 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-1) 2025-11-20 03:30:04,193 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-2) 2025-11-20 03:30:04,194 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:04,200 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:04,212 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:04,326 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:04,337 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:04,352 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:04,365 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:04,375 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/74c1b0fd-3d41-4ae8-9de2-949ee0203390 2025-11-20 03:30:04,386 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:04,386 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:04,402 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:04,420 - INFO - Verified VN network id 15 for VN 5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:04,420 - INFO - Verifications in API Server for VN ctest-vn1-62464585 passed 2025-11-20 03:30:04,420 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:04,431 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:04,442 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:04,452 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/74c1b0fd-3d41-4ae8-9de2-949ee0203390 2025-11-20 03:30:04,466 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:29:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:37.865101'} 2025-11-20 03:30:04,472 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:04,479 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:29:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:37.873530'} 2025-11-20 03:30:04,486 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:04,493 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:29:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:37.887512'} 2025-11-20 03:30:04,501 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:04,501 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-62464585 passed 2025-11-20 03:30:04,501 - DEBUG - ====Verifying policy data for ctest-vn1-62464585 in API_Server ====== 2025-11-20 03:30:04,501 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:04,509 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:04,520 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:04,630 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:04,641 - DEBUG - =>VN ctest-vn1-62464585 has no policy to be verified 2025-11-20 03:30:04,641 - DEBUG - Verifying the vn in opserver 2025-11-20 03:30:04,641 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.23 2025-11-20 03:30:04,641 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 03:30:04,917 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:30:04,917 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.50 2025-11-20 03:30:04,917 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 03:30:05,048 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:30:05,048 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.22 2025-11-20 03:30:05,049 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 03:30:05,439 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:30:05,440 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 is found in opserver 2025-11-20 03:30:05,457 - DEBUG - VRF ids for VN ctest-vn1-62464585: {'10.0.0.48': '2'} 2025-11-20 03:30:05,457 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:05,464 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:05,500 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:05,618 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:05,636 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:05,646 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:05,655 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:05,664 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/92a7047c-1a84-4777-86a8-b834c30c3676 2025-11-20 03:30:05,672 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:05,672 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:05,683 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:05,705 - INFO - Verified VN network id 16 for VN 38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:05,711 - INFO - Verifications in API Server for VN ctest-vn2-96953272 passed 2025-11-20 03:30:05,712 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:05,750 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:05,779 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:05,786 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/92a7047c-1a84-4777-86a8-b834c30c3676 2025-11-20 03:30:05,805 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4102404216218995072', 'uuid-lslong': '11880765259147322651'}, 'enable': 'true', 'created': '2025-11-20T03:29:58', 'last-modified': '2025-11-20T03:29:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.790365'} 2025-11-20 03:30:05,814 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:05,820 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4102404216218995072', 'uuid-lslong': '11880765259147322651'}, 'enable': 'true', 'created': '2025-11-20T03:29:58', 'last-modified': '2025-11-20T03:29:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.804046'} 2025-11-20 03:30:05,828 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:05,835 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4102404216218995072', 'uuid-lslong': '11880765259147322651'}, 'enable': 'true', 'created': '2025-11-20T03:29:58', 'last-modified': '2025-11-20T03:29:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.805328'} 2025-11-20 03:30:05,848 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:05,849 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-96953272 passed 2025-11-20 03:30:05,849 - DEBUG - ====Verifying policy data for ctest-vn2-96953272 in API_Server ====== 2025-11-20 03:30:05,849 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:05,856 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:05,870 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:05,971 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:05,984 - DEBUG - =>VN ctest-vn2-96953272 has no policy to be verified 2025-11-20 03:30:05,984 - DEBUG - Verifying the vn in opserver 2025-11-20 03:30:05,984 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 virtual network link through opserver 10.0.0.23 2025-11-20 03:30:05,984 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 03:30:06,055 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272?flat'} 2025-11-20 03:30:06,055 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 virtual network link through opserver 10.0.0.50 2025-11-20 03:30:06,055 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 03:30:06,134 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272?flat'} 2025-11-20 03:30:06,134 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 virtual network link through opserver 10.0.0.22 2025-11-20 03:30:06,134 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 03:30:06,207 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272?flat'} 2025-11-20 03:30:06,207 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 is found in opserver 2025-11-20 03:30:06,220 - DEBUG - VRF ids for VN ctest-vn2-96953272: {'10.0.0.131': '2'} 2025-11-20 03:30:06,220 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:06,233 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:06,249 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:06,350 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:06,362 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:06,374 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/873a509b-afa9-4df5-9bc0-0120c9b1de5c 2025-11-20 03:30:06,384 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/873a509b-afa9-4df5-9bc0-0120c9b1de5c 2025-11-20 03:30:06,391 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/54801f39-b0ad-4e1a-9238-48d28fbb626d 2025-11-20 03:30:06,399 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 03:30:06,399 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:06,410 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/873a509b-afa9-4df5-9bc0-0120c9b1de5c 2025-11-20 03:30:06,428 - INFO - Verified VN network id 17 for VN a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:06,428 - INFO - Verifications in API Server for VN ctest-fip_vn-59231750 passed 2025-11-20 03:30:06,429 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:06,447 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/873a509b-afa9-4df5-9bc0-0120c9b1de5c 2025-11-20 03:30:06,458 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/873a509b-afa9-4df5-9bc0-0120c9b1de5c 2025-11-20 03:30:06,467 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/54801f39-b0ad-4e1a-9238-48d28fbb626d 2025-11-20 03:30:06,480 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12218391049641019938', 'uuid-lslong': '13443730159047704951'}, 'enable': 'true', 'created': '2025-11-20T03:29:59', 'last-modified': '2025-11-20T03:29:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.803369'} 2025-11-20 03:30:06,488 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 03:30:06,493 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12218391049641019938', 'uuid-lslong': '13443730159047704951'}, 'enable': 'true', 'created': '2025-11-20T03:29:59', 'last-modified': '2025-11-20T03:29:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.812135'} 2025-11-20 03:30:06,501 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 03:30:06,507 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12218391049641019938', 'uuid-lslong': '13443730159047704951'}, 'enable': 'true', 'created': '2025-11-20T03:29:59', 'last-modified': '2025-11-20T03:29:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.822027'} 2025-11-20 03:30:06,516 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 03:30:06,516 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-59231750 passed 2025-11-20 03:30:06,516 - DEBUG - ====Verifying policy data for ctest-fip_vn-59231750 in API_Server ====== 2025-11-20 03:30:06,516 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:06,523 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:06,537 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:06,631 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:06,642 - DEBUG - =>VN ctest-fip_vn-59231750 has no policy to be verified 2025-11-20 03:30:06,642 - DEBUG - Verifying the vn in opserver 2025-11-20 03:30:06,642 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 virtual network link through opserver 10.0.0.23 2025-11-20 03:30:06,642 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 03:30:06,654 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750?flat'} 2025-11-20 03:30:06,654 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 virtual network link through opserver 10.0.0.50 2025-11-20 03:30:06,654 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 03:30:06,667 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750?flat'} 2025-11-20 03:30:06,668 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 virtual network link through opserver 10.0.0.22 2025-11-20 03:30:06,668 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 03:30:06,682 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750?flat'} 2025-11-20 03:30:06,682 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 is found in opserver 2025-11-20 03:30:06,694 - DEBUG - VRF ids for VN ctest-fip_vn-59231750: {'10.0.0.131': '3'} 2025-11-20 03:30:06,694 - INFO - Waiting for VM ctest-fvn_vm1-05859295 to be up.. 2025-11-20 03:30:06,773 - DEBUG - VM is in ACTIVE state now 2025-11-20 03:30:06,774 - INFO - VM name : ctest-fvn_vm1-05859295 2025-11-20 03:30:06,854 - DEBUG - VM ctest-fvn_vm1-05859295 ID is 24da2156-777b-40d3-aa43-0397e6cda888 2025-11-20 03:30:06,854 - DEBUG - VM ctest-fvn_vm1-05859295 launched on Node an-jenkins-deploy-platform-ansible-os-4768-1 2025-11-20 03:30:06,928 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/24da2156-777b-40d3-aa43-0397e6cda888 2025-11-20 03:30:06,938 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/c8059206-3768-42e6-ab1e-f41dd4fe49f4 2025-11-20 03:30:10,126 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms') 2025-11-20 03:30:10,126 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-05859295 failed! 2025-11-20 03:30:10,139 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 is 214.211.78.65 and allocation pool is NOT set 2025-11-20 03:30:14,224 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-11-20 03:30:14,224 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-05859295 failed! 2025-11-20 03:30:14,239 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 is 214.211.78.65 and allocation pool is NOT set 2025-11-20 03:30:18,313 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-11-20 03:30:18,313 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-05859295 failed! 2025-11-20 03:30:18,328 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 is 214.211.78.65 and allocation pool is NOT set 2025-11-20 03:30:22,415 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-20 03:30:22,416 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-05859295 failed! 2025-11-20 03:30:22,429 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 is 214.211.78.65 and allocation pool is NOT set 2025-11-20 03:30:26,515 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-20 03:30:26,515 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-05859295 failed! 2025-11-20 03:30:26,528 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 is 214.211.78.65 and allocation pool is NOT set 2025-11-20 03:30:28,589 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.98 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.588 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.588/2.785/4.982/2.197 ms') 2025-11-20 03:30:28,589 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-05859295 passed 2025-11-20 03:30:28,661 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:30:28,662 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-05859295, IP 214.211.78.67, Port 22 2025-11-20 03:30:28,731 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:30:28,827 - DEBUG - VM ctest-fvn_vm1-05859295 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:30:33,827 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:30:33,828 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-05859295, IP 214.211.78.67, Port 22 2025-11-20 03:30:33,893 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-20 03:30:33,976 - DEBUG - VM ctest-fvn_vm1-05859295 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-20 03:30:38,977 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:30:38,978 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-05859295, IP 214.211.78.67, Port 22 2025-11-20 03:30:39,150 - DEBUG - VM ctest-fvn_vm1-05859295 is ready for SSH connections 2025-11-20 03:30:39,150 - INFO - Waiting for VM ctest-vn2_vm2-63485427 to be up.. 2025-11-20 03:30:39,231 - DEBUG - VM is in ACTIVE state now 2025-11-20 03:30:39,231 - INFO - VM name : ctest-vn2_vm2-63485427 2025-11-20 03:30:39,320 - DEBUG - VM ctest-vn2_vm2-63485427 ID is 792c8077-d4bf-438e-b201-9690fa883e07 2025-11-20 03:30:39,320 - DEBUG - VM ctest-vn2_vm2-63485427 launched on Node an-jenkins-deploy-platform-ansible-os-4768-1 2025-11-20 03:30:39,402 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/792c8077-d4bf-438e-b201-9690fa883e07 2025-11-20 03:30:39,412 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/b6a42d4b-6454-4e29-a8f9-863b67155305 2025-11-20 03:30:40,572 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=1.82 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.538 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.538/1.176/1.815/0.638 ms') 2025-11-20 03:30:40,572 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2_vm2-63485427 passed 2025-11-20 03:30:40,640 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:30:40,640 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-63485427, IP 89.124.78.195, Port 22 2025-11-20 03:30:40,806 - DEBUG - VM ctest-vn2_vm2-63485427 is ready for SSH connections 2025-11-20 03:30:40,806 - INFO - Waiting for VM mltf_vm to be up.. 2025-11-20 03:30:40,886 - DEBUG - VM is in ACTIVE state now 2025-11-20 03:30:40,886 - INFO - VM name : mltf_vm 2025-11-20 03:30:40,974 - DEBUG - VM mltf_vm ID is 69a37c71-3694-4054-9199-e925eee78f0b 2025-11-20 03:30:40,974 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-4768-2 2025-11-20 03:30:41,156 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/69a37c71-3694-4054-9199-e925eee78f0b 2025-11-20 03:30:41,167 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/3cc26225-f3ee-4bff-a2eb-8bf2aa15c31e 2025-11-20 03:30:41,178 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/beb1c780-f608-4169-8f63-59a2b4e9b48a 2025-11-20 03:30:42,361 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.13 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.443 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.443/1.286/2.129/0.843 ms') 2025-11-20 03:30:42,361 - INFO - Ping to Metadata IP 169.254.0.5 of VM mltf_vm passed 2025-11-20 03:30:42,431 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:30:42,431 - DEBUG - Waiting to SSH to VM mltf_vm, IP 13.224.93.197, Port 22 2025-11-20 03:30:42,599 - DEBUG - VM mltf_vm is ready for SSH connections 2025-11-20 03:30:42,671 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-20 03:30:42,671 - DEBUG - Waiting to SSH to VM mltf_vm, IP 13.224.93.197, Port 22 2025-11-20 03:30:42,828 - DEBUG - VM mltf_vm is ready for SSH connections 2025-11-20 03:30:42,831 - INFO - ================================================================================ 2025-11-20 03:30:42,831 - INFO - STARTING TEST : test_verify_session_sampling_teardown 2025-11-20 03:30:42,831 - INFO - TEST DESCRIPTION : 1.query client session samples 2.query server session samples 3.query client session to get number of sessions exported 4.query session record table for teardown bytes/pkts 5.query sample count after teardown on server side 2025-11-20 03:30:44,089 - DEBUG - Skipping xmpp flap check 2025-11-20 03:30:44,089 - INFO - Initial checks done. Running the testcase now 2025-11-20 03:30:44,089 - INFO - 2025-11-20 03:30:44,224 - INFO - Setting flow export rate: 100 2025-11-20 03:30:44,273 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-11-20 03:30:44,618 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '5ce4daef-e537-4f7c-851d-4627ce1686c5', 'name': 'ctest-vn1-62464585', 'tenant_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'project_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['3048ad5d-4b18-438e-9784-024c0739bfa0'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-53324127', 'ctest-vn1-62464585'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-53324127', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '13.224.93.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-11-20 03:30:44,813 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '38eeaae6-30cc-4980-a4e0-f50e6347251b', 'name': 'ctest-vn2-96953272', 'tenant_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'project_id': '2f977d2ef78f4d60b06bbbb3363b4147', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['0487a45f-1284-4542-97c8-84e3821a86ab'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-53324127', 'ctest-vn2-96953272'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-53324127', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '89.124.78.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-11-20 03:30:44,916 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:44,923 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:44,945 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:45,055 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:45,081 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:45,093 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:45,106 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:45,144 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/74c1b0fd-3d41-4ae8-9de2-949ee0203390 2025-11-20 03:30:45,153 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:45,153 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:45,163 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:45,194 - INFO - Verified VN network id 15 for VN 5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:45,194 - INFO - Verifications in API Server for VN ctest-vn1-62464585 passed 2025-11-20 03:30:45,196 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:45,209 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:45,217 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:45,225 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/74c1b0fd-3d41-4ae8-9de2-949ee0203390 2025-11-20 03:30:45,256 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.676109'} 2025-11-20 03:30:45,266 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:45,275 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.698079'} 2025-11-20 03:30:45,281 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:45,287 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.711955'} 2025-11-20 03:30:45,340 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:45,340 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-62464585 passed 2025-11-20 03:30:45,340 - DEBUG - ====Verifying policy data for ctest-vn1-62464585 in API_Server ====== 2025-11-20 03:30:45,340 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:45,351 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:45,373 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:45,533 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:45,549 - DEBUG - ==>Verifying data for policy with id: 2d26b5df-3714-455f-a95c-1d9786002344, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-53324127', 'policy1'] 2025-11-20 03:30:45,549 - INFO - VN ctest-vn1-62464585 Policy verification: verify_vn_policy_in_api_server, status: True 2025-11-20 03:30:45,549 - DEBUG - Verifying the vn in opserver 2025-11-20 03:30:45,549 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.23 2025-11-20 03:30:45,549 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 03:30:45,562 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:30:45,562 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.50 2025-11-20 03:30:45,562 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 03:30:45,588 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:30:45,588 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.22 2025-11-20 03:30:45,588 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 03:30:45,605 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:30:45,605 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 is found in opserver 2025-11-20 03:30:45,618 - DEBUG - VRF ids for VN ctest-vn1-62464585: {'10.0.0.48': '2'} 2025-11-20 03:30:45,618 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:45,625 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:45,646 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:45,756 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:45,772 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:45,790 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:45,802 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:45,813 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/92a7047c-1a84-4777-86a8-b834c30c3676 2025-11-20 03:30:45,820 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:45,821 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:45,830 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:45,853 - INFO - Verified VN network id 16 for VN 38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:45,853 - INFO - Verifications in API Server for VN ctest-vn2-96953272 passed 2025-11-20 03:30:45,853 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:45,863 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:45,872 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:45,879 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/92a7047c-1a84-4777-86a8-b834c30c3676 2025-11-20 03:30:45,901 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4102404216218995072', 'uuid-lslong': '11880765259147322651'}, 'enable': 'true', 'created': '2025-11-20T03:29:58', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.131786'} 2025-11-20 03:30:45,917 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:45,925 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4102404216218995072', 'uuid-lslong': '11880765259147322651'}, 'enable': 'true', 'created': '2025-11-20T03:29:58', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.144582'} 2025-11-20 03:30:45,933 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:45,940 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4102404216218995072', 'uuid-lslong': '11880765259147322651'}, 'enable': 'true', 'created': '2025-11-20T03:29:58', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.159166'} 2025-11-20 03:30:45,950 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:45,950 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-96953272 passed 2025-11-20 03:30:45,951 - DEBUG - ====Verifying policy data for ctest-vn2-96953272 in API_Server ====== 2025-11-20 03:30:45,951 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:45,959 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:45,974 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:46,080 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:46,098 - DEBUG - ==>Verifying data for policy with id: 2d26b5df-3714-455f-a95c-1d9786002344, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-53324127', 'policy1'] 2025-11-20 03:30:46,098 - INFO - VN ctest-vn2-96953272 Policy verification: verify_vn_policy_in_api_server, status: True 2025-11-20 03:30:46,098 - DEBUG - Verifying the vn in opserver 2025-11-20 03:30:46,098 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 virtual network link through opserver 10.0.0.23 2025-11-20 03:30:46,098 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 03:30:46,113 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272?flat'} 2025-11-20 03:30:46,113 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 virtual network link through opserver 10.0.0.50 2025-11-20 03:30:46,113 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 03:30:46,126 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272?flat'} 2025-11-20 03:30:46,126 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 virtual network link through opserver 10.0.0.22 2025-11-20 03:30:46,126 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 03:30:46,140 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272?flat'} 2025-11-20 03:30:46,140 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 is found in opserver 2025-11-20 03:30:46,151 - DEBUG - VRF ids for VN ctest-vn2-96953272: {'10.0.0.131': '2', '10.0.0.48': '3'} 2025-11-20 03:30:46,151 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:46,158 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:46,171 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:46,278 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:46,288 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:46,298 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:46,307 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:46,318 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/74c1b0fd-3d41-4ae8-9de2-949ee0203390 2025-11-20 03:30:46,325 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:46,325 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:46,335 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:46,354 - INFO - Verified VN network id 15 for VN 5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:46,354 - INFO - Verifications in API Server for VN ctest-vn1-62464585 passed 2025-11-20 03:30:46,354 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:46,364 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:46,374 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:30:46,384 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/74c1b0fd-3d41-4ae8-9de2-949ee0203390 2025-11-20 03:30:46,401 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.817341'} 2025-11-20 03:30:46,407 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:46,418 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.839600'} 2025-11-20 03:30:46,425 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:46,431 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6693715670057045884', 'uuid-lslong': '9591899918144276165'}, 'enable': 'true', 'created': '2025-11-20T03:29:26', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.856041'} 2025-11-20 03:30:46,436 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 03:30:46,437 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-62464585 passed 2025-11-20 03:30:46,437 - DEBUG - ====Verifying policy data for ctest-vn1-62464585 in API_Server ====== 2025-11-20 03:30:46,437 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:46,448 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:46,459 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:46,565 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ce4daef-e537-4f7c-851d-4627ce1686c5 2025-11-20 03:30:46,579 - DEBUG - ==>Verifying data for policy with id: 2d26b5df-3714-455f-a95c-1d9786002344, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-53324127', 'policy1'] 2025-11-20 03:30:46,579 - INFO - VN ctest-vn1-62464585 Policy verification: verify_vn_policy_in_api_server, status: True 2025-11-20 03:30:46,579 - DEBUG - Verifying the vn in opserver 2025-11-20 03:30:46,579 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.23 2025-11-20 03:30:46,580 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 03:30:46,595 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:30:46,595 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.50 2025-11-20 03:30:46,595 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 03:30:46,610 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:30:46,610 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 virtual network link through opserver 10.0.0.22 2025-11-20 03:30:46,610 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 03:30:46,622 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585?flat'} 2025-11-20 03:30:46,622 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 is found in opserver 2025-11-20 03:30:46,634 - DEBUG - VRF ids for VN ctest-vn1-62464585: {'10.0.0.48': '2'} 2025-11-20 03:30:46,634 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:46,640 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:46,651 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:46,744 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:46,755 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:46,764 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:46,772 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:46,779 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/92a7047c-1a84-4777-86a8-b834c30c3676 2025-11-20 03:30:46,786 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:46,786 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:46,795 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:46,811 - INFO - Verified VN network id 16 for VN 38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:46,811 - INFO - Verifications in API Server for VN ctest-vn2-96953272 passed 2025-11-20 03:30:46,812 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:46,823 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:46,831 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:30:46,839 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/92a7047c-1a84-4777-86a8-b834c30c3676 2025-11-20 03:30:46,861 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4102404216218995072', 'uuid-lslong': '11880765259147322651'}, 'enable': 'true', 'created': '2025-11-20T03:29:58', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.087593'} 2025-11-20 03:30:46,870 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:46,876 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4102404216218995072', 'uuid-lslong': '11880765259147322651'}, 'enable': 'true', 'created': '2025-11-20T03:29:58', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.096065'} 2025-11-20 03:30:46,882 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:46,888 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4102404216218995072', 'uuid-lslong': '11880765259147322651'}, 'enable': 'true', 'created': '2025-11-20T03:29:58', 'last-modified': '2025-11-20T03:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.108943'} 2025-11-20 03:30:46,896 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 03:30:46,896 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-96953272 passed 2025-11-20 03:30:46,896 - DEBUG - ====Verifying policy data for ctest-vn2-96953272 in API_Server ====== 2025-11-20 03:30:46,896 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:46,904 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:46,915 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:47,024 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/38eeaae6-30cc-4980-a4e0-f50e6347251b 2025-11-20 03:30:47,047 - DEBUG - ==>Verifying data for policy with id: 2d26b5df-3714-455f-a95c-1d9786002344, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-53324127', 'policy1'] 2025-11-20 03:30:47,047 - INFO - VN ctest-vn2-96953272 Policy verification: verify_vn_policy_in_api_server, status: True 2025-11-20 03:30:47,047 - DEBUG - Verifying the vn in opserver 2025-11-20 03:30:47,047 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 virtual network link through opserver 10.0.0.23 2025-11-20 03:30:47,047 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 03:30:47,061 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272?flat'} 2025-11-20 03:30:47,061 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 virtual network link through opserver 10.0.0.50 2025-11-20 03:30:47,061 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 03:30:47,076 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272?flat'} 2025-11-20 03:30:47,076 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 virtual network link through opserver 10.0.0.22 2025-11-20 03:30:47,076 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 03:30:47,091 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272?flat'} 2025-11-20 03:30:47,091 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 is found in opserver 2025-11-20 03:30:47,103 - DEBUG - VRF ids for VN ctest-vn2-96953272: {'10.0.0.131': '2', '10.0.0.48': '3'} 2025-11-20 03:30:47,103 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:47,109 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:47,122 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:47,223 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:47,235 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:47,244 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/873a509b-afa9-4df5-9bc0-0120c9b1de5c 2025-11-20 03:30:47,251 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/873a509b-afa9-4df5-9bc0-0120c9b1de5c 2025-11-20 03:30:47,258 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/54801f39-b0ad-4e1a-9238-48d28fbb626d 2025-11-20 03:30:47,264 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 03:30:47,265 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:47,274 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/873a509b-afa9-4df5-9bc0-0120c9b1de5c 2025-11-20 03:30:47,290 - INFO - Verified VN network id 17 for VN a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:47,290 - INFO - Verifications in API Server for VN ctest-fip_vn-59231750 passed 2025-11-20 03:30:47,290 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:47,299 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/873a509b-afa9-4df5-9bc0-0120c9b1de5c 2025-11-20 03:30:47,313 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/873a509b-afa9-4df5-9bc0-0120c9b1de5c 2025-11-20 03:30:47,323 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/54801f39-b0ad-4e1a-9238-48d28fbb626d 2025-11-20 03:30:47,335 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12218391049641019938', 'uuid-lslong': '13443730159047704951'}, 'enable': 'true', 'created': '2025-11-20T03:29:59', 'last-modified': '2025-11-20T03:29:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:47.658240'} 2025-11-20 03:30:47,345 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 03:30:47,352 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12218391049641019938', 'uuid-lslong': '13443730159047704951'}, 'enable': 'true', 'created': '2025-11-20T03:29:59', 'last-modified': '2025-11-20T03:29:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:47.671081'} 2025-11-20 03:30:47,359 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 03:30:47,364 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-53324127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12218391049641019938', 'uuid-lslong': '13443730159047704951'}, 'enable': 'true', 'created': '2025-11-20T03:29:59', 'last-modified': '2025-11-20T03:29:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:47.679928'} 2025-11-20 03:30:47,370 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 03:30:47,370 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-59231750 passed 2025-11-20 03:30:47,370 - DEBUG - ====Verifying policy data for ctest-fip_vn-59231750 in API_Server ====== 2025-11-20 03:30:47,370 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:30:47,377 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:30:47,387 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:30:47,483 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a99071ec-80aa-4a22-ba91-b95a0a3e8177 2025-11-20 03:30:47,494 - DEBUG - =>VN ctest-fip_vn-59231750 has no policy to be verified 2025-11-20 03:30:47,494 - DEBUG - Verifying the vn in opserver 2025-11-20 03:30:47,494 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 virtual network link through opserver 10.0.0.23 2025-11-20 03:30:47,494 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 03:30:47,507 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750?flat'} 2025-11-20 03:30:47,508 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 virtual network link through opserver 10.0.0.50 2025-11-20 03:30:47,508 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 03:30:47,520 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750?flat'} 2025-11-20 03:30:47,520 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 virtual network link through opserver 10.0.0.22 2025-11-20 03:30:47,520 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 03:30:47,532 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750?flat'} 2025-11-20 03:30:47,533 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 is found in opserver 2025-11-20 03:30:47,544 - DEBUG - VRF ids for VN ctest-fip_vn-59231750: {'10.0.0.131': '3'} 2025-11-20 03:30:47,544 - INFO - start time= 1763609447544727 2025-11-20 03:30:47,545 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 89.124.78.195, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-11-20 03:30:47,545 - DEBUG - ping -s 56 -c 3 -W 1 89.124.78.195 2025-11-20 03:30:51,428 - DEBUG - PING 89.124.78.195 (89.124.78.195): 56 data bytes 64 bytes from 89.124.78.195: seq=0 ttl=63 time=4.388 ms 64 bytes from 89.124.78.195: seq=1 ttl=63 time=1.247 ms 64 bytes from 89.124.78.195: seq=2 ttl=63 time=1.421 ms --- 89.124.78.195 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.247/2.352/4.388 ms 2025-11-20 03:30:51,428 - INFO - Ping to IP 89.124.78.195 from VM ctest-vn1_vm1-92143198 passed 2025-11-20 03:31:01,429 - INFO - Verify session samples and teardown pkts 2025-11-20 03:31:01,429 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.23 2025-11-20 03:31:01,433 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1763609447544727, 'end_time': 1763609461433252, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-11-20 03:31:02,452 - DEBUG - [{'T': 1763609449929598}, {'T': 1763609450929713}, {'T': 1763609451929821}] 2025-11-20 03:31:02,453 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1763609447544727, 'end_time': 1763609462453088, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2025-11-20 03:31:03,475 - DEBUG - [{'T': 1763609449978510}, {'T': 1763609450978566}, {'T': 1763609451978664}] 2025-11-20 03:31:03,475 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1763609447544727, 'end_time': 1763609463475875, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-11-20 03:31:04,497 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'sample_count': 3}] 2025-11-20 03:31:04,497 - INFO - wait for the flows to get expire 2025-11-20 03:34:24,498 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4768-2:Compute:contrail-vrouter-agent:0?flat 2025-11-20 03:34:24,537 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4768-2?flat 2025-11-20 03:34:24,569 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionRecordTable', 'start_time': 1763609447544727, 'end_time': 1763609664569583, 'select_fields': ['vn', 'remote_vn', 'forward_teardown_pkts', 'reverse_teardown_pkts'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-11-20 03:34:25,590 - DEBUG - [{'forward_flow_uuid': 'b67e5525-2bd9-46d3-b8e3-ee415f38a4ed', 'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'reverse_flow_uuid': 'f35b61bd-da5d-4ad6-9e0b-a9a68bf8d0f8', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'forward_teardown_pkts': 3, 'reverse_teardown_pkts': 3}] 2025-11-20 03:34:25,590 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1763609447544727, 'end_time': 1763609665590369, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-11-20 03:34:26,616 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1763609447544727, 'end_time': 1763609666615959, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2025-11-20 03:34:27,641 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272', 'sample_count': 4}] 2025-11-20 03:34:28,102 - INFO - Deleted policy policy1 2025-11-20 03:34:28,216 - INFO - Setting flow export rate: None 2025-11-20 03:34:29,496 - DEBUG - Skipping xmpp flap check
2025-11-20 03:34:29,496 - INFO - END TEST : test_verify_session_sampling_teardown : PASSED[0:03:47]
2025-11-20 03:34:29,496 - INFO - -------------------------------------------------------------------------------- 2025-11-20 03:34:29,499 - INFO - Deleting VM mltf_vm 2025-11-20 03:34:29,576 - INFO - Deleting VM ctest-fvn_vm1-05859295 2025-11-20 03:34:29,648 - INFO - Deleting VM ctest-vn2_vm2-63485427 2025-11-20 03:34:29,715 - INFO - Deleting VN ctest-fip_vn-59231750 2025-11-20 03:34:29,755 - DEBUG - VN a99071ec-80aa-4a22-ba91-b95a0a3e8177 still in use: Unable to complete operation on network a99071ec-80aa-4a22-ba91-b95a0a3e8177. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-b52f1ff4-a69f-44d6-ba4e-7bbe7e1cd6af'] 2025-11-20 03:34:29,756 - WARNING - Deleting VN ctest-fip_vn-59231750 failed..Will retry 2025-11-20 03:34:31,909 - DEBUG - Response for deleting network () 2025-11-20 03:34:31,909 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/873a509b-afa9-4df5-9bc0-0120c9b1de5c 2025-11-20 03:34:31,945 - DEBUG - Response Code: 404 2025-11-20 03:34:31,945 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:34:31,950 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:34:31,961 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:34:32,040 - INFO - Validated that VN ctest-fip_vn-59231750 is not found in API Server 2025-11-20 03:34:32,051 - DEBUG - VN ctest-fip_vn-59231750 is not present in Agent 10.0.0.131 2025-11-20 03:34:32,065 - DEBUG - VN ctest-fip_vn-59231750 is not present in Agent 10.0.0.48 2025-11-20 03:34:32,065 - INFO - Validated that VN ctest-fip_vn-59231750 is not in any agent 2025-11-20 03:34:32,071 - DEBUG - VRF 3 is not seen in agent 10.0.0.131 2025-11-20 03:34:32,076 - DEBUG - Vrouter 10.0.0.131 does not have vrf 3 for VN ctest-fip_vn-59231750 2025-11-20 03:34:32,076 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-fip_vn-59231750 2025-11-20 03:34:32,097 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-59231750 info 2025-11-20 03:34:32,097 - INFO - Deleting VN ctest-vn2-96953272 2025-11-20 03:34:32,260 - DEBUG - Response for deleting network () 2025-11-20 03:34:32,260 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebe7e976-3a46-40d1-9d00-402d7df7c9fd 2025-11-20 03:34:32,265 - DEBUG - Response Code: 404 2025-11-20 03:34:32,265 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:34:32,277 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:34:32,290 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:34:32,389 - INFO - Validated that VN ctest-vn2-96953272 is not found in API Server 2025-11-20 03:34:32,400 - DEBUG - VN ctest-vn2-96953272 is not present in Agent 10.0.0.131 2025-11-20 03:34:32,412 - DEBUG - VN ctest-vn2-96953272 is not present in Agent 10.0.0.48 2025-11-20 03:34:32,412 - INFO - Validated that VN ctest-vn2-96953272 is not in any agent 2025-11-20 03:34:32,421 - DEBUG - VRF 2 is not seen in agent 10.0.0.131 2025-11-20 03:34:32,426 - DEBUG - Vrouter 10.0.0.131 does not have vrf 2 for VN ctest-vn2-96953272 2025-11-20 03:34:32,432 - DEBUG - VRF 3 is not seen in agent 10.0.0.48 2025-11-20 03:34:32,437 - DEBUG - Vrouter 10.0.0.48 does not have vrf 3 for VN ctest-vn2-96953272 2025-11-20 03:34:32,437 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn2-96953272 2025-11-20 03:34:32,458 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-96953272 info 2025-11-20 03:34:32,458 - INFO - Deleting VM ctest-vn1_vm2-09809764 2025-11-20 03:34:32,530 - INFO - Deleting VM ctest-vn1_vm1-92143198 2025-11-20 03:34:32,604 - INFO - Deleting VN ctest-vn1-62464585 2025-11-20 03:34:32,642 - DEBUG - VN 5ce4daef-e537-4f7c-851d-4627ce1686c5 still in use: Unable to complete operation on network 5ce4daef-e537-4f7c-851d-4627ce1686c5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-4d8af6d5-7137-4688-80f4-b128003d03df'] 2025-11-20 03:34:32,643 - WARNING - Deleting VN ctest-vn1-62464585 failed..Will retry 2025-11-20 03:34:34,788 - DEBUG - Response for deleting network () 2025-11-20 03:34:34,789 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/15ed2a25-3236-476a-a830-d92f51af96da 2025-11-20 03:34:34,794 - DEBUG - Response Code: 404 2025-11-20 03:34:34,794 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 03:34:34,800 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 03:34:34,862 - DEBUG - Requesting: http://10.0.0.23:8082/project/2f977d2e-f78f-4d60-b06b-bbb3363b4147 2025-11-20 03:34:34,943 - INFO - Validated that VN ctest-vn1-62464585 is not found in API Server 2025-11-20 03:34:34,955 - DEBUG - VN ctest-vn1-62464585 is not present in Agent 10.0.0.131 2025-11-20 03:34:34,966 - DEBUG - VN ctest-vn1-62464585 is not present in Agent 10.0.0.48 2025-11-20 03:34:34,966 - INFO - Validated that VN ctest-vn1-62464585 is not in any agent 2025-11-20 03:34:34,973 - DEBUG - VRF 2 is not seen in agent 10.0.0.48 2025-11-20 03:34:34,979 - DEBUG - Vrouter 10.0.0.48 does not have vrf 2 for VN ctest-vn1-62464585 2025-11-20 03:34:34,979 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-53324127:ctest-vn1-62464585 2025-11-20 03:34:34,999 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-62464585 info 2025-11-20 03:34:35,772 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-53324127, ID : 2f977d2e-f78f-4d60-b06b-bbb3363b4147