2025-11-24 03:39:18,591 - INFO - Domain Default found not creating 2025-11-24 03:39:18,769 - INFO - Project ctest-AnalyticsTestSanityWithResource-80399071 not found, creating it 2025-11-24 03:39:19,362 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-80399071, ID : 50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:39:21,755 - DEBUG - Response for create_network : {'network': {'id': 'cf1325c3-1156-4eeb-bf98-d0999585ca05', 'name': 'ctest-vn1-41213258', 'tenant_id': '50c24144d63d4356abfb0ff144698fec', 'project_id': '50c24144d63d4356abfb0ff144698fec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-80399071', 'ctest-vn1-41213258'], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:39:22,036 - DEBUG - Response for create_subnet : {'subnet': {'id': '7a4d5e74-ca4e-47ed-8556-8fe9a78e278f', 'name': '', 'tenant_id': '50c24144d63d4356abfb0ff144698fec', 'network_id': 'cf1325c3-1156-4eeb-bf98-d0999585ca05', 'ip_version': 4, 'cidr': '131.126.206.192/26', 'allocation_pools': [{'start': '131.126.206.194', 'end': '131.126.206.254'}], 'gateway_ip': '131.126.206.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '131.126.206.194', 'tags': [], 'project_id': '50c24144d63d4356abfb0ff144698fec'}} 2025-11-24 03:39:22,065 - INFO - Created VN ctest-vn1-41213258 2025-11-24 03:39:22,081 - DEBUG - VN ctest-vn1-41213258 UUID is cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:39:22,195 - DEBUG - Services list from nova: [, , , ] 2025-11-24 03:39:22,195 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4803-2', 'an-jenkins-deploy-platform-ansible-os-4803-1']} 2025-11-24 03:39:23,351 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4803-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4803-2) 2025-11-24 03:39:24,960 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4803-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4803-2) 2025-11-24 03:39:24,960 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:39:25,292 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:39:25,335 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:39:25,353 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:39:25,542 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:39:25,561 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:39:25,576 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:39:25,588 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:39:25,599 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4a4c5d34-ceb9-406a-bdc5-0fb245b2027e 2025-11-24 03:39:25,635 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:39:25,635 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:39:25,660 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:39:25,682 - INFO - Verified VN network id 11 for VN cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:39:25,683 - INFO - Verifications in API Server for VN ctest-vn1-41213258 passed 2025-11-24 03:39:25,683 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:39:25,728 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:39:25,745 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:39:25,758 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4a4c5d34-ceb9-406a-bdc5-0fb245b2027e 2025-11-24 03:39:25,778 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:39:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.793161'} 2025-11-24 03:39:25,790 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:39:25,809 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:39:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.810987'} 2025-11-24 03:39:25,827 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:39:25,833 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:39:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.846559'} 2025-11-24 03:39:25,840 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:39:25,840 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-41213258 passed 2025-11-24 03:39:25,840 - DEBUG - ====Verifying policy data for ctest-vn1-41213258 in API_Server ====== 2025-11-24 03:39:25,841 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:39:25,853 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:39:25,872 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:39:25,979 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:39:26,000 - DEBUG - =>VN ctest-vn1-41213258 has no policy to be verified 2025-11-24 03:39:26,000 - DEBUG - Verifying the vn in opserver 2025-11-24 03:39:26,000 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.41 2025-11-24 03:39:26,000 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:39:26,380 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:39:26,488 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:39:26,488 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.50 2025-11-24 03:39:26,488 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:39:26,802 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:39:26,877 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:39:26,877 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.27 2025-11-24 03:39:26,877 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:39:27,216 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:39:27,285 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:39:27,285 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 is found in opserver 2025-11-24 03:39:27,297 - DEBUG - VRF ids for VN ctest-vn1-41213258: {'10.0.0.56': '2'} 2025-11-24 03:39:27,297 - INFO - Waiting for VM ctest-vn1_vm1-58157894 to be up.. 2025-11-24 03:39:27,390 - DEBUG - VM is in ACTIVE state now 2025-11-24 03:39:27,390 - INFO - VM name : ctest-vn1_vm1-58157894 2025-11-24 03:39:27,490 - DEBUG - VM ctest-vn1_vm1-58157894 ID is 79563068-5503-4243-bbff-3159818db7eb 2025-11-24 03:39:27,519 - DEBUG - VM ctest-vn1_vm1-58157894 launched on Node an-jenkins-deploy-platform-ansible-os-4803-2 2025-11-24 03:39:27,625 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/79563068-5503-4243-bbff-3159818db7eb 2025-11-24 03:39:27,935 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/79563068-5503-4243-bbff-3159818db7eb 2025-11-24 03:39:27,979 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/ef334ae1-bb47-415f-a81e-a0a11dcb762d 2025-11-24 03:39:31,211 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-11-24 03:39:31,211 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-58157894 failed! 2025-11-24 03:39:31,230 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 is 131.126.206.193 and allocation pool is NOT set 2025-11-24 03:39:35,309 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-11-24 03:39:35,309 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-58157894 failed! 2025-11-24 03:39:35,326 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 is 131.126.206.193 and allocation pool is NOT set 2025-11-24 03:39:39,408 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-11-24 03:39:39,408 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-58157894 failed! 2025-11-24 03:39:39,425 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 is 131.126.206.193 and allocation pool is NOT set 2025-11-24 03:39:43,494 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-11-24 03:39:43,494 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-58157894 failed! 2025-11-24 03:39:43,510 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 is 131.126.206.193 and allocation pool is NOT set 2025-11-24 03:39:45,584 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.43 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=9.66 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 9.428/9.542/9.656/0.114 ms') 2025-11-24 03:39:45,584 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-58157894 passed 2025-11-24 03:39:45,658 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-24 03:39:45,659 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-58157894, IP 131.126.206.195, Port 22 2025-11-24 03:39:45,725 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-24 03:39:45,808 - DEBUG - VM ctest-vn1_vm1-58157894 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-24 03:39:50,809 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-24 03:39:50,809 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-58157894, IP 131.126.206.195, Port 22 2025-11-24 03:39:50,866 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-24 03:39:50,952 - DEBUG - VM ctest-vn1_vm1-58157894 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-24 03:39:55,952 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-24 03:39:55,952 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-58157894, IP 131.126.206.195, Port 22 2025-11-24 03:39:56,124 - DEBUG - VM ctest-vn1_vm1-58157894 is ready for SSH connections 2025-11-24 03:39:56,124 - INFO - Waiting for VM ctest-vn1_vm2-99743449 to be up.. 2025-11-24 03:39:56,212 - DEBUG - VM is in ACTIVE state now 2025-11-24 03:39:56,212 - INFO - VM name : ctest-vn1_vm2-99743449 2025-11-24 03:39:56,302 - DEBUG - VM ctest-vn1_vm2-99743449 ID is 5e28048d-f475-4864-bad6-0728a44656f3 2025-11-24 03:39:56,302 - DEBUG - VM ctest-vn1_vm2-99743449 launched on Node an-jenkins-deploy-platform-ansible-os-4803-2 2025-11-24 03:39:56,391 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/5e28048d-f475-4864-bad6-0728a44656f3 2025-11-24 03:39:56,403 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/bbfb6abc-b7f8-452b-b478-9ff30078ca9a 2025-11-24 03:39:57,573 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.43 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.494 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.494/1.960/3.426/1.466 ms') 2025-11-24 03:39:57,573 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn1_vm2-99743449 passed 2025-11-24 03:39:57,645 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-24 03:39:57,645 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-99743449, IP 131.126.206.196, Port 22 2025-11-24 03:39:57,821 - DEBUG - VM ctest-vn1_vm2-99743449 is ready for SSH connections 2025-11-24 03:39:58,189 - DEBUG - Response for create_network : {'network': {'id': '30f5b69c-de14-4e80-82f6-0dd7ca05e82f', 'name': 'ctest-vn2-11905411', 'tenant_id': '50c24144d63d4356abfb0ff144698fec', 'project_id': '50c24144d63d4356abfb0ff144698fec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-80399071', 'ctest-vn2-11905411'], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:39:58,442 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ceeb3c02-b9f2-438e-8070-1e850f6d0269', 'name': '', 'tenant_id': '50c24144d63d4356abfb0ff144698fec', 'network_id': '30f5b69c-de14-4e80-82f6-0dd7ca05e82f', 'ip_version': 4, 'cidr': '138.58.224.192/26', 'allocation_pools': [{'start': '138.58.224.194', 'end': '138.58.224.254'}], 'gateway_ip': '138.58.224.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '138.58.224.194', 'tags': [], 'project_id': '50c24144d63d4356abfb0ff144698fec'}} 2025-11-24 03:39:58,471 - INFO - Created VN ctest-vn2-11905411 2025-11-24 03:39:58,485 - DEBUG - VN ctest-vn2-11905411 UUID is 30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:39:58,844 - DEBUG - Response for create_network : {'network': {'id': 'b1bbdea6-abab-49f9-b5df-910bd1af0355', 'name': 'ctest-fip_vn-09459028', 'tenant_id': '50c24144d63d4356abfb0ff144698fec', 'project_id': '50c24144d63d4356abfb0ff144698fec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-80399071', 'ctest-fip_vn-09459028'], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:39:59,119 - DEBUG - Response for create_subnet : {'subnet': {'id': '8d2f5466-9a75-4c10-be27-caff514d93e9', 'name': '', 'tenant_id': '50c24144d63d4356abfb0ff144698fec', 'network_id': 'b1bbdea6-abab-49f9-b5df-910bd1af0355', 'ip_version': 4, 'cidr': '18.144.239.64/26', 'allocation_pools': [{'start': '18.144.239.66', 'end': '18.144.239.126'}], 'gateway_ip': '18.144.239.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '18.144.239.66', 'tags': [], 'project_id': '50c24144d63d4356abfb0ff144698fec'}} 2025-11-24 03:39:59,145 - INFO - Created VN ctest-fip_vn-09459028 2025-11-24 03:39:59,158 - DEBUG - VN ctest-fip_vn-09459028 UUID is b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:39:59,240 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4803-2', 'an-jenkins-deploy-platform-ansible-os-4803-1']} 2025-11-24 03:40:00,580 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4803-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4803-1) 2025-11-24 03:40:02,298 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4803-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4803-1) 2025-11-24 03:40:04,016 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4803-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4803-2) 2025-11-24 03:40:04,017 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:04,028 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:04,048 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:04,155 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:04,166 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:04,175 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:04,182 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:04,190 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4a4c5d34-ceb9-406a-bdc5-0fb245b2027e 2025-11-24 03:40:04,196 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:04,196 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:04,205 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:04,224 - INFO - Verified VN network id 11 for VN cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:04,224 - INFO - Verifications in API Server for VN ctest-vn1-41213258 passed 2025-11-24 03:40:04,225 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:04,240 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:04,250 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:04,260 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4a4c5d34-ceb9-406a-bdc5-0fb245b2027e 2025-11-24 03:40:04,277 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:39:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:42.290095'} 2025-11-24 03:40:04,284 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:04,295 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:39:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:42.306677'} 2025-11-24 03:40:04,302 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:04,308 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:39:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:42.321803'} 2025-11-24 03:40:04,320 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:04,320 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-41213258 passed 2025-11-24 03:40:04,320 - DEBUG - ====Verifying policy data for ctest-vn1-41213258 in API_Server ====== 2025-11-24 03:40:04,320 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:04,330 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:04,349 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:04,449 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:04,458 - DEBUG - =>VN ctest-vn1-41213258 has no policy to be verified 2025-11-24 03:40:04,458 - DEBUG - Verifying the vn in opserver 2025-11-24 03:40:04,458 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.41 2025-11-24 03:40:04,458 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:40:04,537 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:40:04,537 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.50 2025-11-24 03:40:04,537 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:40:04,689 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:40:04,689 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.27 2025-11-24 03:40:04,689 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:40:04,786 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:40:04,786 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 is found in opserver 2025-11-24 03:40:04,812 - DEBUG - VRF ids for VN ctest-vn1-41213258: {'10.0.0.56': '2'} 2025-11-24 03:40:04,812 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:04,828 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:04,843 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:04,962 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:04,984 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:04,998 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:05,014 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:05,029 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/3110ab02-878f-4648-84e4-44a6fc72fa3d 2025-11-24 03:40:05,044 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:05,044 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:05,061 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:05,086 - INFO - Verified VN network id 12 for VN 30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:05,088 - INFO - Verifications in API Server for VN ctest-vn2-11905411 passed 2025-11-24 03:40:05,088 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:05,146 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:05,156 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:05,167 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/3110ab02-878f-4648-84e4-44a6fc72fa3d 2025-11-24 03:40:05,187 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3527926667971677824', 'uuid-lslong': '9436745289659967535'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:39:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.803786'} 2025-11-24 03:40:05,197 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:05,206 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3527926667971677824', 'uuid-lslong': '9436745289659967535'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:39:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.825887'} 2025-11-24 03:40:05,214 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:05,220 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3527926667971677824', 'uuid-lslong': '9436745289659967535'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:39:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.839380'} 2025-11-24 03:40:05,240 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:05,240 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-11905411 passed 2025-11-24 03:40:05,240 - DEBUG - ====Verifying policy data for ctest-vn2-11905411 in API_Server ====== 2025-11-24 03:40:05,240 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:05,258 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:05,283 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:05,434 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:05,454 - DEBUG - =>VN ctest-vn2-11905411 has no policy to be verified 2025-11-24 03:40:05,454 - DEBUG - Verifying the vn in opserver 2025-11-24 03:40:05,454 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 virtual network link through opserver 10.0.0.41 2025-11-24 03:40:05,455 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:40:05,550 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411?flat'} 2025-11-24 03:40:05,550 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 virtual network link through opserver 10.0.0.50 2025-11-24 03:40:05,550 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:40:05,663 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411?flat'} 2025-11-24 03:40:05,663 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 virtual network link through opserver 10.0.0.27 2025-11-24 03:40:05,663 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:40:05,785 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411?flat'} 2025-11-24 03:40:05,785 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 is found in opserver 2025-11-24 03:40:05,798 - DEBUG - VRF ids for VN ctest-vn2-11905411: {'10.0.0.57': '2'} 2025-11-24 03:40:05,798 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:05,808 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:05,832 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:05,976 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:06,003 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:06,016 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5770b7f7-577d-4515-a7fd-2e7e5cbdc507 2025-11-24 03:40:06,031 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5770b7f7-577d-4515-a7fd-2e7e5cbdc507 2025-11-24 03:40:06,045 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/413dd56f-5d7d-497a-a511-5855d481eff1 2025-11-24 03:40:06,053 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:40:06,054 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:06,068 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5770b7f7-577d-4515-a7fd-2e7e5cbdc507 2025-11-24 03:40:06,089 - INFO - Verified VN network id 13 for VN b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:06,089 - INFO - Verifications in API Server for VN ctest-fip_vn-09459028 passed 2025-11-24 03:40:06,090 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:06,101 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5770b7f7-577d-4515-a7fd-2e7e5cbdc507 2025-11-24 03:40:06,110 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5770b7f7-577d-4515-a7fd-2e7e5cbdc507 2025-11-24 03:40:06,120 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/413dd56f-5d7d-497a-a511-5855d481eff1 2025-11-24 03:40:06,138 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12807074772784204281', 'uuid-lslong': '13105352920620008277'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:39:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.097334'} 2025-11-24 03:40:06,146 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:40:06,154 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12807074772784204281', 'uuid-lslong': '13105352920620008277'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:39:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.102395'} 2025-11-24 03:40:06,164 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:40:06,172 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12807074772784204281', 'uuid-lslong': '13105352920620008277'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:39:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.127348'} 2025-11-24 03:40:06,179 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:40:06,179 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-09459028 passed 2025-11-24 03:40:06,179 - DEBUG - ====Verifying policy data for ctest-fip_vn-09459028 in API_Server ====== 2025-11-24 03:40:06,179 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:06,190 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:06,205 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:06,315 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:06,327 - DEBUG - =>VN ctest-fip_vn-09459028 has no policy to be verified 2025-11-24 03:40:06,327 - DEBUG - Verifying the vn in opserver 2025-11-24 03:40:06,327 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 virtual network link through opserver 10.0.0.41 2025-11-24 03:40:06,327 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:40:06,341 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028?flat'} 2025-11-24 03:40:06,341 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 virtual network link through opserver 10.0.0.50 2025-11-24 03:40:06,341 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:40:06,354 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028?flat'} 2025-11-24 03:40:06,354 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 virtual network link through opserver 10.0.0.27 2025-11-24 03:40:06,354 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:40:06,370 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028?flat'} 2025-11-24 03:40:06,371 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 is found in opserver 2025-11-24 03:40:06,383 - DEBUG - VRF ids for VN ctest-fip_vn-09459028: {'10.0.0.57': '3'} 2025-11-24 03:40:06,383 - INFO - Waiting for VM ctest-fvn_vm1-16088679 to be up.. 2025-11-24 03:40:06,491 - DEBUG - VM is in ACTIVE state now 2025-11-24 03:40:06,491 - INFO - VM name : ctest-fvn_vm1-16088679 2025-11-24 03:40:06,590 - DEBUG - VM ctest-fvn_vm1-16088679 ID is 737e9353-27c5-482e-9cef-e56e953d162f 2025-11-24 03:40:06,590 - DEBUG - VM ctest-fvn_vm1-16088679 launched on Node an-jenkins-deploy-platform-ansible-os-4803-1 2025-11-24 03:40:06,690 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/737e9353-27c5-482e-9cef-e56e953d162f 2025-11-24 03:40:06,702 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/a4d2b8cf-e1cf-414a-8bc5-17ed2df226ef 2025-11-24 03:40:09,921 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-11-24 03:40:09,921 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-16088679 failed! 2025-11-24 03:40:09,949 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 is 18.144.239.65 and allocation pool is NOT set 2025-11-24 03:40:14,045 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms') 2025-11-24 03:40:14,046 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-16088679 failed! 2025-11-24 03:40:14,065 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 is 18.144.239.65 and allocation pool is NOT set 2025-11-24 03:40:18,136 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-11-24 03:40:18,136 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-16088679 failed! 2025-11-24 03:40:18,149 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 is 18.144.239.65 and allocation pool is NOT set 2025-11-24 03:40:22,239 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-11-24 03:40:22,239 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-16088679 failed! 2025-11-24 03:40:22,255 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 is 18.144.239.65 and allocation pool is NOT set 2025-11-24 03:40:26,331 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=4.81 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1014ms\r\nrtt min/avg/max/mdev = 4.805/4.805/4.805/0.000 ms') 2025-11-24 03:40:26,331 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-16088679 passed 2025-11-24 03:40:26,408 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-24 03:40:26,408 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-16088679, IP 18.144.239.67, Port 22 2025-11-24 03:40:26,476 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-24 03:40:26,582 - DEBUG - VM ctest-fvn_vm1-16088679 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-24 03:40:31,582 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-24 03:40:31,582 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-16088679, IP 18.144.239.67, Port 22 2025-11-24 03:40:31,649 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-24 03:40:31,747 - DEBUG - VM ctest-fvn_vm1-16088679 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-24 03:40:36,747 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-24 03:40:36,747 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-16088679, IP 18.144.239.67, Port 22 2025-11-24 03:40:36,917 - DEBUG - VM ctest-fvn_vm1-16088679 is ready for SSH connections 2025-11-24 03:40:36,917 - INFO - Waiting for VM ctest-vn2_vm2-20053055 to be up.. 2025-11-24 03:40:37,020 - DEBUG - VM is in ACTIVE state now 2025-11-24 03:40:37,020 - INFO - VM name : ctest-vn2_vm2-20053055 2025-11-24 03:40:37,117 - DEBUG - VM ctest-vn2_vm2-20053055 ID is 114aa272-e788-48ff-8811-d532ab1579c3 2025-11-24 03:40:37,117 - DEBUG - VM ctest-vn2_vm2-20053055 launched on Node an-jenkins-deploy-platform-ansible-os-4803-1 2025-11-24 03:40:37,209 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/114aa272-e788-48ff-8811-d532ab1579c3 2025-11-24 03:40:37,222 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/1cee44c4-2398-4d78-8e7f-75f029cbd4c9 2025-11-24 03:40:38,398 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.16 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.80 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.804/1.981/2.158/0.177 ms') 2025-11-24 03:40:38,398 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2_vm2-20053055 passed 2025-11-24 03:40:38,472 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-24 03:40:38,472 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-20053055, IP 138.58.224.195, Port 22 2025-11-24 03:40:38,645 - DEBUG - VM ctest-vn2_vm2-20053055 is ready for SSH connections 2025-11-24 03:40:38,645 - INFO - Waiting for VM mltf_vm to be up.. 2025-11-24 03:40:38,733 - DEBUG - VM is in ACTIVE state now 2025-11-24 03:40:38,733 - INFO - VM name : mltf_vm 2025-11-24 03:40:38,820 - DEBUG - VM mltf_vm ID is 57f2efae-d38a-450f-a1d5-a146f1e5a6df 2025-11-24 03:40:38,820 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-4803-2 2025-11-24 03:40:38,993 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/57f2efae-d38a-450f-a1d5-a146f1e5a6df 2025-11-24 03:40:39,004 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/441932ef-d16e-4ddf-a772-67ce415cc204 2025-11-24 03:40:39,014 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/d238250f-a36d-4d4d-9ea6-66e4f09aec3e 2025-11-24 03:40:40,183 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.52 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.507 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.507/1.514/2.522/1.007 ms') 2025-11-24 03:40:40,183 - INFO - Ping to Metadata IP 169.254.0.5 of VM mltf_vm passed 2025-11-24 03:40:40,267 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-24 03:40:40,267 - DEBUG - Waiting to SSH to VM mltf_vm, IP 131.126.206.197, Port 22 2025-11-24 03:40:40,432 - DEBUG - VM mltf_vm is ready for SSH connections 2025-11-24 03:40:40,509 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-24 03:40:40,509 - DEBUG - Waiting to SSH to VM mltf_vm, IP 131.126.206.197, Port 22 2025-11-24 03:40:40,669 - DEBUG - VM mltf_vm is ready for SSH connections 2025-11-24 03:40:40,672 - INFO - ================================================================================ 2025-11-24 03:40:40,672 - INFO - STARTING TEST : test_verify_session_sampling_teardown 2025-11-24 03:40:40,672 - INFO - TEST DESCRIPTION : 1.query client session samples 2.query server session samples 3.query client session to get number of sessions exported 4.query session record table for teardown bytes/pkts 5.query sample count after teardown on server side 2025-11-24 03:40:41,941 - DEBUG - Skipping xmpp flap check 2025-11-24 03:40:41,941 - INFO - Initial checks done. Running the testcase now 2025-11-24 03:40:41,941 - INFO - 2025-11-24 03:40:42,086 - INFO - Setting flow export rate: 100 2025-11-24 03:40:42,134 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-11-24 03:40:42,567 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'cf1325c3-1156-4eeb-bf98-d0999585ca05', 'name': 'ctest-vn1-41213258', 'tenant_id': '50c24144d63d4356abfb0ff144698fec', 'project_id': '50c24144d63d4356abfb0ff144698fec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['7a4d5e74-ca4e-47ed-8556-8fe9a78e278f'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-80399071', 'ctest-vn1-41213258'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-80399071', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '131.126.206.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:40:42,880 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '30f5b69c-de14-4e80-82f6-0dd7ca05e82f', 'name': 'ctest-vn2-11905411', 'tenant_id': '50c24144d63d4356abfb0ff144698fec', 'project_id': '50c24144d63d4356abfb0ff144698fec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['ceeb3c02-b9f2-438e-8070-1e850f6d0269'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-80399071', 'ctest-vn2-11905411'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-80399071', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '138.58.224.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:40:42,987 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:42,998 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:43,069 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:43,202 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:43,236 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:43,256 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:43,267 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:43,277 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4a4c5d34-ceb9-406a-bdc5-0fb245b2027e 2025-11-24 03:40:43,296 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:43,297 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:43,308 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:43,328 - INFO - Verified VN network id 11 for VN cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:43,328 - INFO - Verifications in API Server for VN ctest-vn1-41213258 passed 2025-11-24 03:40:43,328 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:43,342 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:43,354 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:43,365 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4a4c5d34-ceb9-406a-bdc5-0fb245b2027e 2025-11-24 03:40:43,380 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.868327'} 2025-11-24 03:40:43,388 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:43,395 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.887634'} 2025-11-24 03:40:43,402 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:43,407 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.894753'} 2025-11-24 03:40:43,414 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:43,414 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-41213258 passed 2025-11-24 03:40:43,414 - DEBUG - ====Verifying policy data for ctest-vn1-41213258 in API_Server ====== 2025-11-24 03:40:43,414 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:43,421 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:43,437 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:43,535 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:43,547 - DEBUG - ==>Verifying data for policy with id: 5714c8fc-3607-4c8c-9c97-60c2d6a68c2c, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-80399071', 'policy1'] 2025-11-24 03:40:43,547 - INFO - VN ctest-vn1-41213258 Policy verification: verify_vn_policy_in_api_server, status: True 2025-11-24 03:40:43,547 - DEBUG - Verifying the vn in opserver 2025-11-24 03:40:43,547 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.41 2025-11-24 03:40:43,547 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:40:43,560 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:40:43,560 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.50 2025-11-24 03:40:43,560 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:40:43,575 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:40:43,575 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.27 2025-11-24 03:40:43,575 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:40:43,587 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:40:43,587 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 is found in opserver 2025-11-24 03:40:43,599 - DEBUG - VRF ids for VN ctest-vn1-41213258: {'10.0.0.56': '2'} 2025-11-24 03:40:43,599 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:43,606 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:43,618 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:43,709 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:43,733 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:43,745 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:43,755 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:43,764 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/3110ab02-878f-4648-84e4-44a6fc72fa3d 2025-11-24 03:40:43,770 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:43,771 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:43,781 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:43,797 - INFO - Verified VN network id 12 for VN 30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:43,797 - INFO - Verifications in API Server for VN ctest-vn2-11905411 passed 2025-11-24 03:40:43,797 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:43,808 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:43,817 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:43,826 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/3110ab02-878f-4648-84e4-44a6fc72fa3d 2025-11-24 03:40:43,838 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3527926667971677824', 'uuid-lslong': '9436745289659967535'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.994498'} 2025-11-24 03:40:43,845 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:43,851 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3527926667971677824', 'uuid-lslong': '9436745289659967535'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.011519'} 2025-11-24 03:40:43,858 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:43,864 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3527926667971677824', 'uuid-lslong': '9436745289659967535'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.020863'} 2025-11-24 03:40:43,870 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:43,870 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-11905411 passed 2025-11-24 03:40:43,871 - DEBUG - ====Verifying policy data for ctest-vn2-11905411 in API_Server ====== 2025-11-24 03:40:43,871 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:43,877 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:43,888 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:43,996 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:44,008 - DEBUG - ==>Verifying data for policy with id: 5714c8fc-3607-4c8c-9c97-60c2d6a68c2c, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-80399071', 'policy1'] 2025-11-24 03:40:44,008 - INFO - VN ctest-vn2-11905411 Policy verification: verify_vn_policy_in_api_server, status: True 2025-11-24 03:40:44,008 - DEBUG - Verifying the vn in opserver 2025-11-24 03:40:44,008 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 virtual network link through opserver 10.0.0.41 2025-11-24 03:40:44,009 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:40:44,021 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411?flat'} 2025-11-24 03:40:44,021 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 virtual network link through opserver 10.0.0.50 2025-11-24 03:40:44,021 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:40:44,034 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411?flat'} 2025-11-24 03:40:44,034 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 virtual network link through opserver 10.0.0.27 2025-11-24 03:40:44,034 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:40:44,046 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411?flat'} 2025-11-24 03:40:44,046 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 is found in opserver 2025-11-24 03:40:44,058 - DEBUG - VRF ids for VN ctest-vn2-11905411: {'10.0.0.57': '2', '10.0.0.56': '3'} 2025-11-24 03:40:44,058 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:44,064 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:44,077 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:44,178 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:44,190 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:44,202 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:44,211 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:44,222 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4a4c5d34-ceb9-406a-bdc5-0fb245b2027e 2025-11-24 03:40:44,230 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:44,230 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:44,244 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:44,264 - INFO - Verified VN network id 11 for VN cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:44,264 - INFO - Verifications in API Server for VN ctest-vn1-41213258 passed 2025-11-24 03:40:44,264 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:44,274 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:44,283 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:40:44,292 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4a4c5d34-ceb9-406a-bdc5-0fb245b2027e 2025-11-24 03:40:44,306 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.792481'} 2025-11-24 03:40:44,316 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:44,322 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.815250'} 2025-11-24 03:40:44,329 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:44,335 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14921311510148304619', 'uuid-lslong': '13806014015761402373'}, 'enable': 'true', 'created': '2025-11-24T03:39:21', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.822700'} 2025-11-24 03:40:44,344 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:40:44,344 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-41213258 passed 2025-11-24 03:40:44,345 - DEBUG - ====Verifying policy data for ctest-vn1-41213258 in API_Server ====== 2025-11-24 03:40:44,345 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:44,353 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:44,367 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:44,474 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cf1325c3-1156-4eeb-bf98-d0999585ca05 2025-11-24 03:40:44,487 - DEBUG - ==>Verifying data for policy with id: 5714c8fc-3607-4c8c-9c97-60c2d6a68c2c, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-80399071', 'policy1'] 2025-11-24 03:40:44,487 - INFO - VN ctest-vn1-41213258 Policy verification: verify_vn_policy_in_api_server, status: True 2025-11-24 03:40:44,487 - DEBUG - Verifying the vn in opserver 2025-11-24 03:40:44,488 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.41 2025-11-24 03:40:44,488 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:40:44,502 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:40:44,502 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.50 2025-11-24 03:40:44,502 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:40:44,516 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:40:44,516 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 virtual network link through opserver 10.0.0.27 2025-11-24 03:40:44,516 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:40:44,530 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258?flat'} 2025-11-24 03:40:44,530 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 is found in opserver 2025-11-24 03:40:44,541 - DEBUG - VRF ids for VN ctest-vn1-41213258: {'10.0.0.56': '2'} 2025-11-24 03:40:44,541 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:44,548 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:44,561 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:44,655 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:44,673 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:44,686 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:44,694 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:44,705 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/3110ab02-878f-4648-84e4-44a6fc72fa3d 2025-11-24 03:40:44,712 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:44,713 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:44,724 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:44,743 - INFO - Verified VN network id 12 for VN 30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:44,743 - INFO - Verifications in API Server for VN ctest-vn2-11905411 passed 2025-11-24 03:40:44,743 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:44,754 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:44,763 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:40:44,771 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/3110ab02-878f-4648-84e4-44a6fc72fa3d 2025-11-24 03:40:44,784 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3527926667971677824', 'uuid-lslong': '9436745289659967535'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.939995'} 2025-11-24 03:40:44,792 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:44,799 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3527926667971677824', 'uuid-lslong': '9436745289659967535'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.959126'} 2025-11-24 03:40:44,807 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:44,814 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3527926667971677824', 'uuid-lslong': '9436745289659967535'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:40:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.970913'} 2025-11-24 03:40:44,820 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:40:44,820 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-11905411 passed 2025-11-24 03:40:44,820 - DEBUG - ====Verifying policy data for ctest-vn2-11905411 in API_Server ====== 2025-11-24 03:40:44,820 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:44,828 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:44,840 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:44,940 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/30f5b69c-de14-4e80-82f6-0dd7ca05e82f 2025-11-24 03:40:44,951 - DEBUG - ==>Verifying data for policy with id: 5714c8fc-3607-4c8c-9c97-60c2d6a68c2c, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-80399071', 'policy1'] 2025-11-24 03:40:44,951 - INFO - VN ctest-vn2-11905411 Policy verification: verify_vn_policy_in_api_server, status: True 2025-11-24 03:40:44,951 - DEBUG - Verifying the vn in opserver 2025-11-24 03:40:44,951 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 virtual network link through opserver 10.0.0.41 2025-11-24 03:40:44,951 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:40:44,966 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411?flat'} 2025-11-24 03:40:44,966 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 virtual network link through opserver 10.0.0.50 2025-11-24 03:40:44,966 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:40:44,980 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411?flat'} 2025-11-24 03:40:44,980 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 virtual network link through opserver 10.0.0.27 2025-11-24 03:40:44,980 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:40:44,995 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411?flat'} 2025-11-24 03:40:44,995 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 is found in opserver 2025-11-24 03:40:45,008 - DEBUG - VRF ids for VN ctest-vn2-11905411: {'10.0.0.57': '2', '10.0.0.56': '3'} 2025-11-24 03:40:45,008 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:45,015 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:45,027 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:45,129 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:45,143 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:45,154 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5770b7f7-577d-4515-a7fd-2e7e5cbdc507 2025-11-24 03:40:45,163 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5770b7f7-577d-4515-a7fd-2e7e5cbdc507 2025-11-24 03:40:45,173 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/413dd56f-5d7d-497a-a511-5855d481eff1 2025-11-24 03:40:45,182 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:40:45,182 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:45,192 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5770b7f7-577d-4515-a7fd-2e7e5cbdc507 2025-11-24 03:40:45,213 - INFO - Verified VN network id 13 for VN b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:45,213 - INFO - Verifications in API Server for VN ctest-fip_vn-09459028 passed 2025-11-24 03:40:45,213 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:45,227 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5770b7f7-577d-4515-a7fd-2e7e5cbdc507 2025-11-24 03:40:45,237 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5770b7f7-577d-4515-a7fd-2e7e5cbdc507 2025-11-24 03:40:45,248 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/413dd56f-5d7d-497a-a511-5855d481eff1 2025-11-24 03:40:45,266 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12807074772784204281', 'uuid-lslong': '13105352920620008277'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:39:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:46.223097'} 2025-11-24 03:40:45,273 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:40:45,279 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12807074772784204281', 'uuid-lslong': '13105352920620008277'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:39:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:46.228026'} 2025-11-24 03:40:45,286 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:40:45,293 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-80399071', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12807074772784204281', 'uuid-lslong': '13105352920620008277'}, 'enable': 'true', 'created': '2025-11-24T03:39:58', 'last-modified': '2025-11-24T03:39:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:46.248676'} 2025-11-24 03:40:45,300 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:40:45,300 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-09459028 passed 2025-11-24 03:40:45,300 - DEBUG - ====Verifying policy data for ctest-fip_vn-09459028 in API_Server ====== 2025-11-24 03:40:45,300 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:40:45,310 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:40:45,324 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:40:45,421 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b1bbdea6-abab-49f9-b5df-910bd1af0355 2025-11-24 03:40:45,433 - DEBUG - =>VN ctest-fip_vn-09459028 has no policy to be verified 2025-11-24 03:40:45,433 - DEBUG - Verifying the vn in opserver 2025-11-24 03:40:45,433 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 virtual network link through opserver 10.0.0.41 2025-11-24 03:40:45,433 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:40:45,445 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028?flat'} 2025-11-24 03:40:45,445 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 virtual network link through opserver 10.0.0.50 2025-11-24 03:40:45,445 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:40:45,458 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028?flat'} 2025-11-24 03:40:45,458 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 virtual network link through opserver 10.0.0.27 2025-11-24 03:40:45,458 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:40:45,475 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028?flat'} 2025-11-24 03:40:45,475 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 is found in opserver 2025-11-24 03:40:45,487 - DEBUG - VRF ids for VN ctest-fip_vn-09459028: {'10.0.0.57': '3'} 2025-11-24 03:40:45,487 - INFO - start time= 1763955645487929 2025-11-24 03:40:45,488 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 138.58.224.195, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.56, gateway password: c0ntrail123 2025-11-24 03:40:45,488 - DEBUG - ping -s 56 -c 3 -W 1 138.58.224.195 2025-11-24 03:40:49,116 - DEBUG - PING 138.58.224.195 (138.58.224.195): 56 data bytes 64 bytes from 138.58.224.195: seq=0 ttl=63 time=5.929 ms 64 bytes from 138.58.224.195: seq=1 ttl=63 time=1.755 ms 64 bytes from 138.58.224.195: seq=2 ttl=63 time=2.202 ms --- 138.58.224.195 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.755/3.295/5.929 ms 2025-11-24 03:40:49,116 - INFO - Ping to IP 138.58.224.195 from VM ctest-vn1_vm1-58157894 passed 2025-11-24 03:40:59,116 - INFO - Verify session samples and teardown pkts 2025-11-24 03:40:59,116 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.41 2025-11-24 03:40:59,119 - DEBUG - Posting: http://10.0.0.41:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1763955645487929, 'end_time': 1763955659119680, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-11-24 03:41:00,145 - DEBUG - [{'T': 1763955647621904}, {'T': 1763955648621970}, {'T': 1763955649622066}] 2025-11-24 03:41:00,145 - DEBUG - Posting: http://10.0.0.41:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1763955645487929, 'end_time': 1763955660145455, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2025-11-24 03:41:01,169 - DEBUG - [{'T': 1763955647701092}, {'T': 1763955648701400}, {'T': 1763955649701555}] 2025-11-24 03:41:01,169 - DEBUG - Posting: http://10.0.0.41:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1763955645487929, 'end_time': 1763955661169884, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-11-24 03:41:02,192 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'sample_count': 3}] 2025-11-24 03:41:02,192 - INFO - wait for the flows to get expire 2025-11-24 03:44:22,193 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4803-2:Compute:contrail-vrouter-agent:0?flat 2025-11-24 03:44:22,230 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4803-2?flat 2025-11-24 03:44:22,259 - DEBUG - Posting: http://10.0.0.41:8081/analytics/query, payload {'table': 'SessionRecordTable', 'start_time': 1763955645487929, 'end_time': 1763955862259355, 'select_fields': ['vn', 'remote_vn', 'forward_teardown_pkts', 'reverse_teardown_pkts'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-11-24 03:44:23,288 - DEBUG - [{'forward_flow_uuid': 'dba6f065-5427-4bb9-b5ca-a317212a4759', 'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'reverse_flow_uuid': 'a6797833-9630-4ddb-890d-96a3fd660c60', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'forward_teardown_pkts': 3, 'reverse_teardown_pkts': 3}] 2025-11-24 03:44:23,288 - DEBUG - Posting: http://10.0.0.41:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1763955645487929, 'end_time': 1763955863288285, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-11-24 03:44:24,311 - DEBUG - Posting: http://10.0.0.41:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1763955645487929, 'end_time': 1763955864311206, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2025-11-24 03:44:25,344 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411', 'sample_count': 4}] 2025-11-24 03:44:25,898 - INFO - Deleted policy policy1 2025-11-24 03:44:26,022 - INFO - Setting flow export rate: None 2025-11-24 03:44:27,326 - DEBUG - Skipping xmpp flap check
2025-11-24 03:44:27,326 - INFO - END TEST : test_verify_session_sampling_teardown : PASSED[0:03:47]
2025-11-24 03:44:27,326 - INFO - -------------------------------------------------------------------------------- 2025-11-24 03:44:27,328 - INFO - Deleting VM mltf_vm 2025-11-24 03:44:27,401 - INFO - Deleting VM ctest-fvn_vm1-16088679 2025-11-24 03:44:27,486 - INFO - Deleting VM ctest-vn2_vm2-20053055 2025-11-24 03:44:27,569 - INFO - Deleting VN ctest-fip_vn-09459028 2025-11-24 03:44:27,618 - DEBUG - VN b1bbdea6-abab-49f9-b5df-910bd1af0355 still in use: Unable to complete operation on network b1bbdea6-abab-49f9-b5df-910bd1af0355. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-bec087b0-f6d2-4fc2-a76a-831986cb17b9'] 2025-11-24 03:44:27,618 - WARNING - Deleting VN ctest-fip_vn-09459028 failed..Will retry 2025-11-24 03:44:29,830 - DEBUG - Response for deleting network () 2025-11-24 03:44:29,830 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5770b7f7-577d-4515-a7fd-2e7e5cbdc507 2025-11-24 03:44:29,877 - DEBUG - Response Code: 404 2025-11-24 03:44:29,877 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:44:29,884 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:44:29,895 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:44:30,004 - INFO - Validated that VN ctest-fip_vn-09459028 is not found in API Server 2025-11-24 03:44:30,016 - DEBUG - VN ctest-fip_vn-09459028 is not present in Agent 10.0.0.57 2025-11-24 03:44:30,026 - DEBUG - VN ctest-fip_vn-09459028 is not present in Agent 10.0.0.56 2025-11-24 03:44:30,026 - INFO - Validated that VN ctest-fip_vn-09459028 is not in any agent 2025-11-24 03:44:30,032 - DEBUG - VRF 3 is not seen in agent 10.0.0.57 2025-11-24 03:44:30,038 - DEBUG - Vrouter 10.0.0.57 does not have vrf 3 for VN ctest-fip_vn-09459028 2025-11-24 03:44:30,038 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-fip_vn-09459028 2025-11-24 03:44:30,060 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-09459028 info 2025-11-24 03:44:30,060 - INFO - Deleting VN ctest-vn2-11905411 2025-11-24 03:44:30,277 - DEBUG - Response for deleting network () 2025-11-24 03:44:30,277 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3da11759-f41b-40e1-a806-ae575cc5ec37 2025-11-24 03:44:30,294 - DEBUG - Response Code: 404 2025-11-24 03:44:30,295 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:44:30,304 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:44:30,332 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:44:30,442 - INFO - Validated that VN ctest-vn2-11905411 is not found in API Server 2025-11-24 03:44:30,454 - DEBUG - VN ctest-vn2-11905411 is not present in Agent 10.0.0.57 2025-11-24 03:44:30,468 - DEBUG - VN ctest-vn2-11905411 is not present in Agent 10.0.0.56 2025-11-24 03:44:30,469 - INFO - Validated that VN ctest-vn2-11905411 is not in any agent 2025-11-24 03:44:30,476 - DEBUG - VRF 2 is not seen in agent 10.0.0.57 2025-11-24 03:44:30,483 - DEBUG - Vrouter 10.0.0.57 does not have vrf 2 for VN ctest-vn2-11905411 2025-11-24 03:44:30,489 - DEBUG - VRF 3 is not seen in agent 10.0.0.56 2025-11-24 03:44:30,495 - DEBUG - Vrouter 10.0.0.56 does not have vrf 3 for VN ctest-vn2-11905411 2025-11-24 03:44:30,495 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn2-11905411 2025-11-24 03:44:30,546 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-11905411 info 2025-11-24 03:44:30,546 - INFO - Deleting VM ctest-vn1_vm2-99743449 2025-11-24 03:44:30,658 - INFO - Deleting VM ctest-vn1_vm1-58157894 2025-11-24 03:44:30,758 - INFO - Deleting VN ctest-vn1-41213258 2025-11-24 03:44:30,818 - DEBUG - VN cf1325c3-1156-4eeb-bf98-d0999585ca05 still in use: Unable to complete operation on network cf1325c3-1156-4eeb-bf98-d0999585ca05. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-2ff5f5ed-501f-491b-bfa9-eedcde996126'] 2025-11-24 03:44:30,818 - WARNING - Deleting VN ctest-vn1-41213258 failed..Will retry 2025-11-24 03:44:32,977 - DEBUG - Response for deleting network () 2025-11-24 03:44:32,977 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/38421f3f-eec4-40cd-a4da-7aa39de862f8 2025-11-24 03:44:32,984 - DEBUG - Response Code: 404 2025-11-24 03:44:32,984 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:44:32,999 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:44:33,015 - DEBUG - Requesting: http://10.0.0.41:8082/project/50c24144-d63d-4356-abfb-0ff144698fec 2025-11-24 03:44:33,122 - INFO - Validated that VN ctest-vn1-41213258 is not found in API Server 2025-11-24 03:44:33,133 - DEBUG - VN ctest-vn1-41213258 is not present in Agent 10.0.0.57 2025-11-24 03:44:33,143 - DEBUG - VN ctest-vn1-41213258 is not present in Agent 10.0.0.56 2025-11-24 03:44:33,143 - INFO - Validated that VN ctest-vn1-41213258 is not in any agent 2025-11-24 03:44:33,148 - DEBUG - VRF 2 is not seen in agent 10.0.0.56 2025-11-24 03:44:33,152 - DEBUG - Vrouter 10.0.0.56 does not have vrf 2 for VN ctest-vn1-41213258 2025-11-24 03:44:33,152 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-80399071:ctest-vn1-41213258 2025-11-24 03:44:33,173 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-41213258 info 2025-11-24 03:44:34,046 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-80399071, ID : 50c24144-d63d-4356-abfb-0ff144698fec