2026-04-27 04:21:09,382 - INFO - Domain Default found not creating 2026-04-27 04:21:09,581 - INFO - Project ctest-AnalyticsTestSanityWithResource-50363999 not found, creating it 2026-04-27 04:21:10,340 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-50363999, ID : 1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:21:13,149 - DEBUG - Response for create_network : {'network': {'id': 'ba1a3442-c0f2-45b5-a131-1fd9988cba5a', 'name': 'ctest-vn1-99981950', 'tenant_id': '1ef724e03e654514b0b91a94bc70abbd', 'project_id': '1ef724e03e654514b0b91a94bc70abbd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-50363999', 'ctest-vn1-99981950'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 04:21:13,498 - DEBUG - Response for create_subnet : {'subnet': {'id': '39000951-69f8-4fe3-a9a7-a020e6f1a2b8', 'name': '', 'tenant_id': '1ef724e03e654514b0b91a94bc70abbd', 'network_id': 'ba1a3442-c0f2-45b5-a131-1fd9988cba5a', 'ip_version': 4, 'cidr': '163.14.253.128/26', 'allocation_pools': [{'start': '163.14.253.130', 'end': '163.14.253.190'}], 'gateway_ip': '163.14.253.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '163.14.253.130', 'tags': [], 'project_id': '1ef724e03e654514b0b91a94bc70abbd'}} 2026-04-27 04:21:13,528 - INFO - Created VN ctest-vn1-99981950 2026-04-27 04:21:13,545 - DEBUG - VN ctest-vn1-99981950 UUID is ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:21:13,685 - DEBUG - Services list from nova: [, , , ] 2026-04-27 04:21:13,685 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5690-1', 'an-jenkins-deploy-platform-ansible-os-5690-2']} 2026-04-27 04:21:15,353 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5690-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5690-1) 2026-04-27 04:21:17,168 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5690-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5690-1) 2026-04-27 04:21:17,170 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:21:17,509 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:21:17,563 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:21:17,595 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:21:17,757 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:21:17,780 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:21:17,815 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:21:17,852 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:21:17,873 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ae1f1d38-b0b0-4861-827f-8d15e3e767d7 2026-04-27 04:21:17,905 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:21:17,906 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:21:17,940 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:21:17,987 - INFO - Verified VN network id 17 for VN ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:21:17,987 - INFO - Verifications in API Server for VN ctest-vn1-99981950 passed 2026-04-27 04:21:17,987 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:21:18,017 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:21:18,041 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:21:18,067 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ae1f1d38-b0b0-4861-827f-8d15e3e767d7 2026-04-27 04:21:18,092 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:21:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.664139'} 2026-04-27 04:21:18,100 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:21:18,109 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:21:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.691037'} 2026-04-27 04:21:18,121 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:21:18,128 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:21:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.705321'} 2026-04-27 04:21:18,137 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:21:18,137 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-99981950 passed 2026-04-27 04:21:18,137 - DEBUG - ====Verifying policy data for ctest-vn1-99981950 in API_Server ====== 2026-04-27 04:21:18,137 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:21:18,152 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:21:18,172 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:21:18,347 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:21:18,366 - DEBUG - =>VN ctest-vn1-99981950 has no policy to be verified 2026-04-27 04:21:18,366 - DEBUG - Verifying the vn in opserver 2026-04-27 04:21:18,366 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.41 2026-04-27 04:21:18,367 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 04:21:18,677 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 04:21:18,765 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:21:18,765 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.249 2026-04-27 04:21:18,765 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 04:21:19,113 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 04:21:19,205 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:21:19,205 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.23 2026-04-27 04:21:19,205 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 04:21:19,555 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 04:21:19,655 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:21:19,655 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 is found in opserver 2026-04-27 04:21:19,668 - DEBUG - VRF ids for VN ctest-vn1-99981950: {'10.0.0.33': '4'} 2026-04-27 04:21:19,669 - INFO - Waiting for VM ctest-vn1_vm1-00594477 to be up.. 2026-04-27 04:21:19,790 - DEBUG - VM is in ACTIVE state now 2026-04-27 04:21:19,790 - INFO - VM name : ctest-vn1_vm1-00594477 2026-04-27 04:21:19,912 - DEBUG - VM ctest-vn1_vm1-00594477 ID is b8a8fdb8-d146-4051-acd2-a7d7b87b4e24 2026-04-27 04:21:19,944 - DEBUG - VM ctest-vn1_vm1-00594477 launched on Node an-jenkins-deploy-platform-ansible-os-5690-1 2026-04-27 04:21:20,078 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b8a8fdb8-d146-4051-acd2-a7d7b87b4e24 2026-04-27 04:21:20,424 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/b8a8fdb8-d146-4051-acd2-a7d7b87b4e24 2026-04-27 04:21:20,473 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ff6a69aa-a63c-4b75-b55f-ee78e860d5f5 2026-04-27 04:21:23,674 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2026-04-27 04:21:23,674 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-00594477 failed! 2026-04-27 04:21:23,693 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 is 163.14.253.129 and allocation pool is NOT set 2026-04-27 04:21:27,770 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2026-04-27 04:21:27,770 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-00594477 failed! 2026-04-27 04:21:27,794 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 is 163.14.253.129 and allocation pool is NOT set 2026-04-27 04:21:31,870 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2026-04-27 04:21:31,870 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-00594477 failed! 2026-04-27 04:21:31,890 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 is 163.14.253.129 and allocation pool is NOT set 2026-04-27 04:21:35,968 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2026-04-27 04:21:35,968 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-00594477 failed! 2026-04-27 04:21:35,990 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 is 163.14.253.129 and allocation pool is NOT set 2026-04-27 04:21:40,064 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=4.72 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1006ms\r\nrtt min/avg/max/mdev = 4.723/4.723/4.723/0.000 ms') 2026-04-27 04:21:40,064 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-00594477 passed 2026-04-27 04:21:40,148 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-27 04:21:40,149 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-00594477, IP 163.14.253.131, Port 22 2026-04-27 04:21:40,217 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-27 04:21:40,333 - DEBUG - VM ctest-vn1_vm1-00594477 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-27 04:21:45,334 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-27 04:21:45,334 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-00594477, IP 163.14.253.131, Port 22 2026-04-27 04:21:45,405 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-27 04:21:45,566 - DEBUG - VM ctest-vn1_vm1-00594477 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-27 04:21:50,567 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-27 04:21:50,568 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-00594477, IP 163.14.253.131, Port 22 2026-04-27 04:21:50,746 - DEBUG - VM ctest-vn1_vm1-00594477 is ready for SSH connections 2026-04-27 04:21:50,746 - INFO - Waiting for VM ctest-vn1_vm2-75271334 to be up.. 2026-04-27 04:21:50,877 - DEBUG - VM is in ACTIVE state now 2026-04-27 04:21:50,877 - INFO - VM name : ctest-vn1_vm2-75271334 2026-04-27 04:21:51,015 - DEBUG - VM ctest-vn1_vm2-75271334 ID is 31b9a75d-c325-4938-ad8c-13bd6aca6d59 2026-04-27 04:21:51,015 - DEBUG - VM ctest-vn1_vm2-75271334 launched on Node an-jenkins-deploy-platform-ansible-os-5690-1 2026-04-27 04:21:51,144 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/31b9a75d-c325-4938-ad8c-13bd6aca6d59 2026-04-27 04:21:51,163 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/d343f808-6145-4907-9dfc-a02b2390a8d3 2026-04-27 04:21:52,352 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=3.98 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.428 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.428/2.203/3.979/1.775 ms') 2026-04-27 04:21:52,352 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-vn1_vm2-75271334 passed 2026-04-27 04:21:52,448 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-27 04:21:52,448 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-75271334, IP 163.14.253.132, Port 22 2026-04-27 04:21:52,632 - DEBUG - VM ctest-vn1_vm2-75271334 is ready for SSH connections 2026-04-27 04:21:53,050 - DEBUG - Response for create_network : {'network': {'id': '81440108-1240-4921-937d-5ed5b26fbd0f', 'name': 'ctest-vn2-38820587', 'tenant_id': '1ef724e03e654514b0b91a94bc70abbd', 'project_id': '1ef724e03e654514b0b91a94bc70abbd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-50363999', 'ctest-vn2-38820587'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 04:21:53,319 - DEBUG - Response for create_subnet : {'subnet': {'id': '0cba2e03-2c05-48e5-ba0e-a8256b31813a', 'name': '', 'tenant_id': '1ef724e03e654514b0b91a94bc70abbd', 'network_id': '81440108-1240-4921-937d-5ed5b26fbd0f', 'ip_version': 4, 'cidr': '41.197.222.0/26', 'allocation_pools': [{'start': '41.197.222.2', 'end': '41.197.222.62'}], 'gateway_ip': '41.197.222.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '41.197.222.2', 'tags': [], 'project_id': '1ef724e03e654514b0b91a94bc70abbd'}} 2026-04-27 04:21:53,354 - INFO - Created VN ctest-vn2-38820587 2026-04-27 04:21:53,379 - DEBUG - VN ctest-vn2-38820587 UUID is 81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:21:53,908 - DEBUG - Response for create_network : {'network': {'id': 'fe864f9b-ac06-4607-a00a-5ffafa581ca4', 'name': 'ctest-fip_vn-91126554', 'tenant_id': '1ef724e03e654514b0b91a94bc70abbd', 'project_id': '1ef724e03e654514b0b91a94bc70abbd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-50363999', 'ctest-fip_vn-91126554'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 04:21:54,275 - DEBUG - Response for create_subnet : {'subnet': {'id': '07c2b178-2913-49b3-9482-8bcf38bb098b', 'name': '', 'tenant_id': '1ef724e03e654514b0b91a94bc70abbd', 'network_id': 'fe864f9b-ac06-4607-a00a-5ffafa581ca4', 'ip_version': 4, 'cidr': '8.179.159.128/26', 'allocation_pools': [{'start': '8.179.159.130', 'end': '8.179.159.190'}], 'gateway_ip': '8.179.159.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '8.179.159.130', 'tags': [], 'project_id': '1ef724e03e654514b0b91a94bc70abbd'}} 2026-04-27 04:21:54,313 - INFO - Created VN ctest-fip_vn-91126554 2026-04-27 04:21:54,342 - DEBUG - VN ctest-fip_vn-91126554 UUID is fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:21:54,467 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5690-1', 'an-jenkins-deploy-platform-ansible-os-5690-2']} 2026-04-27 04:21:56,282 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5690-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5690-2) 2026-04-27 04:21:58,324 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5690-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5690-2) 2026-04-27 04:22:00,680 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5690-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5690-1) 2026-04-27 04:22:00,681 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:00,700 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:00,718 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:00,875 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:00,890 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:00,915 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:00,927 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:00,939 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ae1f1d38-b0b0-4861-827f-8d15e3e767d7 2026-04-27 04:22:00,955 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:00,955 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:00,977 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:01,005 - INFO - Verified VN network id 17 for VN ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:01,005 - INFO - Verifications in API Server for VN ctest-vn1-99981950 passed 2026-04-27 04:22:01,005 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:01,022 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:01,039 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:01,055 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ae1f1d38-b0b0-4861-827f-8d15e3e767d7 2026-04-27 04:22:01,082 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:21:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:47.651354'} 2026-04-27 04:22:01,098 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:01,114 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:21:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:47.688970'} 2026-04-27 04:22:01,127 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:01,139 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:21:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:47.714083'} 2026-04-27 04:22:01,171 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:01,172 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-99981950 passed 2026-04-27 04:22:01,172 - DEBUG - ====Verifying policy data for ctest-vn1-99981950 in API_Server ====== 2026-04-27 04:22:01,172 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:01,187 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:01,243 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:01,364 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:01,390 - DEBUG - =>VN ctest-vn1-99981950 has no policy to be verified 2026-04-27 04:22:01,391 - DEBUG - Verifying the vn in opserver 2026-04-27 04:22:01,391 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.41 2026-04-27 04:22:01,391 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 04:22:01,607 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:22:01,607 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.249 2026-04-27 04:22:01,607 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 04:22:01,723 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:22:01,723 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.23 2026-04-27 04:22:01,723 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 04:22:01,898 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:22:01,898 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 is found in opserver 2026-04-27 04:22:01,914 - DEBUG - VRF ids for VN ctest-vn1-99981950: {'10.0.0.33': '4'} 2026-04-27 04:22:01,914 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:01,924 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:01,945 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:02,136 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:02,162 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:02,184 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:02,199 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:02,220 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/b2d5ac4a-6c52-4749-95af-f580fde3111f 2026-04-27 04:22:02,246 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:02,246 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:02,274 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:02,300 - INFO - Verified VN network id 18 for VN 81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:02,300 - INFO - Verifications in API Server for VN ctest-vn2-38820587 passed 2026-04-27 04:22:02,301 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:02,317 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:02,327 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:02,341 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/b2d5ac4a-6c52-4749-95af-f580fde3111f 2026-04-27 04:22:02,364 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9314571063486597409', 'uuid-lslong': '10627754967578950927'}, 'enable': 'true', 'created': '2026-04-27T04:21:52', 'last-modified': '2026-04-27T04:21:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:09.120846'} 2026-04-27 04:22:02,372 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:02,382 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9314571063486597409', 'uuid-lslong': '10627754967578950927'}, 'enable': 'true', 'created': '2026-04-27T04:21:52', 'last-modified': '2026-04-27T04:21:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:09.133988'} 2026-04-27 04:22:02,393 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:02,402 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9314571063486597409', 'uuid-lslong': '10627754967578950927'}, 'enable': 'true', 'created': '2026-04-27T04:21:52', 'last-modified': '2026-04-27T04:21:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:09.165270'} 2026-04-27 04:22:02,413 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:02,414 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-38820587 passed 2026-04-27 04:22:02,414 - DEBUG - ====Verifying policy data for ctest-vn2-38820587 in API_Server ====== 2026-04-27 04:22:02,414 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:02,426 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:02,451 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:02,595 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:02,619 - DEBUG - =>VN ctest-vn2-38820587 has no policy to be verified 2026-04-27 04:22:02,619 - DEBUG - Verifying the vn in opserver 2026-04-27 04:22:02,619 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 virtual network link through opserver 10.0.0.41 2026-04-27 04:22:02,619 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 04:22:02,787 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587?flat'} 2026-04-27 04:22:02,787 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 virtual network link through opserver 10.0.0.249 2026-04-27 04:22:02,787 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 04:22:02,930 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587?flat'} 2026-04-27 04:22:02,931 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 virtual network link through opserver 10.0.0.23 2026-04-27 04:22:02,931 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 04:22:03,011 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587?flat'} 2026-04-27 04:22:03,011 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 is found in opserver 2026-04-27 04:22:03,041 - DEBUG - VRF ids for VN ctest-vn2-38820587: {'10.0.0.65': '4'} 2026-04-27 04:22:03,041 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:03,055 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:03,071 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:03,219 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:03,242 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:03,260 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/982a17f9-e77e-4051-b3e8-09a9cefe6276 2026-04-27 04:22:03,286 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/982a17f9-e77e-4051-b3e8-09a9cefe6276 2026-04-27 04:22:03,307 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/240ad795-ce2a-4846-a632-d4c4ffcb0293 2026-04-27 04:22:03,323 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 04:22:03,323 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:03,340 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/982a17f9-e77e-4051-b3e8-09a9cefe6276 2026-04-27 04:22:03,367 - INFO - Verified VN network id 19 for VN fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:03,367 - INFO - Verifications in API Server for VN ctest-fip_vn-91126554 passed 2026-04-27 04:22:03,367 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:03,380 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/982a17f9-e77e-4051-b3e8-09a9cefe6276 2026-04-27 04:22:03,392 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/982a17f9-e77e-4051-b3e8-09a9cefe6276 2026-04-27 04:22:03,414 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/240ad795-ce2a-4846-a632-d4c4ffcb0293 2026-04-27 04:22:03,435 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18340434062537541127', 'uuid-lslong': '11532135327382117540'}, 'enable': 'true', 'created': '2026-04-27T04:21:53', 'last-modified': '2026-04-27T04:21:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:09.269656'} 2026-04-27 04:22:03,447 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 04:22:03,464 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18340434062537541127', 'uuid-lslong': '11532135327382117540'}, 'enable': 'true', 'created': '2026-04-27T04:21:53', 'last-modified': '2026-04-27T04:21:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:09.291803'} 2026-04-27 04:22:03,477 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 04:22:03,489 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18340434062537541127', 'uuid-lslong': '11532135327382117540'}, 'enable': 'true', 'created': '2026-04-27T04:21:53', 'last-modified': '2026-04-27T04:21:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:09.322548'} 2026-04-27 04:22:03,500 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 04:22:03,500 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-91126554 passed 2026-04-27 04:22:03,500 - DEBUG - ====Verifying policy data for ctest-fip_vn-91126554 in API_Server ====== 2026-04-27 04:22:03,500 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:03,519 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:03,544 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:03,696 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:03,712 - DEBUG - =>VN ctest-fip_vn-91126554 has no policy to be verified 2026-04-27 04:22:03,712 - DEBUG - Verifying the vn in opserver 2026-04-27 04:22:03,712 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 virtual network link through opserver 10.0.0.41 2026-04-27 04:22:03,712 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 04:22:03,731 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554?flat'} 2026-04-27 04:22:03,731 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 virtual network link through opserver 10.0.0.249 2026-04-27 04:22:03,731 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 04:22:03,751 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554?flat'} 2026-04-27 04:22:03,752 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 virtual network link through opserver 10.0.0.23 2026-04-27 04:22:03,752 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 04:22:03,778 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554?flat'} 2026-04-27 04:22:03,779 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 is found in opserver 2026-04-27 04:22:03,808 - DEBUG - VRF ids for VN ctest-fip_vn-91126554: {'10.0.0.65': '5'} 2026-04-27 04:22:03,808 - INFO - Waiting for VM ctest-fvn_vm1-67841187 to be up.. 2026-04-27 04:22:03,950 - DEBUG - VM is in ACTIVE state now 2026-04-27 04:22:03,950 - INFO - VM name : ctest-fvn_vm1-67841187 2026-04-27 04:22:04,064 - DEBUG - VM ctest-fvn_vm1-67841187 ID is 7564b527-a818-4b8b-a4cc-c1181ab9d169 2026-04-27 04:22:04,064 - DEBUG - VM ctest-fvn_vm1-67841187 launched on Node an-jenkins-deploy-platform-ansible-os-5690-2 2026-04-27 04:22:04,182 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/7564b527-a818-4b8b-a4cc-c1181ab9d169 2026-04-27 04:22:04,201 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/16095ea1-5aba-4f12-8b08-b0e736905b9c 2026-04-27 04:22:07,430 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms') 2026-04-27 04:22:07,430 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-67841187 failed! 2026-04-27 04:22:07,459 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 is 8.179.159.129 and allocation pool is NOT set 2026-04-27 04:22:11,558 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2026-04-27 04:22:11,558 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-67841187 failed! 2026-04-27 04:22:11,580 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 is 8.179.159.129 and allocation pool is NOT set 2026-04-27 04:22:15,655 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-04-27 04:22:15,655 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-67841187 failed! 2026-04-27 04:22:15,678 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 is 8.179.159.129 and allocation pool is NOT set 2026-04-27 04:22:19,751 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-04-27 04:22:19,751 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-67841187 failed! 2026-04-27 04:22:19,771 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 is 8.179.159.129 and allocation pool is NOT set 2026-04-27 04:22:23,846 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2026-04-27 04:22:23,846 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-67841187 failed! 2026-04-27 04:22:23,867 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 is 8.179.159.129 and allocation pool is NOT set 2026-04-27 04:22:27,940 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=16.6 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1009ms\r\nrtt min/avg/max/mdev = 16.566/16.566/16.566/0.000 ms') 2026-04-27 04:22:27,940 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-67841187 passed 2026-04-27 04:22:28,026 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-27 04:22:28,026 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-67841187, IP 8.179.159.131, Port 22 2026-04-27 04:22:28,093 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-27 04:22:28,229 - DEBUG - VM ctest-fvn_vm1-67841187 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-27 04:22:33,230 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-27 04:22:33,230 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-67841187, IP 8.179.159.131, Port 22 2026-04-27 04:22:33,298 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-27 04:22:33,418 - DEBUG - VM ctest-fvn_vm1-67841187 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-27 04:22:38,419 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-27 04:22:38,419 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-67841187, IP 8.179.159.131, Port 22 2026-04-27 04:22:38,589 - DEBUG - VM ctest-fvn_vm1-67841187 is ready for SSH connections 2026-04-27 04:22:38,589 - INFO - Waiting for VM ctest-vn2_vm2-10300176 to be up.. 2026-04-27 04:22:38,718 - DEBUG - VM is in ACTIVE state now 2026-04-27 04:22:38,718 - INFO - VM name : ctest-vn2_vm2-10300176 2026-04-27 04:22:38,838 - DEBUG - VM ctest-vn2_vm2-10300176 ID is 7b238031-aab4-4d2f-8b1d-3d1ea5c1f3af 2026-04-27 04:22:38,838 - DEBUG - VM ctest-vn2_vm2-10300176 launched on Node an-jenkins-deploy-platform-ansible-os-5690-2 2026-04-27 04:22:38,962 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/7b238031-aab4-4d2f-8b1d-3d1ea5c1f3af 2026-04-27 04:22:38,977 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ac8fc51a-fcfb-49bd-97cc-0f85b52a37fd 2026-04-27 04:22:40,220 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=15.1 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.706 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.706/7.890/15.075/7.184 ms') 2026-04-27 04:22:40,221 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vn2_vm2-10300176 passed 2026-04-27 04:22:40,303 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-27 04:22:40,303 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-10300176, IP 41.197.222.3, Port 22 2026-04-27 04:22:40,488 - DEBUG - VM ctest-vn2_vm2-10300176 is ready for SSH connections 2026-04-27 04:22:40,488 - INFO - Waiting for VM mltf_vm to be up.. 2026-04-27 04:22:40,619 - DEBUG - VM is in ACTIVE state now 2026-04-27 04:22:40,619 - INFO - VM name : mltf_vm 2026-04-27 04:22:40,740 - DEBUG - VM mltf_vm ID is dd1ca66a-66a0-4109-8ba1-6981f9fd1eda 2026-04-27 04:22:40,740 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-5690-1 2026-04-27 04:22:41,036 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/dd1ca66a-66a0-4109-8ba1-6981f9fd1eda 2026-04-27 04:22:41,050 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/61f798f9-80aa-4838-9df3-d49227714b64 2026-04-27 04:22:41,065 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/c263ea0e-f262-4c56-96cb-b8a3ff911baa 2026-04-27 04:22:42,267 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n64 bytes from 169.254.0.7: icmp_seq=1 ttl=63 time=2.03 ms\r\n64 bytes from 169.254.0.7: icmp_seq=2 ttl=63 time=0.391 ms\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.391/1.208/2.026/0.817 ms') 2026-04-27 04:22:42,267 - INFO - Ping to Metadata IP 169.254.0.7 of VM mltf_vm passed 2026-04-27 04:22:42,359 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-27 04:22:42,359 - DEBUG - Waiting to SSH to VM mltf_vm, IP 163.14.253.133, Port 22 2026-04-27 04:22:42,536 - DEBUG - VM mltf_vm is ready for SSH connections 2026-04-27 04:22:42,623 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-27 04:22:42,623 - DEBUG - Waiting to SSH to VM mltf_vm, IP 163.14.253.133, Port 22 2026-04-27 04:22:42,786 - DEBUG - VM mltf_vm is ready for SSH connections 2026-04-27 04:22:42,788 - INFO - ================================================================================ 2026-04-27 04:22:42,789 - INFO - STARTING TEST : test_verify_session_sampling_teardown 2026-04-27 04:22:42,789 - INFO - TEST DESCRIPTION : 1.query client session samples 2.query server session samples 3.query client session to get number of sessions exported 4.query session record table for teardown bytes/pkts 5.query sample count after teardown on server side 2026-04-27 04:22:44,103 - DEBUG - Skipping xmpp flap check 2026-04-27 04:22:44,103 - INFO - Initial checks done. Running the testcase now 2026-04-27 04:22:44,103 - INFO - 2026-04-27 04:22:44,255 - INFO - Setting flow export rate: 100 2026-04-27 04:22:44,307 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-04-27 04:22:44,769 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'ba1a3442-c0f2-45b5-a131-1fd9988cba5a', 'name': 'ctest-vn1-99981950', 'tenant_id': '1ef724e03e654514b0b91a94bc70abbd', 'project_id': '1ef724e03e654514b0b91a94bc70abbd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['39000951-69f8-4fe3-a9a7-a020e6f1a2b8'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-50363999', 'ctest-vn1-99981950'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-50363999', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '163.14.253.128/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2026-04-27 04:22:45,035 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '81440108-1240-4921-937d-5ed5b26fbd0f', 'name': 'ctest-vn2-38820587', 'tenant_id': '1ef724e03e654514b0b91a94bc70abbd', 'project_id': '1ef724e03e654514b0b91a94bc70abbd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['0cba2e03-2c05-48e5-ba0e-a8256b31813a'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-50363999', 'ctest-vn2-38820587'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-50363999', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '41.197.222.0/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2026-04-27 04:22:45,161 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:45,178 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:45,209 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:45,376 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:45,398 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:45,412 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:45,425 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:45,436 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ae1f1d38-b0b0-4861-827f-8d15e3e767d7 2026-04-27 04:22:45,446 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:45,446 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:45,462 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:45,492 - INFO - Verified VN network id 17 for VN ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:45,492 - INFO - Verifications in API Server for VN ctest-vn1-99981950 passed 2026-04-27 04:22:45,492 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:45,513 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:45,533 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:45,547 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ae1f1d38-b0b0-4861-827f-8d15e3e767d7 2026-04-27 04:22:45,570 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.876473'} 2026-04-27 04:22:45,580 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:45,588 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.894135'} 2026-04-27 04:22:45,597 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:45,610 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.915741'} 2026-04-27 04:22:45,624 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:45,624 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-99981950 passed 2026-04-27 04:22:45,624 - DEBUG - ====Verifying policy data for ctest-vn1-99981950 in API_Server ====== 2026-04-27 04:22:45,624 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:45,632 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:45,649 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:45,785 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:45,798 - DEBUG - ==>Verifying data for policy with id: eb838881-a1d3-43ed-8feb-fae6aaee8f2b, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-50363999', 'policy1'] 2026-04-27 04:22:45,798 - INFO - VN ctest-vn1-99981950 Policy verification: verify_vn_policy_in_api_server, status: True 2026-04-27 04:22:45,798 - DEBUG - Verifying the vn in opserver 2026-04-27 04:22:45,798 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.41 2026-04-27 04:22:45,798 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 04:22:45,817 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:22:45,817 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.249 2026-04-27 04:22:45,817 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 04:22:45,842 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:22:45,842 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.23 2026-04-27 04:22:45,842 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 04:22:45,861 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:22:45,861 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 is found in opserver 2026-04-27 04:22:45,877 - DEBUG - VRF ids for VN ctest-vn1-99981950: {'10.0.0.33': '4'} 2026-04-27 04:22:45,877 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:45,889 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:45,911 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:46,038 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:46,060 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:46,072 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:46,084 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:46,094 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/b2d5ac4a-6c52-4749-95af-f580fde3111f 2026-04-27 04:22:46,105 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:46,105 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:46,123 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:46,152 - INFO - Verified VN network id 18 for VN 81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:46,152 - INFO - Verifications in API Server for VN ctest-vn2-38820587 passed 2026-04-27 04:22:46,152 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:46,170 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:46,183 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:46,198 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/b2d5ac4a-6c52-4749-95af-f580fde3111f 2026-04-27 04:22:46,217 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9314571063486597409', 'uuid-lslong': '10627754967578950927'}, 'enable': 'true', 'created': '2026-04-27T04:21:52', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.240800'} 2026-04-27 04:22:46,227 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:46,234 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9314571063486597409', 'uuid-lslong': '10627754967578950927'}, 'enable': 'true', 'created': '2026-04-27T04:21:52', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.258468'} 2026-04-27 04:22:46,243 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:46,252 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9314571063486597409', 'uuid-lslong': '10627754967578950927'}, 'enable': 'true', 'created': '2026-04-27T04:21:52', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.280082'} 2026-04-27 04:22:46,263 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:46,263 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-38820587 passed 2026-04-27 04:22:46,263 - DEBUG - ====Verifying policy data for ctest-vn2-38820587 in API_Server ====== 2026-04-27 04:22:46,263 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:46,274 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:46,287 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:46,403 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:46,423 - DEBUG - ==>Verifying data for policy with id: eb838881-a1d3-43ed-8feb-fae6aaee8f2b, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-50363999', 'policy1'] 2026-04-27 04:22:46,423 - INFO - VN ctest-vn2-38820587 Policy verification: verify_vn_policy_in_api_server, status: True 2026-04-27 04:22:46,423 - DEBUG - Verifying the vn in opserver 2026-04-27 04:22:46,423 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 virtual network link through opserver 10.0.0.41 2026-04-27 04:22:46,424 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 04:22:46,448 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587?flat'} 2026-04-27 04:22:46,448 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 virtual network link through opserver 10.0.0.249 2026-04-27 04:22:46,448 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 04:22:46,468 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587?flat'} 2026-04-27 04:22:46,468 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 virtual network link through opserver 10.0.0.23 2026-04-27 04:22:46,468 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 04:22:46,488 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587?flat'} 2026-04-27 04:22:46,488 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 is found in opserver 2026-04-27 04:22:46,505 - DEBUG - VRF ids for VN ctest-vn2-38820587: {'10.0.0.33': '5', '10.0.0.65': '4'} 2026-04-27 04:22:46,505 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:46,516 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:46,535 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:46,656 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:46,668 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:46,681 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:46,693 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:46,706 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ae1f1d38-b0b0-4861-827f-8d15e3e767d7 2026-04-27 04:22:46,719 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:46,719 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:46,734 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:46,760 - INFO - Verified VN network id 17 for VN ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:46,761 - INFO - Verifications in API Server for VN ctest-vn1-99981950 passed 2026-04-27 04:22:46,761 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:46,777 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:46,791 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:22:46,802 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ae1f1d38-b0b0-4861-827f-8d15e3e767d7 2026-04-27 04:22:46,819 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.125286'} 2026-04-27 04:22:46,825 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:46,834 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.140064'} 2026-04-27 04:22:46,843 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:46,850 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13410088301758662069', 'uuid-lslong': '11615099933392943706'}, 'enable': 'true', 'created': '2026-04-27T04:21:13', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.156195'} 2026-04-27 04:22:46,862 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 04:22:46,862 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-99981950 passed 2026-04-27 04:22:46,862 - DEBUG - ====Verifying policy data for ctest-vn1-99981950 in API_Server ====== 2026-04-27 04:22:46,862 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:46,870 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:46,883 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:46,992 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ba1a3442-c0f2-45b5-a131-1fd9988cba5a 2026-04-27 04:22:47,007 - DEBUG - ==>Verifying data for policy with id: eb838881-a1d3-43ed-8feb-fae6aaee8f2b, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-50363999', 'policy1'] 2026-04-27 04:22:47,007 - INFO - VN ctest-vn1-99981950 Policy verification: verify_vn_policy_in_api_server, status: True 2026-04-27 04:22:47,007 - DEBUG - Verifying the vn in opserver 2026-04-27 04:22:47,007 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.41 2026-04-27 04:22:47,007 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 04:22:47,031 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:22:47,031 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.249 2026-04-27 04:22:47,031 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 04:22:47,058 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:22:47,058 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 virtual network link through opserver 10.0.0.23 2026-04-27 04:22:47,058 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 04:22:47,079 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950?flat'} 2026-04-27 04:22:47,079 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 is found in opserver 2026-04-27 04:22:47,092 - DEBUG - VRF ids for VN ctest-vn1-99981950: {'10.0.0.33': '4'} 2026-04-27 04:22:47,093 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:47,101 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:47,120 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:47,238 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:47,257 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:47,270 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:47,280 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:47,290 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/b2d5ac4a-6c52-4749-95af-f580fde3111f 2026-04-27 04:22:47,299 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:47,299 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:47,311 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:47,332 - INFO - Verified VN network id 18 for VN 81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:47,332 - INFO - Verifications in API Server for VN ctest-vn2-38820587 passed 2026-04-27 04:22:47,333 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:47,348 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:47,359 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:22:47,372 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/b2d5ac4a-6c52-4749-95af-f580fde3111f 2026-04-27 04:22:47,388 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9314571063486597409', 'uuid-lslong': '10627754967578950927'}, 'enable': 'true', 'created': '2026-04-27T04:21:52', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.413040'} 2026-04-27 04:22:47,395 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:47,403 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9314571063486597409', 'uuid-lslong': '10627754967578950927'}, 'enable': 'true', 'created': '2026-04-27T04:21:52', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.427697'} 2026-04-27 04:22:47,415 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:47,422 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9314571063486597409', 'uuid-lslong': '10627754967578950927'}, 'enable': 'true', 'created': '2026-04-27T04:21:52', 'last-modified': '2026-04-27T04:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.450439'} 2026-04-27 04:22:47,430 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 04:22:47,431 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-38820587 passed 2026-04-27 04:22:47,431 - DEBUG - ====Verifying policy data for ctest-vn2-38820587 in API_Server ====== 2026-04-27 04:22:47,431 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:47,439 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:47,455 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:47,571 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81440108-1240-4921-937d-5ed5b26fbd0f 2026-04-27 04:22:47,585 - DEBUG - ==>Verifying data for policy with id: eb838881-a1d3-43ed-8feb-fae6aaee8f2b, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-50363999', 'policy1'] 2026-04-27 04:22:47,585 - INFO - VN ctest-vn2-38820587 Policy verification: verify_vn_policy_in_api_server, status: True 2026-04-27 04:22:47,585 - DEBUG - Verifying the vn in opserver 2026-04-27 04:22:47,585 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 virtual network link through opserver 10.0.0.41 2026-04-27 04:22:47,585 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 04:22:47,601 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587?flat'} 2026-04-27 04:22:47,601 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 virtual network link through opserver 10.0.0.249 2026-04-27 04:22:47,601 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 04:22:47,620 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587?flat'} 2026-04-27 04:22:47,620 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 virtual network link through opserver 10.0.0.23 2026-04-27 04:22:47,620 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 04:22:47,643 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587?flat'} 2026-04-27 04:22:47,643 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 is found in opserver 2026-04-27 04:22:47,656 - DEBUG - VRF ids for VN ctest-vn2-38820587: {'10.0.0.33': '5', '10.0.0.65': '4'} 2026-04-27 04:22:47,656 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:47,664 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:47,679 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:47,789 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:47,803 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:47,819 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/982a17f9-e77e-4051-b3e8-09a9cefe6276 2026-04-27 04:22:47,831 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/982a17f9-e77e-4051-b3e8-09a9cefe6276 2026-04-27 04:22:47,843 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/240ad795-ce2a-4846-a632-d4c4ffcb0293 2026-04-27 04:22:47,851 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 04:22:47,851 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:47,862 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/982a17f9-e77e-4051-b3e8-09a9cefe6276 2026-04-27 04:22:47,883 - INFO - Verified VN network id 19 for VN fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:47,883 - INFO - Verifications in API Server for VN ctest-fip_vn-91126554 passed 2026-04-27 04:22:47,883 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:47,896 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/982a17f9-e77e-4051-b3e8-09a9cefe6276 2026-04-27 04:22:47,907 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/982a17f9-e77e-4051-b3e8-09a9cefe6276 2026-04-27 04:22:47,919 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/240ad795-ce2a-4846-a632-d4c4ffcb0293 2026-04-27 04:22:47,933 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18340434062537541127', 'uuid-lslong': '11532135327382117540'}, 'enable': 'true', 'created': '2026-04-27T04:21:53', 'last-modified': '2026-04-27T04:21:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:53.770259'} 2026-04-27 04:22:47,941 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 04:22:47,949 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18340434062537541127', 'uuid-lslong': '11532135327382117540'}, 'enable': 'true', 'created': '2026-04-27T04:21:53', 'last-modified': '2026-04-27T04:21:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:53.782708'} 2026-04-27 04:22:47,958 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 04:22:47,966 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-50363999', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18340434062537541127', 'uuid-lslong': '11532135327382117540'}, 'enable': 'true', 'created': '2026-04-27T04:21:53', 'last-modified': '2026-04-27T04:21:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:53.801076'} 2026-04-27 04:22:47,974 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 04:22:47,974 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-91126554 passed 2026-04-27 04:22:47,975 - DEBUG - ====Verifying policy data for ctest-fip_vn-91126554 in API_Server ====== 2026-04-27 04:22:47,975 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:22:47,984 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:22:48,001 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:22:48,129 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fe864f9b-ac06-4607-a00a-5ffafa581ca4 2026-04-27 04:22:48,143 - DEBUG - =>VN ctest-fip_vn-91126554 has no policy to be verified 2026-04-27 04:22:48,143 - DEBUG - Verifying the vn in opserver 2026-04-27 04:22:48,143 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 virtual network link through opserver 10.0.0.41 2026-04-27 04:22:48,143 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 04:22:48,160 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554?flat'} 2026-04-27 04:22:48,160 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 virtual network link through opserver 10.0.0.249 2026-04-27 04:22:48,160 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 04:22:48,181 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554?flat'} 2026-04-27 04:22:48,181 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 virtual network link through opserver 10.0.0.23 2026-04-27 04:22:48,181 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 04:22:48,204 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554?flat'} 2026-04-27 04:22:48,204 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 is found in opserver 2026-04-27 04:22:48,216 - DEBUG - VRF ids for VN ctest-fip_vn-91126554: {'10.0.0.65': '5'} 2026-04-27 04:22:48,216 - INFO - start time= 1777263768216416 2026-04-27 04:22:48,216 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 41.197.222.3, host_string: cirros@169.254.0.5, password: gocubsgogateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2026-04-27 04:22:48,216 - DEBUG - ping -s 56 -c 3 -W 1 41.197.222.3 2026-04-27 04:22:51,896 - DEBUG - PING 41.197.222.3 (41.197.222.3): 56 data bytes 64 bytes from 41.197.222.3: seq=0 ttl=63 time=4.931 ms 64 bytes from 41.197.222.3: seq=1 ttl=63 time=1.575 ms 64 bytes from 41.197.222.3: seq=2 ttl=63 time=1.634 ms --- 41.197.222.3 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.575/2.713/4.931 ms 2026-04-27 04:22:51,896 - INFO - Ping to IP 41.197.222.3 from VM ctest-vn1_vm1-00594477 passed 2026-04-27 04:23:01,897 - INFO - Verify session samples and teardown pkts 2026-04-27 04:23:01,897 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.41 2026-04-27 04:23:01,902 - DEBUG - Posting: http://10.0.0.41:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1777263768216416, 'end_time': 1777263781902074, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2026-04-27 04:23:02,932 - DEBUG - [{'T': 1777263770746690}, {'T': 1777263771746807}, {'T': 1777263772746866}] 2026-04-27 04:23:02,933 - DEBUG - Posting: http://10.0.0.41:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1777263768216416, 'end_time': 1777263782933056, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2026-04-27 04:23:03,964 - DEBUG - [{'T': 1777263770604770}, {'T': 1777263771604848}, {'T': 1777263772604963}] 2026-04-27 04:23:03,964 - DEBUG - Posting: http://10.0.0.41:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1777263768216416, 'end_time': 1777263783964230, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2026-04-27 04:23:04,988 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', 'sample_count': 3}] 2026-04-27 04:23:04,988 - INFO - wait for the flows to get expire 2026-04-27 04:26:24,990 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5690-1:Compute:contrail-vrouter-agent:0?flat 2026-04-27 04:26:25,103 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5690-1?flat 2026-04-27 04:26:25,981 - INFO - Deleted policy policy1 2026-04-27 04:26:26,119 - INFO - Setting flow export rate: None 2026-04-27 04:26:27,442 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Mon Apr 27 04:26:25 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_sampling_teardown(self=) 1281 src_vn = self.res.vn1_fixture.vn_fq_name 1282 dst_vn = self.res.vn2_fixture.vn_fq_name 1283 result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) 1284 1285 assert result,'Failed to get expected number of samples' result = True self = self.verify_session_sampling_teardown = > start_time = '1777263768216416' src_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950' dst_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587' /contrail-test/serial_scripts/analytics/base.py in verify_session_sampling_teardown(self=, start_time='1777263768216416', src_vn='default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950', dst_vn='default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587') 486 flow_record = self.analytics_obj.get_flows_vrouter_uve( 487 vrouter=vm_host) 488 assert not flow_record,'flows not got deleted even after 240 sec' 489 490 res = self.analytics_obj.ops_inspect[ip].post_query( flow_record = 8 AssertionError: flows not got deleted even after 240 sec __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('flows not got deleted even after 240 sec',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1283, in test_verify_session_sampling_teardown result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) File "/contrail-test/serial_scripts/analytics/base.py", line 488, in verify_session_sampling_teardown assert not flow_record,'flows not got deleted even after 240 sec' AssertionError: flows not got deleted even after 240 sec 2026-04-27 04:26:27,443 - DEBUG - Skipping xmpp flap check 2026-04-27 04:26:27,443 - INFO -
2026-04-27 04:26:27,443 - INFO - END TEST : test_verify_session_sampling_teardown : FAILED[0:03:45]
2026-04-27 04:26:27,444 - INFO - -------------------------------------------------------------------------------- 2026-04-27 04:26:27,446 - INFO - Deleting VM mltf_vm 2026-04-27 04:26:27,549 - INFO - Deleting VM ctest-fvn_vm1-67841187 2026-04-27 04:26:27,640 - INFO - Deleting VM ctest-vn2_vm2-10300176 2026-04-27 04:26:27,731 - INFO - Deleting VN ctest-fip_vn-91126554 2026-04-27 04:26:27,804 - DEBUG - VN fe864f9b-ac06-4607-a00a-5ffafa581ca4 still in use: Unable to complete operation on network fe864f9b-ac06-4607-a00a-5ffafa581ca4. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-fb1573b6-b12f-405a-b075-356a366510fa'] 2026-04-27 04:26:27,804 - WARNING - Deleting VN ctest-fip_vn-91126554 failed..Will retry 2026-04-27 04:26:30,065 - DEBUG - Response for deleting network () 2026-04-27 04:26:30,065 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/982a17f9-e77e-4051-b3e8-09a9cefe6276 2026-04-27 04:26:30,119 - DEBUG - Response Code: 404 2026-04-27 04:26:30,119 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:26:30,128 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:26:30,149 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:26:30,270 - INFO - Validated that VN ctest-fip_vn-91126554 is not found in API Server 2026-04-27 04:26:30,282 - DEBUG - VN ctest-fip_vn-91126554 is not present in Agent 10.0.0.33 2026-04-27 04:26:30,294 - DEBUG - VN ctest-fip_vn-91126554 is not present in Agent 10.0.0.65 2026-04-27 04:26:30,294 - INFO - Validated that VN ctest-fip_vn-91126554 is not in any agent 2026-04-27 04:26:30,301 - DEBUG - VRF 5 is not seen in agent 10.0.0.65 2026-04-27 04:26:30,307 - DEBUG - Vrouter 10.0.0.65 does not have vrf 5 for VN ctest-fip_vn-91126554 2026-04-27 04:26:30,307 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-fip_vn-91126554 2026-04-27 04:26:30,337 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-91126554 info 2026-04-27 04:26:30,337 - INFO - Deleting VN ctest-vn2-38820587 2026-04-27 04:26:30,610 - DEBUG - Response for deleting network () 2026-04-27 04:26:30,610 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5c7a46f7-532c-43f2-b6d3-6d1fc7e23353 2026-04-27 04:26:30,617 - DEBUG - Response Code: 404 2026-04-27 04:26:30,617 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:26:30,625 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:26:30,639 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:26:30,753 - INFO - Validated that VN ctest-vn2-38820587 is not found in API Server 2026-04-27 04:26:30,769 - DEBUG - VN ctest-vn2-38820587 is not present in Agent 10.0.0.33 2026-04-27 04:26:30,786 - DEBUG - VN ctest-vn2-38820587 is not present in Agent 10.0.0.65 2026-04-27 04:26:30,786 - INFO - Validated that VN ctest-vn2-38820587 is not in any agent 2026-04-27 04:26:30,795 - DEBUG - VRF 5 is not seen in agent 10.0.0.33 2026-04-27 04:26:30,802 - DEBUG - Vrouter 10.0.0.33 does not have vrf 5 for VN ctest-vn2-38820587 2026-04-27 04:26:30,809 - DEBUG - VRF 4 is not seen in agent 10.0.0.65 2026-04-27 04:26:30,820 - DEBUG - Vrouter 10.0.0.65 does not have vrf 4 for VN ctest-vn2-38820587 2026-04-27 04:26:30,820 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn2-38820587 2026-04-27 04:26:30,853 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-38820587 info 2026-04-27 04:26:30,853 - INFO - Deleting VM ctest-vn1_vm2-75271334 2026-04-27 04:26:30,947 - INFO - Deleting VM ctest-vn1_vm1-00594477 2026-04-27 04:26:31,041 - INFO - Deleting VN ctest-vn1-99981950 2026-04-27 04:26:31,105 - DEBUG - VN ba1a3442-c0f2-45b5-a131-1fd9988cba5a still in use: Unable to complete operation on network ba1a3442-c0f2-45b5-a131-1fd9988cba5a. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-5060307d-19c3-4d42-ba40-cd170aa46e36'] 2026-04-27 04:26:31,105 - WARNING - Deleting VN ctest-vn1-99981950 failed..Will retry 2026-04-27 04:26:33,348 - DEBUG - Response for deleting network () 2026-04-27 04:26:33,348 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c7942228-710a-4af1-999a-bd1862a50555 2026-04-27 04:26:33,367 - DEBUG - Response Code: 404 2026-04-27 04:26:33,367 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 04:26:33,384 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 04:26:33,404 - DEBUG - Requesting: http://10.0.0.41:8082/project/1ef724e0-3e65-4514-b0b9-1a94bc70abbd 2026-04-27 04:26:33,551 - INFO - Validated that VN ctest-vn1-99981950 is not found in API Server 2026-04-27 04:26:33,563 - DEBUG - VN ctest-vn1-99981950 is not present in Agent 10.0.0.33 2026-04-27 04:26:33,582 - DEBUG - VN ctest-vn1-99981950 is not present in Agent 10.0.0.65 2026-04-27 04:26:33,582 - INFO - Validated that VN ctest-vn1-99981950 is not in any agent 2026-04-27 04:26:33,589 - DEBUG - VRF 4 is not seen in agent 10.0.0.33 2026-04-27 04:26:33,597 - DEBUG - Vrouter 10.0.0.33 does not have vrf 4 for VN ctest-vn1-99981950 2026-04-27 04:26:33,597 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-50363999:ctest-vn1-99981950 2026-04-27 04:26:33,629 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-99981950 info 2026-04-27 04:26:34,655 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-50363999, ID : 1ef724e0-3e65-4514-b0b9-1a94bc70abbd