2026-06-22 04:02:00,320 - INFO - Domain Default found not creating
2026-06-22 04:02:00,486 - INFO - Project ctest-AnalyticsTestSanityWithResource-03479480 not found, creating it
2026-06-22 04:02:01,114 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-03479480, ID : 3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:02:03,258 - DEBUG - Response for create_network : {'network': {'id': 'e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f', 'name': 'ctest-vn1-49900671', 'tenant_id': '3b0efd22deee424795a8ffcbc565a833', 'project_id': '3b0efd22deee424795a8ffcbc565a833', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-03479480', 'ctest-vn1-49900671'], 'port_security_enabled': True, 'description': ''}}
2026-06-22 04:02:03,579 - DEBUG - Response for create_subnet : {'subnet': {'id': '08059166-30cf-4d0d-9c0a-21ebcf356e82', 'name': '', 'tenant_id': '3b0efd22deee424795a8ffcbc565a833', 'network_id': 'e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f', 'ip_version': 4, 'cidr': '67.152.11.192/26', 'allocation_pools': [{'start': '67.152.11.194', 'end': '67.152.11.254'}], 'gateway_ip': '67.152.11.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '67.152.11.194', 'tags': [], 'project_id': '3b0efd22deee424795a8ffcbc565a833'}}
2026-06-22 04:02:03,596 - INFO - Created VN ctest-vn1-49900671
2026-06-22 04:02:03,610 - DEBUG - VN ctest-vn1-49900671 UUID is e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:03,706 - DEBUG - Services list from nova: [, , , ]
2026-06-22 04:02:03,706 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6014-1', 'an-jenkins-deploy-platform-ansible-os-6014-2']}
2026-06-22 04:02:05,086 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6014-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6014-1)
2026-06-22 04:02:06,227 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6014-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6014-1)
2026-06-22 04:02:06,228 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:02:06,554 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:02:06,580 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:02:06,597 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:02:06,697 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:06,709 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:06,719 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:02:06,728 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:02:06,736 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b11c3331-5cb2-4bb0-a2fd-c2cedbcc6075
2026-06-22 04:02:06,744 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:02:06,744 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:06,755 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:02:06,775 - INFO - Verified VN network id 12 for VN e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:06,775 - INFO - Verifications in API Server for VN ctest-vn1-49900671 passed
2026-06-22 04:02:06,775 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:06,789 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:02:06,800 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:02:06,812 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b11c3331-5cb2-4bb0-a2fd-c2cedbcc6075
2026-06-22 04:02:06,826 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:02:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.321279'}
2026-06-22 04:02:06,832 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:02:06,838 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:02:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.340944'}
2026-06-22 04:02:06,845 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:02:06,851 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:02:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.347382'}
2026-06-22 04:02:06,856 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:02:06,856 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-49900671 passed
2026-06-22 04:02:06,856 - DEBUG - ====Verifying policy data for ctest-vn1-49900671 in API_Server ======
2026-06-22 04:02:06,856 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:02:06,865 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:02:06,878 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:02:06,976 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:06,987 - DEBUG - =>VN ctest-vn1-49900671 has no policy to be verified
2026-06-22 04:02:06,987 - DEBUG - Verifying the vn in opserver
2026-06-22 04:02:06,987 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.19
2026-06-22 04:02:06,987 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 04:02:07,314 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 04:02:07,381 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:02:07,381 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.129
2026-06-22 04:02:07,381 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 04:02:07,704 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 04:02:07,753 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:02:07,753 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.241
2026-06-22 04:02:07,753 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 04:02:08,075 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 04:02:08,134 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:02:08,134 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 is found in opserver
2026-06-22 04:02:08,167 - DEBUG - Do not have enough data to verify VN in agent
2026-06-22 04:02:08,178 - DEBUG - VRF ids for VN ctest-vn1-49900671: {}
2026-06-22 04:02:08,178 - INFO - Waiting for VM ctest-vn1_vm1-96699383 to be up..
2026-06-22 04:02:08,232 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-22 04:02:13,310 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-22 04:02:18,401 - DEBUG - VM is in ACTIVE state now
2026-06-22 04:02:18,401 - INFO - VM name : ctest-vn1_vm1-96699383
2026-06-22 04:02:18,561 - DEBUG - VM ctest-vn1_vm1-96699383 ID is 943b4f63-0022-49b9-bc79-1ac97adaaf0a
2026-06-22 04:02:18,649 - DEBUG - VM ctest-vn1_vm1-96699383 launched on Node an-jenkins-deploy-platform-ansible-os-6014-1
2026-06-22 04:02:18,803 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/943b4f63-0022-49b9-bc79-1ac97adaaf0a
2026-06-22 04:02:19,297 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/943b4f63-0022-49b9-bc79-1ac97adaaf0a
2026-06-22 04:02:19,332 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/d55e26b5-bdf2-469e-a56a-52dfacbad938
2026-06-22 04:02:22,535 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms')
2026-06-22 04:02:22,535 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-96699383 failed!
2026-06-22 04:02:22,549 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 is 67.152.11.193 and allocation pool is NOT set
2026-06-22 04:02:26,630 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2026-06-22 04:02:26,630 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-96699383 failed!
2026-06-22 04:02:26,646 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 is 67.152.11.193 and allocation pool is NOT set
2026-06-22 04:02:28,709 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.92 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.81 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.813/2.866/2.919/0.053 ms')
2026-06-22 04:02:28,709 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-96699383 passed
2026-06-22 04:02:28,785 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:02:28,785 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-96699383, IP 67.152.11.195, Port 22
2026-06-22 04:02:28,842 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-22 04:02:28,942 - DEBUG - VM ctest-vn1_vm1-96699383 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-22 04:02:33,942 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:02:33,943 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-96699383, IP 67.152.11.195, Port 22
2026-06-22 04:02:34,105 - DEBUG - VM ctest-vn1_vm1-96699383 is ready for SSH connections
2026-06-22 04:02:34,106 - INFO - Waiting for VM ctest-vn1_vm2-29974802 to be up..
2026-06-22 04:02:34,193 - DEBUG - VM is in ACTIVE state now
2026-06-22 04:02:34,193 - INFO - VM name : ctest-vn1_vm2-29974802
2026-06-22 04:02:34,270 - DEBUG - VM ctest-vn1_vm2-29974802 ID is c4b2d3bd-c10f-4495-ba85-be54904f07c1
2026-06-22 04:02:34,271 - DEBUG - VM ctest-vn1_vm2-29974802 launched on Node an-jenkins-deploy-platform-ansible-os-6014-1
2026-06-22 04:02:34,348 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/c4b2d3bd-c10f-4495-ba85-be54904f07c1
2026-06-22 04:02:34,358 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/db439ca2-2514-4e64-a837-4e30e78de1c3
2026-06-22 04:02:35,523 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.70 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=3.57 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.702/3.135/3.569/0.433 ms')
2026-06-22 04:02:35,523 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn1_vm2-29974802 passed
2026-06-22 04:02:35,591 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:02:35,591 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-29974802, IP 67.152.11.196, Port 22
2026-06-22 04:02:35,650 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-22 04:02:35,724 - DEBUG - VM ctest-vn1_vm2-29974802 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-22 04:02:40,725 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:02:40,725 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-29974802, IP 67.152.11.196, Port 22
2026-06-22 04:02:40,892 - DEBUG - VM ctest-vn1_vm2-29974802 is ready for SSH connections
2026-06-22 04:02:41,182 - DEBUG - Response for create_network : {'network': {'id': '913d3b19-ce44-47e9-816c-c49f71612bc7', 'name': 'ctest-vn2-10312240', 'tenant_id': '3b0efd22deee424795a8ffcbc565a833', 'project_id': '3b0efd22deee424795a8ffcbc565a833', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-03479480', 'ctest-vn2-10312240'], 'port_security_enabled': True, 'description': ''}}
2026-06-22 04:02:41,447 - DEBUG - Response for create_subnet : {'subnet': {'id': '71ef8ec8-2a6f-4a35-af1d-f0a5aefa5bca', 'name': '', 'tenant_id': '3b0efd22deee424795a8ffcbc565a833', 'network_id': '913d3b19-ce44-47e9-816c-c49f71612bc7', 'ip_version': 4, 'cidr': '31.13.60.192/26', 'allocation_pools': [{'start': '31.13.60.194', 'end': '31.13.60.254'}], 'gateway_ip': '31.13.60.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.13.60.194', 'tags': [], 'project_id': '3b0efd22deee424795a8ffcbc565a833'}}
2026-06-22 04:02:41,471 - INFO - Created VN ctest-vn2-10312240
2026-06-22 04:02:41,483 - DEBUG - VN ctest-vn2-10312240 UUID is 913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:02:41,863 - DEBUG - Response for create_network : {'network': {'id': 'b190a28d-07b4-44bc-a8fb-17e7902f4015', 'name': 'ctest-fip_vn-00366458', 'tenant_id': '3b0efd22deee424795a8ffcbc565a833', 'project_id': '3b0efd22deee424795a8ffcbc565a833', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-03479480', 'ctest-fip_vn-00366458'], 'port_security_enabled': True, 'description': ''}}
2026-06-22 04:02:42,169 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ed7c31c2-4b15-4e86-876c-8d4d55a7e2e2', 'name': '', 'tenant_id': '3b0efd22deee424795a8ffcbc565a833', 'network_id': 'b190a28d-07b4-44bc-a8fb-17e7902f4015', 'ip_version': 4, 'cidr': '30.36.247.192/26', 'allocation_pools': [{'start': '30.36.247.194', 'end': '30.36.247.254'}], 'gateway_ip': '30.36.247.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.36.247.194', 'tags': [], 'project_id': '3b0efd22deee424795a8ffcbc565a833'}}
2026-06-22 04:02:42,202 - INFO - Created VN ctest-fip_vn-00366458
2026-06-22 04:02:42,218 - DEBUG - VN ctest-fip_vn-00366458 UUID is b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:02:42,307 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6014-1', 'an-jenkins-deploy-platform-ansible-os-6014-2']}
2026-06-22 04:02:43,702 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6014-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6014-2)
2026-06-22 04:02:44,980 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6014-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6014-2)
2026-06-22 04:02:46,526 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6014-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6014-1)
2026-06-22 04:02:46,527 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:02:46,536 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:02:46,553 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:02:46,663 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:46,693 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:46,709 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:02:46,727 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:02:46,738 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b11c3331-5cb2-4bb0-a2fd-c2cedbcc6075
2026-06-22 04:02:46,753 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:02:46,753 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:46,770 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:02:46,791 - INFO - Verified VN network id 12 for VN e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:46,791 - INFO - Verifications in API Server for VN ctest-vn1-49900671 passed
2026-06-22 04:02:46,791 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:46,813 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:02:46,824 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:02:46,840 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b11c3331-5cb2-4bb0-a2fd-c2cedbcc6075
2026-06-22 04:02:46,857 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:02:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:43.351865'}
2026-06-22 04:02:46,866 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:02:46,875 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:02:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:43.375820'}
2026-06-22 04:02:46,882 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:02:46,887 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:02:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:43.383897'}
2026-06-22 04:02:46,894 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:02:46,894 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-49900671 passed
2026-06-22 04:02:46,894 - DEBUG - ====Verifying policy data for ctest-vn1-49900671 in API_Server ======
2026-06-22 04:02:46,894 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:02:46,902 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:02:46,919 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:02:47,037 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:02:47,048 - DEBUG - =>VN ctest-vn1-49900671 has no policy to be verified
2026-06-22 04:02:47,048 - DEBUG - Verifying the vn in opserver
2026-06-22 04:02:47,048 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.19
2026-06-22 04:02:47,048 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 04:02:47,115 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:02:47,115 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.129
2026-06-22 04:02:47,115 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 04:02:47,170 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:02:47,170 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.241
2026-06-22 04:02:47,170 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 04:02:47,220 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:02:47,220 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 is found in opserver
2026-06-22 04:02:47,232 - DEBUG - VRF ids for VN ctest-vn1-49900671: {'10.0.0.242': '2'}
2026-06-22 04:02:47,232 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:02:47,240 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:02:47,256 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:02:47,380 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:02:47,400 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:02:47,414 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:02:47,428 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:02:47,440 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/4607bc16-a24f-43d1-ae24-5806d0d347ec
2026-06-22 04:02:47,451 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:02:47,451 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:02:47,466 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:02:47,488 - INFO - Verified VN network id 13 for VN 913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:02:47,488 - INFO - Verifications in API Server for VN ctest-vn2-10312240 passed
2026-06-22 04:02:47,488 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:02:47,502 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:02:47,512 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:02:47,520 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/4607bc16-a24f-43d1-ae24-5806d0d347ec
2026-06-22 04:02:47,538 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10465586091099703273', 'uuid-lslong': '9326045117458492359'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:02:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.167055'}
2026-06-22 04:02:47,548 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:02:47,556 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10465586091099703273', 'uuid-lslong': '9326045117458492359'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:02:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.185326'}
2026-06-22 04:02:47,564 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:02:47,572 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10465586091099703273', 'uuid-lslong': '9326045117458492359'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:02:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.206863'}
2026-06-22 04:02:47,579 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:02:47,579 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-10312240 passed
2026-06-22 04:02:47,580 - DEBUG - ====Verifying policy data for ctest-vn2-10312240 in API_Server ======
2026-06-22 04:02:47,580 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:02:47,588 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:02:47,601 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:02:47,702 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:02:47,711 - DEBUG - =>VN ctest-vn2-10312240 has no policy to be verified
2026-06-22 04:02:47,711 - DEBUG - Verifying the vn in opserver
2026-06-22 04:02:47,712 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 virtual network link through opserver 10.0.0.19
2026-06-22 04:02:47,712 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 04:02:47,755 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240?flat'}
2026-06-22 04:02:47,755 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 virtual network link through opserver 10.0.0.129
2026-06-22 04:02:47,755 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 04:02:47,805 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240?flat'}
2026-06-22 04:02:47,805 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 virtual network link through opserver 10.0.0.241
2026-06-22 04:02:47,805 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 04:02:47,859 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240?flat'}
2026-06-22 04:02:47,859 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 is found in opserver
2026-06-22 04:02:47,887 - DEBUG - Do not have enough data to verify VN in agent
2026-06-22 04:02:47,901 - DEBUG - VRF ids for VN ctest-vn2-10312240: {}
2026-06-22 04:02:47,901 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:02:47,910 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:02:47,983 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:02:48,057 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:02:48,087 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:02:48,108 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ff79813-c07a-4bae-aa2f-87aa238e7677
2026-06-22 04:02:48,120 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ff79813-c07a-4bae-aa2f-87aa238e7677
2026-06-22 04:02:48,138 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/9ef0dc37-89e0-4787-a2a4-50a95229984c
2026-06-22 04:02:48,157 - DEBUG - Route Targets: ['target:64512:8000007']
2026-06-22 04:02:48,157 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:02:48,176 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ff79813-c07a-4bae-aa2f-87aa238e7677
2026-06-22 04:02:48,200 - INFO - Verified VN network id 14 for VN b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:02:48,201 - INFO - Verifications in API Server for VN ctest-fip_vn-00366458 passed
2026-06-22 04:02:48,201 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:02:48,224 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ff79813-c07a-4bae-aa2f-87aa238e7677
2026-06-22 04:02:48,238 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ff79813-c07a-4bae-aa2f-87aa238e7677
2026-06-22 04:02:48,253 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/9ef0dc37-89e0-4787-a2a4-50a95229984c
2026-06-22 04:02:48,272 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12794905267962922172', 'uuid-lslong': '12176352300850167829'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:02:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.195383'}
2026-06-22 04:02:48,281 - DEBUG - Route Targets: ['target:64512:8000007']
2026-06-22 04:02:48,291 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12794905267962922172', 'uuid-lslong': '12176352300850167829'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:02:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.215358'}
2026-06-22 04:02:48,302 - DEBUG - Route Targets: ['target:64512:8000007']
2026-06-22 04:02:48,310 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12794905267962922172', 'uuid-lslong': '12176352300850167829'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:02:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.231784'}
2026-06-22 04:02:48,317 - DEBUG - Route Targets: ['target:64512:8000007']
2026-06-22 04:02:48,317 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-00366458 passed
2026-06-22 04:02:48,317 - DEBUG - ====Verifying policy data for ctest-fip_vn-00366458 in API_Server ======
2026-06-22 04:02:48,317 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:02:48,324 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:02:48,344 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:02:48,459 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:02:48,470 - DEBUG - =>VN ctest-fip_vn-00366458 has no policy to be verified
2026-06-22 04:02:48,470 - DEBUG - Verifying the vn in opserver
2026-06-22 04:02:48,470 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 virtual network link through opserver 10.0.0.19
2026-06-22 04:02:48,470 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 04:02:48,487 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458?flat'}
2026-06-22 04:02:48,487 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 virtual network link through opserver 10.0.0.129
2026-06-22 04:02:48,487 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 04:02:48,507 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458?flat'}
2026-06-22 04:02:48,507 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 virtual network link through opserver 10.0.0.241
2026-06-22 04:02:48,507 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 04:02:48,523 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458?flat'}
2026-06-22 04:02:48,523 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 is found in opserver
2026-06-22 04:02:48,544 - DEBUG - Do not have enough data to verify VN in agent
2026-06-22 04:02:48,579 - DEBUG - VRF ids for VN ctest-fip_vn-00366458: {}
2026-06-22 04:02:48,579 - INFO - Waiting for VM ctest-fvn_vm1-45516864 to be up..
2026-06-22 04:02:48,653 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-22 04:02:53,731 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-22 04:02:58,810 - DEBUG - VM is in ACTIVE state now
2026-06-22 04:02:58,810 - INFO - VM name : ctest-fvn_vm1-45516864
2026-06-22 04:02:58,887 - DEBUG - VM ctest-fvn_vm1-45516864 ID is 79077f1b-4236-47c1-9818-26e466dcc95a
2026-06-22 04:02:58,888 - DEBUG - VM ctest-fvn_vm1-45516864 launched on Node an-jenkins-deploy-platform-ansible-os-6014-2
2026-06-22 04:02:58,995 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/79077f1b-4236-47c1-9818-26e466dcc95a
2026-06-22 04:02:59,006 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/d131879c-c783-4329-bf4a-760c1b608a30
2026-06-22 04:03:02,184 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2026-06-22 04:03:02,184 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-45516864 failed!
2026-06-22 04:03:02,198 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 is 30.36.247.193 and allocation pool is NOT set
2026-06-22 04:03:06,284 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2026-06-22 04:03:06,285 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-45516864 failed!
2026-06-22 04:03:06,300 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 is 30.36.247.193 and allocation pool is NOT set
2026-06-22 04:03:10,381 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2026-06-22 04:03:10,382 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-45516864 failed!
2026-06-22 04:03:10,396 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 is 30.36.247.193 and allocation pool is NOT set
2026-06-22 04:03:14,470 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2026-06-22 04:03:14,470 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-45516864 failed!
2026-06-22 04:03:14,487 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 is 30.36.247.193 and allocation pool is NOT set
2026-06-22 04:03:16,555 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=5.17 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.834 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.834/3.001/5.168/2.167 ms')
2026-06-22 04:03:16,555 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-45516864 passed
2026-06-22 04:03:16,628 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:03:16,628 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-45516864, IP 30.36.247.195, Port 22
2026-06-22 04:03:16,694 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-22 04:03:16,773 - DEBUG - VM ctest-fvn_vm1-45516864 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-22 04:03:21,774 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:03:21,774 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-45516864, IP 30.36.247.195, Port 22
2026-06-22 04:03:21,942 - DEBUG - VM ctest-fvn_vm1-45516864 is ready for SSH connections
2026-06-22 04:03:21,942 - INFO - Waiting for VM ctest-vn2_vm2-99639374 to be up..
2026-06-22 04:03:22,029 - DEBUG - VM is in ACTIVE state now
2026-06-22 04:03:22,029 - INFO - VM name : ctest-vn2_vm2-99639374
2026-06-22 04:03:22,115 - DEBUG - VM ctest-vn2_vm2-99639374 ID is ef12964b-7dad-498b-be7c-3935f4cada52
2026-06-22 04:03:22,115 - DEBUG - VM ctest-vn2_vm2-99639374 launched on Node an-jenkins-deploy-platform-ansible-os-6014-2
2026-06-22 04:03:22,203 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/ef12964b-7dad-498b-be7c-3935f4cada52
2026-06-22 04:03:22,213 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/97f66cab-39bd-4f1d-9504-5a7c605a70ab
2026-06-22 04:03:23,375 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.42 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.530 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.530/1.472/2.415/0.942 ms')
2026-06-22 04:03:23,375 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2_vm2-99639374 passed
2026-06-22 04:03:23,447 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:03:23,447 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-99639374, IP 31.13.60.195, Port 22
2026-06-22 04:03:23,603 - DEBUG - VM ctest-vn2_vm2-99639374 is ready for SSH connections
2026-06-22 04:03:23,603 - INFO - Waiting for VM mltf_vm to be up..
2026-06-22 04:03:23,685 - DEBUG - VM is in ACTIVE state now
2026-06-22 04:03:23,685 - INFO - VM name : mltf_vm
2026-06-22 04:03:23,767 - DEBUG - VM mltf_vm ID is b413adca-f593-4f40-a006-7c8e6842ad78
2026-06-22 04:03:23,767 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-6014-1
2026-06-22 04:03:23,947 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/b413adca-f593-4f40-a006-7c8e6842ad78
2026-06-22 04:03:23,960 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/8620a456-8972-4752-a839-3b307c4fbcdf
2026-06-22 04:03:23,971 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/ba8b344b-dc88-4006-b5aa-d6d67046f809
2026-06-22 04:03:25,166 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.16 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.409 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.409/1.283/2.157/0.874 ms')
2026-06-22 04:03:25,166 - INFO - Ping to Metadata IP 169.254.0.5 of VM mltf_vm passed
2026-06-22 04:03:25,236 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:03:25,236 - DEBUG - Waiting to SSH to VM mltf_vm, IP 67.152.11.197, Port 22
2026-06-22 04:03:25,413 - DEBUG - VM mltf_vm is ready for SSH connections
2026-06-22 04:03:25,486 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:03:25,486 - DEBUG - Waiting to SSH to VM mltf_vm, IP 67.152.11.197, Port 22
2026-06-22 04:03:25,656 - DEBUG - VM mltf_vm is ready for SSH connections
2026-06-22 04:03:25,659 - INFO - ================================================================================
2026-06-22 04:03:25,659 - INFO - STARTING TEST : test_verify_session_sampling_teardown
2026-06-22 04:03:25,659 - INFO - TEST DESCRIPTION :
1.query client session samples
2.query server session samples
3.query client session to get number of sessions exported
4.query session record table for teardown bytes/pkts
5.query sample count after teardown on server side
2026-06-22 04:03:26,919 - DEBUG - Skipping xmpp flap check
2026-06-22 04:03:26,919 - INFO - Initial checks done. Running the testcase now
2026-06-22 04:03:26,919 - INFO -
2026-06-22 04:03:27,043 - INFO - Setting flow export rate: 100
2026-06-22 04:03:27,092 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2026-06-22 04:03:27,439 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f', 'name': 'ctest-vn1-49900671', 'tenant_id': '3b0efd22deee424795a8ffcbc565a833', 'project_id': '3b0efd22deee424795a8ffcbc565a833', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['08059166-30cf-4d0d-9c0a-21ebcf356e82'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-03479480', 'ctest-vn1-49900671'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-03479480', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '67.152.11.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2026-06-22 04:03:27,614 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '913d3b19-ce44-47e9-816c-c49f71612bc7', 'name': 'ctest-vn2-10312240', 'tenant_id': '3b0efd22deee424795a8ffcbc565a833', 'project_id': '3b0efd22deee424795a8ffcbc565a833', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['71ef8ec8-2a6f-4a35-af1d-f0a5aefa5bca'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-03479480', 'ctest-vn2-10312240'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-03479480', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '31.13.60.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2026-06-22 04:03:27,714 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:03:27,722 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:03:27,753 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:03:27,868 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:27,889 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:27,900 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:03:27,918 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:03:27,925 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b11c3331-5cb2-4bb0-a2fd-c2cedbcc6075
2026-06-22 04:03:27,933 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:03:27,933 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:27,943 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:03:27,963 - INFO - Verified VN network id 12 for VN e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:27,963 - INFO - Verifications in API Server for VN ctest-vn1-49900671 passed
2026-06-22 04:03:27,963 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:27,983 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:03:28,030 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:03:28,040 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b11c3331-5cb2-4bb0-a2fd-c2cedbcc6075
2026-06-22 04:03:28,066 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.667795'}
2026-06-22 04:03:28,078 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:03:28,087 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.691132'}
2026-06-22 04:03:28,103 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:03:28,111 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.717486'}
2026-06-22 04:03:28,122 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:03:28,122 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-49900671 passed
2026-06-22 04:03:28,122 - DEBUG - ====Verifying policy data for ctest-vn1-49900671 in API_Server ======
2026-06-22 04:03:28,122 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:03:28,130 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:03:28,144 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:03:28,338 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:28,357 - DEBUG - ==>Verifying data for policy with id: b2f08727-e907-42a6-9b21-3f96fd4aadd8, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-03479480', 'policy1']
2026-06-22 04:03:28,357 - INFO - VN ctest-vn1-49900671 Policy verification: verify_vn_policy_in_api_server, status: True
2026-06-22 04:03:28,357 - DEBUG - Verifying the vn in opserver
2026-06-22 04:03:28,357 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.19
2026-06-22 04:03:28,358 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 04:03:28,372 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:03:28,372 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.129
2026-06-22 04:03:28,372 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 04:03:28,385 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:03:28,386 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.241
2026-06-22 04:03:28,386 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 04:03:28,406 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:03:28,406 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 is found in opserver
2026-06-22 04:03:28,418 - DEBUG - VRF ids for VN ctest-vn1-49900671: {'10.0.0.242': '2'}
2026-06-22 04:03:28,418 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:03:28,425 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:03:28,435 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:03:28,549 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:28,569 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:28,590 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:03:28,602 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:03:28,610 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/4607bc16-a24f-43d1-ae24-5806d0d347ec
2026-06-22 04:03:28,618 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:03:28,618 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:28,630 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:03:28,646 - INFO - Verified VN network id 13 for VN 913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:28,646 - INFO - Verifications in API Server for VN ctest-vn2-10312240 passed
2026-06-22 04:03:28,646 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:28,656 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:03:28,663 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:03:28,670 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/4607bc16-a24f-43d1-ae24-5806d0d347ec
2026-06-22 04:03:28,682 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10465586091099703273', 'uuid-lslong': '9326045117458492359'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.101291'}
2026-06-22 04:03:28,691 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:03:28,699 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10465586091099703273', 'uuid-lslong': '9326045117458492359'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.116118'}
2026-06-22 04:03:28,707 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:03:28,713 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10465586091099703273', 'uuid-lslong': '9326045117458492359'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.129688'}
2026-06-22 04:03:28,721 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:03:28,721 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-10312240 passed
2026-06-22 04:03:28,722 - DEBUG - ====Verifying policy data for ctest-vn2-10312240 in API_Server ======
2026-06-22 04:03:28,722 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:03:28,729 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:03:28,742 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:03:28,857 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:28,868 - DEBUG - ==>Verifying data for policy with id: b2f08727-e907-42a6-9b21-3f96fd4aadd8, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-03479480', 'policy1']
2026-06-22 04:03:28,869 - INFO - VN ctest-vn2-10312240 Policy verification: verify_vn_policy_in_api_server, status: True
2026-06-22 04:03:28,869 - DEBUG - Verifying the vn in opserver
2026-06-22 04:03:28,869 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 virtual network link through opserver 10.0.0.19
2026-06-22 04:03:28,869 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 04:03:28,880 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240?flat'}
2026-06-22 04:03:28,880 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 virtual network link through opserver 10.0.0.129
2026-06-22 04:03:28,880 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 04:03:28,893 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240?flat'}
2026-06-22 04:03:28,893 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 virtual network link through opserver 10.0.0.241
2026-06-22 04:03:28,893 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 04:03:28,906 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240?flat'}
2026-06-22 04:03:28,906 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 is found in opserver
2026-06-22 04:03:28,918 - DEBUG - VRF ids for VN ctest-vn2-10312240: {'10.0.0.242': '3', '10.0.0.22': '2'}
2026-06-22 04:03:28,918 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:03:28,924 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:03:28,934 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:03:29,027 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:29,039 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:29,050 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:03:29,074 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:03:29,086 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b11c3331-5cb2-4bb0-a2fd-c2cedbcc6075
2026-06-22 04:03:29,094 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:03:29,094 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:29,104 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:03:29,124 - INFO - Verified VN network id 12 for VN e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:29,124 - INFO - Verifications in API Server for VN ctest-vn1-49900671 passed
2026-06-22 04:03:29,124 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:29,138 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:03:29,149 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:03:29,161 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b11c3331-5cb2-4bb0-a2fd-c2cedbcc6075
2026-06-22 04:03:29,179 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.782826'}
2026-06-22 04:03:29,187 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:03:29,193 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.798926'}
2026-06-22 04:03:29,200 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:03:29,205 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16481585454426374285', 'uuid-lslong': '11595534956474944815'}, 'enable': 'true', 'created': '2026-06-22T04:02:03', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.812686'}
2026-06-22 04:03:29,212 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 04:03:29,212 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-49900671 passed
2026-06-22 04:03:29,212 - DEBUG - ====Verifying policy data for ctest-vn1-49900671 in API_Server ======
2026-06-22 04:03:29,212 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:03:29,220 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:03:29,234 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:03:29,365 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f
2026-06-22 04:03:29,381 - DEBUG - ==>Verifying data for policy with id: b2f08727-e907-42a6-9b21-3f96fd4aadd8, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-03479480', 'policy1']
2026-06-22 04:03:29,381 - INFO - VN ctest-vn1-49900671 Policy verification: verify_vn_policy_in_api_server, status: True
2026-06-22 04:03:29,381 - DEBUG - Verifying the vn in opserver
2026-06-22 04:03:29,381 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.19
2026-06-22 04:03:29,381 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 04:03:29,395 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:03:29,395 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.129
2026-06-22 04:03:29,395 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 04:03:29,409 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:03:29,410 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 virtual network link through opserver 10.0.0.241
2026-06-22 04:03:29,410 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 04:03:29,422 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671?flat'}
2026-06-22 04:03:29,422 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671 is found in opserver
2026-06-22 04:03:29,433 - DEBUG - VRF ids for VN ctest-vn1-49900671: {'10.0.0.242': '2'}
2026-06-22 04:03:29,433 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:03:29,444 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:03:29,458 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:03:29,557 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:29,567 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:29,577 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:03:29,585 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:03:29,593 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/4607bc16-a24f-43d1-ae24-5806d0d347ec
2026-06-22 04:03:29,600 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:03:29,600 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:29,611 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:03:29,632 - INFO - Verified VN network id 13 for VN 913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:29,632 - INFO - Verifications in API Server for VN ctest-vn2-10312240 passed
2026-06-22 04:03:29,632 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:29,644 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:03:29,653 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:03:29,662 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/4607bc16-a24f-43d1-ae24-5806d0d347ec
2026-06-22 04:03:29,674 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10465586091099703273', 'uuid-lslong': '9326045117458492359'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.092611'}
2026-06-22 04:03:29,681 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:03:29,687 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10465586091099703273', 'uuid-lslong': '9326045117458492359'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.103357'}
2026-06-22 04:03:29,698 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:03:29,704 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10465586091099703273', 'uuid-lslong': '9326045117458492359'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:03:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.121075'}
2026-06-22 04:03:29,713 - DEBUG - Route Targets: ['target:64512:8000006']
2026-06-22 04:03:29,713 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-10312240 passed
2026-06-22 04:03:29,713 - DEBUG - ====Verifying policy data for ctest-vn2-10312240 in API_Server ======
2026-06-22 04:03:29,713 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:03:29,720 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:03:29,731 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:03:29,824 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/913d3b19-ce44-47e9-816c-c49f71612bc7
2026-06-22 04:03:29,836 - DEBUG - ==>Verifying data for policy with id: b2f08727-e907-42a6-9b21-3f96fd4aadd8, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-03479480', 'policy1']
2026-06-22 04:03:29,836 - INFO - VN ctest-vn2-10312240 Policy verification: verify_vn_policy_in_api_server, status: True
2026-06-22 04:03:29,836 - DEBUG - Verifying the vn in opserver
2026-06-22 04:03:29,836 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 virtual network link through opserver 10.0.0.19
2026-06-22 04:03:29,836 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 04:03:29,849 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240?flat'}
2026-06-22 04:03:29,849 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 virtual network link through opserver 10.0.0.129
2026-06-22 04:03:29,849 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 04:03:29,862 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240?flat'}
2026-06-22 04:03:29,862 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 virtual network link through opserver 10.0.0.241
2026-06-22 04:03:29,862 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 04:03:29,876 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240?flat'}
2026-06-22 04:03:29,876 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240 is found in opserver
2026-06-22 04:03:29,886 - DEBUG - VRF ids for VN ctest-vn2-10312240: {'10.0.0.242': '3', '10.0.0.22': '2'}
2026-06-22 04:03:29,887 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:03:29,893 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:03:29,903 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:03:29,999 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:03:30,014 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:03:30,028 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ff79813-c07a-4bae-aa2f-87aa238e7677
2026-06-22 04:03:30,041 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ff79813-c07a-4bae-aa2f-87aa238e7677
2026-06-22 04:03:30,051 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/9ef0dc37-89e0-4787-a2a4-50a95229984c
2026-06-22 04:03:30,058 - DEBUG - Route Targets: ['target:64512:8000007']
2026-06-22 04:03:30,058 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:03:30,068 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ff79813-c07a-4bae-aa2f-87aa238e7677
2026-06-22 04:03:30,085 - INFO - Verified VN network id 14 for VN b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:03:30,085 - INFO - Verifications in API Server for VN ctest-fip_vn-00366458 passed
2026-06-22 04:03:30,085 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:03:30,095 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ff79813-c07a-4bae-aa2f-87aa238e7677
2026-06-22 04:03:30,102 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ff79813-c07a-4bae-aa2f-87aa238e7677
2026-06-22 04:03:30,110 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/9ef0dc37-89e0-4787-a2a4-50a95229984c
2026-06-22 04:03:30,128 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12794905267962922172', 'uuid-lslong': '12176352300850167829'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:02:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:48.055172'}
2026-06-22 04:03:30,135 - DEBUG - Route Targets: ['target:64512:8000007']
2026-06-22 04:03:30,142 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12794905267962922172', 'uuid-lslong': '12176352300850167829'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:02:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:48.067345'}
2026-06-22 04:03:30,150 - DEBUG - Route Targets: ['target:64512:8000007']
2026-06-22 04:03:30,157 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-03479480', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12794905267962922172', 'uuid-lslong': '12176352300850167829'}, 'enable': 'true', 'created': '2026-06-22T04:02:41', 'last-modified': '2026-06-22T04:02:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:48.078458'}
2026-06-22 04:03:30,165 - DEBUG - Route Targets: ['target:64512:8000007']
2026-06-22 04:03:30,165 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-00366458 passed
2026-06-22 04:03:30,165 - DEBUG - ====Verifying policy data for ctest-fip_vn-00366458 in API_Server ======
2026-06-22 04:03:30,165 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:03:30,173 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:03:30,186 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:03:30,287 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b190a28d-07b4-44bc-a8fb-17e7902f4015
2026-06-22 04:03:30,300 - DEBUG - =>VN ctest-fip_vn-00366458 has no policy to be verified
2026-06-22 04:03:30,300 - DEBUG - Verifying the vn in opserver
2026-06-22 04:03:30,300 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 virtual network link through opserver 10.0.0.19
2026-06-22 04:03:30,300 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2026-06-22 04:03:30,314 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458?flat'}
2026-06-22 04:03:30,314 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 virtual network link through opserver 10.0.0.129
2026-06-22 04:03:30,314 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-06-22 04:03:30,328 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458?flat'}
2026-06-22 04:03:30,328 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 virtual network link through opserver 10.0.0.241
2026-06-22 04:03:30,328 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-06-22 04:03:30,340 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458?flat'}
2026-06-22 04:03:30,340 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458 is found in opserver
2026-06-22 04:03:30,350 - DEBUG - VRF ids for VN ctest-fip_vn-00366458: {'10.0.0.22': '3'}
2026-06-22 04:03:30,350 - INFO - start time= 1782101010350852
2026-06-22 04:03:30,351 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.13.60.195, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 04:03:30,351 - DEBUG - ping -s 56 -c 3 -W 1 31.13.60.195
2026-06-22 04:03:33,928 - DEBUG - PING 31.13.60.195 (31.13.60.195): 56 data bytes
64 bytes from 31.13.60.195: seq=0 ttl=63 time=4.110 ms
64 bytes from 31.13.60.195: seq=1 ttl=63 time=1.314 ms
64 bytes from 31.13.60.195: seq=2 ttl=63 time=1.302 ms
--- 31.13.60.195 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.302/2.242/4.110 ms
2026-06-22 04:03:33,928 - INFO - Ping to IP 31.13.60.195 from VM ctest-vn1_vm1-96699383 passed
2026-06-22 04:03:43,929 - INFO - Verify session samples and teardown pkts
2026-06-22 04:03:43,930 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.19
2026-06-22 04:03:43,933 - DEBUG - Posting: http://10.0.0.19:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1782101010350852, 'end_time': 1782101023933378, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2026-06-22 04:03:44,960 - ERROR - Session sample client returned [{'T': 1782101011898959}, {'T': 1782101012899276}, {'T': 1782101013899076}, {'T': 1782101014899144}] not expected
2026-06-22 04:03:44,960 - DEBUG - [{'T': 1782101011898959}, {'T': 1782101012899276}, {'T': 1782101013899076}, {'T': 1782101014899144}]
2026-06-22 04:03:44,960 - DEBUG - Posting: http://10.0.0.19:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1782101010350852, 'end_time': 1782101024960402, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'}
2026-06-22 04:03:45,983 - DEBUG - [{'T': 1782101012449885}, {'T': 1782101013449910}, {'T': 1782101014450036}]
2026-06-22 04:03:45,983 - DEBUG - Posting: http://10.0.0.19:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1782101010350852, 'end_time': 1782101025983622, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2026-06-22 04:03:47,002 - ERROR - Session sample count returned [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'sample_count': 4}] not expected
2026-06-22 04:03:47,003 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'sample_count': 4}]
2026-06-22 04:03:47,003 - INFO - wait for the flows to get expire
2026-06-22 04:07:07,004 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6014-1:Compute:contrail-vrouter-agent:0?flat
2026-06-22 04:07:07,076 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6014-1?flat
2026-06-22 04:07:07,110 - DEBUG - Posting: http://10.0.0.19:8081/analytics/query, payload {'table': 'SessionRecordTable', 'start_time': 1782101010350852, 'end_time': 1782101227110727, 'select_fields': ['vn', 'remote_vn', 'forward_teardown_pkts', 'reverse_teardown_pkts'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2026-06-22 04:07:08,141 - DEBUG - [{'forward_flow_uuid': 'a76fee1b-4a4c-4a7a-8713-8fb7588f9cba', 'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'reverse_flow_uuid': 'db595b11-c415-4370-b7a0-ebdf56c478e5', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'forward_teardown_pkts': 3, 'reverse_teardown_pkts': 3}]
2026-06-22 04:07:08,141 - DEBUG - Posting: http://10.0.0.19:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1782101010350852, 'end_time': 1782101228141644, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2026-06-22 04:07:09,162 - ERROR - Session sample count returned [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'sample_count': 5}] not expected
2026-06-22 04:07:09,162 - DEBUG - Posting: http://10.0.0.19:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1782101010350852, 'end_time': 1782101229162793, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'}
2026-06-22 04:07:10,186 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240', 'sample_count': 4}]
2026-06-22 04:07:10,596 - INFO - Deleted policy policy1
2026-06-22 04:07:10,707 - INFO - Setting flow export rate: None
2026-06-22 04:07:11,967 - ERROR - AssertionError
Python 3.9.25: /usr/bin/python3
Mon Jun 22 04:07:10 2026
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_sampling_teardown(self=)
1283 result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn)
1284
1285 assert result,'Failed to get expected number of samples'
1286 #test_verify_session_sampling_teardown
1287
result = False
AssertionError: Failed to get expected number of samples
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ('Failed to get expected number of samples',)
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1285, in test_verify_session_sampling_teardown
assert result,'Failed to get expected number of samples'
AssertionError: Failed to get expected number of samples
2026-06-22 04:07:11,967 - DEBUG - Skipping xmpp flap check
2026-06-22 04:07:11,967 - INFO -
2026-06-22 04:07:11,967 - INFO - END TEST : test_verify_session_sampling_teardown : FAILED[0:03:46]
2026-06-22 04:07:11,967 - INFO - --------------------------------------------------------------------------------
2026-06-22 04:07:11,969 - INFO - Deleting VM mltf_vm
2026-06-22 04:07:12,036 - INFO - Deleting VM ctest-fvn_vm1-45516864
2026-06-22 04:07:12,106 - INFO - Deleting VM ctest-vn2_vm2-99639374
2026-06-22 04:07:12,177 - INFO - Deleting VN ctest-fip_vn-00366458
2026-06-22 04:07:12,216 - DEBUG - VN b190a28d-07b4-44bc-a8fb-17e7902f4015 still in use: Unable to complete operation on network b190a28d-07b4-44bc-a8fb-17e7902f4015. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-e80586ac-3f76-4ba0-a923-ec4cb9586f45']
2026-06-22 04:07:12,216 - WARNING - Deleting VN ctest-fip_vn-00366458 failed..Will retry
2026-06-22 04:07:14,553 - DEBUG - Response for deleting network ()
2026-06-22 04:07:14,553 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ff79813-c07a-4bae-aa2f-87aa238e7677
2026-06-22 04:07:14,592 - DEBUG - Response Code: 404
2026-06-22 04:07:14,593 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:07:14,605 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:07:14,626 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:07:14,791 - INFO - Validated that VN ctest-fip_vn-00366458 is not found in API Server
2026-06-22 04:07:14,802 - DEBUG - VN ctest-fip_vn-00366458 is not present in Agent 10.0.0.242
2026-06-22 04:07:14,812 - DEBUG - VN ctest-fip_vn-00366458 is not present in Agent 10.0.0.22
2026-06-22 04:07:14,812 - INFO - Validated that VN ctest-fip_vn-00366458 is not in any agent
2026-06-22 04:07:14,817 - DEBUG - VRF 3 is not seen in agent 10.0.0.22
2026-06-22 04:07:14,823 - DEBUG - Vrouter 10.0.0.22 does not have vrf 3 for VN ctest-fip_vn-00366458
2026-06-22 04:07:14,823 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-fip_vn-00366458
2026-06-22 04:07:14,841 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-00366458 info
2026-06-22 04:07:14,842 - INFO - Deleting VN ctest-vn2-10312240
2026-06-22 04:07:15,029 - DEBUG - Response for deleting network ()
2026-06-22 04:07:15,029 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bb115dd9-b19e-4e3b-8654-4ccbddd299bf
2026-06-22 04:07:15,034 - DEBUG - Response Code: 404
2026-06-22 04:07:15,034 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:07:15,039 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:07:15,053 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:07:15,148 - INFO - Validated that VN ctest-vn2-10312240 is not found in API Server
2026-06-22 04:07:15,159 - DEBUG - VN ctest-vn2-10312240 is not present in Agent 10.0.0.242
2026-06-22 04:07:15,172 - DEBUG - VN ctest-vn2-10312240 is not present in Agent 10.0.0.22
2026-06-22 04:07:15,172 - INFO - Validated that VN ctest-vn2-10312240 is not in any agent
2026-06-22 04:07:15,177 - DEBUG - VRF 3 is not seen in agent 10.0.0.242
2026-06-22 04:07:15,182 - DEBUG - Vrouter 10.0.0.242 does not have vrf 3 for VN ctest-vn2-10312240
2026-06-22 04:07:15,187 - DEBUG - VRF 2 is not seen in agent 10.0.0.22
2026-06-22 04:07:15,192 - DEBUG - Vrouter 10.0.0.22 does not have vrf 2 for VN ctest-vn2-10312240
2026-06-22 04:07:15,192 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn2-10312240
2026-06-22 04:07:15,215 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-10312240 info
2026-06-22 04:07:15,216 - INFO - Deleting VM ctest-vn1_vm2-29974802
2026-06-22 04:07:15,288 - INFO - Deleting VM ctest-vn1_vm1-96699383
2026-06-22 04:07:15,408 - INFO - Deleting VN ctest-vn1-49900671
2026-06-22 04:07:15,453 - DEBUG - VN e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f still in use: Unable to complete operation on network e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-383ba5a1-9b91-4b01-9c5b-39fb75e47cbb']
2026-06-22 04:07:15,453 - WARNING - Deleting VN ctest-vn1-49900671 failed..Will retry
2026-06-22 04:07:17,537 - DEBUG - VN e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f still in use: Unable to complete operation on network e4ba5aa5-ca54-408d-a0eb-9d9b6d504d2f. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f991f5c7-9380-465b-9d31-bd3b3871e7ed']
2026-06-22 04:07:17,537 - WARNING - Deleting VN ctest-vn1-49900671 failed..Will retry
2026-06-22 04:07:19,696 - DEBUG - Response for deleting network ()
2026-06-22 04:07:19,696 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/cf761331-2725-4b49-9b22-50c4e0c1e9b2
2026-06-22 04:07:19,703 - DEBUG - Response Code: 404
2026-06-22 04:07:19,703 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:07:19,709 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:07:19,731 - DEBUG - Requesting: http://10.0.0.19:8082/project/3b0efd22-deee-4247-95a8-ffcbc565a833
2026-06-22 04:07:19,822 - INFO - Validated that VN ctest-vn1-49900671 is not found in API Server
2026-06-22 04:07:19,834 - DEBUG - VN ctest-vn1-49900671 is not present in Agent 10.0.0.242
2026-06-22 04:07:19,844 - DEBUG - VN ctest-vn1-49900671 is not present in Agent 10.0.0.22
2026-06-22 04:07:19,844 - INFO - Validated that VN ctest-vn1-49900671 is not in any agent
2026-06-22 04:07:19,849 - DEBUG - VRF 2 is not seen in agent 10.0.0.242
2026-06-22 04:07:19,854 - DEBUG - Vrouter 10.0.0.242 does not have vrf 2 for VN ctest-vn1-49900671
2026-06-22 04:07:19,854 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-03479480:ctest-vn1-49900671
2026-06-22 04:07:19,873 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-49900671 info
2026-06-22 04:07:20,676 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-03479480, ID : 3b0efd22-deee-4247-95a8-ffcbc565a833