The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1375, in test_verify_session_record_table_inter_vn
self.setup_and_create_streams(self.res.vn1_vm1_fixture, self.res.vn2_vm2_fixture)
File "/contrail-test/serial_scripts/analytics/base.py", line 170, in setup_and_create_streams
self.stop_traffic(traffic_obj)
File "/contrail-test/common/base.py", line 798, in stop_traffic
assert sent and recv, "Packets not %s"%msg
AssertionError: Packets not transferred between 5.15.152.195 and 3.231.40.67, proto udp sport 8000 and dport 9000
2025-08-07 03:54:06,414 - DEBUG - Skipping xmpp flap check
2025-08-07 03:54:06,414 - INFO -
2025-08-07 03:54:06,414 - INFO - END TEST : test_verify_session_record_table_inter_vn : FAILED[0:00:50]
2025-08-07 03:54:06,414 - INFO - --------------------------------------------------------------------------------
2025-08-07 03:54:06,419 - INFO - ================================================================================
2025-08-07 03:54:06,419 - INFO - STARTING TEST : test_verify_session_sampling_teardown
2025-08-07 03:54:06,419 - INFO - TEST DESCRIPTION :
1.query client session samples
2.query server session samples
3.query client session to get number of sessions exported
4.query session record table for teardown bytes/pkts
5.query sample count after teardown on server side
2025-08-07 03:54:07,693 - DEBUG - Skipping xmpp flap check
2025-08-07 03:54:07,693 - INFO - Initial checks done. Running the testcase now
2025-08-07 03:54:07,693 - INFO -
2025-08-07 03:54:07,910 - INFO - Setting flow export rate: 100
2025-08-07 03:54:07,962 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2025-08-07 03:54:08,343 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '86dfcaa9-5861-472a-be9d-3232f6e3d340', 'name': 'ctest-vn1-76278277', 'tenant_id': 'e750dce56593495fa4987395bff3b2dd', 'project_id': 'e750dce56593495fa4987395bff3b2dd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['eaf77d94-f3e1-4e0c-bac8-101ee189b394'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'ctest-vn1-76278277'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '5.15.152.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-08-07 03:54:08,594 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '162e47c8-8920-4611-b29b-be9a65dd870c', 'name': 'ctest-vn2-75786057', 'tenant_id': 'e750dce56593495fa4987395bff3b2dd', 'project_id': 'e750dce56593495fa4987395bff3b2dd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['495c77ec-a577-446f-866c-99fd951841eb'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'ctest-vn2-75786057'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '3.231.40.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-08-07 03:54:08,743 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:54:08,758 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:54:08,780 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:54:08,885 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:08,906 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:08,920 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:54:08,933 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:54:08,944 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8810dbb5-1519-48dd-8bad-fa535a465593
2025-08-07 03:54:08,954 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:54:08,954 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:08,966 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:54:08,990 - INFO - Verified VN network id 12 for VN 86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:08,990 - INFO - Verifications in API Server for VN ctest-vn1-76278277 passed
2025-08-07 03:54:08,990 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:09,008 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:54:09,020 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:54:09,030 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8810dbb5-1519-48dd-8bad-fa535a465593
2025-08-07 03:54:09,047 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.740844'}
2025-08-07 03:54:09,055 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:54:09,062 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.754675'}
2025-08-07 03:54:09,073 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:54:09,081 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.795780'}
2025-08-07 03:54:09,089 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:54:09,089 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-76278277 passed
2025-08-07 03:54:09,089 - DEBUG - ====Verifying policy data for ctest-vn1-76278277 in API_Server ======
2025-08-07 03:54:09,089 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:54:09,097 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:54:09,113 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:54:09,255 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:09,276 - DEBUG - ==>Verifying data for policy with id: 849b108b-411e-4ad9-8ac0-e71a8a3af6a1, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']
2025-08-07 03:54:09,276 - INFO - VN ctest-vn1-76278277 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-07 03:54:09,276 - DEBUG - Verifying the vn in opserver
2025-08-07 03:54:09,277 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.56
2025-08-07 03:54:09,277 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:54:09,295 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:54:09,295 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.130
2025-08-07 03:54:09,295 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:54:09,310 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:54:09,310 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.249
2025-08-07 03:54:09,310 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:54:09,328 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:54:09,328 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 is found in opserver
2025-08-07 03:54:09,345 - DEBUG - VRF ids for VN ctest-vn1-76278277: {'10.0.0.61': '2'}
2025-08-07 03:54:09,345 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:54:09,355 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:54:09,371 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:54:09,495 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:09,514 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:09,527 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:54:09,538 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:54:09,551 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/5576ea6c-9c3a-49fa-82a7-e16d5b7dd38b
2025-08-07 03:54:09,561 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:54:09,561 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:09,577 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:54:09,603 - INFO - Verified VN network id 13 for VN 162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:09,603 - INFO - Verifications in API Server for VN ctest-vn2-75786057 passed
2025-08-07 03:54:09,603 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:09,619 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:54:09,631 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:54:09,642 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/5576ea6c-9c3a-49fa-82a7-e16d5b7dd38b
2025-08-07 03:54:09,660 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.104667'}
2025-08-07 03:54:09,670 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:54:09,677 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.123408'}
2025-08-07 03:54:09,688 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:54:09,696 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.148379'}
2025-08-07 03:54:09,705 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:54:09,705 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-75786057 passed
2025-08-07 03:54:09,705 - DEBUG - ====Verifying policy data for ctest-vn2-75786057 in API_Server ======
2025-08-07 03:54:09,706 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:54:09,714 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:54:09,729 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:54:09,842 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:09,856 - DEBUG - ==>Verifying data for policy with id: 849b108b-411e-4ad9-8ac0-e71a8a3af6a1, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']
2025-08-07 03:54:09,856 - INFO - VN ctest-vn2-75786057 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-07 03:54:09,856 - DEBUG - Verifying the vn in opserver
2025-08-07 03:54:09,856 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.56
2025-08-07 03:54:09,856 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:54:09,874 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:54:09,874 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.130
2025-08-07 03:54:09,874 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:54:09,893 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:54:09,893 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.249
2025-08-07 03:54:09,893 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:54:09,910 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:54:09,910 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 is found in opserver
2025-08-07 03:54:09,925 - DEBUG - VRF ids for VN ctest-vn2-75786057: {'10.0.0.41': '2', '10.0.0.61': '3'}
2025-08-07 03:54:09,925 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:54:09,941 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:54:09,961 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:54:10,075 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:10,089 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:10,107 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:54:10,119 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:54:10,132 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8810dbb5-1519-48dd-8bad-fa535a465593
2025-08-07 03:54:10,142 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:54:10,142 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:10,155 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:54:10,179 - INFO - Verified VN network id 12 for VN 86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:10,179 - INFO - Verifications in API Server for VN ctest-vn1-76278277 passed
2025-08-07 03:54:10,180 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:10,206 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:54:10,221 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:54:10,235 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8810dbb5-1519-48dd-8bad-fa535a465593
2025-08-07 03:54:10,254 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.946645'}
2025-08-07 03:54:10,263 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:54:10,271 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.963818'}
2025-08-07 03:54:10,281 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:54:10,290 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.003991'}
2025-08-07 03:54:10,299 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:54:10,299 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-76278277 passed
2025-08-07 03:54:10,299 - DEBUG - ====Verifying policy data for ctest-vn1-76278277 in API_Server ======
2025-08-07 03:54:10,299 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:54:10,307 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:54:10,325 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:54:10,431 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:54:10,445 - DEBUG - ==>Verifying data for policy with id: 849b108b-411e-4ad9-8ac0-e71a8a3af6a1, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']
2025-08-07 03:54:10,446 - INFO - VN ctest-vn1-76278277 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-07 03:54:10,446 - DEBUG - Verifying the vn in opserver
2025-08-07 03:54:10,446 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.56
2025-08-07 03:54:10,446 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:54:10,462 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:54:10,462 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.130
2025-08-07 03:54:10,462 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:54:10,485 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:54:10,485 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.249
2025-08-07 03:54:10,485 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:54:10,502 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:54:10,502 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 is found in opserver
2025-08-07 03:54:10,517 - DEBUG - VRF ids for VN ctest-vn1-76278277: {'10.0.0.61': '2'}
2025-08-07 03:54:10,517 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:54:10,525 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:54:10,540 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:54:10,644 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:10,659 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:10,679 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:54:10,691 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:54:10,703 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/5576ea6c-9c3a-49fa-82a7-e16d5b7dd38b
2025-08-07 03:54:10,712 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:54:10,712 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:10,728 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:54:10,752 - INFO - Verified VN network id 13 for VN 162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:10,752 - INFO - Verifications in API Server for VN ctest-vn2-75786057 passed
2025-08-07 03:54:10,753 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:10,768 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:54:10,781 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:54:10,796 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/5576ea6c-9c3a-49fa-82a7-e16d5b7dd38b
2025-08-07 03:54:10,818 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.260483'}
2025-08-07 03:54:10,829 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:54:10,837 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.282909'}
2025-08-07 03:54:10,847 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:54:10,856 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:54:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.307942'}
2025-08-07 03:54:10,866 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:54:10,866 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-75786057 passed
2025-08-07 03:54:10,867 - DEBUG - ====Verifying policy data for ctest-vn2-75786057 in API_Server ======
2025-08-07 03:54:10,867 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:54:10,875 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:54:10,892 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:54:10,999 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:54:11,021 - DEBUG - ==>Verifying data for policy with id: 849b108b-411e-4ad9-8ac0-e71a8a3af6a1, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']
2025-08-07 03:54:11,021 - INFO - VN ctest-vn2-75786057 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-07 03:54:11,021 - DEBUG - Verifying the vn in opserver
2025-08-07 03:54:11,021 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.56
2025-08-07 03:54:11,021 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:54:11,040 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:54:11,040 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.130
2025-08-07 03:54:11,040 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:54:11,058 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:54:11,058 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.249
2025-08-07 03:54:11,058 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:54:11,075 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:54:11,075 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 is found in opserver
2025-08-07 03:54:11,090 - DEBUG - VRF ids for VN ctest-vn2-75786057: {'10.0.0.41': '2', '10.0.0.61': '3'}
2025-08-07 03:54:11,090 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:54:11,099 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:54:11,114 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:54:11,232 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:54:11,249 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:54:11,262 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a103d4df-1e11-4145-920a-baa03016b822
2025-08-07 03:54:11,277 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a103d4df-1e11-4145-920a-baa03016b822
2025-08-07 03:54:11,291 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/47dce227-58af-481e-9897-d2c61de06498
2025-08-07 03:54:11,301 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-07 03:54:11,301 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:54:11,314 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a103d4df-1e11-4145-920a-baa03016b822
2025-08-07 03:54:11,338 - INFO - Verified VN network id 14 for VN 2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:54:11,338 - INFO - Verifications in API Server for VN ctest-fip_vn-23932101 passed
2025-08-07 03:54:11,338 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:54:11,351 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a103d4df-1e11-4145-920a-baa03016b822
2025-08-07 03:54:11,362 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a103d4df-1e11-4145-920a-baa03016b822
2025-08-07 03:54:11,373 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/47dce227-58af-481e-9897-d2c61de06498
2025-08-07 03:54:11,391 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3339169748737674010', 'uuid-lslong': '10328774971949465628'}, 'enable': 'true', 'created': '2025-08-07T03:52:24', 'last-modified': '2025-08-07T03:52:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:46.888011'}
2025-08-07 03:54:11,400 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-07 03:54:11,409 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3339169748737674010', 'uuid-lslong': '10328774971949465628'}, 'enable': 'true', 'created': '2025-08-07T03:52:24', 'last-modified': '2025-08-07T03:52:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:46.906420'}
2025-08-07 03:54:11,420 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-07 03:54:11,429 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3339169748737674010', 'uuid-lslong': '10328774971949465628'}, 'enable': 'true', 'created': '2025-08-07T03:52:24', 'last-modified': '2025-08-07T03:52:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:46.931358'}
2025-08-07 03:54:11,439 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-07 03:54:11,439 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-23932101 passed
2025-08-07 03:54:11,439 - DEBUG - ====Verifying policy data for ctest-fip_vn-23932101 in API_Server ======
2025-08-07 03:54:11,439 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:54:11,448 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:54:11,464 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:54:11,576 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:54:11,589 - DEBUG - =>VN ctest-fip_vn-23932101 has no policy to be verified
2025-08-07 03:54:11,590 - DEBUG - Verifying the vn in opserver
2025-08-07 03:54:11,590 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101 virtual network link through opserver 10.0.0.56
2025-08-07 03:54:11,590 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:54:11,607 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101?flat'}
2025-08-07 03:54:11,607 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101 virtual network link through opserver 10.0.0.130
2025-08-07 03:54:11,607 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:54:11,626 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101?flat'}
2025-08-07 03:54:11,626 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101 virtual network link through opserver 10.0.0.249
2025-08-07 03:54:11,626 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:54:11,642 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101?flat'}
2025-08-07 03:54:11,642 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101 is found in opserver
2025-08-07 03:54:11,659 - DEBUG - VRF ids for VN ctest-fip_vn-23932101: {'10.0.0.41': '3'}
2025-08-07 03:54:11,659 - INFO - start time= 1754538851659256
2025-08-07 03:54:11,659 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 3.231.40.67, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.61, gateway password: c0ntrail123
2025-08-07 03:54:11,659 - DEBUG - ping -s 56 -c 3 -W 1 3.231.40.67
2025-08-07 03:54:13,934 - DEBUG - PING 3.231.40.67 (3.231.40.67): 56 data bytes
64 bytes from 3.231.40.67: seq=0 ttl=63 time=6.029 ms
64 bytes from 3.231.40.67: seq=1 ttl=63 time=1.666 ms
64 bytes from 3.231.40.67: seq=2 ttl=63 time=1.514 ms
--- 3.231.40.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.514/3.069/6.029 ms
2025-08-07 03:54:13,934 - INFO - Ping to IP 3.231.40.67 from VM ctest-vn1_vm1-14989368 passed
2025-08-07 03:54:23,935 - INFO - Verify session samples and teardown pkts
2025-08-07 03:54:23,935 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.56
2025-08-07 03:54:23,940 - DEBUG - Posting: http://10.0.0.56:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754538851659256, 'end_time': 1754538863940591, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-08-07 03:54:24,970 - DEBUG - [{'T': 1754538852091349}, {'T': 1754538853091416}, {'T': 1754538854091496}]
2025-08-07 03:54:24,970 - DEBUG - Posting: http://10.0.0.56:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754538851659256, 'end_time': 1754538864970482, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'}
2025-08-07 03:54:25,998 - DEBUG - [{'T': 1754538852645326}, {'T': 1754538853645469}, {'T': 1754538854645549}]
2025-08-07 03:54:25,998 - DEBUG - Posting: http://10.0.0.56:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754538851659256, 'end_time': 1754538865998212, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-08-07 03:54:27,024 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'sample_count': 3}]
2025-08-07 03:54:27,024 - INFO - wait for the flows to get expire
2025-08-07 03:57:47,025 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3767-2:Compute:contrail-vrouter-agent:0?flat
2025-08-07 03:57:47,131 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3767-2?flat
2025-08-07 03:57:47,226 - DEBUG - Posting: http://10.0.0.56:8081/analytics/query, payload {'table': 'SessionRecordTable', 'start_time': 1754538851659256, 'end_time': 1754539067226691, 'select_fields': ['vn', 'remote_vn', 'forward_teardown_pkts', 'reverse_teardown_pkts'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-08-07 03:57:48,306 - DEBUG - [{'forward_flow_uuid': '3305216b-a1a1-4204-9d82-eef454e711d6', 'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'reverse_flow_uuid': 'd8b97c09-61bd-4ae8-8108-2548b3643cb6', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'forward_teardown_pkts': 3, 'reverse_teardown_pkts': 3}]
2025-08-07 03:57:48,306 - DEBUG - Posting: http://10.0.0.56:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754538851659256, 'end_time': 1754539068306424, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-08-07 03:57:49,392 - DEBUG - Posting: http://10.0.0.56:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754538851659256, 'end_time': 1754539069392763, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'}
2025-08-07 03:57:50,418 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'sample_count': 4}]
2025-08-07 03:57:51,037 - INFO - Deleted policy policy1
2025-08-07 03:57:51,214 - INFO - Setting flow export rate: None
2025-08-07 03:57:52,521 - DEBUG - Skipping xmpp flap check
2025-08-07 03:57:52,522 - INFO - END TEST : test_verify_session_sampling_teardown : PASSED[0:03:46]
2025-08-07 03:57:52,522 - INFO - --------------------------------------------------------------------------------
2025-08-07 03:57:52,525 - INFO - ================================================================================
2025-08-07 03:57:52,526 - INFO - STARTING TEST : test_verify_session_series_table_inter_vn
2025-08-07 03:57:52,526 - INFO - TEST DESCRIPTION : Verify session series table ,generated stats between different vns
1.query client session samples
2.query for server ports
3.sort results by server_port column
4.verify granularity with T=10
5.verify sampled bytes
6.verify logged bytes
7.query and verify filter by action
2025-08-07 03:57:53,814 - DEBUG - Skipping xmpp flap check
2025-08-07 03:57:53,814 - INFO - Initial checks done. Running the testcase now
2025-08-07 03:57:53,814 - INFO -
2025-08-07 03:57:54,034 - INFO - Setting flow export rate: 100
2025-08-07 03:57:54,082 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2025-08-07 03:57:54,499 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '86dfcaa9-5861-472a-be9d-3232f6e3d340', 'name': 'ctest-vn1-76278277', 'tenant_id': 'e750dce56593495fa4987395bff3b2dd', 'project_id': 'e750dce56593495fa4987395bff3b2dd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['eaf77d94-f3e1-4e0c-bac8-101ee189b394'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'ctest-vn1-76278277'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '5.15.152.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-08-07 03:57:54,748 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '162e47c8-8920-4611-b29b-be9a65dd870c', 'name': 'ctest-vn2-75786057', 'tenant_id': 'e750dce56593495fa4987395bff3b2dd', 'project_id': 'e750dce56593495fa4987395bff3b2dd', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['495c77ec-a577-446f-866c-99fd951841eb'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'ctest-vn2-75786057'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '3.231.40.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-08-07 03:57:54,913 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:57:54,957 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:57:55,036 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:57:55,162 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:55,196 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:55,225 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:57:55,243 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:57:55,267 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8810dbb5-1519-48dd-8bad-fa535a465593
2025-08-07 03:57:55,288 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:57:55,288 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:55,304 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:57:55,335 - INFO - Verified VN network id 12 for VN 86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:55,336 - INFO - Verifications in API Server for VN ctest-vn1-76278277 passed
2025-08-07 03:57:55,336 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:55,352 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:57:55,364 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:57:55,381 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8810dbb5-1519-48dd-8bad-fa535a465593
2025-08-07 03:57:55,407 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.959420'}
2025-08-07 03:57:55,416 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:57:55,423 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.981253'}
2025-08-07 03:57:55,432 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:57:55,440 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.998847'}
2025-08-07 03:57:55,449 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:57:55,449 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-76278277 passed
2025-08-07 03:57:55,450 - DEBUG - ====Verifying policy data for ctest-vn1-76278277 in API_Server ======
2025-08-07 03:57:55,450 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:57:55,457 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:57:55,474 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:57:55,593 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:55,608 - DEBUG - ==>Verifying data for policy with id: 6544adc3-0f57-469c-89db-fefcc4c59643, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']
2025-08-07 03:57:55,608 - INFO - VN ctest-vn1-76278277 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-07 03:57:55,608 - DEBUG - Verifying the vn in opserver
2025-08-07 03:57:55,608 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.56
2025-08-07 03:57:55,608 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:57:55,625 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:57:55,625 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.130
2025-08-07 03:57:55,625 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:57:55,695 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:57:55,695 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.249
2025-08-07 03:57:55,695 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:57:55,764 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:57:55,764 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 is found in opserver
2025-08-07 03:57:55,779 - DEBUG - VRF ids for VN ctest-vn1-76278277: {'10.0.0.61': '2'}
2025-08-07 03:57:55,779 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:57:55,787 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:57:55,803 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:57:55,911 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:55,933 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:55,949 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:57:55,961 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:57:55,973 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/5576ea6c-9c3a-49fa-82a7-e16d5b7dd38b
2025-08-07 03:57:55,985 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:57:55,985 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:56,007 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:57:56,031 - INFO - Verified VN network id 13 for VN 162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:56,031 - INFO - Verifications in API Server for VN ctest-vn2-75786057 passed
2025-08-07 03:57:56,031 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:56,051 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:57:56,070 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:57:56,080 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/5576ea6c-9c3a-49fa-82a7-e16d5b7dd38b
2025-08-07 03:57:56,098 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.387551'}
2025-08-07 03:57:56,107 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:57:56,114 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.407623'}
2025-08-07 03:57:56,126 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:57:56,132 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.430098'}
2025-08-07 03:57:56,141 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:57:56,141 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-75786057 passed
2025-08-07 03:57:56,141 - DEBUG - ====Verifying policy data for ctest-vn2-75786057 in API_Server ======
2025-08-07 03:57:56,141 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:57:56,149 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:57:56,163 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:57:56,282 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:56,295 - DEBUG - ==>Verifying data for policy with id: 6544adc3-0f57-469c-89db-fefcc4c59643, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']
2025-08-07 03:57:56,295 - INFO - VN ctest-vn2-75786057 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-07 03:57:56,296 - DEBUG - Verifying the vn in opserver
2025-08-07 03:57:56,296 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.56
2025-08-07 03:57:56,296 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:57:56,312 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:57:56,312 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.130
2025-08-07 03:57:56,312 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:57:56,378 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:57:56,378 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.249
2025-08-07 03:57:56,378 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:57:56,441 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:57:56,441 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 is found in opserver
2025-08-07 03:57:56,456 - DEBUG - VRF ids for VN ctest-vn2-75786057: {'10.0.0.41': '2', '10.0.0.61': '3'}
2025-08-07 03:57:56,456 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:57:56,463 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:57:56,478 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:57:56,589 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:56,609 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:56,629 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:57:56,641 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:57:56,651 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8810dbb5-1519-48dd-8bad-fa535a465593
2025-08-07 03:57:56,660 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:57:56,660 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:56,674 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:57:56,696 - INFO - Verified VN network id 12 for VN 86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:56,696 - INFO - Verifications in API Server for VN ctest-vn1-76278277 passed
2025-08-07 03:57:56,697 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:56,712 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:57:56,725 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:57:56,737 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8810dbb5-1519-48dd-8bad-fa535a465593
2025-08-07 03:57:56,758 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.318351'}
2025-08-07 03:57:56,773 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:57:56,782 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.338458'}
2025-08-07 03:57:56,790 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:57:56,798 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9718709349569873706', 'uuid-lslong': '13735189633021760320'}, 'enable': 'true', 'created': '2025-08-07T03:51:46', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.356705'}
2025-08-07 03:57:56,806 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-07 03:57:56,806 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-76278277 passed
2025-08-07 03:57:56,806 - DEBUG - ====Verifying policy data for ctest-vn1-76278277 in API_Server ======
2025-08-07 03:57:56,807 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:57:56,814 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:57:56,831 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:57:56,947 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/86dfcaa9-5861-472a-be9d-3232f6e3d340
2025-08-07 03:57:56,964 - DEBUG - ==>Verifying data for policy with id: 6544adc3-0f57-469c-89db-fefcc4c59643, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']
2025-08-07 03:57:56,964 - INFO - VN ctest-vn1-76278277 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-07 03:57:56,965 - DEBUG - Verifying the vn in opserver
2025-08-07 03:57:56,965 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.56
2025-08-07 03:57:56,965 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:57:56,984 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:57:56,984 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.130
2025-08-07 03:57:56,984 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:57:57,005 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:57:57,005 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 virtual network link through opserver 10.0.0.249
2025-08-07 03:57:57,005 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:57:57,071 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277?flat'}
2025-08-07 03:57:57,071 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277 is found in opserver
2025-08-07 03:57:57,086 - DEBUG - VRF ids for VN ctest-vn1-76278277: {'10.0.0.61': '2'}
2025-08-07 03:57:57,086 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:57:57,095 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:57:57,111 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:57:57,213 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:57,235 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:57,250 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:57:57,262 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:57:57,279 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/5576ea6c-9c3a-49fa-82a7-e16d5b7dd38b
2025-08-07 03:57:57,291 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:57:57,291 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:57,308 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:57:57,334 - INFO - Verified VN network id 13 for VN 162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:57,334 - INFO - Verifications in API Server for VN ctest-vn2-75786057 passed
2025-08-07 03:57:57,335 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:57,350 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:57:57,361 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:57:57,373 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/5576ea6c-9c3a-49fa-82a7-e16d5b7dd38b
2025-08-07 03:57:57,394 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.680873'}
2025-08-07 03:57:57,404 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:57:57,412 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.706072'}
2025-08-07 03:57:57,422 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:57:57,431 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1598293844382729745', 'uuid-lslong': '12870089930484582156'}, 'enable': 'true', 'created': '2025-08-07T03:52:23', 'last-modified': '2025-08-07T03:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.727682'}
2025-08-07 03:57:57,441 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-07 03:57:57,441 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-75786057 passed
2025-08-07 03:57:57,441 - DEBUG - ====Verifying policy data for ctest-vn2-75786057 in API_Server ======
2025-08-07 03:57:57,441 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:57:57,450 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:57:57,470 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:57:57,580 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/162e47c8-8920-4611-b29b-be9a65dd870c
2025-08-07 03:57:57,602 - DEBUG - ==>Verifying data for policy with id: 6544adc3-0f57-469c-89db-fefcc4c59643, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-52543708', 'policy1']
2025-08-07 03:57:57,602 - INFO - VN ctest-vn2-75786057 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-07 03:57:57,602 - DEBUG - Verifying the vn in opserver
2025-08-07 03:57:57,602 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.56
2025-08-07 03:57:57,602 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:57:57,619 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:57:57,619 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.130
2025-08-07 03:57:57,619 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:57:57,639 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:57:57,639 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 virtual network link through opserver 10.0.0.249
2025-08-07 03:57:57,639 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:57:57,657 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057?flat'}
2025-08-07 03:57:57,657 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057 is found in opserver
2025-08-07 03:57:57,671 - DEBUG - VRF ids for VN ctest-vn2-75786057: {'10.0.0.41': '2', '10.0.0.61': '3'}
2025-08-07 03:57:57,671 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:57:57,679 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:57:57,695 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:57:57,824 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:57:57,840 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:57:57,856 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a103d4df-1e11-4145-920a-baa03016b822
2025-08-07 03:57:57,882 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a103d4df-1e11-4145-920a-baa03016b822
2025-08-07 03:57:57,893 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/47dce227-58af-481e-9897-d2c61de06498
2025-08-07 03:57:57,906 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-07 03:57:57,906 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:57:57,922 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a103d4df-1e11-4145-920a-baa03016b822
2025-08-07 03:57:57,946 - INFO - Verified VN network id 14 for VN 2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:57:57,947 - INFO - Verifications in API Server for VN ctest-fip_vn-23932101 passed
2025-08-07 03:57:57,947 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:57:57,963 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a103d4df-1e11-4145-920a-baa03016b822
2025-08-07 03:57:57,979 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a103d4df-1e11-4145-920a-baa03016b822
2025-08-07 03:57:57,992 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/47dce227-58af-481e-9897-d2c61de06498
2025-08-07 03:57:58,011 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3339169748737674010', 'uuid-lslong': '10328774971949465628'}, 'enable': 'true', 'created': '2025-08-07T03:52:24', 'last-modified': '2025-08-07T03:52:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:05:33.508200'}
2025-08-07 03:57:58,021 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-07 03:57:58,029 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3339169748737674010', 'uuid-lslong': '10328774971949465628'}, 'enable': 'true', 'created': '2025-08-07T03:52:24', 'last-modified': '2025-08-07T03:52:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:05:33.525931'}
2025-08-07 03:57:58,039 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-07 03:57:58,047 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-52543708', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3339169748737674010', 'uuid-lslong': '10328774971949465628'}, 'enable': 'true', 'created': '2025-08-07T03:52:24', 'last-modified': '2025-08-07T03:52:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:05:33.549407'}
2025-08-07 03:57:58,056 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-07 03:57:58,056 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-23932101 passed
2025-08-07 03:57:58,056 - DEBUG - ====Verifying policy data for ctest-fip_vn-23932101 in API_Server ======
2025-08-07 03:57:58,056 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:57:58,065 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:57:58,081 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:57:58,195 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2e571d31-de3d-4b1a-8f57-2e1cdffe401c
2025-08-07 03:57:58,210 - DEBUG - =>VN ctest-fip_vn-23932101 has no policy to be verified
2025-08-07 03:57:58,210 - DEBUG - Verifying the vn in opserver
2025-08-07 03:57:58,210 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101 virtual network link through opserver 10.0.0.56
2025-08-07 03:57:58,210 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks
2025-08-07 03:57:58,227 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101?flat'}
2025-08-07 03:57:58,227 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101 virtual network link through opserver 10.0.0.130
2025-08-07 03:57:58,227 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks
2025-08-07 03:57:58,244 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101?flat'}
2025-08-07 03:57:58,244 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101 virtual network link through opserver 10.0.0.249
2025-08-07 03:57:58,244 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-08-07 03:57:58,260 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101?flat'}
2025-08-07 03:57:58,260 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101 is found in opserver
2025-08-07 03:57:58,277 - DEBUG - VRF ids for VN ctest-fip_vn-23932101: {'10.0.0.41': '3'}
2025-08-07 03:57:58,277 - INFO - start time= 1754539078277677
2025-08-07 03:57:58,277 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 03:57:58,278 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 03:57:58,278 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoserver.py already copied to 3.231.40.67
2025-08-07 03:57:58,278 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoserver.py --start_port 9000 --end_port 9000 --pid_file /tmp/server-ctest-random-36848789.pid --stats_file /tmp/server-ctest-random-36848789.stats 0<&- &> /tmp/server-ctest-random-36848789.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-07 03:57:58,278 - DEBUG - nohup python /tmp/udpechoserver.py --start_port 9000 --end_port 9000 --pid_file /tmp/server-ctest-random-36848789.pid --stats_file /tmp/server-ctest-random-36848789.stats 0<&- &> /tmp/server-ctest-random-36848789.log &
2025-08-07 03:57:58,521 - DEBUG - None
2025-08-07 03:57:58,521 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 03:57:58,521 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoclient.py already copied to 5.15.152.195
2025-08-07 03:57:58,521 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoclient.py --servers 3.231.40.67 --sport 8000 --dports 9000 --retry --count 100 --pid_file /tmp/client-ctest-random-36848789.pid --stats_file /tmp/client-ctest-random-36848789.stats 0<&- &> /tmp/client-ctest-random-36848789.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.61, gateway password: c0ntrail123
2025-08-07 03:57:58,521 - DEBUG - nohup python /tmp/udpechoclient.py --servers 3.231.40.67 --sport 8000 --dports 9000 --retry --count 100 --pid_file /tmp/client-ctest-random-36848789.pid --stats_file /tmp/client-ctest-random-36848789.stats 0<&- &> /tmp/client-ctest-random-36848789.log &
2025-08-07 03:57:58,752 - DEBUG - None
2025-08-07 03:57:58,752 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 03:57:58,752 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 03:57:58,752 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoserver.py already copied to 3.231.40.67
2025-08-07 03:57:58,753 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoserver.py --start_port 9001 --end_port 9001 --pid_file /tmp/server-ctest-random-07768473.pid --stats_file /tmp/server-ctest-random-07768473.stats 0<&- &> /tmp/server-ctest-random-07768473.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-07 03:57:58,753 - DEBUG - nohup python /tmp/udpechoserver.py --start_port 9001 --end_port 9001 --pid_file /tmp/server-ctest-random-07768473.pid --stats_file /tmp/server-ctest-random-07768473.stats 0<&- &> /tmp/server-ctest-random-07768473.log &
2025-08-07 03:57:58,992 - DEBUG - None
2025-08-07 03:57:58,992 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 03:57:58,993 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoclient.py already copied to 5.15.152.195
2025-08-07 03:57:58,993 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoclient.py --servers 3.231.40.67 --sport 8000 --dports 9001 --retry --count 100 --pid_file /tmp/client-ctest-random-07768473.pid --stats_file /tmp/client-ctest-random-07768473.stats 0<&- &> /tmp/client-ctest-random-07768473.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.61, gateway password: c0ntrail123
2025-08-07 03:57:58,993 - DEBUG - nohup python /tmp/udpechoclient.py --servers 3.231.40.67 --sport 8000 --dports 9001 --retry --count 100 --pid_file /tmp/client-ctest-random-07768473.pid --stats_file /tmp/client-ctest-random-07768473.stats 0<&- &> /tmp/client-ctest-random-07768473.log &
2025-08-07 03:57:59,219 - DEBUG - None
2025-08-07 03:57:59,219 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 03:57:59,219 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 03:57:59,219 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoserver.py already copied to 3.231.40.67
2025-08-07 03:57:59,219 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoserver.py --start_port 9003 --end_port 9003 --pid_file /tmp/server-ctest-random-80148230.pid --stats_file /tmp/server-ctest-random-80148230.stats 0<&- &> /tmp/server-ctest-random-80148230.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-07 03:57:59,219 - DEBUG - nohup python /tmp/udpechoserver.py --start_port 9003 --end_port 9003 --pid_file /tmp/server-ctest-random-80148230.pid --stats_file /tmp/server-ctest-random-80148230.stats 0<&- &> /tmp/server-ctest-random-80148230.log &
2025-08-07 03:57:59,483 - DEBUG - None
2025-08-07 03:57:59,483 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-07 03:57:59,483 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoclient.py already copied to 5.15.152.195
2025-08-07 03:57:59,483 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoclient.py --servers 3.231.40.67 --sport 8000 --dports 9003 --retry --count 100 --pid_file /tmp/client-ctest-random-80148230.pid --stats_file /tmp/client-ctest-random-80148230.stats 0<&- &> /tmp/client-ctest-random-80148230.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.61, gateway password: c0ntrail123
2025-08-07 03:57:59,483 - DEBUG - nohup python /tmp/udpechoclient.py --servers 3.231.40.67 --sport 8000 --dports 9003 --retry --count 100 --pid_file /tmp/client-ctest-random-80148230.pid --stats_file /tmp/client-ctest-random-80148230.stats 0<&- &> /tmp/client-ctest-random-80148230.log &
2025-08-07 03:57:59,715 - DEBUG - None
2025-08-07 03:58:09,715 - DEBUG - Running remote_cmd, Cmd : kill $(cat /tmp/client-ctest-random-36848789.pid); sync; cat /tmp/client-ctest-random-36848789.stats, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.61, gateway password: c0ntrail123
2025-08-07 03:58:09,715 - DEBUG - kill $(cat /tmp/client-ctest-random-36848789.pid); sync; cat /tmp/client-ctest-random-36848789.stats
2025-08-07 03:58:10,031 - DEBUG - cat: can't open '/tmp/client-ctest-random-36848789.pid': No such file or directory
sh: you need to specify whom to kill
cat: can't open '/tmp/client-ctest-random-36848789.stats': No such file or directory
2025-08-07 03:58:10,031 - DEBUG - Running remote_cmd, Cmd : kill $(cat /tmp/server-ctest-random-36848789.pid); sync; cat /tmp/server-ctest-random-36848789.stats, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-07 03:58:10,031 - DEBUG - kill $(cat /tmp/server-ctest-random-36848789.pid); sync; cat /tmp/server-ctest-random-36848789.stats
2025-08-07 03:58:10,376 - DEBUG - cat: can't open '/tmp/server-ctest-random-36848789.pid': No such file or directory
sh: you need to specify whom to kill
cat: can't open '/tmp/server-ctest-random-36848789.stats': No such file or directory
2025-08-07 03:58:10,376 - INFO - Client - Sent: 0, Received: 0
2025-08-07 03:58:10,376 - INFO - Server - Sent: 0, Received: 0
2025-08-07 03:58:10,928 - INFO - Deleted policy policy1
2025-08-07 03:58:11,114 - INFO - Setting flow export rate: None
2025-08-07 03:58:12,377 - ERROR - AssertionError
Python 3.6.8: /usr/bin/python3
Thu Aug 7 03:58:10 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_series_table_inter_vn(self=)
1336 start_time = self.analytics_obj.getstarttime(vm_node_ip)
1337 self.logger.info("start time= %s" % (start_time))
1338 self.setup_and_create_streams(self.res.vn1_vm1_fixture, self.res.vn2_vm2_fixture)
1339 src_vn = self.res.vn1_fixture.vn_fq_name
1340 dst_vn = self.res.vn2_fixture.vn_fq_name
self =
self.setup_and_create_streams = >
self.res =
self.res.vn1_vm1_fixture =
self.res.vn2_vm2_fixture =
/contrail-test/serial_scripts/analytics/base.py in setup_and_create_streams(self=, src_vm=, dst_vm=, sport=8000, dport=9003, count=100)
168 time.sleep(10)
169 for traffic_obj in traffic_objs:
170 self.stop_traffic(traffic_obj)
171
172 #end setup_create_streams
self =
self.stop_traffic = >
traffic_obj =
/contrail-test/common/base.py in stop_traffic(self=, traffic_obj=, expectation=True, unidirection=False, partial=False)
796 assert False, "No drops observed in packets %s"%msg
797 elif expectation:
798 assert sent and recv, "Packets not %s"%msg
799 if recv*100/float(sent) < 90:
800 assert False, "Packets not %s"%msg
sent = 0
recv = 0
msg = 'transferred between 5.15.152.195 and 3.231.40.67, proto udp sport 8000 and dport 9000'
AssertionError: Packets not transferred between 5.15.152.195 and 3.231.40.67, proto udp sport 8000 and dport 9000
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ('Packets not transferred between 5.15.152.195 and 3.231.40.67, proto udp sport 8000 and dport 9000',)
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1338, in test_verify_session_series_table_inter_vn
self.setup_and_create_streams(self.res.vn1_vm1_fixture, self.res.vn2_vm2_fixture)
File "/contrail-test/serial_scripts/analytics/base.py", line 170, in setup_and_create_streams
self.stop_traffic(traffic_obj)
File "/contrail-test/common/base.py", line 798, in stop_traffic
assert sent and recv, "Packets not %s"%msg
AssertionError: Packets not transferred between 5.15.152.195 and 3.231.40.67, proto udp sport 8000 and dport 9000
2025-08-07 03:58:12,377 - DEBUG - Skipping xmpp flap check
2025-08-07 03:58:12,377 - INFO -
2025-08-07 03:58:12,378 - INFO - END TEST : test_verify_session_series_table_inter_vn : FAILED[0:00:20]
2025-08-07 03:58:12,378 - INFO - --------------------------------------------------------------------------------
2025-08-07 03:58:12,381 - INFO - Deleting VM mltf_vm
2025-08-07 03:58:12,471 - INFO - Deleting VM ctest-fvn_vm1-00268763
2025-08-07 03:58:12,557 - INFO - Deleting VM ctest-vn2_vm2-53196154
2025-08-07 03:58:12,632 - INFO - Deleting VN ctest-fip_vn-23932101
2025-08-07 03:58:12,694 - DEBUG - VN 2e571d31-de3d-4b1a-8f57-2e1cdffe401c still in use: Unable to complete operation on network 2e571d31-de3d-4b1a-8f57-2e1cdffe401c. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d26c10f2-df1f-4c7c-a470-da49c6c20ea8']
2025-08-07 03:58:12,694 - WARNING - Deleting VN ctest-fip_vn-23932101 failed..Will retry
2025-08-07 03:58:14,886 - DEBUG - Response for deleting network ()
2025-08-07 03:58:14,886 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a103d4df-1e11-4145-920a-baa03016b822
2025-08-07 03:58:14,893 - DEBUG - Response Code: 404
2025-08-07 03:58:14,893 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:58:14,910 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:58:14,928 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:58:15,044 - INFO - Validated that VN ctest-fip_vn-23932101 is not found in API Server
2025-08-07 03:58:15,057 - DEBUG - VN ctest-fip_vn-23932101 is not present in Agent 10.0.0.41
2025-08-07 03:58:15,074 - DEBUG - VN ctest-fip_vn-23932101 is not present in Agent 10.0.0.61
2025-08-07 03:58:15,074 - INFO - Validated that VN ctest-fip_vn-23932101 is not in any agent
2025-08-07 03:58:15,082 - DEBUG - VRF 3 is not seen in agent 10.0.0.41
2025-08-07 03:58:15,090 - DEBUG - Vrouter 10.0.0.41 does not have vrf 3 for VN ctest-fip_vn-23932101
2025-08-07 03:58:15,090 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-fip_vn-23932101
2025-08-07 03:58:15,117 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-23932101 info
2025-08-07 03:58:15,117 - INFO - Deleting VN ctest-vn2-75786057
2025-08-07 03:58:15,302 - DEBUG - Response for deleting network ()
2025-08-07 03:58:15,302 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6d42434f-997b-4f8a-b65d-895b112183df
2025-08-07 03:58:15,319 - DEBUG - Response Code: 404
2025-08-07 03:58:15,320 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:58:15,327 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:58:15,344 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:58:15,447 - INFO - Validated that VN ctest-vn2-75786057 is not found in API Server
2025-08-07 03:58:15,460 - DEBUG - VN ctest-vn2-75786057 is not present in Agent 10.0.0.41
2025-08-07 03:58:15,474 - DEBUG - VN ctest-vn2-75786057 is not present in Agent 10.0.0.61
2025-08-07 03:58:15,474 - INFO - Validated that VN ctest-vn2-75786057 is not in any agent
2025-08-07 03:58:15,481 - DEBUG - VRF 2 is not seen in agent 10.0.0.41
2025-08-07 03:58:15,487 - DEBUG - Vrouter 10.0.0.41 does not have vrf 2 for VN ctest-vn2-75786057
2025-08-07 03:58:15,494 - DEBUG - VRF 3 is not seen in agent 10.0.0.61
2025-08-07 03:58:15,501 - DEBUG - Vrouter 10.0.0.61 does not have vrf 3 for VN ctest-vn2-75786057
2025-08-07 03:58:15,501 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn2-75786057
2025-08-07 03:58:15,529 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-75786057 info
2025-08-07 03:58:15,529 - INFO - Deleting VM ctest-vn1_vm2-91156958
2025-08-07 03:58:15,630 - INFO - Deleting VM ctest-vn1_vm1-14989368
2025-08-07 03:58:15,708 - INFO - Deleting VN ctest-vn1-76278277
2025-08-07 03:58:15,764 - DEBUG - VN 86dfcaa9-5861-472a-be9d-3232f6e3d340 still in use: Unable to complete operation on network 86dfcaa9-5861-472a-be9d-3232f6e3d340. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-4ae0090c-93be-438b-b30c-1da792ec6abd']
2025-08-07 03:58:15,765 - WARNING - Deleting VN ctest-vn1-76278277 failed..Will retry
2025-08-07 03:58:18,001 - DEBUG - Response for deleting network ()
2025-08-07 03:58:18,002 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/e70612e3-8778-48cd-badf-80905eabdc5c
2025-08-07 03:58:18,008 - DEBUG - Response Code: 404
2025-08-07 03:58:18,008 - DEBUG - Requesting: http://10.0.0.56:8082/domains
2025-08-07 03:58:18,028 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569
2025-08-07 03:58:18,048 - DEBUG - Requesting: http://10.0.0.56:8082/project/e750dce5-6593-495f-a498-7395bff3b2dd
2025-08-07 03:58:18,155 - INFO - Validated that VN ctest-vn1-76278277 is not found in API Server
2025-08-07 03:58:18,175 - DEBUG - VN ctest-vn1-76278277 is not present in Agent 10.0.0.41
2025-08-07 03:58:18,190 - DEBUG - VN ctest-vn1-76278277 is not present in Agent 10.0.0.61
2025-08-07 03:58:18,190 - INFO - Validated that VN ctest-vn1-76278277 is not in any agent
2025-08-07 03:58:18,197 - DEBUG - VRF 2 is not seen in agent 10.0.0.61
2025-08-07 03:58:18,203 - DEBUG - Vrouter 10.0.0.61 does not have vrf 2 for VN ctest-vn1-76278277
2025-08-07 03:58:18,203 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-52543708:ctest-vn1-76278277
2025-08-07 03:58:18,230 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-76278277 info
2025-08-07 03:58:19,384 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-52543708, ID : e750dce5-6593-495f-a498-7395bff3b2dd