2025-09-11 02:52:34,521 - INFO - Domain Default found not creating 2025-09-11 02:52:34,670 - INFO - Project ctest-TestSvcHC-47130880 not found, creating it 2025-09-11 02:52:35,185 - INFO - Created Project:ctest-TestSvcHC-47130880, ID : 5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:36,765 - INFO - ================================================================================ 2025-09-11 02:52:36,765 - INFO - STARTING TEST : test_svc_hc_basic 2025-09-11 02:52:38,040 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.19': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-09-11 02:52:38,040 - INFO - Initial checks done. Running the testcase now 2025-09-11 02:52:38,040 - INFO - 2025-09-11 02:52:38,703 - DEBUG - Response for create_network : {'network': {'id': 'ec118268-f64b-4b5e-ab2b-1dee9c15e309', 'name': 'ctest-mgmt_vn-26489143', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'project_id': '5b94f8aba75844d2abe86fa881a38844', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47130880', 'ctest-mgmt_vn-26489143'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:38,984 - DEBUG - Response for create_subnet : {'subnet': {'id': '8ad8faf0-101c-4bf5-b4f1-077c9698d99e', 'name': '', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'network_id': 'ec118268-f64b-4b5e-ab2b-1dee9c15e309', 'ip_version': 4, 'cidr': '5.33.0.192/26', 'allocation_pools': [{'start': '5.33.0.194', 'end': '5.33.0.254'}], 'gateway_ip': '5.33.0.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '5.33.0.194', 'tags': [], 'project_id': '5b94f8aba75844d2abe86fa881a38844'}} 2025-09-11 02:52:39,009 - INFO - Created VN ctest-mgmt_vn-26489143 2025-09-11 02:52:39,024 - DEBUG - VN ctest-mgmt_vn-26489143 UUID is ec118268-f64b-4b5e-ab2b-1dee9c15e309 2025-09-11 02:52:39,093 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:39,386 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:39,414 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:39,428 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:39,527 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ec118268-f64b-4b5e-ab2b-1dee9c15e309 2025-09-11 02:52:39,537 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ec118268-f64b-4b5e-ab2b-1dee9c15e309 2025-09-11 02:52:39,547 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9ef8e91f-bd49-43e1-ac12-3f113430d855 2025-09-11 02:52:39,555 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9ef8e91f-bd49-43e1-ac12-3f113430d855 2025-09-11 02:52:39,563 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/67290c29-37c0-4d11-9a69-ede2c20d5285 2025-09-11 02:52:39,571 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:39,572 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ec118268-f64b-4b5e-ab2b-1dee9c15e309 2025-09-11 02:52:39,580 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9ef8e91f-bd49-43e1-ac12-3f113430d855 2025-09-11 02:52:39,595 - INFO - Verified VN network id 14 for VN ec118268-f64b-4b5e-ab2b-1dee9c15e309 2025-09-11 02:52:39,595 - INFO - Verifications in API Server for VN ctest-mgmt_vn-26489143 passed 2025-09-11 02:52:39,595 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ec118268-f64b-4b5e-ab2b-1dee9c15e309 2025-09-11 02:52:39,604 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9ef8e91f-bd49-43e1-ac12-3f113430d855 2025-09-11 02:52:39,610 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9ef8e91f-bd49-43e1-ac12-3f113430d855 2025-09-11 02:52:39,616 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/67290c29-37c0-4d11-9a69-ede2c20d5285 2025-09-11 02:52:39,627 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17010520654875413342', 'uuid-lslong': '12333984915142337289'}, 'enable': 'true', 'created': '2025-09-11T02:52:38', 'last-modified': '2025-09-11T02:52:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.699708'} 2025-09-11 02:52:39,632 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:39,637 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17010520654875413342', 'uuid-lslong': '12333984915142337289'}, 'enable': 'true', 'created': '2025-09-11T02:52:38', 'last-modified': '2025-09-11T02:52:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.714972'} 2025-09-11 02:52:39,642 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:39,647 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17010520654875413342', 'uuid-lslong': '12333984915142337289'}, 'enable': 'true', 'created': '2025-09-11T02:52:38', 'last-modified': '2025-09-11T02:52:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.725264'} 2025-09-11 02:52:39,652 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:39,653 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-26489143 passed 2025-09-11 02:52:39,653 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-26489143 in API_Server ====== 2025-09-11 02:52:39,653 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:39,658 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:39,667 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:39,764 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ec118268-f64b-4b5e-ab2b-1dee9c15e309 2025-09-11 02:52:39,778 - DEBUG - =>VN ctest-mgmt_vn-26489143 has no policy to be verified 2025-09-11 02:52:39,778 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:39,778 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:39,778 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:40,077 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:40,132 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143?flat'} 2025-09-11 02:52:40,132 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:40,133 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:40,435 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:40,492 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143?flat'} 2025-09-11 02:52:40,492 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:40,492 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:40,781 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:40,831 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143?flat'} 2025-09-11 02:52:40,831 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-26489143 is found in opserver 2025-09-11 02:52:40,851 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:40,861 - DEBUG - VRF ids for VN ctest-mgmt_vn-26489143: {} 2025-09-11 02:52:41,112 - DEBUG - Response for create_network : {'network': {'id': '3d53c38d-e0a7-42c2-a720-f7038ba21798', 'name': 'ctest-left_vn-28488811', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'project_id': '5b94f8aba75844d2abe86fa881a38844', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47130880', 'ctest-left_vn-28488811'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:41,305 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e770919d-d0d5-4a8b-85a8-662dda08a69b', 'name': '', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'network_id': '3d53c38d-e0a7-42c2-a720-f7038ba21798', 'ip_version': 4, 'cidr': '149.142.109.128/26', 'allocation_pools': [{'start': '149.142.109.130', 'end': '149.142.109.190'}], 'gateway_ip': '149.142.109.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '149.142.109.130', 'tags': [], 'project_id': '5b94f8aba75844d2abe86fa881a38844'}} 2025-09-11 02:52:41,326 - INFO - Created VN ctest-left_vn-28488811 2025-09-11 02:52:41,337 - DEBUG - VN ctest-left_vn-28488811 UUID is 3d53c38d-e0a7-42c2-a720-f7038ba21798 2025-09-11 02:52:41,405 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:41,410 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:41,420 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:41,509 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/3d53c38d-e0a7-42c2-a720-f7038ba21798 2025-09-11 02:52:41,521 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/3d53c38d-e0a7-42c2-a720-f7038ba21798 2025-09-11 02:52:41,531 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/c800666f-a19d-4f92-9101-7d4b808af1eb 2025-09-11 02:52:41,541 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/c800666f-a19d-4f92-9101-7d4b808af1eb 2025-09-11 02:52:41,547 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/8a5e1af8-26d7-4c56-8ce3-1b8305559ad3 2025-09-11 02:52:41,554 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:41,554 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/3d53c38d-e0a7-42c2-a720-f7038ba21798 2025-09-11 02:52:41,562 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/c800666f-a19d-4f92-9101-7d4b808af1eb 2025-09-11 02:52:41,579 - INFO - Verified VN network id 15 for VN 3d53c38d-e0a7-42c2-a720-f7038ba21798 2025-09-11 02:52:41,579 - INFO - Verifications in API Server for VN ctest-left_vn-28488811 passed 2025-09-11 02:52:41,579 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/3d53c38d-e0a7-42c2-a720-f7038ba21798 2025-09-11 02:52:41,589 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/c800666f-a19d-4f92-9101-7d4b808af1eb 2025-09-11 02:52:41,596 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/c800666f-a19d-4f92-9101-7d4b808af1eb 2025-09-11 02:52:41,603 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/8a5e1af8-26d7-4c56-8ce3-1b8305559ad3 2025-09-11 02:52:41,614 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4419090673507451586', 'uuid-lslong': '12042896998188324760'}, 'enable': 'true', 'created': '2025-09-11T02:52:41', 'last-modified': '2025-09-11T02:52:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.363206'} 2025-09-11 02:52:41,620 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:41,626 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4419090673507451586', 'uuid-lslong': '12042896998188324760'}, 'enable': 'true', 'created': '2025-09-11T02:52:41', 'last-modified': '2025-09-11T02:52:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.367984'} 2025-09-11 02:52:41,631 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:41,637 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4419090673507451586', 'uuid-lslong': '12042896998188324760'}, 'enable': 'true', 'created': '2025-09-11T02:52:41', 'last-modified': '2025-09-11T02:52:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.387392'} 2025-09-11 02:52:41,643 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:41,643 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-28488811 passed 2025-09-11 02:52:41,643 - DEBUG - ====Verifying policy data for ctest-left_vn-28488811 in API_Server ====== 2025-09-11 02:52:41,643 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:41,649 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:41,660 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:41,753 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/3d53c38d-e0a7-42c2-a720-f7038ba21798 2025-09-11 02:52:41,762 - DEBUG - =>VN ctest-left_vn-28488811 has no policy to be verified 2025-09-11 02:52:41,762 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:41,762 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:41,763 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:41,814 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811?flat'} 2025-09-11 02:52:41,814 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:41,814 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:41,866 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811?flat'} 2025-09-11 02:52:41,866 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:41,866 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:41,919 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811?flat'} 2025-09-11 02:52:41,919 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-28488811 is found in opserver 2025-09-11 02:52:41,939 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:41,950 - DEBUG - VRF ids for VN ctest-left_vn-28488811: {} 2025-09-11 02:52:42,180 - DEBUG - Response for create_network : {'network': {'id': 'bcdbfa65-9eec-44e9-b64a-62b5d3b523e6', 'name': 'ctest-right_vn-15715899', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'project_id': '5b94f8aba75844d2abe86fa881a38844', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47130880', 'ctest-right_vn-15715899'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:42,428 - DEBUG - Response for create_subnet : {'subnet': {'id': '449b3e76-55c1-49c6-8c5a-482d8725e3ca', 'name': '', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'network_id': 'bcdbfa65-9eec-44e9-b64a-62b5d3b523e6', 'ip_version': 4, 'cidr': '116.132.250.64/26', 'allocation_pools': [{'start': '116.132.250.66', 'end': '116.132.250.126'}], 'gateway_ip': '116.132.250.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '116.132.250.66', 'tags': [], 'project_id': '5b94f8aba75844d2abe86fa881a38844'}} 2025-09-11 02:52:42,452 - INFO - Created VN ctest-right_vn-15715899 2025-09-11 02:52:42,463 - DEBUG - VN ctest-right_vn-15715899 UUID is bcdbfa65-9eec-44e9-b64a-62b5d3b523e6 2025-09-11 02:52:42,543 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:42,549 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:42,561 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:42,654 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bcdbfa65-9eec-44e9-b64a-62b5d3b523e6 2025-09-11 02:52:42,671 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bcdbfa65-9eec-44e9-b64a-62b5d3b523e6 2025-09-11 02:52:42,682 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0900c61d-4539-4b49-a9e7-af950b18301d 2025-09-11 02:52:42,693 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0900c61d-4539-4b49-a9e7-af950b18301d 2025-09-11 02:52:42,700 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/9075c80c-3f2c-4c15-a33d-06b90aca9ec9 2025-09-11 02:52:42,708 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:42,708 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bcdbfa65-9eec-44e9-b64a-62b5d3b523e6 2025-09-11 02:52:42,727 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0900c61d-4539-4b49-a9e7-af950b18301d 2025-09-11 02:52:42,746 - INFO - Verified VN network id 16 for VN bcdbfa65-9eec-44e9-b64a-62b5d3b523e6 2025-09-11 02:52:42,747 - INFO - Verifications in API Server for VN ctest-right_vn-15715899 passed 2025-09-11 02:52:42,747 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bcdbfa65-9eec-44e9-b64a-62b5d3b523e6 2025-09-11 02:52:42,761 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0900c61d-4539-4b49-a9e7-af950b18301d 2025-09-11 02:52:42,769 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0900c61d-4539-4b49-a9e7-af950b18301d 2025-09-11 02:52:42,777 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/9075c80c-3f2c-4c15-a33d-06b90aca9ec9 2025-09-11 02:52:42,790 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13608746013395010793', 'uuid-lslong': '13135419796259939302'}, 'enable': 'true', 'created': '2025-09-11T02:52:42', 'last-modified': '2025-09-11T02:52:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414649'} 2025-09-11 02:52:42,797 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:42,802 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13608746013395010793', 'uuid-lslong': '13135419796259939302'}, 'enable': 'true', 'created': '2025-09-11T02:52:42', 'last-modified': '2025-09-11T02:52:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.431317'} 2025-09-11 02:52:42,808 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:42,814 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13608746013395010793', 'uuid-lslong': '13135419796259939302'}, 'enable': 'true', 'created': '2025-09-11T02:52:42', 'last-modified': '2025-09-11T02:52:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.442425'} 2025-09-11 02:52:42,820 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:42,820 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-15715899 passed 2025-09-11 02:52:42,820 - DEBUG - ====Verifying policy data for ctest-right_vn-15715899 in API_Server ====== 2025-09-11 02:52:42,820 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:42,827 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:42,839 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:42,939 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bcdbfa65-9eec-44e9-b64a-62b5d3b523e6 2025-09-11 02:52:42,950 - DEBUG - =>VN ctest-right_vn-15715899 has no policy to be verified 2025-09-11 02:52:42,950 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:42,950 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:42,951 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:43,001 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899?flat'} 2025-09-11 02:52:43,001 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:43,001 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:43,055 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899?flat'} 2025-09-11 02:52:43,055 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:43,055 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:43,112 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899?flat'} 2025-09-11 02:52:43,112 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-15715899 is found in opserver 2025-09-11 02:52:43,133 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:43,142 - DEBUG - VRF ids for VN ctest-right_vn-15715899: {} 2025-09-11 02:52:43,272 - DEBUG - Services list from nova: [, , , ] 2025-09-11 02:52:44,375 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-1) 2025-09-11 02:52:45,816 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-2) 2025-09-11 02:52:45,817 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-63974972'] 2025-09-11 02:52:46,126 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-63974972'] created succesfully 2025-09-11 02:52:46,500 - DEBUG - Image by name tiny_nat_fw not found 2025-09-11 02:52:46,500 - DEBUG - Installing image tiny_nat_fw 2025-09-11 02:52:46,500 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-09-11 02:52:46,501 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:52:46,501 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:52:46,501 - DEBUG - Unzip image 2025-09-11 02:52:46,501 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:52:46,518 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-09-11 02:52:46,519 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-63974972'] 2025-09-11 02:52:46,635 - INFO - Service template: ['default-domain', 'ctest-service_template_1-63974972'] deleted successfully. 2025-09-11 02:52:46,635 - INFO - Skip interface_detach for VM ctest-right_vm-58726359 in state BUILD 2025-09-11 02:52:46,635 - INFO - Deleting VM ctest-right_vm-58726359 2025-09-11 02:52:46,666 - ERROR - VM ctest-right_vm-58726359 has failed to come up 2025-09-11 02:52:46,666 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:46,666 - ERROR - VM ctest-right_vm-58726359 has failed to come up 2025-09-11 02:52:46,666 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:46,837 - INFO - Skip interface_detach for VM ctest-left_vm-56424640 in state BUILD 2025-09-11 02:52:46,837 - INFO - Deleting VM ctest-left_vm-56424640 2025-09-11 02:52:46,837 - ERROR - VM ctest-left_vm-56424640 has failed to come up 2025-09-11 02:52:46,837 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:46,837 - ERROR - VM ctest-left_vm-56424640 has failed to come up 2025-09-11 02:52:46,837 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:46,910 - INFO - Deleting VN ctest-right_vn-15715899 2025-09-11 02:52:47,055 - DEBUG - Response for deleting network () 2025-09-11 02:52:47,055 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0900c61d-4539-4b49-a9e7-af950b18301d 2025-09-11 02:52:47,061 - DEBUG - Response Code: 404 2025-09-11 02:52:47,061 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:47,067 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:47,084 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:47,186 - INFO - Validated that VN ctest-right_vn-15715899 is not found in API Server 2025-09-11 02:52:47,197 - DEBUG - VN ctest-right_vn-15715899 is not present in Agent 10.0.0.254 2025-09-11 02:52:47,208 - DEBUG - VN ctest-right_vn-15715899 is not present in Agent 10.0.0.19 2025-09-11 02:52:47,208 - INFO - Validated that VN ctest-right_vn-15715899 is not in any agent 2025-09-11 02:52:47,241 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-15715899 info 2025-09-11 02:52:47,241 - INFO - Deleting VN ctest-left_vn-28488811 2025-09-11 02:52:47,287 - DEBUG - VN 3d53c38d-e0a7-42c2-a720-f7038ba21798 still in use: Unable to complete operation on network 3d53c38d-e0a7-42c2-a720-f7038ba21798. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1928a808-79a8-4907-8e69-0c239edaebc6'] 2025-09-11 02:52:47,287 - WARNING - Deleting VN ctest-left_vn-28488811 failed..Will retry 2025-09-11 02:52:49,452 - DEBUG - Response for deleting network () 2025-09-11 02:52:49,452 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/c800666f-a19d-4f92-9101-7d4b808af1eb 2025-09-11 02:52:49,459 - DEBUG - Response Code: 404 2025-09-11 02:52:49,459 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:49,472 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:49,529 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:49,619 - INFO - Validated that VN ctest-left_vn-28488811 is not found in API Server 2025-09-11 02:52:49,632 - DEBUG - VN ctest-left_vn-28488811 is not present in Agent 10.0.0.254 2025-09-11 02:52:49,644 - DEBUG - VN ctest-left_vn-28488811 is not present in Agent 10.0.0.19 2025-09-11 02:52:49,644 - INFO - Validated that VN ctest-left_vn-28488811 is not in any agent 2025-09-11 02:52:49,681 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-28488811 info 2025-09-11 02:52:49,681 - INFO - Deleting VN ctest-mgmt_vn-26489143 2025-09-11 02:52:49,838 - DEBUG - Response for deleting network () 2025-09-11 02:52:49,838 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9ef8e91f-bd49-43e1-ac12-3f113430d855 2025-09-11 02:52:49,844 - DEBUG - Response Code: 404 2025-09-11 02:52:49,844 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:49,850 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:49,860 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:49,954 - INFO - Validated that VN ctest-mgmt_vn-26489143 is not found in API Server 2025-09-11 02:52:49,965 - DEBUG - VN ctest-mgmt_vn-26489143 is not present in Agent 10.0.0.254 2025-09-11 02:52:49,979 - DEBUG - VN ctest-mgmt_vn-26489143 is not present in Agent 10.0.0.19 2025-09-11 02:52:49,979 - INFO - Validated that VN ctest-mgmt_vn-26489143 is not in any agent 2025-09-11 02:52:50,008 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-26489143 info 2025-09-11 02:52:51,281 - DEBUG - No XMPP flaps were noticed during the test 2025-09-11 02:52:51,281 - INFO - 2025-09-11 02:52:51,281 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15] 2025-09-11 02:52:51,281 - INFO - -------------------------------------------------------------------------------- 2025-09-11 02:52:51,285 - INFO - ================================================================================ 2025-09-11 02:52:51,285 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-09-11 02:52:52,547 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.19': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-09-11 02:52:52,547 - INFO - Initial checks done. Running the testcase now 2025-09-11 02:52:52,547 - INFO - 2025-09-11 02:52:52,789 - DEBUG - Response for create_network : {'network': {'id': 'a3f53cea-2cdb-4e43-b496-6f42df1f7e13', 'name': 'ctest-mgmt_vn-89173337', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'project_id': '5b94f8aba75844d2abe86fa881a38844', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47130880', 'ctest-mgmt_vn-89173337'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:53,029 - DEBUG - Response for create_subnet : {'subnet': {'id': '844808c7-2cc5-4afb-8ab9-46661bbced1b', 'name': '', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'network_id': 'a3f53cea-2cdb-4e43-b496-6f42df1f7e13', 'ip_version': 4, 'cidr': '180.236.143.128/26', 'allocation_pools': [{'start': '180.236.143.130', 'end': '180.236.143.190'}], 'gateway_ip': '180.236.143.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '180.236.143.130', 'tags': [], 'project_id': '5b94f8aba75844d2abe86fa881a38844'}} 2025-09-11 02:52:53,050 - INFO - Created VN ctest-mgmt_vn-89173337 2025-09-11 02:52:53,064 - DEBUG - VN ctest-mgmt_vn-89173337 UUID is a3f53cea-2cdb-4e43-b496-6f42df1f7e13 2025-09-11 02:52:53,135 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:53,141 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:53,154 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:53,244 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a3f53cea-2cdb-4e43-b496-6f42df1f7e13 2025-09-11 02:52:53,256 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a3f53cea-2cdb-4e43-b496-6f42df1f7e13 2025-09-11 02:52:53,264 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a5fc0c6-f2e7-47ec-af33-959bde5cd1a6 2025-09-11 02:52:53,273 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a5fc0c6-f2e7-47ec-af33-959bde5cd1a6 2025-09-11 02:52:53,280 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/440f3b92-f893-492e-b5d6-d21dc50e10a3 2025-09-11 02:52:53,287 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:53,287 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a3f53cea-2cdb-4e43-b496-6f42df1f7e13 2025-09-11 02:52:53,295 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a5fc0c6-f2e7-47ec-af33-959bde5cd1a6 2025-09-11 02:52:53,310 - INFO - Verified VN network id 14 for VN a3f53cea-2cdb-4e43-b496-6f42df1f7e13 2025-09-11 02:52:53,310 - INFO - Verifications in API Server for VN ctest-mgmt_vn-89173337 passed 2025-09-11 02:52:53,310 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a3f53cea-2cdb-4e43-b496-6f42df1f7e13 2025-09-11 02:52:53,319 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a5fc0c6-f2e7-47ec-af33-959bde5cd1a6 2025-09-11 02:52:53,325 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a5fc0c6-f2e7-47ec-af33-959bde5cd1a6 2025-09-11 02:52:53,333 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/440f3b92-f893-492e-b5d6-d21dc50e10a3 2025-09-11 02:52:53,344 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11814416173948948035', 'uuid-lslong': '13012710506335534611'}, 'enable': 'true', 'created': '2025-09-11T02:52:52', 'last-modified': '2025-09-11T02:52:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.379032'} 2025-09-11 02:52:53,350 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:53,356 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11814416173948948035', 'uuid-lslong': '13012710506335534611'}, 'enable': 'true', 'created': '2025-09-11T02:52:52', 'last-modified': '2025-09-11T02:52:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.387888'} 2025-09-11 02:52:53,361 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:53,367 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11814416173948948035', 'uuid-lslong': '13012710506335534611'}, 'enable': 'true', 'created': '2025-09-11T02:52:52', 'last-modified': '2025-09-11T02:52:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.388033'} 2025-09-11 02:52:53,372 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:53,372 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-89173337 passed 2025-09-11 02:52:53,372 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-89173337 in API_Server ====== 2025-09-11 02:52:53,372 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:53,378 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:53,388 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:53,472 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a3f53cea-2cdb-4e43-b496-6f42df1f7e13 2025-09-11 02:52:53,486 - DEBUG - =>VN ctest-mgmt_vn-89173337 has no policy to be verified 2025-09-11 02:52:53,486 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:53,486 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:53,486 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:53,499 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337?flat'} 2025-09-11 02:52:53,499 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:53,499 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:53,511 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337?flat'} 2025-09-11 02:52:53,511 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:53,511 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:53,523 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337?flat'} 2025-09-11 02:52:53,523 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47130880:ctest-mgmt_vn-89173337 is found in opserver 2025-09-11 02:52:53,547 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:53,556 - DEBUG - VRF ids for VN ctest-mgmt_vn-89173337: {} 2025-09-11 02:52:53,825 - DEBUG - Response for create_network : {'network': {'id': 'b79572e4-d092-4cee-ad10-495c6e20e7af', 'name': 'ctest-left_vn-41201679', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'project_id': '5b94f8aba75844d2abe86fa881a38844', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47130880', 'ctest-left_vn-41201679'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:54,059 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ed348a66-d77a-4b30-a264-18d63615f834', 'name': '', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'network_id': 'b79572e4-d092-4cee-ad10-495c6e20e7af', 'ip_version': 4, 'cidr': '61.144.192.192/26', 'allocation_pools': [{'start': '61.144.192.194', 'end': '61.144.192.254'}], 'gateway_ip': '61.144.192.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '61.144.192.194', 'tags': [], 'project_id': '5b94f8aba75844d2abe86fa881a38844'}} 2025-09-11 02:52:54,081 - INFO - Created VN ctest-left_vn-41201679 2025-09-11 02:52:54,095 - DEBUG - VN ctest-left_vn-41201679 UUID is b79572e4-d092-4cee-ad10-495c6e20e7af 2025-09-11 02:52:54,168 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:54,175 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:54,186 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:54,284 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/b79572e4-d092-4cee-ad10-495c6e20e7af 2025-09-11 02:52:54,298 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/b79572e4-d092-4cee-ad10-495c6e20e7af 2025-09-11 02:52:54,310 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5bbc4cf7-d0ae-4d3c-8444-0f711769a279 2025-09-11 02:52:54,319 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5bbc4cf7-d0ae-4d3c-8444-0f711769a279 2025-09-11 02:52:54,328 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/7e391391-9d19-4279-af8d-7c9eb03a1933 2025-09-11 02:52:54,335 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:54,335 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/b79572e4-d092-4cee-ad10-495c6e20e7af 2025-09-11 02:52:54,344 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5bbc4cf7-d0ae-4d3c-8444-0f711769a279 2025-09-11 02:52:54,360 - INFO - Verified VN network id 15 for VN b79572e4-d092-4cee-ad10-495c6e20e7af 2025-09-11 02:52:54,360 - INFO - Verifications in API Server for VN ctest-left_vn-41201679 passed 2025-09-11 02:52:54,361 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/b79572e4-d092-4cee-ad10-495c6e20e7af 2025-09-11 02:52:54,370 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5bbc4cf7-d0ae-4d3c-8444-0f711769a279 2025-09-11 02:52:54,377 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5bbc4cf7-d0ae-4d3c-8444-0f711769a279 2025-09-11 02:52:54,384 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/7e391391-9d19-4279-af8d-7c9eb03a1933 2025-09-11 02:52:54,395 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13228605807548058862', 'uuid-lslong': '12470548029522372527'}, 'enable': 'true', 'created': '2025-09-11T02:52:53', 'last-modified': '2025-09-11T02:52:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.382562'} 2025-09-11 02:52:54,400 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:54,406 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13228605807548058862', 'uuid-lslong': '12470548029522372527'}, 'enable': 'true', 'created': '2025-09-11T02:52:53', 'last-modified': '2025-09-11T02:52:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.393775'} 2025-09-11 02:52:54,411 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:54,418 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13228605807548058862', 'uuid-lslong': '12470548029522372527'}, 'enable': 'true', 'created': '2025-09-11T02:52:53', 'last-modified': '2025-09-11T02:52:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399111'} 2025-09-11 02:52:54,425 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:54,425 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-41201679 passed 2025-09-11 02:52:54,425 - DEBUG - ====Verifying policy data for ctest-left_vn-41201679 in API_Server ====== 2025-09-11 02:52:54,425 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:54,431 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:54,441 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:54,527 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/b79572e4-d092-4cee-ad10-495c6e20e7af 2025-09-11 02:52:54,538 - DEBUG - =>VN ctest-left_vn-41201679 has no policy to be verified 2025-09-11 02:52:54,538 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:54,538 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:54,538 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:54,553 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679?flat'} 2025-09-11 02:52:54,553 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:54,553 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:54,565 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679?flat'} 2025-09-11 02:52:54,565 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:54,565 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:54,578 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679?flat'} 2025-09-11 02:52:54,578 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47130880:ctest-left_vn-41201679 is found in opserver 2025-09-11 02:52:54,603 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:54,614 - DEBUG - VRF ids for VN ctest-left_vn-41201679: {} 2025-09-11 02:52:54,880 - DEBUG - Response for create_network : {'network': {'id': '8e57010e-0a44-4c4c-ae9e-c3ad71e9b90a', 'name': 'ctest-right_vn-52410198', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'project_id': '5b94f8aba75844d2abe86fa881a38844', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47130880', 'ctest-right_vn-52410198'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:55,084 - DEBUG - Response for create_subnet : {'subnet': {'id': '7c2dae3e-7c0b-4e2a-b958-a62b020d34ce', 'name': '', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'network_id': '8e57010e-0a44-4c4c-ae9e-c3ad71e9b90a', 'ip_version': 4, 'cidr': '189.114.247.0/26', 'allocation_pools': [{'start': '189.114.247.2', 'end': '189.114.247.62'}], 'gateway_ip': '189.114.247.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '189.114.247.2', 'tags': [], 'project_id': '5b94f8aba75844d2abe86fa881a38844'}} 2025-09-11 02:52:55,109 - INFO - Created VN ctest-right_vn-52410198 2025-09-11 02:52:55,120 - DEBUG - VN ctest-right_vn-52410198 UUID is 8e57010e-0a44-4c4c-ae9e-c3ad71e9b90a 2025-09-11 02:52:55,187 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:55,192 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:55,203 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:55,298 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/8e57010e-0a44-4c4c-ae9e-c3ad71e9b90a 2025-09-11 02:52:55,309 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/8e57010e-0a44-4c4c-ae9e-c3ad71e9b90a 2025-09-11 02:52:55,326 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f73eb8df-0825-499e-9eb2-7b6f90102f61 2025-09-11 02:52:55,333 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f73eb8df-0825-499e-9eb2-7b6f90102f61 2025-09-11 02:52:55,340 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a9e02595-9fae-439a-ad70-ab7cb7f1c62f 2025-09-11 02:52:55,346 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:55,347 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/8e57010e-0a44-4c4c-ae9e-c3ad71e9b90a 2025-09-11 02:52:55,356 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f73eb8df-0825-499e-9eb2-7b6f90102f61 2025-09-11 02:52:55,373 - INFO - Verified VN network id 16 for VN 8e57010e-0a44-4c4c-ae9e-c3ad71e9b90a 2025-09-11 02:52:55,373 - INFO - Verifications in API Server for VN ctest-right_vn-52410198 passed 2025-09-11 02:52:55,373 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/8e57010e-0a44-4c4c-ae9e-c3ad71e9b90a 2025-09-11 02:52:55,382 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f73eb8df-0825-499e-9eb2-7b6f90102f61 2025-09-11 02:52:55,390 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f73eb8df-0825-499e-9eb2-7b6f90102f61 2025-09-11 02:52:55,397 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a9e02595-9fae-439a-ad70-ab7cb7f1c62f 2025-09-11 02:52:55,409 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10256667836173012044', 'uuid-lslong': '12582709558627645706'}, 'enable': 'true', 'created': '2025-09-11T02:52:54', 'last-modified': '2025-09-11T02:52:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.371859'} 2025-09-11 02:52:55,415 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:55,421 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10256667836173012044', 'uuid-lslong': '12582709558627645706'}, 'enable': 'true', 'created': '2025-09-11T02:52:54', 'last-modified': '2025-09-11T02:52:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.383123'} 2025-09-11 02:52:55,428 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:55,435 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10256667836173012044', 'uuid-lslong': '12582709558627645706'}, 'enable': 'true', 'created': '2025-09-11T02:52:54', 'last-modified': '2025-09-11T02:52:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.391787'} 2025-09-11 02:52:55,441 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:55,441 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-52410198 passed 2025-09-11 02:52:55,441 - DEBUG - ====Verifying policy data for ctest-right_vn-52410198 in API_Server ====== 2025-09-11 02:52:55,441 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:55,447 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:55,457 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:55,555 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/8e57010e-0a44-4c4c-ae9e-c3ad71e9b90a 2025-09-11 02:52:55,566 - DEBUG - =>VN ctest-right_vn-52410198 has no policy to be verified 2025-09-11 02:52:55,566 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:55,566 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:55,566 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:55,578 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198?flat'} 2025-09-11 02:52:55,578 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:55,578 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:55,590 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198?flat'} 2025-09-11 02:52:55,590 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:55,590 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:55,601 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198?flat'} 2025-09-11 02:52:55,601 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47130880:ctest-right_vn-52410198 is found in opserver 2025-09-11 02:52:55,624 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:55,635 - DEBUG - VRF ids for VN ctest-right_vn-52410198: {} 2025-09-11 02:52:55,891 - DEBUG - Response for create_network : {'network': {'id': '02f28f6b-4371-4684-8520-e69ebb272077', 'name': 'ctest-trans_left_vn-42579961', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'project_id': '5b94f8aba75844d2abe86fa881a38844', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47130880', 'ctest-trans_left_vn-42579961'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:56,098 - DEBUG - Response for create_subnet : {'subnet': {'id': '1c3e890e-7411-4b5f-b70c-226eb67ad754', 'name': '', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'network_id': '02f28f6b-4371-4684-8520-e69ebb272077', 'ip_version': 4, 'cidr': '61.103.153.0/26', 'allocation_pools': [{'start': '61.103.153.2', 'end': '61.103.153.62'}], 'gateway_ip': '61.103.153.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '61.103.153.2', 'tags': [], 'project_id': '5b94f8aba75844d2abe86fa881a38844'}} 2025-09-11 02:52:56,118 - INFO - Created VN ctest-trans_left_vn-42579961 2025-09-11 02:52:56,130 - DEBUG - VN ctest-trans_left_vn-42579961 UUID is 02f28f6b-4371-4684-8520-e69ebb272077 2025-09-11 02:52:56,198 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:56,203 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:56,213 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:56,297 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/02f28f6b-4371-4684-8520-e69ebb272077 2025-09-11 02:52:56,310 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/02f28f6b-4371-4684-8520-e69ebb272077 2025-09-11 02:52:56,325 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/42feac04-b5d1-444d-a789-0e97b2be38d1 2025-09-11 02:52:56,336 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/42feac04-b5d1-444d-a789-0e97b2be38d1 2025-09-11 02:52:56,342 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6000a55d-b3fb-4d56-a9f0-20bb37e02f59 2025-09-11 02:52:56,349 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:52:56,349 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/02f28f6b-4371-4684-8520-e69ebb272077 2025-09-11 02:52:56,358 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/42feac04-b5d1-444d-a789-0e97b2be38d1 2025-09-11 02:52:56,371 - INFO - Verified VN network id 17 for VN 02f28f6b-4371-4684-8520-e69ebb272077 2025-09-11 02:52:56,371 - INFO - Verifications in API Server for VN ctest-trans_left_vn-42579961 passed 2025-09-11 02:52:56,371 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/02f28f6b-4371-4684-8520-e69ebb272077 2025-09-11 02:52:56,380 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/42feac04-b5d1-444d-a789-0e97b2be38d1 2025-09-11 02:52:56,387 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/42feac04-b5d1-444d-a789-0e97b2be38d1 2025-09-11 02:52:56,396 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6000a55d-b3fb-4d56-a9f0-20bb37e02f59 2025-09-11 02:52:56,408 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '212389823295604356', 'uuid-lslong': '9592920775718281335'}, 'enable': 'true', 'created': '2025-09-11T02:52:55', 'last-modified': '2025-09-11T02:52:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.365713'} 2025-09-11 02:52:56,413 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:52:56,418 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '212389823295604356', 'uuid-lslong': '9592920775718281335'}, 'enable': 'true', 'created': '2025-09-11T02:52:55', 'last-modified': '2025-09-11T02:52:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.377604'} 2025-09-11 02:52:56,423 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:52:56,429 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '212389823295604356', 'uuid-lslong': '9592920775718281335'}, 'enable': 'true', 'created': '2025-09-11T02:52:55', 'last-modified': '2025-09-11T02:52:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.388054'} 2025-09-11 02:52:56,435 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:52:56,435 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-42579961 passed 2025-09-11 02:52:56,435 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-42579961 in API_Server ====== 2025-09-11 02:52:56,435 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:56,441 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:56,450 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:56,544 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/02f28f6b-4371-4684-8520-e69ebb272077 2025-09-11 02:52:56,553 - DEBUG - =>VN ctest-trans_left_vn-42579961 has no policy to be verified 2025-09-11 02:52:56,553 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:56,553 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:56,553 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:56,564 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961?flat'} 2025-09-11 02:52:56,564 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:56,564 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:56,576 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961?flat'} 2025-09-11 02:52:56,576 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:56,576 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:56,594 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961?flat'} 2025-09-11 02:52:56,594 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47130880:ctest-trans_left_vn-42579961 is found in opserver 2025-09-11 02:52:56,621 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:56,636 - DEBUG - VRF ids for VN ctest-trans_left_vn-42579961: {} 2025-09-11 02:52:56,904 - DEBUG - Response for create_network : {'network': {'id': 'da160f0c-31b4-4224-9408-75912971acc8', 'name': 'ctest-trans_right_vn-76254129', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'project_id': '5b94f8aba75844d2abe86fa881a38844', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47130880', 'ctest-trans_right_vn-76254129'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:57,137 - DEBUG - Response for create_subnet : {'subnet': {'id': '7c6c7c0c-c0cc-4fea-b862-f73786c3cbb3', 'name': '', 'tenant_id': '5b94f8aba75844d2abe86fa881a38844', 'network_id': 'da160f0c-31b4-4224-9408-75912971acc8', 'ip_version': 4, 'cidr': '122.189.183.64/26', 'allocation_pools': [{'start': '122.189.183.66', 'end': '122.189.183.126'}], 'gateway_ip': '122.189.183.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '122.189.183.66', 'tags': [], 'project_id': '5b94f8aba75844d2abe86fa881a38844'}} 2025-09-11 02:52:57,157 - INFO - Created VN ctest-trans_right_vn-76254129 2025-09-11 02:52:57,170 - DEBUG - VN ctest-trans_right_vn-76254129 UUID is da160f0c-31b4-4224-9408-75912971acc8 2025-09-11 02:52:57,238 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:57,245 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:57,256 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:57,376 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/da160f0c-31b4-4224-9408-75912971acc8 2025-09-11 02:52:57,403 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/da160f0c-31b4-4224-9408-75912971acc8 2025-09-11 02:52:57,421 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/67450dfd-f8f0-4d67-b1ec-2e66170969cb 2025-09-11 02:52:57,428 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/67450dfd-f8f0-4d67-b1ec-2e66170969cb 2025-09-11 02:52:57,437 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/d7e09f03-31b2-461b-98fd-f871b878108d 2025-09-11 02:52:57,443 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-11 02:52:57,443 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/da160f0c-31b4-4224-9408-75912971acc8 2025-09-11 02:52:57,452 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/67450dfd-f8f0-4d67-b1ec-2e66170969cb 2025-09-11 02:52:57,468 - INFO - Verified VN network id 18 for VN da160f0c-31b4-4224-9408-75912971acc8 2025-09-11 02:52:57,468 - INFO - Verifications in API Server for VN ctest-trans_right_vn-76254129 passed 2025-09-11 02:52:57,468 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/da160f0c-31b4-4224-9408-75912971acc8 2025-09-11 02:52:57,480 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/67450dfd-f8f0-4d67-b1ec-2e66170969cb 2025-09-11 02:52:57,514 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/67450dfd-f8f0-4d67-b1ec-2e66170969cb 2025-09-11 02:52:57,531 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/d7e09f03-31b2-461b-98fd-f871b878108d 2025-09-11 02:52:57,568 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15714764494803845668', 'uuid-lslong': '10666904983753043144'}, 'enable': 'true', 'created': '2025-09-11T02:52:56', 'last-modified': '2025-09-11T02:52:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.478036'} 2025-09-11 02:52:57,576 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-11 02:52:57,582 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15714764494803845668', 'uuid-lslong': '10666904983753043144'}, 'enable': 'true', 'created': '2025-09-11T02:52:56', 'last-modified': '2025-09-11T02:52:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.492464'} 2025-09-11 02:52:57,593 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-11 02:52:57,599 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47130880', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15714764494803845668', 'uuid-lslong': '10666904983753043144'}, 'enable': 'true', 'created': '2025-09-11T02:52:56', 'last-modified': '2025-09-11T02:52:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.506400'} 2025-09-11 02:52:57,606 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-11 02:52:57,606 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-76254129 passed 2025-09-11 02:52:57,606 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-76254129 in API_Server ====== 2025-09-11 02:52:57,606 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:57,611 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:57,623 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:52:57,744 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/da160f0c-31b4-4224-9408-75912971acc8 2025-09-11 02:52:57,760 - DEBUG - =>VN ctest-trans_right_vn-76254129 has no policy to be verified 2025-09-11 02:52:57,760 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:57,760 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:57,760 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:57,780 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129?flat'} 2025-09-11 02:52:57,780 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:57,780 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:57,794 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129?flat'} 2025-09-11 02:52:57,794 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:57,794 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:57,830 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129?flat'} 2025-09-11 02:52:57,830 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47130880:ctest-trans_right_vn-76254129 is found in opserver 2025-09-11 02:52:57,855 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:57,869 - DEBUG - VRF ids for VN ctest-trans_right_vn-76254129: {} 2025-09-11 02:52:59,176 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-2) 2025-09-11 02:53:00,324 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-1) 2025-09-11 02:53:00,324 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-35520068'] 2025-09-11 02:53:00,635 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-35520068'] created succesfully 2025-09-11 02:53:01,019 - DEBUG - Image by name tiny_trans_fw not found 2025-09-11 02:53:01,022 - DEBUG - Installing image tiny_trans_fw 2025-09-11 02:53:01,022 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-09-11 02:53:01,023 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-11 02:53:01,023 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-11 02:53:01,023 - DEBUG - Unzip image 2025-09-11 02:53:01,023 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-11 02:53:01,042 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-09-11 02:53:01,043 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-35520068'] 2025-09-11 02:53:01,139 - INFO - Service template: ['default-domain', 'ctest-service_template_1-35520068'] deleted successfully. 2025-09-11 02:53:01,139 - INFO - Skip interface_detach for VM ctest-right_vm-97661753 in state BUILD 2025-09-11 02:53:01,139 - INFO - Deleting VM ctest-right_vm-97661753 2025-09-11 02:53:01,139 - ERROR - VM ctest-right_vm-97661753 has failed to come up 2025-09-11 02:53:01,139 - ERROR - Nova failed to get host of the VM 2025-09-11 02:53:01,139 - ERROR - VM ctest-right_vm-97661753 has failed to come up 2025-09-11 02:53:01,139 - ERROR - Nova failed to get host of the VM 2025-09-11 02:53:01,227 - INFO - Skip interface_detach for VM ctest-left_vm-36955355 in state BUILD 2025-09-11 02:53:01,228 - INFO - Deleting VM ctest-left_vm-36955355 2025-09-11 02:53:01,228 - ERROR - VM ctest-left_vm-36955355 has failed to come up 2025-09-11 02:53:01,228 - ERROR - Nova failed to get host of the VM 2025-09-11 02:53:01,228 - ERROR - VM ctest-left_vm-36955355 has failed to come up 2025-09-11 02:53:01,228 - ERROR - Nova failed to get host of the VM 2025-09-11 02:53:01,406 - INFO - Deleting VN ctest-trans_right_vn-76254129 2025-09-11 02:53:01,558 - DEBUG - Response for deleting network () 2025-09-11 02:53:01,558 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/67450dfd-f8f0-4d67-b1ec-2e66170969cb 2025-09-11 02:53:01,565 - DEBUG - Response Code: 404 2025-09-11 02:53:01,565 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:53:01,574 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:53:01,602 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:53:01,695 - INFO - Validated that VN ctest-trans_right_vn-76254129 is not found in API Server 2025-09-11 02:53:01,708 - DEBUG - VN ctest-trans_right_vn-76254129 is not present in Agent 10.0.0.254 2025-09-11 02:53:01,718 - DEBUG - VN ctest-trans_right_vn-76254129 is not present in Agent 10.0.0.19 2025-09-11 02:53:01,718 - INFO - Validated that VN ctest-trans_right_vn-76254129 is not in any agent 2025-09-11 02:53:01,748 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-76254129 info 2025-09-11 02:53:01,749 - INFO - Deleting VN ctest-trans_left_vn-42579961 2025-09-11 02:53:01,897 - DEBUG - Response for deleting network () 2025-09-11 02:53:01,897 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/42feac04-b5d1-444d-a789-0e97b2be38d1 2025-09-11 02:53:01,905 - DEBUG - Response Code: 404 2025-09-11 02:53:01,906 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:53:01,913 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:53:01,931 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:53:02,014 - INFO - Validated that VN ctest-trans_left_vn-42579961 is not found in API Server 2025-09-11 02:53:02,038 - DEBUG - VN ctest-trans_left_vn-42579961 is not present in Agent 10.0.0.254 2025-09-11 02:53:02,050 - DEBUG - VN ctest-trans_left_vn-42579961 is not present in Agent 10.0.0.19 2025-09-11 02:53:02,050 - INFO - Validated that VN ctest-trans_left_vn-42579961 is not in any agent 2025-09-11 02:53:02,083 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-42579961 info 2025-09-11 02:53:02,084 - INFO - Deleting VN ctest-right_vn-52410198 2025-09-11 02:53:02,124 - DEBUG - VN 8e57010e-0a44-4c4c-ae9e-c3ad71e9b90a still in use: Unable to complete operation on network 8e57010e-0a44-4c4c-ae9e-c3ad71e9b90a. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f3224449-103d-4130-a6bb-8825ea5bb3df'] 2025-09-11 02:53:02,124 - WARNING - Deleting VN ctest-right_vn-52410198 failed..Will retry 2025-09-11 02:53:04,268 - DEBUG - Response for deleting network () 2025-09-11 02:53:04,268 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f73eb8df-0825-499e-9eb2-7b6f90102f61 2025-09-11 02:53:04,274 - DEBUG - Response Code: 404 2025-09-11 02:53:04,274 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:53:04,284 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:53:04,349 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:53:04,443 - INFO - Validated that VN ctest-right_vn-52410198 is not found in API Server 2025-09-11 02:53:04,454 - DEBUG - VN ctest-right_vn-52410198 is not present in Agent 10.0.0.254 2025-09-11 02:53:04,468 - DEBUG - VN ctest-right_vn-52410198 is not present in Agent 10.0.0.19 2025-09-11 02:53:04,468 - INFO - Validated that VN ctest-right_vn-52410198 is not in any agent 2025-09-11 02:53:04,510 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-52410198 info 2025-09-11 02:53:04,511 - INFO - Deleting VN ctest-left_vn-41201679 2025-09-11 02:53:04,657 - DEBUG - Response for deleting network () 2025-09-11 02:53:04,657 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5bbc4cf7-d0ae-4d3c-8444-0f711769a279 2025-09-11 02:53:04,662 - DEBUG - Response Code: 404 2025-09-11 02:53:04,662 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:53:04,673 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:53:04,686 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:53:04,770 - INFO - Validated that VN ctest-left_vn-41201679 is not found in API Server 2025-09-11 02:53:04,782 - DEBUG - VN ctest-left_vn-41201679 is not present in Agent 10.0.0.254 2025-09-11 02:53:04,797 - DEBUG - VN ctest-left_vn-41201679 is not present in Agent 10.0.0.19 2025-09-11 02:53:04,797 - INFO - Validated that VN ctest-left_vn-41201679 is not in any agent 2025-09-11 02:53:04,832 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-41201679 info 2025-09-11 02:53:04,832 - INFO - Deleting VN ctest-mgmt_vn-89173337 2025-09-11 02:53:04,960 - DEBUG - Response for deleting network () 2025-09-11 02:53:04,961 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a5fc0c6-f2e7-47ec-af33-959bde5cd1a6 2025-09-11 02:53:04,967 - DEBUG - Response Code: 404 2025-09-11 02:53:04,967 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:53:04,972 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:53:04,996 - DEBUG - Requesting: http://10.0.0.249:8082/project/5b94f8ab-a758-44d2-abe8-6fa881a38844 2025-09-11 02:53:05,093 - INFO - Validated that VN ctest-mgmt_vn-89173337 is not found in API Server 2025-09-11 02:53:05,103 - DEBUG - VN ctest-mgmt_vn-89173337 is not present in Agent 10.0.0.254 2025-09-11 02:53:05,115 - DEBUG - VN ctest-mgmt_vn-89173337 is not present in Agent 10.0.0.19 2025-09-11 02:53:05,115 - INFO - Validated that VN ctest-mgmt_vn-89173337 is not in any agent 2025-09-11 02:53:05,143 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-89173337 info 2025-09-11 02:53:06,407 - DEBUG - No XMPP flaps were noticed during the test 2025-09-11 02:53:06,407 - INFO - 2025-09-11 02:53:06,407 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15] 2025-09-11 02:53:06,407 - INFO - -------------------------------------------------------------------------------- 2025-09-11 02:53:07,092 - INFO - Deleted project: ctest-TestSvcHC-47130880, ID : 5b94f8ab-a758-44d2-abe8-6fa881a38844