2025-11-24 03:05:25,158 - INFO - Domain Default found not creating 2025-11-24 03:05:25,334 - INFO - Project ctest-TestSvcHC-66740115 not found, creating it 2025-11-24 03:05:25,886 - INFO - Created Project:ctest-TestSvcHC-66740115, ID : e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:27,473 - INFO - ================================================================================ 2025-11-24 03:05:27,474 - INFO - STARTING TEST : test_svc_hc_basic 2025-11-24 03:05:28,755 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.25': '0', '10.20.0.193': '0'}, '10.0.0.56': {'10.20.0.193': '0', '10.20.0.25': '0'}} with 2025-11-24 03:05:28,755 - INFO - Initial checks done. Running the testcase now 2025-11-24 03:05:28,755 - INFO - 2025-11-24 03:05:29,546 - DEBUG - Response for create_network : {'network': {'id': '775ed355-a52c-4558-9e32-1dc997214ce0', 'name': 'ctest-mgmt_vn-93458732', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'project_id': 'e0a9f53355d24c5da043c152c6794519', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-66740115', 'ctest-mgmt_vn-93458732'], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:05:29,869 - DEBUG - Response for create_subnet : {'subnet': {'id': '01b8dc5c-7d06-4728-a8ae-680be16e78b8', 'name': '', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'network_id': '775ed355-a52c-4558-9e32-1dc997214ce0', 'ip_version': 4, 'cidr': '118.200.136.192/26', 'allocation_pools': [{'start': '118.200.136.194', 'end': '118.200.136.254'}], 'gateway_ip': '118.200.136.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '118.200.136.194', 'tags': [], 'project_id': 'e0a9f53355d24c5da043c152c6794519'}} 2025-11-24 03:05:29,896 - INFO - Created VN ctest-mgmt_vn-93458732 2025-11-24 03:05:29,908 - DEBUG - VN ctest-mgmt_vn-93458732 UUID is 775ed355-a52c-4558-9e32-1dc997214ce0 2025-11-24 03:05:30,011 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:30,332 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:30,382 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:30,400 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:30,495 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/775ed355-a52c-4558-9e32-1dc997214ce0 2025-11-24 03:05:30,512 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/775ed355-a52c-4558-9e32-1dc997214ce0 2025-11-24 03:05:30,523 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/6536b4e1-f66f-4734-ae0a-c5995d849fc7 2025-11-24 03:05:30,534 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/6536b4e1-f66f-4734-ae0a-c5995d849fc7 2025-11-24 03:05:30,543 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/a94f7531-a061-4ed2-8edf-a7b14c5ff670 2025-11-24 03:05:30,570 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:05:30,570 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/775ed355-a52c-4558-9e32-1dc997214ce0 2025-11-24 03:05:30,581 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/6536b4e1-f66f-4734-ae0a-c5995d849fc7 2025-11-24 03:05:30,602 - INFO - Verified VN network id 11 for VN 775ed355-a52c-4558-9e32-1dc997214ce0 2025-11-24 03:05:30,603 - INFO - Verifications in API Server for VN ctest-mgmt_vn-93458732 passed 2025-11-24 03:05:30,603 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/775ed355-a52c-4558-9e32-1dc997214ce0 2025-11-24 03:05:30,622 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/6536b4e1-f66f-4734-ae0a-c5995d849fc7 2025-11-24 03:05:30,633 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/6536b4e1-f66f-4734-ae0a-c5995d849fc7 2025-11-24 03:05:30,641 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/a94f7531-a061-4ed2-8edf-a7b14c5ff670 2025-11-24 03:05:30,654 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8601544703121048920', 'uuid-lslong': '11399206358489320672'}, 'enable': 'true', 'created': '2025-11-24T03:05:29', 'last-modified': '2025-11-24T03:05:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.849103'} 2025-11-24 03:05:30,665 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:05:30,672 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8601544703121048920', 'uuid-lslong': '11399206358489320672'}, 'enable': 'true', 'created': '2025-11-24T03:05:29', 'last-modified': '2025-11-24T03:05:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.863646'} 2025-11-24 03:05:30,678 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:05:30,685 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8601544703121048920', 'uuid-lslong': '11399206358489320672'}, 'enable': 'true', 'created': '2025-11-24T03:05:29', 'last-modified': '2025-11-24T03:05:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.879559'} 2025-11-24 03:05:30,693 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:05:30,694 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-93458732 passed 2025-11-24 03:05:30,694 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-93458732 in API_Server ====== 2025-11-24 03:05:30,694 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:30,702 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:30,721 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:30,835 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/775ed355-a52c-4558-9e32-1dc997214ce0 2025-11-24 03:05:30,850 - DEBUG - =>VN ctest-mgmt_vn-93458732 has no policy to be verified 2025-11-24 03:05:30,850 - DEBUG - Verifying the vn in opserver 2025-11-24 03:05:30,850 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732 virtual network link through opserver 10.0.0.41 2025-11-24 03:05:30,850 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:05:31,178 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:05:31,265 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732?flat'} 2025-11-24 03:05:31,265 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732 virtual network link through opserver 10.0.0.50 2025-11-24 03:05:31,265 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:05:31,576 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:05:31,644 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732?flat'} 2025-11-24 03:05:31,644 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732 virtual network link through opserver 10.0.0.27 2025-11-24 03:05:31,644 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:05:31,972 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:05:32,052 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732?flat'} 2025-11-24 03:05:32,052 - INFO - Validated that VN default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-93458732 is found in opserver 2025-11-24 03:05:32,081 - DEBUG - Do not have enough data to verify VN in agent 2025-11-24 03:05:32,094 - DEBUG - VRF ids for VN ctest-mgmt_vn-93458732: {} 2025-11-24 03:05:32,446 - DEBUG - Response for create_network : {'network': {'id': '50655894-7238-4e0a-81bb-3b418e72ff76', 'name': 'ctest-left_vn-08166702', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'project_id': 'e0a9f53355d24c5da043c152c6794519', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-66740115', 'ctest-left_vn-08166702'], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:05:32,722 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a1e08c21-0efa-4d48-a0c5-bbafbdf9c844', 'name': '', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'network_id': '50655894-7238-4e0a-81bb-3b418e72ff76', 'ip_version': 4, 'cidr': '70.214.214.128/26', 'allocation_pools': [{'start': '70.214.214.130', 'end': '70.214.214.190'}], 'gateway_ip': '70.214.214.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '70.214.214.130', 'tags': [], 'project_id': 'e0a9f53355d24c5da043c152c6794519'}} 2025-11-24 03:05:32,750 - INFO - Created VN ctest-left_vn-08166702 2025-11-24 03:05:32,767 - DEBUG - VN ctest-left_vn-08166702 UUID is 50655894-7238-4e0a-81bb-3b418e72ff76 2025-11-24 03:05:32,858 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:32,864 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:32,876 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:32,970 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/50655894-7238-4e0a-81bb-3b418e72ff76 2025-11-24 03:05:32,988 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/50655894-7238-4e0a-81bb-3b418e72ff76 2025-11-24 03:05:32,998 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ac74de43-cee1-405a-91a5-e77688f7e988 2025-11-24 03:05:33,006 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ac74de43-cee1-405a-91a5-e77688f7e988 2025-11-24 03:05:33,013 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/6ed33a72-9a47-46d4-a9bc-945b06d9502d 2025-11-24 03:05:33,021 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:05:33,021 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/50655894-7238-4e0a-81bb-3b418e72ff76 2025-11-24 03:05:33,030 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ac74de43-cee1-405a-91a5-e77688f7e988 2025-11-24 03:05:33,046 - INFO - Verified VN network id 12 for VN 50655894-7238-4e0a-81bb-3b418e72ff76 2025-11-24 03:05:33,046 - INFO - Verifications in API Server for VN ctest-left_vn-08166702 passed 2025-11-24 03:05:33,046 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/50655894-7238-4e0a-81bb-3b418e72ff76 2025-11-24 03:05:33,058 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ac74de43-cee1-405a-91a5-e77688f7e988 2025-11-24 03:05:33,066 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ac74de43-cee1-405a-91a5-e77688f7e988 2025-11-24 03:05:33,084 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/6ed33a72-9a47-46d4-a9bc-945b06d9502d 2025-11-24 03:05:33,101 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5793133890276707850', 'uuid-lslong': '9348130604286410614'}, 'enable': 'true', 'created': '2025-11-24T03:05:32', 'last-modified': '2025-11-24T03:05:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.436527'} 2025-11-24 03:05:33,107 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:05:33,112 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5793133890276707850', 'uuid-lslong': '9348130604286410614'}, 'enable': 'true', 'created': '2025-11-24T03:05:32', 'last-modified': '2025-11-24T03:05:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.460117'} 2025-11-24 03:05:33,119 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:05:33,127 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5793133890276707850', 'uuid-lslong': '9348130604286410614'}, 'enable': 'true', 'created': '2025-11-24T03:05:32', 'last-modified': '2025-11-24T03:05:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.463887'} 2025-11-24 03:05:33,134 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:05:33,134 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-08166702 passed 2025-11-24 03:05:33,135 - DEBUG - ====Verifying policy data for ctest-left_vn-08166702 in API_Server ====== 2025-11-24 03:05:33,135 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:33,142 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:33,157 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:33,259 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/50655894-7238-4e0a-81bb-3b418e72ff76 2025-11-24 03:05:33,268 - DEBUG - =>VN ctest-left_vn-08166702 has no policy to be verified 2025-11-24 03:05:33,268 - DEBUG - Verifying the vn in opserver 2025-11-24 03:05:33,268 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702 virtual network link through opserver 10.0.0.41 2025-11-24 03:05:33,268 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:05:33,349 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702?flat'} 2025-11-24 03:05:33,349 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702 virtual network link through opserver 10.0.0.50 2025-11-24 03:05:33,349 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:05:33,410 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702?flat'} 2025-11-24 03:05:33,410 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702 virtual network link through opserver 10.0.0.27 2025-11-24 03:05:33,410 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:05:33,475 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702?flat'} 2025-11-24 03:05:33,475 - INFO - Validated that VN default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-08166702 is found in opserver 2025-11-24 03:05:33,499 - DEBUG - Do not have enough data to verify VN in agent 2025-11-24 03:05:33,509 - DEBUG - VRF ids for VN ctest-left_vn-08166702: {} 2025-11-24 03:05:33,825 - DEBUG - Response for create_network : {'network': {'id': '83d02c6d-30d5-4689-b8d4-fb1dbb96b551', 'name': 'ctest-right_vn-54763315', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'project_id': 'e0a9f53355d24c5da043c152c6794519', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-66740115', 'ctest-right_vn-54763315'], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:05:34,108 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd97dc99e-c9b1-47d5-9b98-155fc4643c24', 'name': '', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'network_id': '83d02c6d-30d5-4689-b8d4-fb1dbb96b551', 'ip_version': 4, 'cidr': '134.94.136.0/26', 'allocation_pools': [{'start': '134.94.136.2', 'end': '134.94.136.62'}], 'gateway_ip': '134.94.136.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '134.94.136.2', 'tags': [], 'project_id': 'e0a9f53355d24c5da043c152c6794519'}} 2025-11-24 03:05:34,137 - INFO - Created VN ctest-right_vn-54763315 2025-11-24 03:05:34,149 - DEBUG - VN ctest-right_vn-54763315 UUID is 83d02c6d-30d5-4689-b8d4-fb1dbb96b551 2025-11-24 03:05:34,234 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:34,241 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:34,253 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:34,348 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83d02c6d-30d5-4689-b8d4-fb1dbb96b551 2025-11-24 03:05:34,362 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83d02c6d-30d5-4689-b8d4-fb1dbb96b551 2025-11-24 03:05:34,374 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/10b1df42-1cf5-4357-810c-965e0e2e5533 2025-11-24 03:05:34,382 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/10b1df42-1cf5-4357-810c-965e0e2e5533 2025-11-24 03:05:34,391 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/65b454e8-21cc-47b9-bb16-4c7c1bb886f2 2025-11-24 03:05:34,399 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:05:34,400 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83d02c6d-30d5-4689-b8d4-fb1dbb96b551 2025-11-24 03:05:34,410 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/10b1df42-1cf5-4357-810c-965e0e2e5533 2025-11-24 03:05:34,427 - INFO - Verified VN network id 13 for VN 83d02c6d-30d5-4689-b8d4-fb1dbb96b551 2025-11-24 03:05:34,427 - INFO - Verifications in API Server for VN ctest-right_vn-54763315 passed 2025-11-24 03:05:34,427 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83d02c6d-30d5-4689-b8d4-fb1dbb96b551 2025-11-24 03:05:34,436 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/10b1df42-1cf5-4357-810c-965e0e2e5533 2025-11-24 03:05:34,444 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/10b1df42-1cf5-4357-810c-965e0e2e5533 2025-11-24 03:05:34,452 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/65b454e8-21cc-47b9-bb16-4c7c1bb886f2 2025-11-24 03:05:34,467 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9498140461606717065', 'uuid-lslong': '13318546103161238865'}, 'enable': 'true', 'created': '2025-11-24T03:05:33', 'last-modified': '2025-11-24T03:05:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416313'} 2025-11-24 03:05:34,472 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:05:34,478 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9498140461606717065', 'uuid-lslong': '13318546103161238865'}, 'enable': 'true', 'created': '2025-11-24T03:05:33', 'last-modified': '2025-11-24T03:05:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422850'} 2025-11-24 03:05:34,486 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:05:34,491 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9498140461606717065', 'uuid-lslong': '13318546103161238865'}, 'enable': 'true', 'created': '2025-11-24T03:05:33', 'last-modified': '2025-11-24T03:05:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443952'} 2025-11-24 03:05:34,498 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:05:34,498 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-54763315 passed 2025-11-24 03:05:34,499 - DEBUG - ====Verifying policy data for ctest-right_vn-54763315 in API_Server ====== 2025-11-24 03:05:34,499 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:34,506 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:34,520 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:34,623 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83d02c6d-30d5-4689-b8d4-fb1dbb96b551 2025-11-24 03:05:34,634 - DEBUG - =>VN ctest-right_vn-54763315 has no policy to be verified 2025-11-24 03:05:34,634 - DEBUG - Verifying the vn in opserver 2025-11-24 03:05:34,634 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315 virtual network link through opserver 10.0.0.41 2025-11-24 03:05:34,634 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:05:34,703 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315?flat'} 2025-11-24 03:05:34,703 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315 virtual network link through opserver 10.0.0.50 2025-11-24 03:05:34,703 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:05:34,773 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315?flat'} 2025-11-24 03:05:34,773 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315 virtual network link through opserver 10.0.0.27 2025-11-24 03:05:34,774 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:05:34,846 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315?flat'} 2025-11-24 03:05:34,846 - INFO - Validated that VN default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-54763315 is found in opserver 2025-11-24 03:05:34,868 - DEBUG - Do not have enough data to verify VN in agent 2025-11-24 03:05:34,878 - DEBUG - VRF ids for VN ctest-right_vn-54763315: {} 2025-11-24 03:05:34,940 - DEBUG - Services list from nova: [, , , ] 2025-11-24 03:05:36,045 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4803-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4803-2) 2025-11-24 03:05:37,464 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4803-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4803-1) 2025-11-24 03:05:37,464 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-32101441'] 2025-11-24 03:05:37,769 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-32101441'] created succesfully 2025-11-24 03:05:38,182 - DEBUG - Image by name tiny_nat_fw not found 2025-11-24 03:05:38,182 - DEBUG - Installing image tiny_nat_fw 2025-11-24 03:05:38,183 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-11-24 03:05:38,183 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-24 03:05:38,183 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-24 03:05:38,183 - DEBUG - Unzip image 2025-11-24 03:05:38,183 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-24 03:05:38,215 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-11-24 03:05:38,216 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-32101441'] 2025-11-24 03:05:38,318 - INFO - Service template: ['default-domain', 'ctest-service_template_1-32101441'] deleted successfully. 2025-11-24 03:05:38,318 - INFO - Skip interface_detach for VM ctest-right_vm-85496075 in state BUILD 2025-11-24 03:05:38,318 - INFO - Deleting VM ctest-right_vm-85496075 2025-11-24 03:05:38,359 - ERROR - VM ctest-right_vm-85496075 has failed to come up 2025-11-24 03:05:38,359 - ERROR - Nova failed to get host of the VM 2025-11-24 03:05:38,359 - ERROR - VM ctest-right_vm-85496075 has failed to come up 2025-11-24 03:05:38,359 - ERROR - Nova failed to get host of the VM 2025-11-24 03:05:38,479 - INFO - Skip interface_detach for VM ctest-left_vm-89928829 in state BUILD 2025-11-24 03:05:38,479 - INFO - Deleting VM ctest-left_vm-89928829 2025-11-24 03:05:38,479 - ERROR - VM ctest-left_vm-89928829 has failed to come up 2025-11-24 03:05:38,479 - ERROR - Nova failed to get host of the VM 2025-11-24 03:05:38,479 - ERROR - VM ctest-left_vm-89928829 has failed to come up 2025-11-24 03:05:38,479 - ERROR - Nova failed to get host of the VM 2025-11-24 03:05:38,554 - INFO - Deleting VN ctest-right_vn-54763315 2025-11-24 03:05:38,609 - DEBUG - VN 83d02c6d-30d5-4689-b8d4-fb1dbb96b551 still in use: Unable to complete operation on network 83d02c6d-30d5-4689-b8d4-fb1dbb96b551. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-68300e41-7123-48b9-a917-b88ed7f114b4'] 2025-11-24 03:05:38,609 - WARNING - Deleting VN ctest-right_vn-54763315 failed..Will retry 2025-11-24 03:05:40,794 - DEBUG - Response for deleting network () 2025-11-24 03:05:40,795 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/10b1df42-1cf5-4357-810c-965e0e2e5533 2025-11-24 03:05:40,808 - DEBUG - Response Code: 404 2025-11-24 03:05:40,808 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:40,819 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:40,848 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:40,945 - INFO - Validated that VN ctest-right_vn-54763315 is not found in API Server 2025-11-24 03:05:40,959 - DEBUG - VN ctest-right_vn-54763315 is not present in Agent 10.0.0.57 2025-11-24 03:05:40,972 - DEBUG - VN ctest-right_vn-54763315 is not present in Agent 10.0.0.56 2025-11-24 03:05:40,972 - INFO - Validated that VN ctest-right_vn-54763315 is not in any agent 2025-11-24 03:05:41,006 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-54763315 info 2025-11-24 03:05:41,007 - INFO - Deleting VN ctest-left_vn-08166702 2025-11-24 03:05:41,180 - DEBUG - Response for deleting network () 2025-11-24 03:05:41,180 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ac74de43-cee1-405a-91a5-e77688f7e988 2025-11-24 03:05:41,186 - DEBUG - Response Code: 404 2025-11-24 03:05:41,187 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:41,193 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:41,222 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:41,325 - INFO - Validated that VN ctest-left_vn-08166702 is not found in API Server 2025-11-24 03:05:41,336 - DEBUG - VN ctest-left_vn-08166702 is not present in Agent 10.0.0.57 2025-11-24 03:05:41,350 - DEBUG - VN ctest-left_vn-08166702 is not present in Agent 10.0.0.56 2025-11-24 03:05:41,350 - INFO - Validated that VN ctest-left_vn-08166702 is not in any agent 2025-11-24 03:05:41,386 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-08166702 info 2025-11-24 03:05:41,386 - INFO - Deleting VN ctest-mgmt_vn-93458732 2025-11-24 03:05:41,560 - DEBUG - Response for deleting network () 2025-11-24 03:05:41,560 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/6536b4e1-f66f-4734-ae0a-c5995d849fc7 2025-11-24 03:05:41,566 - DEBUG - Response Code: 404 2025-11-24 03:05:41,566 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:41,572 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:41,598 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:41,693 - INFO - Validated that VN ctest-mgmt_vn-93458732 is not found in API Server 2025-11-24 03:05:41,708 - DEBUG - VN ctest-mgmt_vn-93458732 is not present in Agent 10.0.0.57 2025-11-24 03:05:41,718 - DEBUG - VN ctest-mgmt_vn-93458732 is not present in Agent 10.0.0.56 2025-11-24 03:05:41,718 - INFO - Validated that VN ctest-mgmt_vn-93458732 is not in any agent 2025-11-24 03:05:41,755 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-93458732 info 2025-11-24 03:05:43,048 - DEBUG - No XMPP flaps were noticed during the test 2025-11-24 03:05:43,048 - INFO -
2025-11-24 03:05:43,048 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:16]
2025-11-24 03:05:43,048 - INFO - -------------------------------------------------------------------------------- 2025-11-24 03:05:43,051 - INFO - ================================================================================ 2025-11-24 03:05:43,051 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-11-24 03:05:44,336 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.25': '0', '10.20.0.193': '0'}, '10.0.0.56': {'10.20.0.193': '0', '10.20.0.25': '0'}} with 2025-11-24 03:05:44,336 - INFO - Initial checks done. Running the testcase now 2025-11-24 03:05:44,336 - INFO - 2025-11-24 03:05:44,626 - DEBUG - Response for create_network : {'network': {'id': '975ff8ba-6845-4be8-994f-d466cc2a69ba', 'name': 'ctest-mgmt_vn-77453414', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'project_id': 'e0a9f53355d24c5da043c152c6794519', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-66740115', 'ctest-mgmt_vn-77453414'], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:05:44,881 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a3a568fb-03f6-4bad-9f7e-7f07fba7a3a0', 'name': '', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'network_id': '975ff8ba-6845-4be8-994f-d466cc2a69ba', 'ip_version': 4, 'cidr': '4.200.213.128/26', 'allocation_pools': [{'start': '4.200.213.130', 'end': '4.200.213.190'}], 'gateway_ip': '4.200.213.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '4.200.213.130', 'tags': [], 'project_id': 'e0a9f53355d24c5da043c152c6794519'}} 2025-11-24 03:05:44,909 - INFO - Created VN ctest-mgmt_vn-77453414 2025-11-24 03:05:44,920 - DEBUG - VN ctest-mgmt_vn-77453414 UUID is 975ff8ba-6845-4be8-994f-d466cc2a69ba 2025-11-24 03:05:44,994 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:45,001 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:45,013 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:45,116 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/975ff8ba-6845-4be8-994f-d466cc2a69ba 2025-11-24 03:05:45,136 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/975ff8ba-6845-4be8-994f-d466cc2a69ba 2025-11-24 03:05:45,148 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a2375cd8-28a3-46c6-bbf6-dd6e0cea9967 2025-11-24 03:05:45,159 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a2375cd8-28a3-46c6-bbf6-dd6e0cea9967 2025-11-24 03:05:45,167 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/01a9a39b-eb16-410a-8503-ceeb45b7cbfa 2025-11-24 03:05:45,174 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:05:45,174 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/975ff8ba-6845-4be8-994f-d466cc2a69ba 2025-11-24 03:05:45,184 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a2375cd8-28a3-46c6-bbf6-dd6e0cea9967 2025-11-24 03:05:45,201 - INFO - Verified VN network id 11 for VN 975ff8ba-6845-4be8-994f-d466cc2a69ba 2025-11-24 03:05:45,203 - INFO - Verifications in API Server for VN ctest-mgmt_vn-77453414 passed 2025-11-24 03:05:45,203 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/975ff8ba-6845-4be8-994f-d466cc2a69ba 2025-11-24 03:05:45,214 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a2375cd8-28a3-46c6-bbf6-dd6e0cea9967 2025-11-24 03:05:45,222 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a2375cd8-28a3-46c6-bbf6-dd6e0cea9967 2025-11-24 03:05:45,230 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/01a9a39b-eb16-410a-8503-ceeb45b7cbfa 2025-11-24 03:05:45,242 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10907710302011608040', 'uuid-lslong': '11047281948940200378'}, 'enable': 'true', 'created': '2025-11-24T03:05:44', 'last-modified': '2025-11-24T03:05:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426359'} 2025-11-24 03:05:45,249 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:05:45,254 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10907710302011608040', 'uuid-lslong': '11047281948940200378'}, 'enable': 'true', 'created': '2025-11-24T03:05:44', 'last-modified': '2025-11-24T03:05:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.435986'} 2025-11-24 03:05:45,262 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:05:45,268 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10907710302011608040', 'uuid-lslong': '11047281948940200378'}, 'enable': 'true', 'created': '2025-11-24T03:05:44', 'last-modified': '2025-11-24T03:05:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.454210'} 2025-11-24 03:05:45,274 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-24 03:05:45,275 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-77453414 passed 2025-11-24 03:05:45,275 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-77453414 in API_Server ====== 2025-11-24 03:05:45,275 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:45,281 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:45,292 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:45,398 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/975ff8ba-6845-4be8-994f-d466cc2a69ba 2025-11-24 03:05:45,410 - DEBUG - =>VN ctest-mgmt_vn-77453414 has no policy to be verified 2025-11-24 03:05:45,410 - DEBUG - Verifying the vn in opserver 2025-11-24 03:05:45,410 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414 virtual network link through opserver 10.0.0.41 2025-11-24 03:05:45,410 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:05:45,423 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414?flat'} 2025-11-24 03:05:45,423 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414 virtual network link through opserver 10.0.0.50 2025-11-24 03:05:45,423 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:05:45,437 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414?flat'} 2025-11-24 03:05:45,437 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414 virtual network link through opserver 10.0.0.27 2025-11-24 03:05:45,437 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:05:45,449 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414?flat'} 2025-11-24 03:05:45,449 - INFO - Validated that VN default-domain:ctest-TestSvcHC-66740115:ctest-mgmt_vn-77453414 is found in opserver 2025-11-24 03:05:45,473 - DEBUG - Do not have enough data to verify VN in agent 2025-11-24 03:05:45,484 - DEBUG - VRF ids for VN ctest-mgmt_vn-77453414: {} 2025-11-24 03:05:45,821 - DEBUG - Response for create_network : {'network': {'id': '2b45b0c8-cb6b-4746-ac29-ac931dbcf797', 'name': 'ctest-left_vn-16829223', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'project_id': 'e0a9f53355d24c5da043c152c6794519', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-66740115', 'ctest-left_vn-16829223'], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:05:46,046 - DEBUG - Response for create_subnet : {'subnet': {'id': '67dcc275-fa78-4474-9fb0-b51fdee90f79', 'name': '', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'network_id': '2b45b0c8-cb6b-4746-ac29-ac931dbcf797', 'ip_version': 4, 'cidr': '206.215.112.64/26', 'allocation_pools': [{'start': '206.215.112.66', 'end': '206.215.112.126'}], 'gateway_ip': '206.215.112.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '206.215.112.66', 'tags': [], 'project_id': 'e0a9f53355d24c5da043c152c6794519'}} 2025-11-24 03:05:46,078 - INFO - Created VN ctest-left_vn-16829223 2025-11-24 03:05:46,090 - DEBUG - VN ctest-left_vn-16829223 UUID is 2b45b0c8-cb6b-4746-ac29-ac931dbcf797 2025-11-24 03:05:46,183 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:46,190 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:46,202 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:46,302 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2b45b0c8-cb6b-4746-ac29-ac931dbcf797 2025-11-24 03:05:46,318 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2b45b0c8-cb6b-4746-ac29-ac931dbcf797 2025-11-24 03:05:46,329 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c635b934-f054-4bd7-a721-8212df891d4e 2025-11-24 03:05:46,340 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c635b934-f054-4bd7-a721-8212df891d4e 2025-11-24 03:05:46,349 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d911ab6a-f99c-4e01-b8d1-06711db55ae7 2025-11-24 03:05:46,357 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:05:46,357 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2b45b0c8-cb6b-4746-ac29-ac931dbcf797 2025-11-24 03:05:46,369 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c635b934-f054-4bd7-a721-8212df891d4e 2025-11-24 03:05:46,385 - INFO - Verified VN network id 12 for VN 2b45b0c8-cb6b-4746-ac29-ac931dbcf797 2025-11-24 03:05:46,387 - INFO - Verifications in API Server for VN ctest-left_vn-16829223 passed 2025-11-24 03:05:46,387 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2b45b0c8-cb6b-4746-ac29-ac931dbcf797 2025-11-24 03:05:46,398 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c635b934-f054-4bd7-a721-8212df891d4e 2025-11-24 03:05:46,407 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c635b934-f054-4bd7-a721-8212df891d4e 2025-11-24 03:05:46,415 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d911ab6a-f99c-4e01-b8d1-06711db55ae7 2025-11-24 03:05:46,427 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3118092693476689734', 'uuid-lslong': '12405636396427835287'}, 'enable': 'true', 'created': '2025-11-24T03:05:45', 'last-modified': '2025-11-24T03:05:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.442814'} 2025-11-24 03:05:46,432 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:05:46,439 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3118092693476689734', 'uuid-lslong': '12405636396427835287'}, 'enable': 'true', 'created': '2025-11-24T03:05:45', 'last-modified': '2025-11-24T03:05:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444960'} 2025-11-24 03:05:46,447 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:05:46,453 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3118092693476689734', 'uuid-lslong': '12405636396427835287'}, 'enable': 'true', 'created': '2025-11-24T03:05:45', 'last-modified': '2025-11-24T03:05:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.461900'} 2025-11-24 03:05:46,460 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-24 03:05:46,460 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-16829223 passed 2025-11-24 03:05:46,460 - DEBUG - ====Verifying policy data for ctest-left_vn-16829223 in API_Server ====== 2025-11-24 03:05:46,460 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:46,467 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:46,481 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:46,578 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2b45b0c8-cb6b-4746-ac29-ac931dbcf797 2025-11-24 03:05:46,590 - DEBUG - =>VN ctest-left_vn-16829223 has no policy to be verified 2025-11-24 03:05:46,590 - DEBUG - Verifying the vn in opserver 2025-11-24 03:05:46,590 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223 virtual network link through opserver 10.0.0.41 2025-11-24 03:05:46,590 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:05:46,605 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223?flat'} 2025-11-24 03:05:46,605 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223 virtual network link through opserver 10.0.0.50 2025-11-24 03:05:46,605 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:05:46,620 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223?flat'} 2025-11-24 03:05:46,620 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223 virtual network link through opserver 10.0.0.27 2025-11-24 03:05:46,620 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:05:46,634 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223?flat'} 2025-11-24 03:05:46,634 - INFO - Validated that VN default-domain:ctest-TestSvcHC-66740115:ctest-left_vn-16829223 is found in opserver 2025-11-24 03:05:46,657 - DEBUG - Do not have enough data to verify VN in agent 2025-11-24 03:05:46,668 - DEBUG - VRF ids for VN ctest-left_vn-16829223: {} 2025-11-24 03:05:46,958 - DEBUG - Response for create_network : {'network': {'id': '8c672c51-3282-441d-9641-aa07c2e6bc9f', 'name': 'ctest-right_vn-16171266', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'project_id': 'e0a9f53355d24c5da043c152c6794519', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-66740115', 'ctest-right_vn-16171266'], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:05:47,217 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a070da1a-ba25-4855-83aa-8ec9d4b897d8', 'name': '', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'network_id': '8c672c51-3282-441d-9641-aa07c2e6bc9f', 'ip_version': 4, 'cidr': '99.193.235.0/26', 'allocation_pools': [{'start': '99.193.235.2', 'end': '99.193.235.62'}], 'gateway_ip': '99.193.235.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '99.193.235.2', 'tags': [], 'project_id': 'e0a9f53355d24c5da043c152c6794519'}} 2025-11-24 03:05:47,248 - INFO - Created VN ctest-right_vn-16171266 2025-11-24 03:05:47,261 - DEBUG - VN ctest-right_vn-16171266 UUID is 8c672c51-3282-441d-9641-aa07c2e6bc9f 2025-11-24 03:05:47,335 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:47,341 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:47,353 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:47,443 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/8c672c51-3282-441d-9641-aa07c2e6bc9f 2025-11-24 03:05:47,457 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/8c672c51-3282-441d-9641-aa07c2e6bc9f 2025-11-24 03:05:47,470 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5258d1b8-9408-4ab3-b0dd-66b12c13912e 2025-11-24 03:05:47,480 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5258d1b8-9408-4ab3-b0dd-66b12c13912e 2025-11-24 03:05:47,489 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/c8d0f59b-43bf-44d2-9d74-0864021a3045 2025-11-24 03:05:47,498 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:05:47,498 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/8c672c51-3282-441d-9641-aa07c2e6bc9f 2025-11-24 03:05:47,509 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5258d1b8-9408-4ab3-b0dd-66b12c13912e 2025-11-24 03:05:47,526 - INFO - Verified VN network id 13 for VN 8c672c51-3282-441d-9641-aa07c2e6bc9f 2025-11-24 03:05:47,526 - INFO - Verifications in API Server for VN ctest-right_vn-16171266 passed 2025-11-24 03:05:47,526 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/8c672c51-3282-441d-9641-aa07c2e6bc9f 2025-11-24 03:05:47,540 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5258d1b8-9408-4ab3-b0dd-66b12c13912e 2025-11-24 03:05:47,548 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5258d1b8-9408-4ab3-b0dd-66b12c13912e 2025-11-24 03:05:47,556 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/c8d0f59b-43bf-44d2-9d74-0864021a3045 2025-11-24 03:05:47,569 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10117103815162479645', 'uuid-lslong': '10827121929486777503'}, 'enable': 'true', 'created': '2025-11-24T03:05:46', 'last-modified': '2025-11-24T03:05:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420278'} 2025-11-24 03:05:47,574 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:05:47,580 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10117103815162479645', 'uuid-lslong': '10827121929486777503'}, 'enable': 'true', 'created': '2025-11-24T03:05:46', 'last-modified': '2025-11-24T03:05:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419129'} 2025-11-24 03:05:47,586 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:05:47,593 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10117103815162479645', 'uuid-lslong': '10827121929486777503'}, 'enable': 'true', 'created': '2025-11-24T03:05:46', 'last-modified': '2025-11-24T03:05:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.442733'} 2025-11-24 03:05:47,600 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-24 03:05:47,601 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-16171266 passed 2025-11-24 03:05:47,601 - DEBUG - ====Verifying policy data for ctest-right_vn-16171266 in API_Server ====== 2025-11-24 03:05:47,601 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:47,608 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:47,622 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:47,711 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/8c672c51-3282-441d-9641-aa07c2e6bc9f 2025-11-24 03:05:47,723 - DEBUG - =>VN ctest-right_vn-16171266 has no policy to be verified 2025-11-24 03:05:47,723 - DEBUG - Verifying the vn in opserver 2025-11-24 03:05:47,724 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266 virtual network link through opserver 10.0.0.41 2025-11-24 03:05:47,724 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:05:47,737 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266?flat'} 2025-11-24 03:05:47,737 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266 virtual network link through opserver 10.0.0.50 2025-11-24 03:05:47,737 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:05:47,754 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266?flat'} 2025-11-24 03:05:47,754 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266 virtual network link through opserver 10.0.0.27 2025-11-24 03:05:47,754 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:05:47,769 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266?flat'} 2025-11-24 03:05:47,769 - INFO - Validated that VN default-domain:ctest-TestSvcHC-66740115:ctest-right_vn-16171266 is found in opserver 2025-11-24 03:05:47,793 - DEBUG - Do not have enough data to verify VN in agent 2025-11-24 03:05:47,806 - DEBUG - VRF ids for VN ctest-right_vn-16171266: {} 2025-11-24 03:05:48,109 - DEBUG - Response for create_network : {'network': {'id': 'c95b410a-fbb2-4129-abca-a39f310e2cac', 'name': 'ctest-trans_left_vn-50991850', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'project_id': 'e0a9f53355d24c5da043c152c6794519', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-66740115', 'ctest-trans_left_vn-50991850'], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:05:48,371 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cdc97b0b-9e60-47ec-899d-5af6e7c60e86', 'name': '', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'network_id': 'c95b410a-fbb2-4129-abca-a39f310e2cac', 'ip_version': 4, 'cidr': '42.60.177.64/26', 'allocation_pools': [{'start': '42.60.177.66', 'end': '42.60.177.126'}], 'gateway_ip': '42.60.177.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '42.60.177.66', 'tags': [], 'project_id': 'e0a9f53355d24c5da043c152c6794519'}} 2025-11-24 03:05:48,399 - INFO - Created VN ctest-trans_left_vn-50991850 2025-11-24 03:05:48,412 - DEBUG - VN ctest-trans_left_vn-50991850 UUID is c95b410a-fbb2-4129-abca-a39f310e2cac 2025-11-24 03:05:48,498 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:48,505 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:48,520 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:48,619 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c95b410a-fbb2-4129-abca-a39f310e2cac 2025-11-24 03:05:48,630 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c95b410a-fbb2-4129-abca-a39f310e2cac 2025-11-24 03:05:48,639 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ddb52310-e085-4939-bbb9-e4247a7c0335 2025-11-24 03:05:48,648 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ddb52310-e085-4939-bbb9-e4247a7c0335 2025-11-24 03:05:48,656 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/264da3be-67bb-4841-b458-6c5b4dd8e8d0 2025-11-24 03:05:48,663 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-24 03:05:48,663 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c95b410a-fbb2-4129-abca-a39f310e2cac 2025-11-24 03:05:48,673 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ddb52310-e085-4939-bbb9-e4247a7c0335 2025-11-24 03:05:48,688 - INFO - Verified VN network id 14 for VN c95b410a-fbb2-4129-abca-a39f310e2cac 2025-11-24 03:05:48,689 - INFO - Verifications in API Server for VN ctest-trans_left_vn-50991850 passed 2025-11-24 03:05:48,689 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c95b410a-fbb2-4129-abca-a39f310e2cac 2025-11-24 03:05:48,699 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ddb52310-e085-4939-bbb9-e4247a7c0335 2025-11-24 03:05:48,709 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ddb52310-e085-4939-bbb9-e4247a7c0335 2025-11-24 03:05:48,717 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/264da3be-67bb-4841-b458-6c5b4dd8e8d0 2025-11-24 03:05:48,731 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14509262139932426537', 'uuid-lslong': '12378886429899369644'}, 'enable': 'true', 'created': '2025-11-24T03:05:48', 'last-modified': '2025-11-24T03:05:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.406701'} 2025-11-24 03:05:48,737 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-24 03:05:48,743 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14509262139932426537', 'uuid-lslong': '12378886429899369644'}, 'enable': 'true', 'created': '2025-11-24T03:05:48', 'last-modified': '2025-11-24T03:05:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.421971'} 2025-11-24 03:05:48,750 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-24 03:05:48,757 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14509262139932426537', 'uuid-lslong': '12378886429899369644'}, 'enable': 'true', 'created': '2025-11-24T03:05:48', 'last-modified': '2025-11-24T03:05:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432490'} 2025-11-24 03:05:48,764 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-24 03:05:48,764 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-50991850 passed 2025-11-24 03:05:48,764 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-50991850 in API_Server ====== 2025-11-24 03:05:48,764 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:48,774 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:48,788 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:48,893 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c95b410a-fbb2-4129-abca-a39f310e2cac 2025-11-24 03:05:48,904 - DEBUG - =>VN ctest-trans_left_vn-50991850 has no policy to be verified 2025-11-24 03:05:48,904 - DEBUG - Verifying the vn in opserver 2025-11-24 03:05:48,904 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850 virtual network link through opserver 10.0.0.41 2025-11-24 03:05:48,904 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:05:48,918 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850?flat'} 2025-11-24 03:05:48,918 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850 virtual network link through opserver 10.0.0.50 2025-11-24 03:05:48,918 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:05:48,933 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850?flat'} 2025-11-24 03:05:48,933 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850 virtual network link through opserver 10.0.0.27 2025-11-24 03:05:48,933 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:05:48,947 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850?flat'} 2025-11-24 03:05:48,947 - INFO - Validated that VN default-domain:ctest-TestSvcHC-66740115:ctest-trans_left_vn-50991850 is found in opserver 2025-11-24 03:05:48,969 - DEBUG - Do not have enough data to verify VN in agent 2025-11-24 03:05:48,981 - DEBUG - VRF ids for VN ctest-trans_left_vn-50991850: {} 2025-11-24 03:05:49,276 - DEBUG - Response for create_network : {'network': {'id': '9a101e9e-145b-41e8-98c3-7d53aa65b545', 'name': 'ctest-trans_right_vn-93404428', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'project_id': 'e0a9f53355d24c5da043c152c6794519', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-66740115', 'ctest-trans_right_vn-93404428'], 'port_security_enabled': True, 'description': ''}} 2025-11-24 03:05:49,517 - DEBUG - Response for create_subnet : {'subnet': {'id': '19e86f0b-5fd7-4e4b-9bb5-3deeb3ce815c', 'name': '', 'tenant_id': 'e0a9f53355d24c5da043c152c6794519', 'network_id': '9a101e9e-145b-41e8-98c3-7d53aa65b545', 'ip_version': 4, 'cidr': '76.245.140.192/26', 'allocation_pools': [{'start': '76.245.140.194', 'end': '76.245.140.254'}], 'gateway_ip': '76.245.140.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '76.245.140.194', 'tags': [], 'project_id': 'e0a9f53355d24c5da043c152c6794519'}} 2025-11-24 03:05:49,539 - INFO - Created VN ctest-trans_right_vn-93404428 2025-11-24 03:05:49,551 - DEBUG - VN ctest-trans_right_vn-93404428 UUID is 9a101e9e-145b-41e8-98c3-7d53aa65b545 2025-11-24 03:05:49,632 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:49,638 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:49,663 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:49,767 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9a101e9e-145b-41e8-98c3-7d53aa65b545 2025-11-24 03:05:49,784 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9a101e9e-145b-41e8-98c3-7d53aa65b545 2025-11-24 03:05:49,796 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1afb7e9e-9cd5-47c3-91c1-958b8e36d2dd 2025-11-24 03:05:49,808 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1afb7e9e-9cd5-47c3-91c1-958b8e36d2dd 2025-11-24 03:05:49,818 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/b296db1a-fde6-4ec5-9b8e-795c9d66dc33 2025-11-24 03:05:49,829 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-24 03:05:49,829 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9a101e9e-145b-41e8-98c3-7d53aa65b545 2025-11-24 03:05:49,840 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1afb7e9e-9cd5-47c3-91c1-958b8e36d2dd 2025-11-24 03:05:49,862 - INFO - Verified VN network id 15 for VN 9a101e9e-145b-41e8-98c3-7d53aa65b545 2025-11-24 03:05:49,862 - INFO - Verifications in API Server for VN ctest-trans_right_vn-93404428 passed 2025-11-24 03:05:49,862 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9a101e9e-145b-41e8-98c3-7d53aa65b545 2025-11-24 03:05:49,875 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1afb7e9e-9cd5-47c3-91c1-958b8e36d2dd 2025-11-24 03:05:49,884 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1afb7e9e-9cd5-47c3-91c1-958b8e36d2dd 2025-11-24 03:05:49,893 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/b296db1a-fde6-4ec5-9b8e-795c9d66dc33 2025-11-24 03:05:49,907 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11101406745763463656', 'uuid-lslong': '11007779712518174021'}, 'enable': 'true', 'created': '2025-11-24T03:05:49', 'last-modified': '2025-11-24T03:05:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.441151'} 2025-11-24 03:05:49,915 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-24 03:05:49,922 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11101406745763463656', 'uuid-lslong': '11007779712518174021'}, 'enable': 'true', 'created': '2025-11-24T03:05:49', 'last-modified': '2025-11-24T03:05:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.454388'} 2025-11-24 03:05:49,931 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-24 03:05:49,938 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-66740115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11101406745763463656', 'uuid-lslong': '11007779712518174021'}, 'enable': 'true', 'created': '2025-11-24T03:05:49', 'last-modified': '2025-11-24T03:05:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.472080'} 2025-11-24 03:05:49,946 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-24 03:05:49,946 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-93404428 passed 2025-11-24 03:05:49,947 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-93404428 in API_Server ====== 2025-11-24 03:05:49,947 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:49,959 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:49,977 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:50,083 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9a101e9e-145b-41e8-98c3-7d53aa65b545 2025-11-24 03:05:50,096 - DEBUG - =>VN ctest-trans_right_vn-93404428 has no policy to be verified 2025-11-24 03:05:50,096 - DEBUG - Verifying the vn in opserver 2025-11-24 03:05:50,097 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428 virtual network link through opserver 10.0.0.41 2025-11-24 03:05:50,097 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-24 03:05:50,115 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428?flat'} 2025-11-24 03:05:50,115 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428 virtual network link through opserver 10.0.0.50 2025-11-24 03:05:50,115 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-24 03:05:50,130 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428?flat'} 2025-11-24 03:05:50,131 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428 virtual network link through opserver 10.0.0.27 2025-11-24 03:05:50,131 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-24 03:05:50,144 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428?flat'} 2025-11-24 03:05:50,144 - INFO - Validated that VN default-domain:ctest-TestSvcHC-66740115:ctest-trans_right_vn-93404428 is found in opserver 2025-11-24 03:05:50,167 - DEBUG - Do not have enough data to verify VN in agent 2025-11-24 03:05:50,181 - DEBUG - VRF ids for VN ctest-trans_right_vn-93404428: {} 2025-11-24 03:05:51,325 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4803-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4803-1) 2025-11-24 03:05:52,697 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4803-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4803-2) 2025-11-24 03:05:52,698 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-59700181'] 2025-11-24 03:05:53,030 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-59700181'] created succesfully 2025-11-24 03:05:53,417 - DEBUG - Image by name tiny_trans_fw not found 2025-11-24 03:05:53,417 - DEBUG - Installing image tiny_trans_fw 2025-11-24 03:05:53,418 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-11-24 03:05:53,418 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-24 03:05:53,418 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-24 03:05:53,418 - DEBUG - Unzip image 2025-11-24 03:05:53,418 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-24 03:05:53,442 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-11-24 03:05:53,442 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-59700181'] 2025-11-24 03:05:53,558 - INFO - Service template: ['default-domain', 'ctest-service_template_1-59700181'] deleted successfully. 2025-11-24 03:05:53,559 - INFO - Skip interface_detach for VM ctest-right_vm-59732896 in state BUILD 2025-11-24 03:05:53,559 - INFO - Deleting VM ctest-right_vm-59732896 2025-11-24 03:05:53,559 - ERROR - VM ctest-right_vm-59732896 has failed to come up 2025-11-24 03:05:53,559 - ERROR - Nova failed to get host of the VM 2025-11-24 03:05:53,559 - ERROR - VM ctest-right_vm-59732896 has failed to come up 2025-11-24 03:05:53,559 - ERROR - Nova failed to get host of the VM 2025-11-24 03:05:53,741 - INFO - Skip interface_detach for VM ctest-left_vm-54965086 in state BUILD 2025-11-24 03:05:53,742 - INFO - Deleting VM ctest-left_vm-54965086 2025-11-24 03:05:53,742 - ERROR - VM ctest-left_vm-54965086 has failed to come up 2025-11-24 03:05:53,742 - ERROR - Nova failed to get host of the VM 2025-11-24 03:05:53,742 - ERROR - VM ctest-left_vm-54965086 has failed to come up 2025-11-24 03:05:53,742 - ERROR - Nova failed to get host of the VM 2025-11-24 03:05:53,846 - INFO - Deleting VN ctest-trans_right_vn-93404428 2025-11-24 03:05:54,012 - DEBUG - Response for deleting network () 2025-11-24 03:05:54,012 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1afb7e9e-9cd5-47c3-91c1-958b8e36d2dd 2025-11-24 03:05:54,019 - DEBUG - Response Code: 404 2025-11-24 03:05:54,020 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:54,034 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:54,071 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:54,176 - INFO - Validated that VN ctest-trans_right_vn-93404428 is not found in API Server 2025-11-24 03:05:54,189 - DEBUG - VN ctest-trans_right_vn-93404428 is not present in Agent 10.0.0.57 2025-11-24 03:05:54,206 - DEBUG - VN ctest-trans_right_vn-93404428 is not present in Agent 10.0.0.56 2025-11-24 03:05:54,206 - INFO - Validated that VN ctest-trans_right_vn-93404428 is not in any agent 2025-11-24 03:05:54,244 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-93404428 info 2025-11-24 03:05:54,244 - INFO - Deleting VN ctest-trans_left_vn-50991850 2025-11-24 03:05:54,432 - DEBUG - Response for deleting network () 2025-11-24 03:05:54,432 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ddb52310-e085-4939-bbb9-e4247a7c0335 2025-11-24 03:05:54,439 - DEBUG - Response Code: 404 2025-11-24 03:05:54,439 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:54,449 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:54,461 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:54,555 - INFO - Validated that VN ctest-trans_left_vn-50991850 is not found in API Server 2025-11-24 03:05:54,571 - DEBUG - VN ctest-trans_left_vn-50991850 is not present in Agent 10.0.0.57 2025-11-24 03:05:54,594 - DEBUG - VN ctest-trans_left_vn-50991850 is not present in Agent 10.0.0.56 2025-11-24 03:05:54,594 - INFO - Validated that VN ctest-trans_left_vn-50991850 is not in any agent 2025-11-24 03:05:54,628 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-50991850 info 2025-11-24 03:05:54,628 - INFO - Deleting VN ctest-right_vn-16171266 2025-11-24 03:05:54,684 - DEBUG - VN 8c672c51-3282-441d-9641-aa07c2e6bc9f still in use: Unable to complete operation on network 8c672c51-3282-441d-9641-aa07c2e6bc9f. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-e34c3836-a1f5-4c84-8909-3be327dda20e'] 2025-11-24 03:05:54,684 - WARNING - Deleting VN ctest-right_vn-16171266 failed..Will retry 2025-11-24 03:05:56,822 - DEBUG - Response for deleting network () 2025-11-24 03:05:56,822 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/5258d1b8-9408-4ab3-b0dd-66b12c13912e 2025-11-24 03:05:56,829 - DEBUG - Response Code: 404 2025-11-24 03:05:56,829 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:56,836 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:56,852 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:56,944 - INFO - Validated that VN ctest-right_vn-16171266 is not found in API Server 2025-11-24 03:05:56,958 - DEBUG - VN ctest-right_vn-16171266 is not present in Agent 10.0.0.57 2025-11-24 03:05:56,968 - DEBUG - VN ctest-right_vn-16171266 is not present in Agent 10.0.0.56 2025-11-24 03:05:56,968 - INFO - Validated that VN ctest-right_vn-16171266 is not in any agent 2025-11-24 03:05:57,000 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-16171266 info 2025-11-24 03:05:57,000 - INFO - Deleting VN ctest-left_vn-16829223 2025-11-24 03:05:57,160 - DEBUG - Response for deleting network () 2025-11-24 03:05:57,160 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/c635b934-f054-4bd7-a721-8212df891d4e 2025-11-24 03:05:57,168 - DEBUG - Response Code: 404 2025-11-24 03:05:57,168 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:57,175 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:57,201 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:57,291 - INFO - Validated that VN ctest-left_vn-16829223 is not found in API Server 2025-11-24 03:05:57,303 - DEBUG - VN ctest-left_vn-16829223 is not present in Agent 10.0.0.57 2025-11-24 03:05:57,313 - DEBUG - VN ctest-left_vn-16829223 is not present in Agent 10.0.0.56 2025-11-24 03:05:57,313 - INFO - Validated that VN ctest-left_vn-16829223 is not in any agent 2025-11-24 03:05:57,344 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-16829223 info 2025-11-24 03:05:57,344 - INFO - Deleting VN ctest-mgmt_vn-77453414 2025-11-24 03:05:57,496 - DEBUG - Response for deleting network () 2025-11-24 03:05:57,496 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a2375cd8-28a3-46c6-bbf6-dd6e0cea9967 2025-11-24 03:05:57,502 - DEBUG - Response Code: 404 2025-11-24 03:05:57,503 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-24 03:05:57,517 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9a9efa54-edd3-449b-89f6-47a8074a2fba 2025-11-24 03:05:57,572 - DEBUG - Requesting: http://10.0.0.41:8082/project/e0a9f533-55d2-4c5d-a043-c152c6794519 2025-11-24 03:05:57,662 - INFO - Validated that VN ctest-mgmt_vn-77453414 is not found in API Server 2025-11-24 03:05:57,676 - DEBUG - VN ctest-mgmt_vn-77453414 is not present in Agent 10.0.0.57 2025-11-24 03:05:57,688 - DEBUG - VN ctest-mgmt_vn-77453414 is not present in Agent 10.0.0.56 2025-11-24 03:05:57,688 - INFO - Validated that VN ctest-mgmt_vn-77453414 is not in any agent 2025-11-24 03:05:57,722 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-77453414 info 2025-11-24 03:05:59,004 - DEBUG - No XMPP flaps were noticed during the test 2025-11-24 03:05:59,004 - INFO -
2025-11-24 03:05:59,004 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16]
2025-11-24 03:05:59,004 - INFO - -------------------------------------------------------------------------------- 2025-11-24 03:05:59,777 - INFO - Deleted project: ctest-TestSvcHC-66740115, ID : e0a9f533-55d2-4c5d-a043-c152c6794519