2026-04-27 03:43:23,975 - INFO - Domain Default found not creating 2026-04-27 03:43:24,207 - INFO - Project ctest-TestSvcHC-93054250 not found, creating it 2026-04-27 03:43:24,917 - INFO - Created Project:ctest-TestSvcHC-93054250, ID : 4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:26,767 - INFO - ================================================================================ 2026-04-27 03:43:26,768 - INFO - STARTING TEST : test_svc_hc_basic 2026-04-27 03:43:28,088 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.65': {'10.20.0.25': '0', '10.20.0.18': '0'}} with 2026-04-27 03:43:28,088 - INFO - Initial checks done. Running the testcase now 2026-04-27 03:43:28,088 - INFO - 2026-04-27 03:43:28,920 - DEBUG - Response for create_network : {'network': {'id': '98b5d286-948b-4934-9f09-7f0faee0fb7b', 'name': 'ctest-mgmt_vn-85439152', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'project_id': '4c26852c319e4675b9563246c0788ca9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-93054250', 'ctest-mgmt_vn-85439152'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 03:43:29,264 - DEBUG - Response for create_subnet : {'subnet': {'id': '02c91287-c88d-4a35-a7f6-a14111db0eee', 'name': '', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'network_id': '98b5d286-948b-4934-9f09-7f0faee0fb7b', 'ip_version': 4, 'cidr': '56.12.101.0/26', 'allocation_pools': [{'start': '56.12.101.2', 'end': '56.12.101.62'}], 'gateway_ip': '56.12.101.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '56.12.101.2', 'tags': [], 'project_id': '4c26852c319e4675b9563246c0788ca9'}} 2026-04-27 03:43:29,292 - INFO - Created VN ctest-mgmt_vn-85439152 2026-04-27 03:43:29,312 - DEBUG - VN ctest-mgmt_vn-85439152 UUID is 98b5d286-948b-4934-9f09-7f0faee0fb7b 2026-04-27 03:43:29,406 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:29,722 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:29,765 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:29,789 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:29,888 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/98b5d286-948b-4934-9f09-7f0faee0fb7b 2026-04-27 03:43:29,907 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/98b5d286-948b-4934-9f09-7f0faee0fb7b 2026-04-27 03:43:29,917 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/45c1a76c-c76d-4fc2-9223-dc8dd3a85b25 2026-04-27 03:43:29,927 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/45c1a76c-c76d-4fc2-9223-dc8dd3a85b25 2026-04-27 03:43:29,938 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/f2752c87-94e0-4d41-9af1-fe1e1ac2f586 2026-04-27 03:43:29,947 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 03:43:29,947 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/98b5d286-948b-4934-9f09-7f0faee0fb7b 2026-04-27 03:43:29,959 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/45c1a76c-c76d-4fc2-9223-dc8dd3a85b25 2026-04-27 03:43:29,984 - INFO - Verified VN network id 17 for VN 98b5d286-948b-4934-9f09-7f0faee0fb7b 2026-04-27 03:43:29,985 - INFO - Verifications in API Server for VN ctest-mgmt_vn-85439152 passed 2026-04-27 03:43:29,985 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/98b5d286-948b-4934-9f09-7f0faee0fb7b 2026-04-27 03:43:30,007 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/45c1a76c-c76d-4fc2-9223-dc8dd3a85b25 2026-04-27 03:43:30,019 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/45c1a76c-c76d-4fc2-9223-dc8dd3a85b25 2026-04-27 03:43:30,028 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/f2752c87-94e0-4d41-9af1-fe1e1ac2f586 2026-04-27 03:43:30,045 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11003932740009281844', 'uuid-lslong': '11459830432156154747'}, 'enable': 'true', 'created': '2026-04-27T03:43:28', 'last-modified': '2026-04-27T03:43:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.874708'} 2026-04-27 03:43:30,052 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 03:43:30,059 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11003932740009281844', 'uuid-lslong': '11459830432156154747'}, 'enable': 'true', 'created': '2026-04-27T03:43:28', 'last-modified': '2026-04-27T03:43:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.877743'} 2026-04-27 03:43:30,067 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 03:43:30,077 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11003932740009281844', 'uuid-lslong': '11459830432156154747'}, 'enable': 'true', 'created': '2026-04-27T03:43:28', 'last-modified': '2026-04-27T03:43:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.895706'} 2026-04-27 03:43:30,086 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 03:43:30,086 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-85439152 passed 2026-04-27 03:43:30,087 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-85439152 in API_Server ====== 2026-04-27 03:43:30,087 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:30,097 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:30,112 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:30,232 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/98b5d286-948b-4934-9f09-7f0faee0fb7b 2026-04-27 03:43:30,245 - DEBUG - =>VN ctest-mgmt_vn-85439152 has no policy to be verified 2026-04-27 03:43:30,245 - DEBUG - Verifying the vn in opserver 2026-04-27 03:43:30,245 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152 virtual network link through opserver 10.0.0.41 2026-04-27 03:43:30,245 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 03:43:30,565 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 03:43:30,643 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152?flat'} 2026-04-27 03:43:30,643 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152 virtual network link through opserver 10.0.0.249 2026-04-27 03:43:30,643 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 03:43:30,971 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 03:43:31,054 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152?flat'} 2026-04-27 03:43:31,054 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152 virtual network link through opserver 10.0.0.23 2026-04-27 03:43:31,054 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 03:43:31,388 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 03:43:31,484 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152?flat'} 2026-04-27 03:43:31,484 - INFO - Validated that VN default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-85439152 is found in opserver 2026-04-27 03:43:31,518 - DEBUG - Do not have enough data to verify VN in agent 2026-04-27 03:43:31,532 - DEBUG - VRF ids for VN ctest-mgmt_vn-85439152: {} 2026-04-27 03:43:31,904 - DEBUG - Response for create_network : {'network': {'id': '6137ccf9-cf22-4307-a89b-3ce7b8383ba9', 'name': 'ctest-left_vn-25719467', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'project_id': '4c26852c319e4675b9563246c0788ca9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-93054250', 'ctest-left_vn-25719467'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 03:43:32,238 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ba49b8f3-1f71-496b-afb0-6c58c157b216', 'name': '', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'network_id': '6137ccf9-cf22-4307-a89b-3ce7b8383ba9', 'ip_version': 4, 'cidr': '178.254.161.64/26', 'allocation_pools': [{'start': '178.254.161.66', 'end': '178.254.161.126'}], 'gateway_ip': '178.254.161.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '178.254.161.66', 'tags': [], 'project_id': '4c26852c319e4675b9563246c0788ca9'}} 2026-04-27 03:43:32,281 - INFO - Created VN ctest-left_vn-25719467 2026-04-27 03:43:32,296 - DEBUG - VN ctest-left_vn-25719467 UUID is 6137ccf9-cf22-4307-a89b-3ce7b8383ba9 2026-04-27 03:43:32,406 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:32,414 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:32,427 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:32,552 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/6137ccf9-cf22-4307-a89b-3ce7b8383ba9 2026-04-27 03:43:32,577 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/6137ccf9-cf22-4307-a89b-3ce7b8383ba9 2026-04-27 03:43:32,597 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/966222e8-4efb-4d46-a6e6-9dbd4f458afa 2026-04-27 03:43:32,610 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/966222e8-4efb-4d46-a6e6-9dbd4f458afa 2026-04-27 03:43:32,620 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/0de769a5-da22-4073-980d-1db0064bcadb 2026-04-27 03:43:32,629 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 03:43:32,630 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/6137ccf9-cf22-4307-a89b-3ce7b8383ba9 2026-04-27 03:43:32,643 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/966222e8-4efb-4d46-a6e6-9dbd4f458afa 2026-04-27 03:43:32,663 - INFO - Verified VN network id 18 for VN 6137ccf9-cf22-4307-a89b-3ce7b8383ba9 2026-04-27 03:43:32,664 - INFO - Verifications in API Server for VN ctest-left_vn-25719467 passed 2026-04-27 03:43:32,664 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/6137ccf9-cf22-4307-a89b-3ce7b8383ba9 2026-04-27 03:43:32,676 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/966222e8-4efb-4d46-a6e6-9dbd4f458afa 2026-04-27 03:43:32,687 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/966222e8-4efb-4d46-a6e6-9dbd4f458afa 2026-04-27 03:43:32,699 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/0de769a5-da22-4073-980d-1db0064bcadb 2026-04-27 03:43:32,719 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7005293118692147975', 'uuid-lslong': '12149371385687849897'}, 'enable': 'true', 'created': '2026-04-27T03:43:31', 'last-modified': '2026-04-27T03:43:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.566916'} 2026-04-27 03:43:32,733 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 03:43:32,741 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7005293118692147975', 'uuid-lslong': '12149371385687849897'}, 'enable': 'true', 'created': '2026-04-27T03:43:31', 'last-modified': '2026-04-27T03:43:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.590114'} 2026-04-27 03:43:32,749 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 03:43:32,760 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7005293118692147975', 'uuid-lslong': '12149371385687849897'}, 'enable': 'true', 'created': '2026-04-27T03:43:31', 'last-modified': '2026-04-27T03:43:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.605252'} 2026-04-27 03:43:32,769 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 03:43:32,769 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-25719467 passed 2026-04-27 03:43:32,769 - DEBUG - ====Verifying policy data for ctest-left_vn-25719467 in API_Server ====== 2026-04-27 03:43:32,769 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:32,778 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:32,793 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:32,916 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/6137ccf9-cf22-4307-a89b-3ce7b8383ba9 2026-04-27 03:43:32,928 - DEBUG - =>VN ctest-left_vn-25719467 has no policy to be verified 2026-04-27 03:43:32,929 - DEBUG - Verifying the vn in opserver 2026-04-27 03:43:32,929 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467 virtual network link through opserver 10.0.0.41 2026-04-27 03:43:32,929 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 03:43:33,042 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467?flat'} 2026-04-27 03:43:33,042 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467 virtual network link through opserver 10.0.0.249 2026-04-27 03:43:33,042 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 03:43:33,481 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467?flat'} 2026-04-27 03:43:33,481 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467 virtual network link through opserver 10.0.0.23 2026-04-27 03:43:33,481 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 03:43:33,887 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467?flat'} 2026-04-27 03:43:33,887 - INFO - Validated that VN default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-25719467 is found in opserver 2026-04-27 03:43:33,921 - DEBUG - Do not have enough data to verify VN in agent 2026-04-27 03:43:33,945 - DEBUG - VRF ids for VN ctest-left_vn-25719467: {} 2026-04-27 03:43:34,318 - DEBUG - Response for create_network : {'network': {'id': 'fb53e812-0e4d-4b8e-9229-940a083a4fb2', 'name': 'ctest-right_vn-52740847', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'project_id': '4c26852c319e4675b9563246c0788ca9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-93054250', 'ctest-right_vn-52740847'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 03:43:34,607 - DEBUG - Response for create_subnet : {'subnet': {'id': '3a3ac9c9-cd88-4d02-824c-ae9f4b07e048', 'name': '', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'network_id': 'fb53e812-0e4d-4b8e-9229-940a083a4fb2', 'ip_version': 4, 'cidr': '103.42.213.192/26', 'allocation_pools': [{'start': '103.42.213.194', 'end': '103.42.213.254'}], 'gateway_ip': '103.42.213.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '103.42.213.194', 'tags': [], 'project_id': '4c26852c319e4675b9563246c0788ca9'}} 2026-04-27 03:43:34,643 - INFO - Created VN ctest-right_vn-52740847 2026-04-27 03:43:34,659 - DEBUG - VN ctest-right_vn-52740847 UUID is fb53e812-0e4d-4b8e-9229-940a083a4fb2 2026-04-27 03:43:34,763 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:34,770 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:34,787 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:34,905 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fb53e812-0e4d-4b8e-9229-940a083a4fb2 2026-04-27 03:43:34,925 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fb53e812-0e4d-4b8e-9229-940a083a4fb2 2026-04-27 03:43:34,941 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/200d5d91-46f1-426a-a9de-aa892862c767 2026-04-27 03:43:34,955 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/200d5d91-46f1-426a-a9de-aa892862c767 2026-04-27 03:43:34,964 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/fad3164b-7d9f-4ad4-9cd5-c8e154dacde8 2026-04-27 03:43:34,977 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 03:43:34,978 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fb53e812-0e4d-4b8e-9229-940a083a4fb2 2026-04-27 03:43:34,993 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/200d5d91-46f1-426a-a9de-aa892862c767 2026-04-27 03:43:35,018 - INFO - Verified VN network id 19 for VN fb53e812-0e4d-4b8e-9229-940a083a4fb2 2026-04-27 03:43:35,018 - INFO - Verifications in API Server for VN ctest-right_vn-52740847 passed 2026-04-27 03:43:35,018 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fb53e812-0e4d-4b8e-9229-940a083a4fb2 2026-04-27 03:43:35,035 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/200d5d91-46f1-426a-a9de-aa892862c767 2026-04-27 03:43:35,047 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/200d5d91-46f1-426a-a9de-aa892862c767 2026-04-27 03:43:35,059 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/fad3164b-7d9f-4ad4-9cd5-c8e154dacde8 2026-04-27 03:43:35,080 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18110073690833898382', 'uuid-lslong': '10532111974391238578'}, 'enable': 'true', 'created': '2026-04-27T03:43:34', 'last-modified': '2026-04-27T03:43:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.571805'} 2026-04-27 03:43:35,089 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 03:43:35,098 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18110073690833898382', 'uuid-lslong': '10532111974391238578'}, 'enable': 'true', 'created': '2026-04-27T03:43:34', 'last-modified': '2026-04-27T03:43:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.589666'} 2026-04-27 03:43:35,107 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 03:43:35,115 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18110073690833898382', 'uuid-lslong': '10532111974391238578'}, 'enable': 'true', 'created': '2026-04-27T03:43:34', 'last-modified': '2026-04-27T03:43:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.609131'} 2026-04-27 03:43:35,124 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 03:43:35,124 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-52740847 passed 2026-04-27 03:43:35,124 - DEBUG - ====Verifying policy data for ctest-right_vn-52740847 in API_Server ====== 2026-04-27 03:43:35,124 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:35,138 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:35,156 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:35,268 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fb53e812-0e4d-4b8e-9229-940a083a4fb2 2026-04-27 03:43:35,284 - DEBUG - =>VN ctest-right_vn-52740847 has no policy to be verified 2026-04-27 03:43:35,284 - DEBUG - Verifying the vn in opserver 2026-04-27 03:43:35,284 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847 virtual network link through opserver 10.0.0.41 2026-04-27 03:43:35,284 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 03:43:35,370 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847?flat'} 2026-04-27 03:43:35,370 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847 virtual network link through opserver 10.0.0.249 2026-04-27 03:43:35,370 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 03:43:35,388 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847?flat'} 2026-04-27 03:43:35,388 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847 virtual network link through opserver 10.0.0.23 2026-04-27 03:43:35,388 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 03:43:35,409 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847?flat'} 2026-04-27 03:43:35,409 - INFO - Validated that VN default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-52740847 is found in opserver 2026-04-27 03:43:35,434 - DEBUG - Do not have enough data to verify VN in agent 2026-04-27 03:43:35,448 - DEBUG - VRF ids for VN ctest-right_vn-52740847: {} 2026-04-27 03:43:35,727 - DEBUG - Services list from nova: [, , , ] 2026-04-27 03:43:37,092 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5690-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5690-1) 2026-04-27 03:43:38,804 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5690-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5690-2) 2026-04-27 03:43:38,804 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-50586058'] 2026-04-27 03:43:39,135 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-50586058'] created succesfully 2026-04-27 03:43:39,749 - DEBUG - Image by name tiny_nat_fw not found 2026-04-27 03:43:39,749 - DEBUG - Installing image tiny_nat_fw 2026-04-27 03:43:39,749 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-04-27 03:43:39,749 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-04-27 03:43:39,749 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-04-27 03:43:39,750 - DEBUG - Unzip image 2026-04-27 03:43:39,750 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-04-27 03:43:39,775 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2026-04-27 03:43:39,776 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-50586058'] 2026-04-27 03:43:39,915 - INFO - Service template: ['default-domain', 'ctest-service_template_1-50586058'] deleted successfully. 2026-04-27 03:43:39,915 - INFO - Skip interface_detach for VM ctest-right_vm-07199987 in state BUILD 2026-04-27 03:43:39,915 - INFO - Deleting VM ctest-right_vm-07199987 2026-04-27 03:43:39,965 - ERROR - VM ctest-right_vm-07199987 has failed to come up 2026-04-27 03:43:39,966 - ERROR - Nova failed to get host of the VM 2026-04-27 03:43:39,966 - ERROR - VM ctest-right_vm-07199987 has failed to come up 2026-04-27 03:43:39,966 - ERROR - Nova failed to get host of the VM 2026-04-27 03:43:40,078 - INFO - Skip interface_detach for VM ctest-left_vm-89191723 in state BUILD 2026-04-27 03:43:40,078 - INFO - Deleting VM ctest-left_vm-89191723 2026-04-27 03:43:40,078 - ERROR - VM ctest-left_vm-89191723 has failed to come up 2026-04-27 03:43:40,078 - ERROR - Nova failed to get host of the VM 2026-04-27 03:43:40,078 - ERROR - VM ctest-left_vm-89191723 has failed to come up 2026-04-27 03:43:40,078 - ERROR - Nova failed to get host of the VM 2026-04-27 03:43:40,188 - INFO - Deleting VN ctest-right_vn-52740847 2026-04-27 03:43:40,264 - DEBUG - VN fb53e812-0e4d-4b8e-9229-940a083a4fb2 still in use: Unable to complete operation on network fb53e812-0e4d-4b8e-9229-940a083a4fb2. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-83e47ce9-2611-40ea-99d9-868f456f98c8'] 2026-04-27 03:43:40,264 - WARNING - Deleting VN ctest-right_vn-52740847 failed..Will retry 2026-04-27 03:43:42,520 - DEBUG - Response for deleting network () 2026-04-27 03:43:42,520 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/200d5d91-46f1-426a-a9de-aa892862c767 2026-04-27 03:43:42,529 - DEBUG - Response Code: 404 2026-04-27 03:43:42,529 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:42,539 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:42,576 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:42,706 - INFO - Validated that VN ctest-right_vn-52740847 is not found in API Server 2026-04-27 03:43:42,719 - DEBUG - VN ctest-right_vn-52740847 is not present in Agent 10.0.0.33 2026-04-27 03:43:42,734 - DEBUG - VN ctest-right_vn-52740847 is not present in Agent 10.0.0.65 2026-04-27 03:43:42,734 - INFO - Validated that VN ctest-right_vn-52740847 is not in any agent 2026-04-27 03:43:42,782 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-52740847 info 2026-04-27 03:43:42,782 - INFO - Deleting VN ctest-left_vn-25719467 2026-04-27 03:43:43,025 - DEBUG - Response for deleting network () 2026-04-27 03:43:43,025 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/966222e8-4efb-4d46-a6e6-9dbd4f458afa 2026-04-27 03:43:43,032 - DEBUG - Response Code: 404 2026-04-27 03:43:43,033 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:43,040 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:43,065 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:43,213 - INFO - Validated that VN ctest-left_vn-25719467 is not found in API Server 2026-04-27 03:43:43,227 - DEBUG - VN ctest-left_vn-25719467 is not present in Agent 10.0.0.33 2026-04-27 03:43:43,239 - DEBUG - VN ctest-left_vn-25719467 is not present in Agent 10.0.0.65 2026-04-27 03:43:43,239 - INFO - Validated that VN ctest-left_vn-25719467 is not in any agent 2026-04-27 03:43:43,289 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-25719467 info 2026-04-27 03:43:43,289 - INFO - Deleting VN ctest-mgmt_vn-85439152 2026-04-27 03:43:43,589 - DEBUG - Response for deleting network () 2026-04-27 03:43:43,589 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/45c1a76c-c76d-4fc2-9223-dc8dd3a85b25 2026-04-27 03:43:43,599 - DEBUG - Response Code: 404 2026-04-27 03:43:43,599 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:43,606 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:43,675 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:43,782 - INFO - Validated that VN ctest-mgmt_vn-85439152 is not found in API Server 2026-04-27 03:43:43,796 - DEBUG - VN ctest-mgmt_vn-85439152 is not present in Agent 10.0.0.33 2026-04-27 03:43:43,807 - DEBUG - VN ctest-mgmt_vn-85439152 is not present in Agent 10.0.0.65 2026-04-27 03:43:43,808 - INFO - Validated that VN ctest-mgmt_vn-85439152 is not in any agent 2026-04-27 03:43:43,852 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-85439152 info 2026-04-27 03:43:45,156 - DEBUG - No XMPP flaps were noticed during the test 2026-04-27 03:43:45,156 - INFO - 2026-04-27 03:43:45,156 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:19] 2026-04-27 03:43:45,156 - INFO - -------------------------------------------------------------------------------- 2026-04-27 03:43:45,159 - INFO - ================================================================================ 2026-04-27 03:43:45,159 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2026-04-27 03:43:46,469 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.65': {'10.20.0.25': '0', '10.20.0.18': '0'}} with 2026-04-27 03:43:46,470 - INFO - Initial checks done. Running the testcase now 2026-04-27 03:43:46,470 - INFO - 2026-04-27 03:43:46,794 - DEBUG - Response for create_network : {'network': {'id': '0e17be89-385c-48f4-a99c-ddff09cd11fe', 'name': 'ctest-mgmt_vn-46330215', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'project_id': '4c26852c319e4675b9563246c0788ca9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-93054250', 'ctest-mgmt_vn-46330215'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 03:43:47,117 - DEBUG - Response for create_subnet : {'subnet': {'id': '160e7d65-011a-480b-aba0-7d7401f8ab8f', 'name': '', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'network_id': '0e17be89-385c-48f4-a99c-ddff09cd11fe', 'ip_version': 4, 'cidr': '87.127.111.192/26', 'allocation_pools': [{'start': '87.127.111.194', 'end': '87.127.111.254'}], 'gateway_ip': '87.127.111.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '87.127.111.194', 'tags': [], 'project_id': '4c26852c319e4675b9563246c0788ca9'}} 2026-04-27 03:43:47,154 - INFO - Created VN ctest-mgmt_vn-46330215 2026-04-27 03:43:47,175 - DEBUG - VN ctest-mgmt_vn-46330215 UUID is 0e17be89-385c-48f4-a99c-ddff09cd11fe 2026-04-27 03:43:47,274 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:47,281 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:47,299 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:47,439 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0e17be89-385c-48f4-a99c-ddff09cd11fe 2026-04-27 03:43:47,458 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0e17be89-385c-48f4-a99c-ddff09cd11fe 2026-04-27 03:43:47,474 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/142dfa0a-cd47-4c40-a710-1afd2cd74655 2026-04-27 03:43:47,486 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/142dfa0a-cd47-4c40-a710-1afd2cd74655 2026-04-27 03:43:47,498 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/7ba01e7f-1eef-473b-809a-9860b2cee22a 2026-04-27 03:43:47,508 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 03:43:47,508 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0e17be89-385c-48f4-a99c-ddff09cd11fe 2026-04-27 03:43:47,521 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/142dfa0a-cd47-4c40-a710-1afd2cd74655 2026-04-27 03:43:47,544 - INFO - Verified VN network id 17 for VN 0e17be89-385c-48f4-a99c-ddff09cd11fe 2026-04-27 03:43:47,545 - INFO - Verifications in API Server for VN ctest-mgmt_vn-46330215 passed 2026-04-27 03:43:47,545 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0e17be89-385c-48f4-a99c-ddff09cd11fe 2026-04-27 03:43:47,556 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/142dfa0a-cd47-4c40-a710-1afd2cd74655 2026-04-27 03:43:47,565 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/142dfa0a-cd47-4c40-a710-1afd2cd74655 2026-04-27 03:43:47,576 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/7ba01e7f-1eef-473b-809a-9860b2cee22a 2026-04-27 03:43:47,592 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1015489737560705268', 'uuid-lslong': '12221887576227516926'}, 'enable': 'true', 'created': '2026-04-27T03:43:46', 'last-modified': '2026-04-27T03:43:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.549036'} 2026-04-27 03:43:47,600 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 03:43:47,610 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1015489737560705268', 'uuid-lslong': '12221887576227516926'}, 'enable': 'true', 'created': '2026-04-27T03:43:46', 'last-modified': '2026-04-27T03:43:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.566552'} 2026-04-27 03:43:47,618 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 03:43:47,626 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1015489737560705268', 'uuid-lslong': '12221887576227516926'}, 'enable': 'true', 'created': '2026-04-27T03:43:46', 'last-modified': '2026-04-27T03:43:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.588691'} 2026-04-27 03:43:47,637 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-27 03:43:47,637 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-46330215 passed 2026-04-27 03:43:47,637 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-46330215 in API_Server ====== 2026-04-27 03:43:47,637 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:47,651 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:47,675 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:47,790 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0e17be89-385c-48f4-a99c-ddff09cd11fe 2026-04-27 03:43:47,810 - DEBUG - =>VN ctest-mgmt_vn-46330215 has no policy to be verified 2026-04-27 03:43:47,810 - DEBUG - Verifying the vn in opserver 2026-04-27 03:43:47,811 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215 virtual network link through opserver 10.0.0.41 2026-04-27 03:43:47,811 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 03:43:47,827 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215?flat'} 2026-04-27 03:43:47,827 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215 virtual network link through opserver 10.0.0.249 2026-04-27 03:43:47,827 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 03:43:47,847 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215?flat'} 2026-04-27 03:43:47,847 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215 virtual network link through opserver 10.0.0.23 2026-04-27 03:43:47,847 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 03:43:47,866 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215?flat'} 2026-04-27 03:43:47,866 - INFO - Validated that VN default-domain:ctest-TestSvcHC-93054250:ctest-mgmt_vn-46330215 is found in opserver 2026-04-27 03:43:47,893 - DEBUG - Do not have enough data to verify VN in agent 2026-04-27 03:43:47,906 - DEBUG - VRF ids for VN ctest-mgmt_vn-46330215: {} 2026-04-27 03:43:48,262 - DEBUG - Response for create_network : {'network': {'id': '3a3ef6de-7be8-48e5-a11b-8e22dd01cd4a', 'name': 'ctest-left_vn-00374650', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'project_id': '4c26852c319e4675b9563246c0788ca9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-93054250', 'ctest-left_vn-00374650'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 03:43:48,591 - DEBUG - Response for create_subnet : {'subnet': {'id': '9b739c45-6eaf-450c-ba8a-01f5e8fc47fc', 'name': '', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'network_id': '3a3ef6de-7be8-48e5-a11b-8e22dd01cd4a', 'ip_version': 4, 'cidr': '139.253.67.0/26', 'allocation_pools': [{'start': '139.253.67.2', 'end': '139.253.67.62'}], 'gateway_ip': '139.253.67.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '139.253.67.2', 'tags': [], 'project_id': '4c26852c319e4675b9563246c0788ca9'}} 2026-04-27 03:43:48,618 - INFO - Created VN ctest-left_vn-00374650 2026-04-27 03:43:48,632 - DEBUG - VN ctest-left_vn-00374650 UUID is 3a3ef6de-7be8-48e5-a11b-8e22dd01cd4a 2026-04-27 03:43:48,733 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:48,741 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:48,755 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:48,871 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/3a3ef6de-7be8-48e5-a11b-8e22dd01cd4a 2026-04-27 03:43:48,887 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/3a3ef6de-7be8-48e5-a11b-8e22dd01cd4a 2026-04-27 03:43:48,900 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/173253d2-d584-42e6-b52f-e36ae157efcf 2026-04-27 03:43:48,912 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/173253d2-d584-42e6-b52f-e36ae157efcf 2026-04-27 03:43:48,921 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/8f36394e-1733-4433-be96-d025f85dc935 2026-04-27 03:43:48,930 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 03:43:48,930 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/3a3ef6de-7be8-48e5-a11b-8e22dd01cd4a 2026-04-27 03:43:48,943 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/173253d2-d584-42e6-b52f-e36ae157efcf 2026-04-27 03:43:48,973 - INFO - Verified VN network id 18 for VN 3a3ef6de-7be8-48e5-a11b-8e22dd01cd4a 2026-04-27 03:43:48,973 - INFO - Verifications in API Server for VN ctest-left_vn-00374650 passed 2026-04-27 03:43:48,974 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/3a3ef6de-7be8-48e5-a11b-8e22dd01cd4a 2026-04-27 03:43:48,986 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/173253d2-d584-42e6-b52f-e36ae157efcf 2026-04-27 03:43:48,996 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/173253d2-d584-42e6-b52f-e36ae157efcf 2026-04-27 03:43:49,005 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/8f36394e-1733-4433-be96-d025f85dc935 2026-04-27 03:43:49,020 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4197063338177874149', 'uuid-lslong': '11609028744865500490'}, 'enable': 'true', 'created': '2026-04-27T03:43:48', 'last-modified': '2026-04-27T03:43:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.518355'} 2026-04-27 03:43:49,027 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 03:43:49,036 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4197063338177874149', 'uuid-lslong': '11609028744865500490'}, 'enable': 'true', 'created': '2026-04-27T03:43:48', 'last-modified': '2026-04-27T03:43:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.527276'} 2026-04-27 03:43:49,045 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 03:43:49,053 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4197063338177874149', 'uuid-lslong': '11609028744865500490'}, 'enable': 'true', 'created': '2026-04-27T03:43:48', 'last-modified': '2026-04-27T03:43:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.551928'} 2026-04-27 03:43:49,061 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-27 03:43:49,062 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-00374650 passed 2026-04-27 03:43:49,062 - DEBUG - ====Verifying policy data for ctest-left_vn-00374650 in API_Server ====== 2026-04-27 03:43:49,062 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:49,070 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:49,084 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:49,199 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/3a3ef6de-7be8-48e5-a11b-8e22dd01cd4a 2026-04-27 03:43:49,210 - DEBUG - =>VN ctest-left_vn-00374650 has no policy to be verified 2026-04-27 03:43:49,210 - DEBUG - Verifying the vn in opserver 2026-04-27 03:43:49,210 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650 virtual network link through opserver 10.0.0.41 2026-04-27 03:43:49,210 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 03:43:49,228 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650?flat'} 2026-04-27 03:43:49,228 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650 virtual network link through opserver 10.0.0.249 2026-04-27 03:43:49,228 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 03:43:49,308 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650?flat'} 2026-04-27 03:43:49,309 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650 virtual network link through opserver 10.0.0.23 2026-04-27 03:43:49,309 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 03:43:49,387 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650?flat'} 2026-04-27 03:43:49,387 - INFO - Validated that VN default-domain:ctest-TestSvcHC-93054250:ctest-left_vn-00374650 is found in opserver 2026-04-27 03:43:49,412 - DEBUG - Do not have enough data to verify VN in agent 2026-04-27 03:43:49,424 - DEBUG - VRF ids for VN ctest-left_vn-00374650: {} 2026-04-27 03:43:49,845 - DEBUG - Response for create_network : {'network': {'id': '0fa8cd82-6f1a-4114-a256-8bb13f1209d1', 'name': 'ctest-right_vn-20658587', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'project_id': '4c26852c319e4675b9563246c0788ca9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-93054250', 'ctest-right_vn-20658587'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 03:43:50,179 - DEBUG - Response for create_subnet : {'subnet': {'id': '51aad992-20d3-4eab-b589-f70a22c089c6', 'name': '', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'network_id': '0fa8cd82-6f1a-4114-a256-8bb13f1209d1', 'ip_version': 4, 'cidr': '188.158.242.64/26', 'allocation_pools': [{'start': '188.158.242.66', 'end': '188.158.242.126'}], 'gateway_ip': '188.158.242.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '188.158.242.66', 'tags': [], 'project_id': '4c26852c319e4675b9563246c0788ca9'}} 2026-04-27 03:43:50,206 - INFO - Created VN ctest-right_vn-20658587 2026-04-27 03:43:50,229 - DEBUG - VN ctest-right_vn-20658587 UUID is 0fa8cd82-6f1a-4114-a256-8bb13f1209d1 2026-04-27 03:43:50,340 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:50,351 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:50,378 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:50,571 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0fa8cd82-6f1a-4114-a256-8bb13f1209d1 2026-04-27 03:43:50,644 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0fa8cd82-6f1a-4114-a256-8bb13f1209d1 2026-04-27 03:43:50,683 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4b013b78-643e-4980-92b2-64a79a84d416 2026-04-27 03:43:50,704 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4b013b78-643e-4980-92b2-64a79a84d416 2026-04-27 03:43:50,827 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/0e9c3961-58e9-42cc-8382-7938fce2c6fb 2026-04-27 03:43:50,895 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 03:43:50,895 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0fa8cd82-6f1a-4114-a256-8bb13f1209d1 2026-04-27 03:43:50,935 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4b013b78-643e-4980-92b2-64a79a84d416 2026-04-27 03:43:50,983 - INFO - Verified VN network id 19 for VN 0fa8cd82-6f1a-4114-a256-8bb13f1209d1 2026-04-27 03:43:50,986 - INFO - Verifications in API Server for VN ctest-right_vn-20658587 passed 2026-04-27 03:43:50,986 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0fa8cd82-6f1a-4114-a256-8bb13f1209d1 2026-04-27 03:43:51,028 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4b013b78-643e-4980-92b2-64a79a84d416 2026-04-27 03:43:51,055 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4b013b78-643e-4980-92b2-64a79a84d416 2026-04-27 03:43:51,081 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/0e9c3961-58e9-42cc-8382-7938fce2c6fb 2026-04-27 03:43:51,109 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1128377666749743380', 'uuid-lslong': '11697690675525061073'}, 'enable': 'true', 'created': '2026-04-27T03:43:49', 'last-modified': '2026-04-27T03:43:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.028196'} 2026-04-27 03:43:51,119 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 03:43:51,126 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1128377666749743380', 'uuid-lslong': '11697690675525061073'}, 'enable': 'true', 'created': '2026-04-27T03:43:49', 'last-modified': '2026-04-27T03:43:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.045213'} 2026-04-27 03:43:51,135 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 03:43:51,154 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1128377666749743380', 'uuid-lslong': '11697690675525061073'}, 'enable': 'true', 'created': '2026-04-27T03:43:49', 'last-modified': '2026-04-27T03:43:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.083281'} 2026-04-27 03:43:51,165 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-27 03:43:51,165 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-20658587 passed 2026-04-27 03:43:51,165 - DEBUG - ====Verifying policy data for ctest-right_vn-20658587 in API_Server ====== 2026-04-27 03:43:51,165 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:51,174 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:51,199 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:51,327 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0fa8cd82-6f1a-4114-a256-8bb13f1209d1 2026-04-27 03:43:51,344 - DEBUG - =>VN ctest-right_vn-20658587 has no policy to be verified 2026-04-27 03:43:51,344 - DEBUG - Verifying the vn in opserver 2026-04-27 03:43:51,344 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587 virtual network link through opserver 10.0.0.41 2026-04-27 03:43:51,344 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 03:43:51,360 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587?flat'} 2026-04-27 03:43:51,360 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587 virtual network link through opserver 10.0.0.249 2026-04-27 03:43:51,360 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 03:43:51,379 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587?flat'} 2026-04-27 03:43:51,379 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587 virtual network link through opserver 10.0.0.23 2026-04-27 03:43:51,379 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 03:43:51,397 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587?flat'} 2026-04-27 03:43:51,397 - INFO - Validated that VN default-domain:ctest-TestSvcHC-93054250:ctest-right_vn-20658587 is found in opserver 2026-04-27 03:43:51,429 - DEBUG - Do not have enough data to verify VN in agent 2026-04-27 03:43:51,456 - DEBUG - VRF ids for VN ctest-right_vn-20658587: {} 2026-04-27 03:43:51,891 - DEBUG - Response for create_network : {'network': {'id': 'c7b2d781-4278-4dd0-a9ae-91c03640e5ec', 'name': 'ctest-trans_left_vn-04511148', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'project_id': '4c26852c319e4675b9563246c0788ca9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-93054250', 'ctest-trans_left_vn-04511148'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 03:43:52,199 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b8dbc60a-4d44-4e96-9b3c-0a4efd899561', 'name': '', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'network_id': 'c7b2d781-4278-4dd0-a9ae-91c03640e5ec', 'ip_version': 4, 'cidr': '175.206.100.0/26', 'allocation_pools': [{'start': '175.206.100.2', 'end': '175.206.100.62'}], 'gateway_ip': '175.206.100.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '175.206.100.2', 'tags': [], 'project_id': '4c26852c319e4675b9563246c0788ca9'}} 2026-04-27 03:43:52,228 - INFO - Created VN ctest-trans_left_vn-04511148 2026-04-27 03:43:52,249 - DEBUG - VN ctest-trans_left_vn-04511148 UUID is c7b2d781-4278-4dd0-a9ae-91c03640e5ec 2026-04-27 03:43:52,370 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:52,377 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:52,396 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:52,524 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c7b2d781-4278-4dd0-a9ae-91c03640e5ec 2026-04-27 03:43:52,541 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c7b2d781-4278-4dd0-a9ae-91c03640e5ec 2026-04-27 03:43:52,553 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/84d20435-7626-411e-a3fd-9954f6e1848a 2026-04-27 03:43:52,565 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/84d20435-7626-411e-a3fd-9954f6e1848a 2026-04-27 03:43:52,576 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4d17c2d2-c487-4fd8-8af2-3832a37be999 2026-04-27 03:43:52,587 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-27 03:43:52,588 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c7b2d781-4278-4dd0-a9ae-91c03640e5ec 2026-04-27 03:43:52,607 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/84d20435-7626-411e-a3fd-9954f6e1848a 2026-04-27 03:43:52,636 - INFO - Verified VN network id 20 for VN c7b2d781-4278-4dd0-a9ae-91c03640e5ec 2026-04-27 03:43:52,636 - INFO - Verifications in API Server for VN ctest-trans_left_vn-04511148 passed 2026-04-27 03:43:52,637 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c7b2d781-4278-4dd0-a9ae-91c03640e5ec 2026-04-27 03:43:52,655 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/84d20435-7626-411e-a3fd-9954f6e1848a 2026-04-27 03:43:52,671 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/84d20435-7626-411e-a3fd-9954f6e1848a 2026-04-27 03:43:52,683 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4d17c2d2-c487-4fd8-8af2-3832a37be999 2026-04-27 03:43:52,707 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14389800709568089552', 'uuid-lslong': '12226870293087446508'}, 'enable': 'true', 'created': '2026-04-27T03:43:51', 'last-modified': '2026-04-27T03:43:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.607383'} 2026-04-27 03:43:52,718 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-27 03:43:52,724 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14389800709568089552', 'uuid-lslong': '12226870293087446508'}, 'enable': 'true', 'created': '2026-04-27T03:43:51', 'last-modified': '2026-04-27T03:43:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.613987'} 2026-04-27 03:43:52,733 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-27 03:43:52,740 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14389800709568089552', 'uuid-lslong': '12226870293087446508'}, 'enable': 'true', 'created': '2026-04-27T03:43:51', 'last-modified': '2026-04-27T03:43:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.641187'} 2026-04-27 03:43:52,750 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-27 03:43:52,750 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-04511148 passed 2026-04-27 03:43:52,750 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-04511148 in API_Server ====== 2026-04-27 03:43:52,750 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:52,759 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:52,777 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:52,898 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c7b2d781-4278-4dd0-a9ae-91c03640e5ec 2026-04-27 03:43:52,918 - DEBUG - =>VN ctest-trans_left_vn-04511148 has no policy to be verified 2026-04-27 03:43:52,918 - DEBUG - Verifying the vn in opserver 2026-04-27 03:43:52,918 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148 virtual network link through opserver 10.0.0.41 2026-04-27 03:43:52,918 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 03:43:52,935 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148?flat'} 2026-04-27 03:43:52,935 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148 virtual network link through opserver 10.0.0.249 2026-04-27 03:43:52,935 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 03:43:52,958 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148?flat'} 2026-04-27 03:43:52,958 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148 virtual network link through opserver 10.0.0.23 2026-04-27 03:43:52,958 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 03:43:52,979 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148?flat'} 2026-04-27 03:43:52,979 - INFO - Validated that VN default-domain:ctest-TestSvcHC-93054250:ctest-trans_left_vn-04511148 is found in opserver 2026-04-27 03:43:53,005 - DEBUG - Do not have enough data to verify VN in agent 2026-04-27 03:43:53,017 - DEBUG - VRF ids for VN ctest-trans_left_vn-04511148: {} 2026-04-27 03:43:53,394 - DEBUG - Response for create_network : {'network': {'id': '7a4cad90-6425-423e-8d14-8cf0b9c5b5b9', 'name': 'ctest-trans_right_vn-47010188', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'project_id': '4c26852c319e4675b9563246c0788ca9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-93054250', 'ctest-trans_right_vn-47010188'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 03:43:53,692 - DEBUG - Response for create_subnet : {'subnet': {'id': '69bd6ba4-9f03-4b67-9642-9f818e45f773', 'name': '', 'tenant_id': '4c26852c319e4675b9563246c0788ca9', 'network_id': '7a4cad90-6425-423e-8d14-8cf0b9c5b5b9', 'ip_version': 4, 'cidr': '181.64.21.64/26', 'allocation_pools': [{'start': '181.64.21.66', 'end': '181.64.21.126'}], 'gateway_ip': '181.64.21.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '181.64.21.66', 'tags': [], 'project_id': '4c26852c319e4675b9563246c0788ca9'}} 2026-04-27 03:43:53,731 - INFO - Created VN ctest-trans_right_vn-47010188 2026-04-27 03:43:53,752 - DEBUG - VN ctest-trans_right_vn-47010188 UUID is 7a4cad90-6425-423e-8d14-8cf0b9c5b5b9 2026-04-27 03:43:53,881 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:53,891 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:53,924 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:54,054 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/7a4cad90-6425-423e-8d14-8cf0b9c5b5b9 2026-04-27 03:43:54,081 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/7a4cad90-6425-423e-8d14-8cf0b9c5b5b9 2026-04-27 03:43:54,096 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cd99c953-76a9-45ff-861b-3d604f0a40c8 2026-04-27 03:43:54,122 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cd99c953-76a9-45ff-861b-3d604f0a40c8 2026-04-27 03:43:54,141 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/e5b9be2d-096a-4f0c-830f-f3c5dc7b0984 2026-04-27 03:43:54,152 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-27 03:43:54,152 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/7a4cad90-6425-423e-8d14-8cf0b9c5b5b9 2026-04-27 03:43:54,163 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cd99c953-76a9-45ff-861b-3d604f0a40c8 2026-04-27 03:43:54,198 - INFO - Verified VN network id 21 for VN 7a4cad90-6425-423e-8d14-8cf0b9c5b5b9 2026-04-27 03:43:54,198 - INFO - Verifications in API Server for VN ctest-trans_right_vn-47010188 passed 2026-04-27 03:43:54,198 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/7a4cad90-6425-423e-8d14-8cf0b9c5b5b9 2026-04-27 03:43:54,214 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cd99c953-76a9-45ff-861b-3d604f0a40c8 2026-04-27 03:43:54,226 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cd99c953-76a9-45ff-861b-3d604f0a40c8 2026-04-27 03:43:54,234 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/e5b9be2d-096a-4f0c-830f-f3c5dc7b0984 2026-04-27 03:43:54,255 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8812609406524277310', 'uuid-lslong': '10165905224418833849'}, 'enable': 'true', 'created': '2026-04-27T03:43:53', 'last-modified': '2026-04-27T03:43:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.658232'} 2026-04-27 03:43:54,266 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-27 03:43:54,282 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8812609406524277310', 'uuid-lslong': '10165905224418833849'}, 'enable': 'true', 'created': '2026-04-27T03:43:53', 'last-modified': '2026-04-27T03:43:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.684447'} 2026-04-27 03:43:54,296 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-27 03:43:54,307 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-93054250', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8812609406524277310', 'uuid-lslong': '10165905224418833849'}, 'enable': 'true', 'created': '2026-04-27T03:43:53', 'last-modified': '2026-04-27T03:43:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.714161'} 2026-04-27 03:43:54,318 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-27 03:43:54,318 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-47010188 passed 2026-04-27 03:43:54,319 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-47010188 in API_Server ====== 2026-04-27 03:43:54,319 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:54,330 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:54,350 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:54,506 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/7a4cad90-6425-423e-8d14-8cf0b9c5b5b9 2026-04-27 03:43:54,527 - DEBUG - =>VN ctest-trans_right_vn-47010188 has no policy to be verified 2026-04-27 03:43:54,527 - DEBUG - Verifying the vn in opserver 2026-04-27 03:43:54,527 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188 virtual network link through opserver 10.0.0.41 2026-04-27 03:43:54,527 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2026-04-27 03:43:54,544 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188?flat'} 2026-04-27 03:43:54,544 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188 virtual network link through opserver 10.0.0.249 2026-04-27 03:43:54,544 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-04-27 03:43:54,564 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188?flat'} 2026-04-27 03:43:54,564 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188 virtual network link through opserver 10.0.0.23 2026-04-27 03:43:54,564 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-27 03:43:54,589 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188?flat'} 2026-04-27 03:43:54,589 - INFO - Validated that VN default-domain:ctest-TestSvcHC-93054250:ctest-trans_right_vn-47010188 is found in opserver 2026-04-27 03:43:54,621 - DEBUG - Do not have enough data to verify VN in agent 2026-04-27 03:43:54,636 - DEBUG - VRF ids for VN ctest-trans_right_vn-47010188: {} 2026-04-27 03:43:56,191 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5690-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5690-2) 2026-04-27 03:43:58,054 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5690-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5690-1) 2026-04-27 03:43:58,055 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-36309323'] 2026-04-27 03:43:58,423 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-36309323'] created succesfully 2026-04-27 03:43:58,988 - DEBUG - Image by name tiny_trans_fw not found 2026-04-27 03:43:58,988 - DEBUG - Installing image tiny_trans_fw 2026-04-27 03:43:58,988 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-04-27 03:43:58,988 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-04-27 03:43:58,988 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-04-27 03:43:58,988 - DEBUG - Unzip image 2026-04-27 03:43:58,988 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-04-27 03:43:59,068 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2026-04-27 03:43:59,070 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-36309323'] 2026-04-27 03:43:59,231 - INFO - Service template: ['default-domain', 'ctest-service_template_1-36309323'] deleted successfully. 2026-04-27 03:43:59,231 - INFO - Skip interface_detach for VM ctest-right_vm-51765701 in state BUILD 2026-04-27 03:43:59,231 - INFO - Deleting VM ctest-right_vm-51765701 2026-04-27 03:43:59,231 - ERROR - VM ctest-right_vm-51765701 has failed to come up 2026-04-27 03:43:59,231 - ERROR - Nova failed to get host of the VM 2026-04-27 03:43:59,231 - ERROR - VM ctest-right_vm-51765701 has failed to come up 2026-04-27 03:43:59,231 - ERROR - Nova failed to get host of the VM 2026-04-27 03:43:59,353 - INFO - Skip interface_detach for VM ctest-left_vm-47700198 in state BUILD 2026-04-27 03:43:59,353 - INFO - Deleting VM ctest-left_vm-47700198 2026-04-27 03:43:59,353 - ERROR - VM ctest-left_vm-47700198 has failed to come up 2026-04-27 03:43:59,353 - ERROR - Nova failed to get host of the VM 2026-04-27 03:43:59,354 - ERROR - VM ctest-left_vm-47700198 has failed to come up 2026-04-27 03:43:59,354 - ERROR - Nova failed to get host of the VM 2026-04-27 03:43:59,488 - INFO - Deleting VN ctest-trans_right_vn-47010188 2026-04-27 03:43:59,763 - DEBUG - Response for deleting network () 2026-04-27 03:43:59,763 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cd99c953-76a9-45ff-861b-3d604f0a40c8 2026-04-27 03:43:59,773 - DEBUG - Response Code: 404 2026-04-27 03:43:59,773 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:43:59,791 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:43:59,844 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:43:59,944 - INFO - Validated that VN ctest-trans_right_vn-47010188 is not found in API Server 2026-04-27 03:43:59,963 - DEBUG - VN ctest-trans_right_vn-47010188 is not present in Agent 10.0.0.33 2026-04-27 03:43:59,983 - DEBUG - VN ctest-trans_right_vn-47010188 is not present in Agent 10.0.0.65 2026-04-27 03:43:59,983 - INFO - Validated that VN ctest-trans_right_vn-47010188 is not in any agent 2026-04-27 03:44:00,043 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-47010188 info 2026-04-27 03:44:00,044 - INFO - Deleting VN ctest-trans_left_vn-04511148 2026-04-27 03:44:00,294 - DEBUG - Response for deleting network () 2026-04-27 03:44:00,295 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/84d20435-7626-411e-a3fd-9954f6e1848a 2026-04-27 03:44:00,304 - DEBUG - Response Code: 404 2026-04-27 03:44:00,305 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:44:00,313 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:44:00,328 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:44:00,456 - INFO - Validated that VN ctest-trans_left_vn-04511148 is not found in API Server 2026-04-27 03:44:00,481 - DEBUG - VN ctest-trans_left_vn-04511148 is not present in Agent 10.0.0.33 2026-04-27 03:44:00,503 - DEBUG - VN ctest-trans_left_vn-04511148 is not present in Agent 10.0.0.65 2026-04-27 03:44:00,503 - INFO - Validated that VN ctest-trans_left_vn-04511148 is not in any agent 2026-04-27 03:44:00,574 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-04511148 info 2026-04-27 03:44:00,575 - INFO - Deleting VN ctest-right_vn-20658587 2026-04-27 03:44:00,679 - DEBUG - VN 0fa8cd82-6f1a-4114-a256-8bb13f1209d1 still in use: Unable to complete operation on network 0fa8cd82-6f1a-4114-a256-8bb13f1209d1. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-49c337f8-96a4-4e83-806c-415f4b1a7de5'] 2026-04-27 03:44:00,679 - WARNING - Deleting VN ctest-right_vn-20658587 failed..Will retry 2026-04-27 03:44:02,939 - DEBUG - Response for deleting network () 2026-04-27 03:44:02,939 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4b013b78-643e-4980-92b2-64a79a84d416 2026-04-27 03:44:02,946 - DEBUG - Response Code: 404 2026-04-27 03:44:02,947 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:44:02,954 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:44:02,969 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:44:03,084 - INFO - Validated that VN ctest-right_vn-20658587 is not found in API Server 2026-04-27 03:44:03,100 - DEBUG - VN ctest-right_vn-20658587 is not present in Agent 10.0.0.33 2026-04-27 03:44:03,113 - DEBUG - VN ctest-right_vn-20658587 is not present in Agent 10.0.0.65 2026-04-27 03:44:03,114 - INFO - Validated that VN ctest-right_vn-20658587 is not in any agent 2026-04-27 03:44:03,160 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-20658587 info 2026-04-27 03:44:03,160 - INFO - Deleting VN ctest-left_vn-00374650 2026-04-27 03:44:03,383 - DEBUG - Response for deleting network () 2026-04-27 03:44:03,383 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/173253d2-d584-42e6-b52f-e36ae157efcf 2026-04-27 03:44:03,393 - DEBUG - Response Code: 404 2026-04-27 03:44:03,394 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:44:03,401 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:44:03,426 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:44:03,549 - INFO - Validated that VN ctest-left_vn-00374650 is not found in API Server 2026-04-27 03:44:03,564 - DEBUG - VN ctest-left_vn-00374650 is not present in Agent 10.0.0.33 2026-04-27 03:44:03,576 - DEBUG - VN ctest-left_vn-00374650 is not present in Agent 10.0.0.65 2026-04-27 03:44:03,576 - INFO - Validated that VN ctest-left_vn-00374650 is not in any agent 2026-04-27 03:44:03,620 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-00374650 info 2026-04-27 03:44:03,620 - INFO - Deleting VN ctest-mgmt_vn-46330215 2026-04-27 03:44:03,849 - DEBUG - Response for deleting network () 2026-04-27 03:44:03,849 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/142dfa0a-cd47-4c40-a710-1afd2cd74655 2026-04-27 03:44:03,856 - DEBUG - Response Code: 404 2026-04-27 03:44:03,856 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2026-04-27 03:44:03,866 - DEBUG - Requesting: http://10.0.0.41:8082/domain/3cfd3207-f874-4fca-b30c-5a5349ff35bf 2026-04-27 03:44:03,921 - DEBUG - Requesting: http://10.0.0.41:8082/project/4c26852c-319e-4675-b956-3246c0788ca9 2026-04-27 03:44:04,028 - INFO - Validated that VN ctest-mgmt_vn-46330215 is not found in API Server 2026-04-27 03:44:04,042 - DEBUG - VN ctest-mgmt_vn-46330215 is not present in Agent 10.0.0.33 2026-04-27 03:44:04,058 - DEBUG - VN ctest-mgmt_vn-46330215 is not present in Agent 10.0.0.65 2026-04-27 03:44:04,058 - INFO - Validated that VN ctest-mgmt_vn-46330215 is not in any agent 2026-04-27 03:44:04,104 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-46330215 info 2026-04-27 03:44:05,402 - DEBUG - No XMPP flaps were noticed during the test 2026-04-27 03:44:05,402 - INFO - 2026-04-27 03:44:05,402 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:20] 2026-04-27 03:44:05,402 - INFO - -------------------------------------------------------------------------------- 2026-04-27 03:44:06,296 - INFO - Deleted project: ctest-TestSvcHC-93054250, ID : 4c26852c-319e-4675-b956-3246c0788ca9