2025-10-06 02:44:44,259 - INFO - Domain Default found not creating 2025-10-06 02:44:44,401 - INFO - Project ctest-TestSvcHC-43015574 not found, creating it 2025-10-06 02:44:44,921 - INFO - Created Project:ctest-TestSvcHC-43015574, ID : b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:44:46,457 - INFO - ================================================================================ 2025-10-06 02:44:46,457 - INFO - STARTING TEST : test_svc_hc_basic 2025-10-06 02:44:47,706 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.193': '0', '10.20.0.25': '0'}, '10.0.0.19': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2025-10-06 02:44:47,706 - INFO - Initial checks done. Running the testcase now 2025-10-06 02:44:47,706 - INFO - 2025-10-06 02:44:48,367 - DEBUG - Response for create_network : {'network': {'id': '46b7b70c-1032-46ad-b993-d0d42b43b1bc', 'name': 'ctest-mgmt_vn-19696982', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'project_id': 'b60c48469db348c49b173a841a574943', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-43015574', 'ctest-mgmt_vn-19696982'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:44:48,667 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f3fee112-6d81-49b8-84f5-419b36af8c49', 'name': '', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'network_id': '46b7b70c-1032-46ad-b993-d0d42b43b1bc', 'ip_version': 4, 'cidr': '85.213.84.128/26', 'allocation_pools': [{'start': '85.213.84.130', 'end': '85.213.84.190'}], 'gateway_ip': '85.213.84.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '85.213.84.130', 'tags': [], 'project_id': 'b60c48469db348c49b173a841a574943'}} 2025-10-06 02:44:48,694 - INFO - Created VN ctest-mgmt_vn-19696982 2025-10-06 02:44:48,706 - DEBUG - VN ctest-mgmt_vn-19696982 UUID is 46b7b70c-1032-46ad-b993-d0d42b43b1bc 2025-10-06 02:44:48,774 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:44:49,070 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:44:49,099 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:44:49,116 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:44:49,210 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46b7b70c-1032-46ad-b993-d0d42b43b1bc 2025-10-06 02:44:49,220 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46b7b70c-1032-46ad-b993-d0d42b43b1bc 2025-10-06 02:44:49,229 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/3828350c-5ba0-4d92-b4a3-d3d240714219 2025-10-06 02:44:49,238 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/3828350c-5ba0-4d92-b4a3-d3d240714219 2025-10-06 02:44:49,246 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/fdfb4009-ca3e-4003-b38a-75dca2573eb8 2025-10-06 02:44:49,252 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:44:49,252 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46b7b70c-1032-46ad-b993-d0d42b43b1bc 2025-10-06 02:44:49,262 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/3828350c-5ba0-4d92-b4a3-d3d240714219 2025-10-06 02:44:49,279 - INFO - Verified VN network id 10 for VN 46b7b70c-1032-46ad-b993-d0d42b43b1bc 2025-10-06 02:44:49,279 - INFO - Verifications in API Server for VN ctest-mgmt_vn-19696982 passed 2025-10-06 02:44:49,279 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46b7b70c-1032-46ad-b993-d0d42b43b1bc 2025-10-06 02:44:49,293 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/3828350c-5ba0-4d92-b4a3-d3d240714219 2025-10-06 02:44:49,301 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/3828350c-5ba0-4d92-b4a3-d3d240714219 2025-10-06 02:44:49,312 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/fdfb4009-ca3e-4003-b38a-75dca2573eb8 2025-10-06 02:44:49,324 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5095742765832226477', 'uuid-lslong': '13372261328270635452'}, 'enable': 'true', 'created': '2025-10-06T02:44:48', 'last-modified': '2025-10-06T02:44:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.708637'} 2025-10-06 02:44:49,329 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:44:49,334 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5095742765832226477', 'uuid-lslong': '13372261328270635452'}, 'enable': 'true', 'created': '2025-10-06T02:44:48', 'last-modified': '2025-10-06T02:44:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.714952'} 2025-10-06 02:44:49,338 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:44:49,344 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5095742765832226477', 'uuid-lslong': '13372261328270635452'}, 'enable': 'true', 'created': '2025-10-06T02:44:48', 'last-modified': '2025-10-06T02:44:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.725850'} 2025-10-06 02:44:49,350 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:44:49,350 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-19696982 passed 2025-10-06 02:44:49,350 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-19696982 in API_Server ====== 2025-10-06 02:44:49,350 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:44:49,356 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:44:49,369 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:44:49,454 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/46b7b70c-1032-46ad-b993-d0d42b43b1bc 2025-10-06 02:44:49,463 - DEBUG - =>VN ctest-mgmt_vn-19696982 has no policy to be verified 2025-10-06 02:44:49,463 - DEBUG - Verifying the vn in opserver 2025-10-06 02:44:49,463 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982 virtual network link through opserver 10.0.0.33 2025-10-06 02:44:49,463 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:44:49,755 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:44:49,803 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982?flat'} 2025-10-06 02:44:49,804 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982 virtual network link through opserver 10.0.0.38 2025-10-06 02:44:49,804 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:44:50,092 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:44:50,143 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982?flat'} 2025-10-06 02:44:50,143 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982 virtual network link through opserver 10.0.0.249 2025-10-06 02:44:50,143 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:44:50,433 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:44:50,484 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982?flat'} 2025-10-06 02:44:50,484 - INFO - Validated that VN default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-19696982 is found in opserver 2025-10-06 02:44:50,503 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:44:50,511 - DEBUG - VRF ids for VN ctest-mgmt_vn-19696982: {} 2025-10-06 02:44:50,763 - DEBUG - Response for create_network : {'network': {'id': '6c4bec25-c581-42c9-b882-f2fa55d91f22', 'name': 'ctest-left_vn-56168220', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'project_id': 'b60c48469db348c49b173a841a574943', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-43015574', 'ctest-left_vn-56168220'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:44:50,964 - DEBUG - Response for create_subnet : {'subnet': {'id': '56f9059e-1001-4222-835a-99df1100ae3f', 'name': '', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'network_id': '6c4bec25-c581-42c9-b882-f2fa55d91f22', 'ip_version': 4, 'cidr': '115.231.151.128/26', 'allocation_pools': [{'start': '115.231.151.130', 'end': '115.231.151.190'}], 'gateway_ip': '115.231.151.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '115.231.151.130', 'tags': [], 'project_id': 'b60c48469db348c49b173a841a574943'}} 2025-10-06 02:44:50,983 - INFO - Created VN ctest-left_vn-56168220 2025-10-06 02:44:50,996 - DEBUG - VN ctest-left_vn-56168220 UUID is 6c4bec25-c581-42c9-b882-f2fa55d91f22 2025-10-06 02:44:51,059 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:44:51,065 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:44:51,074 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:44:51,157 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/6c4bec25-c581-42c9-b882-f2fa55d91f22 2025-10-06 02:44:51,174 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/6c4bec25-c581-42c9-b882-f2fa55d91f22 2025-10-06 02:44:51,182 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/04e2c599-9c06-44ea-bef7-d27f57ba1cfd 2025-10-06 02:44:51,189 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/04e2c599-9c06-44ea-bef7-d27f57ba1cfd 2025-10-06 02:44:51,196 - DEBUG - Route Targets: [] 2025-10-06 02:44:51,196 - DEBUG - RT names not yet present for VN ctest-left_vn-56168220 2025-10-06 02:44:56,197 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:44:56,203 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:44:56,214 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:44:56,303 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/6c4bec25-c581-42c9-b882-f2fa55d91f22 2025-10-06 02:44:56,318 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/6c4bec25-c581-42c9-b882-f2fa55d91f22 2025-10-06 02:44:56,328 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/04e2c599-9c06-44ea-bef7-d27f57ba1cfd 2025-10-06 02:44:56,336 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/04e2c599-9c06-44ea-bef7-d27f57ba1cfd 2025-10-06 02:44:56,343 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/480adc82-2888-441e-a109-15207527db8a 2025-10-06 02:44:56,352 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:44:56,352 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/6c4bec25-c581-42c9-b882-f2fa55d91f22 2025-10-06 02:44:56,362 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/04e2c599-9c06-44ea-bef7-d27f57ba1cfd 2025-10-06 02:44:56,379 - INFO - Verified VN network id 11 for VN 6c4bec25-c581-42c9-b882-f2fa55d91f22 2025-10-06 02:44:56,379 - INFO - Verifications in API Server for VN ctest-left_vn-56168220 passed 2025-10-06 02:44:56,380 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/6c4bec25-c581-42c9-b882-f2fa55d91f22 2025-10-06 02:44:56,389 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/04e2c599-9c06-44ea-bef7-d27f57ba1cfd 2025-10-06 02:44:56,395 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/04e2c599-9c06-44ea-bef7-d27f57ba1cfd 2025-10-06 02:44:56,402 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/480adc82-2888-441e-a109-15207527db8a 2025-10-06 02:44:56,414 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7803590426321044169', 'uuid-lslong': '13295456206947163938'}, 'enable': 'true', 'created': '2025-10-06T02:44:50', 'last-modified': '2025-10-06T02:44:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.497899'} 2025-10-06 02:44:56,419 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:44:56,423 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7803590426321044169', 'uuid-lslong': '13295456206947163938'}, 'enable': 'true', 'created': '2025-10-06T02:44:50', 'last-modified': '2025-10-06T02:44:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.505668'} 2025-10-06 02:44:56,428 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:44:56,433 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7803590426321044169', 'uuid-lslong': '13295456206947163938'}, 'enable': 'true', 'created': '2025-10-06T02:44:50', 'last-modified': '2025-10-06T02:44:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.516489'} 2025-10-06 02:44:56,439 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:44:56,439 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-56168220 passed 2025-10-06 02:44:56,439 - DEBUG - ====Verifying policy data for ctest-left_vn-56168220 in API_Server ====== 2025-10-06 02:44:56,439 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:44:56,444 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:44:56,456 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:44:56,549 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/6c4bec25-c581-42c9-b882-f2fa55d91f22 2025-10-06 02:44:56,558 - DEBUG - =>VN ctest-left_vn-56168220 has no policy to be verified 2025-10-06 02:44:56,558 - DEBUG - Verifying the vn in opserver 2025-10-06 02:44:56,558 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220 virtual network link through opserver 10.0.0.33 2025-10-06 02:44:56,558 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:44:56,611 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220?flat'} 2025-10-06 02:44:56,611 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220 virtual network link through opserver 10.0.0.38 2025-10-06 02:44:56,611 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:44:56,663 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220?flat'} 2025-10-06 02:44:56,663 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220 virtual network link through opserver 10.0.0.249 2025-10-06 02:44:56,663 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:44:56,713 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220?flat'} 2025-10-06 02:44:56,713 - INFO - Validated that VN default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-56168220 is found in opserver 2025-10-06 02:44:56,733 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:44:56,741 - DEBUG - VRF ids for VN ctest-left_vn-56168220: {} 2025-10-06 02:44:57,017 - DEBUG - Response for create_network : {'network': {'id': 'ad47ea68-779d-40bf-98ed-199a06a7a9a8', 'name': 'ctest-right_vn-49268615', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'project_id': 'b60c48469db348c49b173a841a574943', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-43015574', 'ctest-right_vn-49268615'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:44:57,218 - DEBUG - Response for create_subnet : {'subnet': {'id': '8fe630e1-880a-4205-a037-7add0b67fd96', 'name': '', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'network_id': 'ad47ea68-779d-40bf-98ed-199a06a7a9a8', 'ip_version': 4, 'cidr': '173.10.220.64/26', 'allocation_pools': [{'start': '173.10.220.66', 'end': '173.10.220.126'}], 'gateway_ip': '173.10.220.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '173.10.220.66', 'tags': [], 'project_id': 'b60c48469db348c49b173a841a574943'}} 2025-10-06 02:44:57,241 - INFO - Created VN ctest-right_vn-49268615 2025-10-06 02:44:57,251 - DEBUG - VN ctest-right_vn-49268615 UUID is ad47ea68-779d-40bf-98ed-199a06a7a9a8 2025-10-06 02:44:57,316 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:44:57,322 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:44:57,332 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:44:57,421 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/ad47ea68-779d-40bf-98ed-199a06a7a9a8 2025-10-06 02:44:57,433 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/ad47ea68-779d-40bf-98ed-199a06a7a9a8 2025-10-06 02:44:57,441 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/2fd96413-9ee7-43f8-9f23-f273986fda4a 2025-10-06 02:44:57,449 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/2fd96413-9ee7-43f8-9f23-f273986fda4a 2025-10-06 02:44:57,454 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/cb72734a-e648-471b-b279-35cf7c3b3224 2025-10-06 02:44:57,461 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:44:57,461 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/ad47ea68-779d-40bf-98ed-199a06a7a9a8 2025-10-06 02:44:57,468 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/2fd96413-9ee7-43f8-9f23-f273986fda4a 2025-10-06 02:44:57,483 - INFO - Verified VN network id 12 for VN ad47ea68-779d-40bf-98ed-199a06a7a9a8 2025-10-06 02:44:57,483 - INFO - Verifications in API Server for VN ctest-right_vn-49268615 passed 2025-10-06 02:44:57,483 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/ad47ea68-779d-40bf-98ed-199a06a7a9a8 2025-10-06 02:44:57,491 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/2fd96413-9ee7-43f8-9f23-f273986fda4a 2025-10-06 02:44:57,498 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/2fd96413-9ee7-43f8-9f23-f273986fda4a 2025-10-06 02:44:57,504 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/cb72734a-e648-471b-b279-35cf7c3b3224 2025-10-06 02:44:57,517 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12486206226312282303', 'uuid-lslong': '11019492012572780968'}, 'enable': 'true', 'created': '2025-10-06T02:44:56', 'last-modified': '2025-10-06T02:44:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.349256'} 2025-10-06 02:44:57,523 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:44:57,527 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12486206226312282303', 'uuid-lslong': '11019492012572780968'}, 'enable': 'true', 'created': '2025-10-06T02:44:56', 'last-modified': '2025-10-06T02:44:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.360701'} 2025-10-06 02:44:57,532 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:44:57,537 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12486206226312282303', 'uuid-lslong': '11019492012572780968'}, 'enable': 'true', 'created': '2025-10-06T02:44:56', 'last-modified': '2025-10-06T02:44:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.372992'} 2025-10-06 02:44:57,542 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:44:57,542 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-49268615 passed 2025-10-06 02:44:57,543 - DEBUG - ====Verifying policy data for ctest-right_vn-49268615 in API_Server ====== 2025-10-06 02:44:57,543 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:44:57,548 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:44:57,557 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:44:57,664 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/ad47ea68-779d-40bf-98ed-199a06a7a9a8 2025-10-06 02:44:57,677 - DEBUG - =>VN ctest-right_vn-49268615 has no policy to be verified 2025-10-06 02:44:57,677 - DEBUG - Verifying the vn in opserver 2025-10-06 02:44:57,677 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615 virtual network link through opserver 10.0.0.33 2025-10-06 02:44:57,677 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:44:57,727 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615?flat'} 2025-10-06 02:44:57,727 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615 virtual network link through opserver 10.0.0.38 2025-10-06 02:44:57,727 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:44:57,780 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615?flat'} 2025-10-06 02:44:57,780 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615 virtual network link through opserver 10.0.0.249 2025-10-06 02:44:57,780 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:44:57,830 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615?flat'} 2025-10-06 02:44:57,830 - INFO - Validated that VN default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-49268615 is found in opserver 2025-10-06 02:44:57,850 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:44:57,859 - DEBUG - VRF ids for VN ctest-right_vn-49268615: {} 2025-10-06 02:44:57,908 - DEBUG - Services list from nova: [, , , ] 2025-10-06 02:44:58,879 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4219-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4219-1) 2025-10-06 02:45:00,151 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4219-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4219-2) 2025-10-06 02:45:00,152 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-46028612'] 2025-10-06 02:45:00,456 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-46028612'] created succesfully 2025-10-06 02:45:00,811 - DEBUG - Image by name tiny_nat_fw not found 2025-10-06 02:45:00,811 - DEBUG - Installing image tiny_nat_fw 2025-10-06 02:45:00,811 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-10-06 02:45:00,812 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-06 02:45:00,812 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-06 02:45:00,812 - DEBUG - Unzip image 2025-10-06 02:45:00,812 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-06 02:45:00,829 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-10-06 02:45:00,829 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-46028612'] 2025-10-06 02:45:00,946 - INFO - Service template: ['default-domain', 'ctest-service_template_1-46028612'] deleted successfully. 2025-10-06 02:45:00,946 - INFO - Skip interface_detach for VM ctest-right_vm-88158904 in state BUILD 2025-10-06 02:45:00,946 - INFO - Deleting VM ctest-right_vm-88158904 2025-10-06 02:45:00,980 - ERROR - VM ctest-right_vm-88158904 has failed to come up 2025-10-06 02:45:00,980 - ERROR - Nova failed to get host of the VM 2025-10-06 02:45:00,980 - ERROR - VM ctest-right_vm-88158904 has failed to come up 2025-10-06 02:45:00,980 - ERROR - Nova failed to get host of the VM 2025-10-06 02:45:01,076 - INFO - Skip interface_detach for VM ctest-left_vm-48833947 in state BUILD 2025-10-06 02:45:01,077 - INFO - Deleting VM ctest-left_vm-48833947 2025-10-06 02:45:01,077 - ERROR - VM ctest-left_vm-48833947 has failed to come up 2025-10-06 02:45:01,077 - ERROR - Nova failed to get host of the VM 2025-10-06 02:45:01,077 - ERROR - VM ctest-left_vm-48833947 has failed to come up 2025-10-06 02:45:01,077 - ERROR - Nova failed to get host of the VM 2025-10-06 02:45:01,152 - INFO - Deleting VN ctest-right_vn-49268615 2025-10-06 02:45:01,199 - DEBUG - VN ad47ea68-779d-40bf-98ed-199a06a7a9a8 still in use: Unable to complete operation on network ad47ea68-779d-40bf-98ed-199a06a7a9a8. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-0b56c7cb-8df2-426d-85e1-3da5fe22b3ca'] 2025-10-06 02:45:01,200 - WARNING - Deleting VN ctest-right_vn-49268615 failed..Will retry 2025-10-06 02:45:03,429 - DEBUG - Response for deleting network () 2025-10-06 02:45:03,430 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/2fd96413-9ee7-43f8-9f23-f273986fda4a 2025-10-06 02:45:03,436 - DEBUG - Response Code: 404 2025-10-06 02:45:03,436 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:03,443 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:03,502 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:03,595 - INFO - Validated that VN ctest-right_vn-49268615 is not found in API Server 2025-10-06 02:45:03,611 - DEBUG - VN ctest-right_vn-49268615 is not present in Agent 10.0.0.49 2025-10-06 02:45:03,625 - DEBUG - VN ctest-right_vn-49268615 is not present in Agent 10.0.0.19 2025-10-06 02:45:03,625 - INFO - Validated that VN ctest-right_vn-49268615 is not in any agent 2025-10-06 02:45:03,653 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-49268615 info 2025-10-06 02:45:03,653 - INFO - Deleting VN ctest-left_vn-56168220 2025-10-06 02:45:03,806 - DEBUG - Response for deleting network () 2025-10-06 02:45:03,806 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/04e2c599-9c06-44ea-bef7-d27f57ba1cfd 2025-10-06 02:45:03,812 - DEBUG - Response Code: 404 2025-10-06 02:45:03,813 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:03,818 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:03,844 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:03,953 - INFO - Validated that VN ctest-left_vn-56168220 is not found in API Server 2025-10-06 02:45:03,962 - DEBUG - VN ctest-left_vn-56168220 is not present in Agent 10.0.0.49 2025-10-06 02:45:03,971 - DEBUG - VN ctest-left_vn-56168220 is not present in Agent 10.0.0.19 2025-10-06 02:45:03,971 - INFO - Validated that VN ctest-left_vn-56168220 is not in any agent 2025-10-06 02:45:04,001 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-56168220 info 2025-10-06 02:45:04,001 - INFO - Deleting VN ctest-mgmt_vn-19696982 2025-10-06 02:45:04,136 - DEBUG - Response for deleting network () 2025-10-06 02:45:04,136 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/3828350c-5ba0-4d92-b4a3-d3d240714219 2025-10-06 02:45:04,142 - DEBUG - Response Code: 404 2025-10-06 02:45:04,142 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:04,158 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:04,179 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:04,272 - INFO - Validated that VN ctest-mgmt_vn-19696982 is not found in API Server 2025-10-06 02:45:04,288 - DEBUG - VN ctest-mgmt_vn-19696982 is not present in Agent 10.0.0.49 2025-10-06 02:45:04,310 - DEBUG - VN ctest-mgmt_vn-19696982 is not present in Agent 10.0.0.19 2025-10-06 02:45:04,310 - INFO - Validated that VN ctest-mgmt_vn-19696982 is not in any agent 2025-10-06 02:45:04,356 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-19696982 info 2025-10-06 02:45:05,608 - DEBUG - No XMPP flaps were noticed during the test 2025-10-06 02:45:05,608 - INFO -
2025-10-06 02:45:05,608 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:19]
2025-10-06 02:45:05,608 - INFO - -------------------------------------------------------------------------------- 2025-10-06 02:45:05,612 - INFO - ================================================================================ 2025-10-06 02:45:05,612 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-10-06 02:45:06,884 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.193': '0', '10.20.0.25': '0'}, '10.0.0.19': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2025-10-06 02:45:06,884 - INFO - Initial checks done. Running the testcase now 2025-10-06 02:45:06,884 - INFO - 2025-10-06 02:45:07,257 - DEBUG - Response for create_network : {'network': {'id': '22781963-a9e9-4b17-87d6-220d92d38f48', 'name': 'ctest-mgmt_vn-29777405', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'project_id': 'b60c48469db348c49b173a841a574943', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-43015574', 'ctest-mgmt_vn-29777405'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:45:07,491 - DEBUG - Response for create_subnet : {'subnet': {'id': '4f928192-9daa-4c25-8950-486a75eb16a7', 'name': '', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'network_id': '22781963-a9e9-4b17-87d6-220d92d38f48', 'ip_version': 4, 'cidr': '71.73.229.192/26', 'allocation_pools': [{'start': '71.73.229.194', 'end': '71.73.229.254'}], 'gateway_ip': '71.73.229.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '71.73.229.194', 'tags': [], 'project_id': 'b60c48469db348c49b173a841a574943'}} 2025-10-06 02:45:07,512 - INFO - Created VN ctest-mgmt_vn-29777405 2025-10-06 02:45:07,522 - DEBUG - VN ctest-mgmt_vn-29777405 UUID is 22781963-a9e9-4b17-87d6-220d92d38f48 2025-10-06 02:45:07,596 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:07,602 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:07,612 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:07,717 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/22781963-a9e9-4b17-87d6-220d92d38f48 2025-10-06 02:45:07,732 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/22781963-a9e9-4b17-87d6-220d92d38f48 2025-10-06 02:45:07,744 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/41ac79aa-4127-42ad-8a82-f57c7ce834b4 2025-10-06 02:45:07,754 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/41ac79aa-4127-42ad-8a82-f57c7ce834b4 2025-10-06 02:45:07,762 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/a17f8226-84f5-4f13-af64-46bb9d28bd73 2025-10-06 02:45:07,769 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:45:07,769 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/22781963-a9e9-4b17-87d6-220d92d38f48 2025-10-06 02:45:07,777 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/41ac79aa-4127-42ad-8a82-f57c7ce834b4 2025-10-06 02:45:07,793 - INFO - Verified VN network id 10 for VN 22781963-a9e9-4b17-87d6-220d92d38f48 2025-10-06 02:45:07,794 - INFO - Verifications in API Server for VN ctest-mgmt_vn-29777405 passed 2025-10-06 02:45:07,794 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/22781963-a9e9-4b17-87d6-220d92d38f48 2025-10-06 02:45:07,803 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/41ac79aa-4127-42ad-8a82-f57c7ce834b4 2025-10-06 02:45:07,811 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/41ac79aa-4127-42ad-8a82-f57c7ce834b4 2025-10-06 02:45:07,818 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/a17f8226-84f5-4f13-af64-46bb9d28bd73 2025-10-06 02:45:07,831 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2483763110337923863', 'uuid-lslong': '9788048281829609288'}, 'enable': 'true', 'created': '2025-10-06T02:45:07', 'last-modified': '2025-10-06T02:45:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.380371'} 2025-10-06 02:45:07,837 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:45:07,842 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2483763110337923863', 'uuid-lslong': '9788048281829609288'}, 'enable': 'true', 'created': '2025-10-06T02:45:07', 'last-modified': '2025-10-06T02:45:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.392397'} 2025-10-06 02:45:07,849 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:45:07,855 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2483763110337923863', 'uuid-lslong': '9788048281829609288'}, 'enable': 'true', 'created': '2025-10-06T02:45:07', 'last-modified': '2025-10-06T02:45:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.408748'} 2025-10-06 02:45:07,861 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:45:07,861 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-29777405 passed 2025-10-06 02:45:07,861 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-29777405 in API_Server ====== 2025-10-06 02:45:07,861 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:07,867 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:07,878 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:07,976 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/22781963-a9e9-4b17-87d6-220d92d38f48 2025-10-06 02:45:07,988 - DEBUG - =>VN ctest-mgmt_vn-29777405 has no policy to be verified 2025-10-06 02:45:07,988 - DEBUG - Verifying the vn in opserver 2025-10-06 02:45:07,988 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405 virtual network link through opserver 10.0.0.33 2025-10-06 02:45:07,989 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:45:08,001 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405?flat'} 2025-10-06 02:45:08,001 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405 virtual network link through opserver 10.0.0.38 2025-10-06 02:45:08,001 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:45:08,016 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405?flat'} 2025-10-06 02:45:08,016 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405 virtual network link through opserver 10.0.0.249 2025-10-06 02:45:08,016 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:45:08,029 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405?flat'} 2025-10-06 02:45:08,029 - INFO - Validated that VN default-domain:ctest-TestSvcHC-43015574:ctest-mgmt_vn-29777405 is found in opserver 2025-10-06 02:45:08,048 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:45:08,058 - DEBUG - VRF ids for VN ctest-mgmt_vn-29777405: {} 2025-10-06 02:45:08,311 - DEBUG - Response for create_network : {'network': {'id': '945130ad-8f58-4246-a347-3291a7f49f16', 'name': 'ctest-left_vn-18819878', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'project_id': 'b60c48469db348c49b173a841a574943', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-43015574', 'ctest-left_vn-18819878'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:45:08,506 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c1d9989f-97c9-4b6f-8a11-e21eff901e0b', 'name': '', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'network_id': '945130ad-8f58-4246-a347-3291a7f49f16', 'ip_version': 4, 'cidr': '22.182.62.0/26', 'allocation_pools': [{'start': '22.182.62.2', 'end': '22.182.62.62'}], 'gateway_ip': '22.182.62.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '22.182.62.2', 'tags': [], 'project_id': 'b60c48469db348c49b173a841a574943'}} 2025-10-06 02:45:08,551 - INFO - Created VN ctest-left_vn-18819878 2025-10-06 02:45:08,563 - DEBUG - VN ctest-left_vn-18819878 UUID is 945130ad-8f58-4246-a347-3291a7f49f16 2025-10-06 02:45:08,662 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:08,673 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:08,693 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:08,807 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/945130ad-8f58-4246-a347-3291a7f49f16 2025-10-06 02:45:08,824 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/945130ad-8f58-4246-a347-3291a7f49f16 2025-10-06 02:45:08,835 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d6a4f65-2f5c-4193-ab18-30fd8a0d5ed9 2025-10-06 02:45:08,843 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d6a4f65-2f5c-4193-ab18-30fd8a0d5ed9 2025-10-06 02:45:08,853 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/69994ecc-bc88-4ecd-9734-1a736b438261 2025-10-06 02:45:08,863 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:45:08,863 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/945130ad-8f58-4246-a347-3291a7f49f16 2025-10-06 02:45:08,873 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d6a4f65-2f5c-4193-ab18-30fd8a0d5ed9 2025-10-06 02:45:08,890 - INFO - Verified VN network id 11 for VN 945130ad-8f58-4246-a347-3291a7f49f16 2025-10-06 02:45:08,890 - INFO - Verifications in API Server for VN ctest-left_vn-18819878 passed 2025-10-06 02:45:08,890 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/945130ad-8f58-4246-a347-3291a7f49f16 2025-10-06 02:45:08,902 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d6a4f65-2f5c-4193-ab18-30fd8a0d5ed9 2025-10-06 02:45:08,911 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d6a4f65-2f5c-4193-ab18-30fd8a0d5ed9 2025-10-06 02:45:08,919 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/69994ecc-bc88-4ecd-9734-1a736b438261 2025-10-06 02:45:08,935 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10687376912719299142', 'uuid-lslong': '11765428152698183446'}, 'enable': 'true', 'created': '2025-10-06T02:45:08', 'last-modified': '2025-10-06T02:45:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.471715'} 2025-10-06 02:45:08,943 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:45:08,949 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10687376912719299142', 'uuid-lslong': '11765428152698183446'}, 'enable': 'true', 'created': '2025-10-06T02:45:08', 'last-modified': '2025-10-06T02:45:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.486101'} 2025-10-06 02:45:08,956 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:45:08,962 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10687376912719299142', 'uuid-lslong': '11765428152698183446'}, 'enable': 'true', 'created': '2025-10-06T02:45:08', 'last-modified': '2025-10-06T02:45:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.501353'} 2025-10-06 02:45:08,967 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:45:08,967 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-18819878 passed 2025-10-06 02:45:08,967 - DEBUG - ====Verifying policy data for ctest-left_vn-18819878 in API_Server ====== 2025-10-06 02:45:08,967 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:08,974 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:08,985 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:09,082 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/945130ad-8f58-4246-a347-3291a7f49f16 2025-10-06 02:45:09,092 - DEBUG - =>VN ctest-left_vn-18819878 has no policy to be verified 2025-10-06 02:45:09,092 - DEBUG - Verifying the vn in opserver 2025-10-06 02:45:09,092 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878 virtual network link through opserver 10.0.0.33 2025-10-06 02:45:09,092 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:45:09,104 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878?flat'} 2025-10-06 02:45:09,104 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878 virtual network link through opserver 10.0.0.38 2025-10-06 02:45:09,104 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:45:09,119 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878?flat'} 2025-10-06 02:45:09,119 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878 virtual network link through opserver 10.0.0.249 2025-10-06 02:45:09,119 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:45:09,131 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878?flat'} 2025-10-06 02:45:09,131 - INFO - Validated that VN default-domain:ctest-TestSvcHC-43015574:ctest-left_vn-18819878 is found in opserver 2025-10-06 02:45:09,149 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:45:09,158 - DEBUG - VRF ids for VN ctest-left_vn-18819878: {} 2025-10-06 02:45:09,418 - DEBUG - Response for create_network : {'network': {'id': '59cf0620-8aae-4b45-ae8b-522bc5a4a548', 'name': 'ctest-right_vn-96762276', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'project_id': 'b60c48469db348c49b173a841a574943', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-43015574', 'ctest-right_vn-96762276'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:45:09,678 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ac3212bc-b924-4dd1-82d8-66b00f508242', 'name': '', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'network_id': '59cf0620-8aae-4b45-ae8b-522bc5a4a548', 'ip_version': 4, 'cidr': '160.155.57.64/26', 'allocation_pools': [{'start': '160.155.57.66', 'end': '160.155.57.126'}], 'gateway_ip': '160.155.57.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '160.155.57.66', 'tags': [], 'project_id': 'b60c48469db348c49b173a841a574943'}} 2025-10-06 02:45:09,705 - INFO - Created VN ctest-right_vn-96762276 2025-10-06 02:45:09,720 - DEBUG - VN ctest-right_vn-96762276 UUID is 59cf0620-8aae-4b45-ae8b-522bc5a4a548 2025-10-06 02:45:09,795 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:09,801 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:09,811 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:09,898 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/59cf0620-8aae-4b45-ae8b-522bc5a4a548 2025-10-06 02:45:09,910 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/59cf0620-8aae-4b45-ae8b-522bc5a4a548 2025-10-06 02:45:09,918 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/0bd99c3d-acf2-4a4a-b372-1731a6afbbbb 2025-10-06 02:45:09,925 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/0bd99c3d-acf2-4a4a-b372-1731a6afbbbb 2025-10-06 02:45:09,931 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/6b95584a-07a6-4943-938f-2f5463b780fb 2025-10-06 02:45:09,936 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:45:09,936 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/59cf0620-8aae-4b45-ae8b-522bc5a4a548 2025-10-06 02:45:09,945 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/0bd99c3d-acf2-4a4a-b372-1731a6afbbbb 2025-10-06 02:45:09,959 - INFO - Verified VN network id 12 for VN 59cf0620-8aae-4b45-ae8b-522bc5a4a548 2025-10-06 02:45:09,959 - INFO - Verifications in API Server for VN ctest-right_vn-96762276 passed 2025-10-06 02:45:09,959 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/59cf0620-8aae-4b45-ae8b-522bc5a4a548 2025-10-06 02:45:09,969 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/0bd99c3d-acf2-4a4a-b372-1731a6afbbbb 2025-10-06 02:45:09,975 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/0bd99c3d-acf2-4a4a-b372-1731a6afbbbb 2025-10-06 02:45:09,982 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/6b95584a-07a6-4943-938f-2f5463b780fb 2025-10-06 02:45:09,993 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6471397926390090565', 'uuid-lslong': '12577236732315215176'}, 'enable': 'true', 'created': '2025-10-06T02:45:09', 'last-modified': '2025-10-06T02:45:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.367302'} 2025-10-06 02:45:10,001 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:45:10,007 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6471397926390090565', 'uuid-lslong': '12577236732315215176'}, 'enable': 'true', 'created': '2025-10-06T02:45:09', 'last-modified': '2025-10-06T02:45:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.375945'} 2025-10-06 02:45:10,013 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:45:10,018 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6471397926390090565', 'uuid-lslong': '12577236732315215176'}, 'enable': 'true', 'created': '2025-10-06T02:45:09', 'last-modified': '2025-10-06T02:45:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.392412'} 2025-10-06 02:45:10,023 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:45:10,023 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-96762276 passed 2025-10-06 02:45:10,023 - DEBUG - ====Verifying policy data for ctest-right_vn-96762276 in API_Server ====== 2025-10-06 02:45:10,023 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:10,029 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:10,038 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:10,130 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/59cf0620-8aae-4b45-ae8b-522bc5a4a548 2025-10-06 02:45:10,139 - DEBUG - =>VN ctest-right_vn-96762276 has no policy to be verified 2025-10-06 02:45:10,139 - DEBUG - Verifying the vn in opserver 2025-10-06 02:45:10,139 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276 virtual network link through opserver 10.0.0.33 2025-10-06 02:45:10,139 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:45:10,151 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276?flat'} 2025-10-06 02:45:10,151 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276 virtual network link through opserver 10.0.0.38 2025-10-06 02:45:10,151 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:45:10,162 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276?flat'} 2025-10-06 02:45:10,162 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276 virtual network link through opserver 10.0.0.249 2025-10-06 02:45:10,162 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:45:10,175 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276?flat'} 2025-10-06 02:45:10,175 - INFO - Validated that VN default-domain:ctest-TestSvcHC-43015574:ctest-right_vn-96762276 is found in opserver 2025-10-06 02:45:10,193 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:45:10,200 - DEBUG - VRF ids for VN ctest-right_vn-96762276: {} 2025-10-06 02:45:10,502 - DEBUG - Response for create_network : {'network': {'id': '8f16a677-93e4-488c-82d9-e82a0786cbd6', 'name': 'ctest-trans_left_vn-52500182', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'project_id': 'b60c48469db348c49b173a841a574943', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-43015574', 'ctest-trans_left_vn-52500182'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:45:10,762 - DEBUG - Response for create_subnet : {'subnet': {'id': '9b7301d9-bef8-4dd2-834a-e4464a31fa62', 'name': '', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'network_id': '8f16a677-93e4-488c-82d9-e82a0786cbd6', 'ip_version': 4, 'cidr': '131.27.11.192/26', 'allocation_pools': [{'start': '131.27.11.194', 'end': '131.27.11.254'}], 'gateway_ip': '131.27.11.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '131.27.11.194', 'tags': [], 'project_id': 'b60c48469db348c49b173a841a574943'}} 2025-10-06 02:45:10,784 - INFO - Created VN ctest-trans_left_vn-52500182 2025-10-06 02:45:10,794 - DEBUG - VN ctest-trans_left_vn-52500182 UUID is 8f16a677-93e4-488c-82d9-e82a0786cbd6 2025-10-06 02:45:10,879 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:10,886 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:10,898 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:11,002 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/8f16a677-93e4-488c-82d9-e82a0786cbd6 2025-10-06 02:45:11,016 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/8f16a677-93e4-488c-82d9-e82a0786cbd6 2025-10-06 02:45:11,025 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/b2b3cf2a-9ff6-4aa7-9558-dc3f0fa96d13 2025-10-06 02:45:11,039 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/b2b3cf2a-9ff6-4aa7-9558-dc3f0fa96d13 2025-10-06 02:45:11,046 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/e2980925-827f-4281-90fd-df43c622cc00 2025-10-06 02:45:11,053 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-06 02:45:11,053 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/8f16a677-93e4-488c-82d9-e82a0786cbd6 2025-10-06 02:45:11,062 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/b2b3cf2a-9ff6-4aa7-9558-dc3f0fa96d13 2025-10-06 02:45:11,082 - INFO - Verified VN network id 13 for VN 8f16a677-93e4-488c-82d9-e82a0786cbd6 2025-10-06 02:45:11,082 - INFO - Verifications in API Server for VN ctest-trans_left_vn-52500182 passed 2025-10-06 02:45:11,082 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/8f16a677-93e4-488c-82d9-e82a0786cbd6 2025-10-06 02:45:11,091 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/b2b3cf2a-9ff6-4aa7-9558-dc3f0fa96d13 2025-10-06 02:45:11,101 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/b2b3cf2a-9ff6-4aa7-9558-dc3f0fa96d13 2025-10-06 02:45:11,110 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/e2980925-827f-4281-90fd-df43c622cc00 2025-10-06 02:45:11,125 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10310611429423859852', 'uuid-lslong': '9428822562089389014'}, 'enable': 'true', 'created': '2025-10-06T02:45:10', 'last-modified': '2025-10-06T02:45:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.413461'} 2025-10-06 02:45:11,134 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-06 02:45:11,141 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10310611429423859852', 'uuid-lslong': '9428822562089389014'}, 'enable': 'true', 'created': '2025-10-06T02:45:10', 'last-modified': '2025-10-06T02:45:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.427595'} 2025-10-06 02:45:11,147 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-06 02:45:11,153 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10310611429423859852', 'uuid-lslong': '9428822562089389014'}, 'enable': 'true', 'created': '2025-10-06T02:45:10', 'last-modified': '2025-10-06T02:45:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.446497'} 2025-10-06 02:45:11,159 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-06 02:45:11,159 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-52500182 passed 2025-10-06 02:45:11,159 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-52500182 in API_Server ====== 2025-10-06 02:45:11,159 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:11,166 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:11,189 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:11,290 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/8f16a677-93e4-488c-82d9-e82a0786cbd6 2025-10-06 02:45:11,303 - DEBUG - =>VN ctest-trans_left_vn-52500182 has no policy to be verified 2025-10-06 02:45:11,303 - DEBUG - Verifying the vn in opserver 2025-10-06 02:45:11,303 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182 virtual network link through opserver 10.0.0.33 2025-10-06 02:45:11,303 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:45:11,315 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182?flat'} 2025-10-06 02:45:11,315 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182 virtual network link through opserver 10.0.0.38 2025-10-06 02:45:11,315 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:45:11,329 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182?flat'} 2025-10-06 02:45:11,329 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182 virtual network link through opserver 10.0.0.249 2025-10-06 02:45:11,329 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:45:11,342 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182?flat'} 2025-10-06 02:45:11,342 - INFO - Validated that VN default-domain:ctest-TestSvcHC-43015574:ctest-trans_left_vn-52500182 is found in opserver 2025-10-06 02:45:11,362 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:45:11,371 - DEBUG - VRF ids for VN ctest-trans_left_vn-52500182: {} 2025-10-06 02:45:11,621 - DEBUG - Response for create_network : {'network': {'id': 'c00c84ba-c45b-4418-af77-70dd4c6aee21', 'name': 'ctest-trans_right_vn-51728147', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'project_id': 'b60c48469db348c49b173a841a574943', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-43015574', 'ctest-trans_right_vn-51728147'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:45:11,876 - DEBUG - Response for create_subnet : {'subnet': {'id': '8a15287c-a25a-44a2-b0b8-8172947666df', 'name': '', 'tenant_id': 'b60c48469db348c49b173a841a574943', 'network_id': 'c00c84ba-c45b-4418-af77-70dd4c6aee21', 'ip_version': 4, 'cidr': '123.212.249.0/26', 'allocation_pools': [{'start': '123.212.249.2', 'end': '123.212.249.62'}], 'gateway_ip': '123.212.249.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '123.212.249.2', 'tags': [], 'project_id': 'b60c48469db348c49b173a841a574943'}} 2025-10-06 02:45:11,898 - INFO - Created VN ctest-trans_right_vn-51728147 2025-10-06 02:45:11,910 - DEBUG - VN ctest-trans_right_vn-51728147 UUID is c00c84ba-c45b-4418-af77-70dd4c6aee21 2025-10-06 02:45:11,984 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:11,990 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:12,001 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:12,109 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c00c84ba-c45b-4418-af77-70dd4c6aee21 2025-10-06 02:45:12,126 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c00c84ba-c45b-4418-af77-70dd4c6aee21 2025-10-06 02:45:12,137 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/716c0171-058d-440e-8cac-bb7796696a70 2025-10-06 02:45:12,149 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/716c0171-058d-440e-8cac-bb7796696a70 2025-10-06 02:45:12,192 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/cbe6c1fc-af72-4f71-891c-a2ff89ab3699 2025-10-06 02:45:12,200 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-06 02:45:12,200 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c00c84ba-c45b-4418-af77-70dd4c6aee21 2025-10-06 02:45:12,215 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/716c0171-058d-440e-8cac-bb7796696a70 2025-10-06 02:45:12,232 - INFO - Verified VN network id 14 for VN c00c84ba-c45b-4418-af77-70dd4c6aee21 2025-10-06 02:45:12,233 - INFO - Verifications in API Server for VN ctest-trans_right_vn-51728147 passed 2025-10-06 02:45:12,235 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c00c84ba-c45b-4418-af77-70dd4c6aee21 2025-10-06 02:45:12,246 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/716c0171-058d-440e-8cac-bb7796696a70 2025-10-06 02:45:12,254 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/716c0171-058d-440e-8cac-bb7796696a70 2025-10-06 02:45:12,263 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/cbe6c1fc-af72-4f71-891c-a2ff89ab3699 2025-10-06 02:45:12,277 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13838581692695790616', 'uuid-lslong': '12643698574638116385'}, 'enable': 'true', 'created': '2025-10-06T02:45:11', 'last-modified': '2025-10-06T02:45:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.447352'} 2025-10-06 02:45:12,287 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-06 02:45:12,296 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13838581692695790616', 'uuid-lslong': '12643698574638116385'}, 'enable': 'true', 'created': '2025-10-06T02:45:11', 'last-modified': '2025-10-06T02:45:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.471074'} 2025-10-06 02:45:12,301 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-06 02:45:12,306 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-43015574', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13838581692695790616', 'uuid-lslong': '12643698574638116385'}, 'enable': 'true', 'created': '2025-10-06T02:45:11', 'last-modified': '2025-10-06T02:45:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.482851'} 2025-10-06 02:45:12,312 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-06 02:45:12,312 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-51728147 passed 2025-10-06 02:45:12,312 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-51728147 in API_Server ====== 2025-10-06 02:45:12,312 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:12,320 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:12,330 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:12,439 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c00c84ba-c45b-4418-af77-70dd4c6aee21 2025-10-06 02:45:12,453 - DEBUG - =>VN ctest-trans_right_vn-51728147 has no policy to be verified 2025-10-06 02:45:12,453 - DEBUG - Verifying the vn in opserver 2025-10-06 02:45:12,453 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147 virtual network link through opserver 10.0.0.33 2025-10-06 02:45:12,453 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:45:12,465 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147?flat'} 2025-10-06 02:45:12,465 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147 virtual network link through opserver 10.0.0.38 2025-10-06 02:45:12,465 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:45:12,478 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147?flat'} 2025-10-06 02:45:12,478 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147 virtual network link through opserver 10.0.0.249 2025-10-06 02:45:12,479 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:45:12,492 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147?flat'} 2025-10-06 02:45:12,492 - INFO - Validated that VN default-domain:ctest-TestSvcHC-43015574:ctest-trans_right_vn-51728147 is found in opserver 2025-10-06 02:45:12,510 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:45:12,519 - DEBUG - VRF ids for VN ctest-trans_right_vn-51728147: {} 2025-10-06 02:45:13,600 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4219-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4219-2) 2025-10-06 02:45:15,117 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4219-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4219-1) 2025-10-06 02:45:15,117 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-82206835'] 2025-10-06 02:45:15,416 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-82206835'] created succesfully 2025-10-06 02:45:15,782 - DEBUG - Image by name tiny_trans_fw not found 2025-10-06 02:45:15,782 - DEBUG - Installing image tiny_trans_fw 2025-10-06 02:45:15,782 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-10-06 02:45:15,783 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-06 02:45:15,783 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-06 02:45:15,783 - DEBUG - Unzip image 2025-10-06 02:45:15,783 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-06 02:45:15,812 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-10-06 02:45:15,812 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-82206835'] 2025-10-06 02:45:15,929 - INFO - Service template: ['default-domain', 'ctest-service_template_1-82206835'] deleted successfully. 2025-10-06 02:45:15,929 - INFO - Skip interface_detach for VM ctest-right_vm-64210850 in state BUILD 2025-10-06 02:45:15,929 - INFO - Deleting VM ctest-right_vm-64210850 2025-10-06 02:45:15,930 - ERROR - VM ctest-right_vm-64210850 has failed to come up 2025-10-06 02:45:15,930 - ERROR - Nova failed to get host of the VM 2025-10-06 02:45:15,930 - ERROR - VM ctest-right_vm-64210850 has failed to come up 2025-10-06 02:45:15,930 - ERROR - Nova failed to get host of the VM 2025-10-06 02:45:16,074 - INFO - Skip interface_detach for VM ctest-left_vm-50363687 in state BUILD 2025-10-06 02:45:16,074 - INFO - Deleting VM ctest-left_vm-50363687 2025-10-06 02:45:16,074 - ERROR - VM ctest-left_vm-50363687 has failed to come up 2025-10-06 02:45:16,074 - ERROR - Nova failed to get host of the VM 2025-10-06 02:45:16,074 - ERROR - VM ctest-left_vm-50363687 has failed to come up 2025-10-06 02:45:16,074 - ERROR - Nova failed to get host of the VM 2025-10-06 02:45:16,140 - INFO - Deleting VN ctest-trans_right_vn-51728147 2025-10-06 02:45:16,341 - DEBUG - Response for deleting network () 2025-10-06 02:45:16,341 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/716c0171-058d-440e-8cac-bb7796696a70 2025-10-06 02:45:16,347 - DEBUG - Response Code: 404 2025-10-06 02:45:16,347 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:16,368 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:16,391 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:16,499 - INFO - Validated that VN ctest-trans_right_vn-51728147 is not found in API Server 2025-10-06 02:45:16,533 - DEBUG - VN ctest-trans_right_vn-51728147 is not present in Agent 10.0.0.49 2025-10-06 02:45:16,548 - DEBUG - VN ctest-trans_right_vn-51728147 is not present in Agent 10.0.0.19 2025-10-06 02:45:16,548 - INFO - Validated that VN ctest-trans_right_vn-51728147 is not in any agent 2025-10-06 02:45:16,596 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-51728147 info 2025-10-06 02:45:16,596 - INFO - Deleting VN ctest-trans_left_vn-52500182 2025-10-06 02:45:16,829 - DEBUG - Response for deleting network () 2025-10-06 02:45:16,829 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/b2b3cf2a-9ff6-4aa7-9558-dc3f0fa96d13 2025-10-06 02:45:16,848 - DEBUG - Response Code: 404 2025-10-06 02:45:16,848 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:16,858 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:16,881 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:16,998 - INFO - Validated that VN ctest-trans_left_vn-52500182 is not found in API Server 2025-10-06 02:45:17,008 - DEBUG - VN ctest-trans_left_vn-52500182 is not present in Agent 10.0.0.49 2025-10-06 02:45:17,017 - DEBUG - VN ctest-trans_left_vn-52500182 is not present in Agent 10.0.0.19 2025-10-06 02:45:17,017 - INFO - Validated that VN ctest-trans_left_vn-52500182 is not in any agent 2025-10-06 02:45:17,073 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-52500182 info 2025-10-06 02:45:17,073 - INFO - Deleting VN ctest-right_vn-96762276 2025-10-06 02:45:17,135 - DEBUG - VN 59cf0620-8aae-4b45-ae8b-522bc5a4a548 still in use: Unable to complete operation on network 59cf0620-8aae-4b45-ae8b-522bc5a4a548. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1c6fd864-3e47-4a1c-8035-126505c3f259'] 2025-10-06 02:45:17,135 - WARNING - Deleting VN ctest-right_vn-96762276 failed..Will retry 2025-10-06 02:45:19,269 - DEBUG - Response for deleting network () 2025-10-06 02:45:19,269 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/0bd99c3d-acf2-4a4a-b372-1731a6afbbbb 2025-10-06 02:45:19,276 - DEBUG - Response Code: 404 2025-10-06 02:45:19,276 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:19,290 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:19,305 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:19,399 - INFO - Validated that VN ctest-right_vn-96762276 is not found in API Server 2025-10-06 02:45:19,408 - DEBUG - VN ctest-right_vn-96762276 is not present in Agent 10.0.0.49 2025-10-06 02:45:19,417 - DEBUG - VN ctest-right_vn-96762276 is not present in Agent 10.0.0.19 2025-10-06 02:45:19,418 - INFO - Validated that VN ctest-right_vn-96762276 is not in any agent 2025-10-06 02:45:19,443 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-96762276 info 2025-10-06 02:45:19,443 - INFO - Deleting VN ctest-left_vn-18819878 2025-10-06 02:45:19,599 - DEBUG - Response for deleting network () 2025-10-06 02:45:19,599 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/1d6a4f65-2f5c-4193-ab18-30fd8a0d5ed9 2025-10-06 02:45:19,605 - DEBUG - Response Code: 404 2025-10-06 02:45:19,605 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:19,614 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:19,627 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:19,716 - INFO - Validated that VN ctest-left_vn-18819878 is not found in API Server 2025-10-06 02:45:19,726 - DEBUG - VN ctest-left_vn-18819878 is not present in Agent 10.0.0.49 2025-10-06 02:45:19,735 - DEBUG - VN ctest-left_vn-18819878 is not present in Agent 10.0.0.19 2025-10-06 02:45:19,735 - INFO - Validated that VN ctest-left_vn-18819878 is not in any agent 2025-10-06 02:45:19,763 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-18819878 info 2025-10-06 02:45:19,763 - INFO - Deleting VN ctest-mgmt_vn-29777405 2025-10-06 02:45:19,920 - DEBUG - Response for deleting network () 2025-10-06 02:45:19,920 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/41ac79aa-4127-42ad-8a82-f57c7ce834b4 2025-10-06 02:45:19,928 - DEBUG - Response Code: 404 2025-10-06 02:45:19,928 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:19,934 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:19,994 - DEBUG - Requesting: http://10.0.0.33:8082/project/b60c4846-9db3-48c4-9b17-3a841a574943 2025-10-06 02:45:20,076 - INFO - Validated that VN ctest-mgmt_vn-29777405 is not found in API Server 2025-10-06 02:45:20,085 - DEBUG - VN ctest-mgmt_vn-29777405 is not present in Agent 10.0.0.49 2025-10-06 02:45:20,094 - DEBUG - VN ctest-mgmt_vn-29777405 is not present in Agent 10.0.0.19 2025-10-06 02:45:20,094 - INFO - Validated that VN ctest-mgmt_vn-29777405 is not in any agent 2025-10-06 02:45:20,123 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-29777405 info 2025-10-06 02:45:21,400 - DEBUG - No XMPP flaps were noticed during the test 2025-10-06 02:45:21,400 - INFO -
2025-10-06 02:45:21,400 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16]
2025-10-06 02:45:21,400 - INFO - -------------------------------------------------------------------------------- 2025-10-06 02:45:22,082 - INFO - Deleted project: ctest-TestSvcHC-43015574, ID : b60c4846-9db3-48c4-9b17-3a841a574943