2025-10-16 03:16:57,495 - INFO - Domain Default found not creating 2025-10-16 03:16:57,638 - INFO - Project ctest-TestSvcHC-40481843 not found, creating it 2025-10-16 03:16:58,136 - INFO - Created Project:ctest-TestSvcHC-40481843, ID : 66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:16:59,559 - INFO - ================================================================================ 2025-10-16 03:16:59,560 - INFO - STARTING TEST : test_svc_hc_basic 2025-10-16 03:17:00,836 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.252': '0', '10.20.0.5': '0'}, '10.0.0.129': {'10.20.0.5': '0', '10.20.0.252': '0'}} with 2025-10-16 03:17:00,836 - INFO - Initial checks done. Running the testcase now 2025-10-16 03:17:00,836 - INFO - 2025-10-16 03:17:01,501 - DEBUG - Response for create_network : {'network': {'id': 'ce6c51bc-0f93-40d3-8da7-795ad58778de', 'name': 'ctest-mgmt_vn-51657733', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'project_id': '66c4edd5ff7741e693df39709ae3fa4b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-40481843', 'ctest-mgmt_vn-51657733'], 'port_security_enabled': True, 'description': ''}} 2025-10-16 03:17:01,831 - DEBUG - Response for create_subnet : {'subnet': {'id': '514dcc83-eeb7-42aa-b8a5-84426aa74b09', 'name': '', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'network_id': 'ce6c51bc-0f93-40d3-8da7-795ad58778de', 'ip_version': 4, 'cidr': '134.229.151.128/26', 'allocation_pools': [{'start': '134.229.151.130', 'end': '134.229.151.190'}], 'gateway_ip': '134.229.151.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '134.229.151.130', 'tags': [], 'project_id': '66c4edd5ff7741e693df39709ae3fa4b'}} 2025-10-16 03:17:01,858 - INFO - Created VN ctest-mgmt_vn-51657733 2025-10-16 03:17:01,871 - DEBUG - VN ctest-mgmt_vn-51657733 UUID is ce6c51bc-0f93-40d3-8da7-795ad58778de 2025-10-16 03:17:01,942 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:02,246 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:02,282 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:02,297 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:02,401 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/ce6c51bc-0f93-40d3-8da7-795ad58778de 2025-10-16 03:17:02,419 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/ce6c51bc-0f93-40d3-8da7-795ad58778de 2025-10-16 03:17:02,428 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9fcf9e75-662c-4341-bdaa-1fccfd9e00de 2025-10-16 03:17:02,436 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9fcf9e75-662c-4341-bdaa-1fccfd9e00de 2025-10-16 03:17:02,444 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/68446787-8ccd-4e5b-b4ff-e2b0fc0070bc 2025-10-16 03:17:02,451 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-16 03:17:02,451 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/ce6c51bc-0f93-40d3-8da7-795ad58778de 2025-10-16 03:17:02,461 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9fcf9e75-662c-4341-bdaa-1fccfd9e00de 2025-10-16 03:17:02,475 - INFO - Verified VN network id 11 for VN ce6c51bc-0f93-40d3-8da7-795ad58778de 2025-10-16 03:17:02,475 - INFO - Verifications in API Server for VN ctest-mgmt_vn-51657733 passed 2025-10-16 03:17:02,475 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/ce6c51bc-0f93-40d3-8da7-795ad58778de 2025-10-16 03:17:02,485 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9fcf9e75-662c-4341-bdaa-1fccfd9e00de 2025-10-16 03:17:02,492 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9fcf9e75-662c-4341-bdaa-1fccfd9e00de 2025-10-16 03:17:02,500 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/68446787-8ccd-4e5b-b4ff-e2b0fc0070bc 2025-10-16 03:17:02,511 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14874353537454915795', 'uuid-lslong': '10207260511494961374'}, 'enable': 'true', 'created': '2025-10-16T03:17:01', 'last-modified': '2025-10-16T03:17:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.755474'} 2025-10-16 03:17:02,517 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-16 03:17:02,522 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14874353537454915795', 'uuid-lslong': '10207260511494961374'}, 'enable': 'true', 'created': '2025-10-16T03:17:01', 'last-modified': '2025-10-16T03:17:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.771022'} 2025-10-16 03:17:02,529 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-16 03:17:02,534 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14874353537454915795', 'uuid-lslong': '10207260511494961374'}, 'enable': 'true', 'created': '2025-10-16T03:17:01', 'last-modified': '2025-10-16T03:17:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.783739'} 2025-10-16 03:17:02,540 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-16 03:17:02,540 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-51657733 passed 2025-10-16 03:17:02,540 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-51657733 in API_Server ====== 2025-10-16 03:17:02,540 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:02,548 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:02,560 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:02,665 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/ce6c51bc-0f93-40d3-8da7-795ad58778de 2025-10-16 03:17:02,682 - DEBUG - =>VN ctest-mgmt_vn-51657733 has no policy to be verified 2025-10-16 03:17:02,682 - DEBUG - Verifying the vn in opserver 2025-10-16 03:17:02,682 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733 virtual network link through opserver 10.0.0.19 2025-10-16 03:17:02,682 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-16 03:17:02,993 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-16 03:17:03,058 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733?flat'} 2025-10-16 03:17:03,058 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733 virtual network link through opserver 10.0.0.57 2025-10-16 03:17:03,058 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-10-16 03:17:03,365 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-10-16 03:17:03,423 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733?flat'} 2025-10-16 03:17:03,423 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733 virtual network link through opserver 10.0.0.23 2025-10-16 03:17:03,423 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-10-16 03:17:03,718 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-10-16 03:17:03,774 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733?flat'} 2025-10-16 03:17:03,774 - INFO - Validated that VN default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-51657733 is found in opserver 2025-10-16 03:17:03,796 - DEBUG - Do not have enough data to verify VN in agent 2025-10-16 03:17:03,806 - DEBUG - VRF ids for VN ctest-mgmt_vn-51657733: {} 2025-10-16 03:17:04,083 - DEBUG - Response for create_network : {'network': {'id': '7add6839-fe3d-471e-b659-ac26d23a6dcc', 'name': 'ctest-left_vn-01155841', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'project_id': '66c4edd5ff7741e693df39709ae3fa4b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-40481843', 'ctest-left_vn-01155841'], 'port_security_enabled': True, 'description': ''}} 2025-10-16 03:17:04,328 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ad64c9eb-fbf7-46aa-a907-391187dab513', 'name': '', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'network_id': '7add6839-fe3d-471e-b659-ac26d23a6dcc', 'ip_version': 4, 'cidr': '212.184.231.128/26', 'allocation_pools': [{'start': '212.184.231.130', 'end': '212.184.231.190'}], 'gateway_ip': '212.184.231.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '212.184.231.130', 'tags': [], 'project_id': '66c4edd5ff7741e693df39709ae3fa4b'}} 2025-10-16 03:17:04,351 - INFO - Created VN ctest-left_vn-01155841 2025-10-16 03:17:04,360 - DEBUG - VN ctest-left_vn-01155841 UUID is 7add6839-fe3d-471e-b659-ac26d23a6dcc 2025-10-16 03:17:04,427 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:04,437 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:04,450 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:04,533 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7add6839-fe3d-471e-b659-ac26d23a6dcc 2025-10-16 03:17:04,548 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7add6839-fe3d-471e-b659-ac26d23a6dcc 2025-10-16 03:17:04,559 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/0ce1b09f-8504-454c-ad83-d11bbb56230b 2025-10-16 03:17:04,571 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/0ce1b09f-8504-454c-ad83-d11bbb56230b 2025-10-16 03:17:04,578 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/1657cdfe-d975-4627-8a6d-9f9937354ebd 2025-10-16 03:17:04,585 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-16 03:17:04,585 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7add6839-fe3d-471e-b659-ac26d23a6dcc 2025-10-16 03:17:04,596 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/0ce1b09f-8504-454c-ad83-d11bbb56230b 2025-10-16 03:17:04,610 - INFO - Verified VN network id 12 for VN 7add6839-fe3d-471e-b659-ac26d23a6dcc 2025-10-16 03:17:04,610 - INFO - Verifications in API Server for VN ctest-left_vn-01155841 passed 2025-10-16 03:17:04,610 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7add6839-fe3d-471e-b659-ac26d23a6dcc 2025-10-16 03:17:04,618 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/0ce1b09f-8504-454c-ad83-d11bbb56230b 2025-10-16 03:17:04,624 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/0ce1b09f-8504-454c-ad83-d11bbb56230b 2025-10-16 03:17:04,631 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/1657cdfe-d975-4627-8a6d-9f9937354ebd 2025-10-16 03:17:04,648 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8853347040768116510', 'uuid-lslong': '13139722670565912012'}, 'enable': 'true', 'created': '2025-10-16T03:17:04', 'last-modified': '2025-10-16T03:17:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.376375'} 2025-10-16 03:17:04,654 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-16 03:17:04,661 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8853347040768116510', 'uuid-lslong': '13139722670565912012'}, 'enable': 'true', 'created': '2025-10-16T03:17:04', 'last-modified': '2025-10-16T03:17:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.390336'} 2025-10-16 03:17:04,667 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-16 03:17:04,672 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8853347040768116510', 'uuid-lslong': '13139722670565912012'}, 'enable': 'true', 'created': '2025-10-16T03:17:04', 'last-modified': '2025-10-16T03:17:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402314'} 2025-10-16 03:17:04,677 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-16 03:17:04,677 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-01155841 passed 2025-10-16 03:17:04,677 - DEBUG - ====Verifying policy data for ctest-left_vn-01155841 in API_Server ====== 2025-10-16 03:17:04,677 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:04,683 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:04,693 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:04,785 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7add6839-fe3d-471e-b659-ac26d23a6dcc 2025-10-16 03:17:04,795 - DEBUG - =>VN ctest-left_vn-01155841 has no policy to be verified 2025-10-16 03:17:04,796 - DEBUG - Verifying the vn in opserver 2025-10-16 03:17:04,796 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841 virtual network link through opserver 10.0.0.19 2025-10-16 03:17:04,796 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-16 03:17:04,874 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841?flat'} 2025-10-16 03:17:04,875 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841 virtual network link through opserver 10.0.0.57 2025-10-16 03:17:04,875 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-10-16 03:17:04,955 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841?flat'} 2025-10-16 03:17:04,955 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841 virtual network link through opserver 10.0.0.23 2025-10-16 03:17:04,955 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-10-16 03:17:05,048 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841?flat'} 2025-10-16 03:17:05,048 - INFO - Validated that VN default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-01155841 is found in opserver 2025-10-16 03:17:05,068 - DEBUG - Do not have enough data to verify VN in agent 2025-10-16 03:17:05,079 - DEBUG - VRF ids for VN ctest-left_vn-01155841: {} 2025-10-16 03:17:05,439 - DEBUG - Response for create_network : {'network': {'id': 'e01b3556-e81b-482f-b644-a014b7ab7b3e', 'name': 'ctest-right_vn-90998694', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'project_id': '66c4edd5ff7741e693df39709ae3fa4b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-40481843', 'ctest-right_vn-90998694'], 'port_security_enabled': True, 'description': ''}} 2025-10-16 03:17:05,651 - DEBUG - Response for create_subnet : {'subnet': {'id': '2c6b210f-0050-450b-aafe-293f6cbbf9bd', 'name': '', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'network_id': 'e01b3556-e81b-482f-b644-a014b7ab7b3e', 'ip_version': 4, 'cidr': '142.99.24.0/26', 'allocation_pools': [{'start': '142.99.24.2', 'end': '142.99.24.62'}], 'gateway_ip': '142.99.24.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '142.99.24.2', 'tags': [], 'project_id': '66c4edd5ff7741e693df39709ae3fa4b'}} 2025-10-16 03:17:05,675 - INFO - Created VN ctest-right_vn-90998694 2025-10-16 03:17:05,684 - DEBUG - VN ctest-right_vn-90998694 UUID is e01b3556-e81b-482f-b644-a014b7ab7b3e 2025-10-16 03:17:05,751 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:05,756 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:05,770 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:05,865 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e01b3556-e81b-482f-b644-a014b7ab7b3e 2025-10-16 03:17:05,885 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e01b3556-e81b-482f-b644-a014b7ab7b3e 2025-10-16 03:17:05,893 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9cb578c6-83fe-4310-a227-8479552d4b4b 2025-10-16 03:17:05,904 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9cb578c6-83fe-4310-a227-8479552d4b4b 2025-10-16 03:17:05,912 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/a8c88415-7d87-4ac8-b1ca-72923d68d512 2025-10-16 03:17:05,920 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-16 03:17:05,920 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e01b3556-e81b-482f-b644-a014b7ab7b3e 2025-10-16 03:17:05,929 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9cb578c6-83fe-4310-a227-8479552d4b4b 2025-10-16 03:17:05,945 - INFO - Verified VN network id 13 for VN e01b3556-e81b-482f-b644-a014b7ab7b3e 2025-10-16 03:17:05,945 - INFO - Verifications in API Server for VN ctest-right_vn-90998694 passed 2025-10-16 03:17:05,945 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e01b3556-e81b-482f-b644-a014b7ab7b3e 2025-10-16 03:17:05,957 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9cb578c6-83fe-4310-a227-8479552d4b4b 2025-10-16 03:17:05,968 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9cb578c6-83fe-4310-a227-8479552d4b4b 2025-10-16 03:17:05,977 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/a8c88415-7d87-4ac8-b1ca-72923d68d512 2025-10-16 03:17:05,993 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16148559536244607023', 'uuid-lslong': '13133798424160467774'}, 'enable': 'true', 'created': '2025-10-16T03:17:05', 'last-modified': '2025-10-16T03:17:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.376903'} 2025-10-16 03:17:06,002 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-16 03:17:06,009 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16148559536244607023', 'uuid-lslong': '13133798424160467774'}, 'enable': 'true', 'created': '2025-10-16T03:17:05', 'last-modified': '2025-10-16T03:17:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.403471'} 2025-10-16 03:17:06,017 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-16 03:17:06,024 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16148559536244607023', 'uuid-lslong': '13133798424160467774'}, 'enable': 'true', 'created': '2025-10-16T03:17:05', 'last-modified': '2025-10-16T03:17:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416628'} 2025-10-16 03:17:06,031 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-16 03:17:06,031 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-90998694 passed 2025-10-16 03:17:06,032 - DEBUG - ====Verifying policy data for ctest-right_vn-90998694 in API_Server ====== 2025-10-16 03:17:06,032 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:06,040 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:06,052 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:06,143 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/e01b3556-e81b-482f-b644-a014b7ab7b3e 2025-10-16 03:17:06,155 - DEBUG - =>VN ctest-right_vn-90998694 has no policy to be verified 2025-10-16 03:17:06,155 - DEBUG - Verifying the vn in opserver 2025-10-16 03:17:06,155 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694 virtual network link through opserver 10.0.0.19 2025-10-16 03:17:06,155 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-16 03:17:06,205 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694?flat'} 2025-10-16 03:17:06,206 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694 virtual network link through opserver 10.0.0.57 2025-10-16 03:17:06,206 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-10-16 03:17:06,256 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694?flat'} 2025-10-16 03:17:06,256 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694 virtual network link through opserver 10.0.0.23 2025-10-16 03:17:06,256 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-10-16 03:17:06,308 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694?flat'} 2025-10-16 03:17:06,308 - INFO - Validated that VN default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-90998694 is found in opserver 2025-10-16 03:17:06,328 - DEBUG - Do not have enough data to verify VN in agent 2025-10-16 03:17:06,338 - DEBUG - VRF ids for VN ctest-right_vn-90998694: {} 2025-10-16 03:17:06,393 - DEBUG - Services list from nova: [, , , ] 2025-10-16 03:17:07,424 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4339-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4339-1) 2025-10-16 03:17:08,732 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4339-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4339-2) 2025-10-16 03:17:08,732 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-90123902'] 2025-10-16 03:17:09,041 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-90123902'] created succesfully 2025-10-16 03:17:09,379 - DEBUG - Image by name tiny_nat_fw not found 2025-10-16 03:17:09,379 - DEBUG - Installing image tiny_nat_fw 2025-10-16 03:17:09,379 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-10-16 03:17:09,380 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-16 03:17:09,380 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-16 03:17:09,380 - DEBUG - Unzip image 2025-10-16 03:17:09,380 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-16 03:17:09,399 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-10-16 03:17:09,399 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-90123902'] 2025-10-16 03:17:09,502 - INFO - Service template: ['default-domain', 'ctest-service_template_1-90123902'] deleted successfully. 2025-10-16 03:17:09,502 - INFO - Skip interface_detach for VM ctest-right_vm-99170639 in state BUILD 2025-10-16 03:17:09,502 - INFO - Deleting VM ctest-right_vm-99170639 2025-10-16 03:17:09,552 - ERROR - VM ctest-right_vm-99170639 has failed to come up 2025-10-16 03:17:09,552 - ERROR - Nova failed to get host of the VM 2025-10-16 03:17:09,552 - ERROR - VM ctest-right_vm-99170639 has failed to come up 2025-10-16 03:17:09,552 - ERROR - Nova failed to get host of the VM 2025-10-16 03:17:09,679 - INFO - Skip interface_detach for VM ctest-left_vm-88992837 in state BUILD 2025-10-16 03:17:09,679 - INFO - Deleting VM ctest-left_vm-88992837 2025-10-16 03:17:09,679 - ERROR - VM ctest-left_vm-88992837 has failed to come up 2025-10-16 03:17:09,679 - ERROR - Nova failed to get host of the VM 2025-10-16 03:17:09,679 - ERROR - VM ctest-left_vm-88992837 has failed to come up 2025-10-16 03:17:09,680 - ERROR - Nova failed to get host of the VM 2025-10-16 03:17:09,775 - INFO - Deleting VN ctest-right_vn-90998694 2025-10-16 03:17:09,831 - DEBUG - VN e01b3556-e81b-482f-b644-a014b7ab7b3e still in use: Unable to complete operation on network e01b3556-e81b-482f-b644-a014b7ab7b3e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f65af0f0-dbae-446b-90a6-146dac1fcf3c'] 2025-10-16 03:17:09,832 - WARNING - Deleting VN ctest-right_vn-90998694 failed..Will retry 2025-10-16 03:17:12,133 - DEBUG - Response for deleting network () 2025-10-16 03:17:12,134 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9cb578c6-83fe-4310-a227-8479552d4b4b 2025-10-16 03:17:12,142 - DEBUG - Response Code: 404 2025-10-16 03:17:12,143 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:12,159 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:12,180 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:12,290 - INFO - Validated that VN ctest-right_vn-90998694 is not found in API Server 2025-10-16 03:17:12,303 - DEBUG - VN ctest-right_vn-90998694 is not present in Agent 10.0.0.38 2025-10-16 03:17:12,314 - DEBUG - VN ctest-right_vn-90998694 is not present in Agent 10.0.0.129 2025-10-16 03:17:12,314 - INFO - Validated that VN ctest-right_vn-90998694 is not in any agent 2025-10-16 03:17:12,350 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-90998694 info 2025-10-16 03:17:12,350 - INFO - Deleting VN ctest-left_vn-01155841 2025-10-16 03:17:12,547 - DEBUG - Response for deleting network () 2025-10-16 03:17:12,547 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/0ce1b09f-8504-454c-ad83-d11bbb56230b 2025-10-16 03:17:12,561 - DEBUG - Response Code: 404 2025-10-16 03:17:12,561 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:12,568 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:12,625 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:12,724 - INFO - Validated that VN ctest-left_vn-01155841 is not found in API Server 2025-10-16 03:17:12,741 - DEBUG - VN ctest-left_vn-01155841 is not present in Agent 10.0.0.38 2025-10-16 03:17:12,751 - DEBUG - VN ctest-left_vn-01155841 is not present in Agent 10.0.0.129 2025-10-16 03:17:12,751 - INFO - Validated that VN ctest-left_vn-01155841 is not in any agent 2025-10-16 03:17:12,786 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-01155841 info 2025-10-16 03:17:12,786 - INFO - Deleting VN ctest-mgmt_vn-51657733 2025-10-16 03:17:13,001 - DEBUG - Response for deleting network () 2025-10-16 03:17:13,002 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/9fcf9e75-662c-4341-bdaa-1fccfd9e00de 2025-10-16 03:17:13,007 - DEBUG - Response Code: 404 2025-10-16 03:17:13,007 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:13,013 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:13,024 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:13,119 - INFO - Validated that VN ctest-mgmt_vn-51657733 is not found in API Server 2025-10-16 03:17:13,129 - DEBUG - VN ctest-mgmt_vn-51657733 is not present in Agent 10.0.0.38 2025-10-16 03:17:13,145 - DEBUG - VN ctest-mgmt_vn-51657733 is not present in Agent 10.0.0.129 2025-10-16 03:17:13,145 - INFO - Validated that VN ctest-mgmt_vn-51657733 is not in any agent 2025-10-16 03:17:13,177 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-51657733 info 2025-10-16 03:17:14,472 - DEBUG - No XMPP flaps were noticed during the test 2025-10-16 03:17:14,472 - INFO -
2025-10-16 03:17:14,472 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15]
2025-10-16 03:17:14,472 - INFO - -------------------------------------------------------------------------------- 2025-10-16 03:17:14,476 - INFO - ================================================================================ 2025-10-16 03:17:14,476 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-10-16 03:17:15,767 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.252': '0', '10.20.0.5': '0'}, '10.0.0.129': {'10.20.0.5': '0', '10.20.0.252': '0'}} with 2025-10-16 03:17:15,767 - INFO - Initial checks done. Running the testcase now 2025-10-16 03:17:15,767 - INFO - 2025-10-16 03:17:16,015 - DEBUG - Response for create_network : {'network': {'id': '7a79133c-6629-4572-949d-7db2cd2a9aed', 'name': 'ctest-mgmt_vn-90760129', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'project_id': '66c4edd5ff7741e693df39709ae3fa4b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-40481843', 'ctest-mgmt_vn-90760129'], 'port_security_enabled': True, 'description': ''}} 2025-10-16 03:17:16,236 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ec7721a8-c6f3-4783-819f-4b1a20bc1271', 'name': '', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'network_id': '7a79133c-6629-4572-949d-7db2cd2a9aed', 'ip_version': 4, 'cidr': '22.2.110.192/26', 'allocation_pools': [{'start': '22.2.110.194', 'end': '22.2.110.254'}], 'gateway_ip': '22.2.110.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '22.2.110.194', 'tags': [], 'project_id': '66c4edd5ff7741e693df39709ae3fa4b'}} 2025-10-16 03:17:16,257 - INFO - Created VN ctest-mgmt_vn-90760129 2025-10-16 03:17:16,267 - DEBUG - VN ctest-mgmt_vn-90760129 UUID is 7a79133c-6629-4572-949d-7db2cd2a9aed 2025-10-16 03:17:16,337 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:16,344 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:16,356 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:16,452 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7a79133c-6629-4572-949d-7db2cd2a9aed 2025-10-16 03:17:16,463 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7a79133c-6629-4572-949d-7db2cd2a9aed 2025-10-16 03:17:16,473 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/45137d31-d098-490e-8071-2a34e5c0229b 2025-10-16 03:17:16,483 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/45137d31-d098-490e-8071-2a34e5c0229b 2025-10-16 03:17:16,490 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/661b8dbb-9c69-417b-87d3-40c34ff51899 2025-10-16 03:17:16,497 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-16 03:17:16,498 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7a79133c-6629-4572-949d-7db2cd2a9aed 2025-10-16 03:17:16,507 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/45137d31-d098-490e-8071-2a34e5c0229b 2025-10-16 03:17:16,523 - INFO - Verified VN network id 11 for VN 7a79133c-6629-4572-949d-7db2cd2a9aed 2025-10-16 03:17:16,523 - INFO - Verifications in API Server for VN ctest-mgmt_vn-90760129 passed 2025-10-16 03:17:16,523 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7a79133c-6629-4572-949d-7db2cd2a9aed 2025-10-16 03:17:16,532 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/45137d31-d098-490e-8071-2a34e5c0229b 2025-10-16 03:17:16,540 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/45137d31-d098-490e-8071-2a34e5c0229b 2025-10-16 03:17:16,547 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/661b8dbb-9c69-417b-87d3-40c34ff51899 2025-10-16 03:17:16,560 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8825106094942143858', 'uuid-lslong': '10708853695856679661'}, 'enable': 'true', 'created': '2025-10-16T03:17:15', 'last-modified': '2025-10-16T03:17:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.381182'} 2025-10-16 03:17:16,566 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-16 03:17:16,571 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8825106094942143858', 'uuid-lslong': '10708853695856679661'}, 'enable': 'true', 'created': '2025-10-16T03:17:15', 'last-modified': '2025-10-16T03:17:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.398101'} 2025-10-16 03:17:16,576 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-16 03:17:16,581 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8825106094942143858', 'uuid-lslong': '10708853695856679661'}, 'enable': 'true', 'created': '2025-10-16T03:17:15', 'last-modified': '2025-10-16T03:17:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.408095'} 2025-10-16 03:17:16,586 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-16 03:17:16,586 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-90760129 passed 2025-10-16 03:17:16,586 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-90760129 in API_Server ====== 2025-10-16 03:17:16,586 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:16,592 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:16,603 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:16,694 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7a79133c-6629-4572-949d-7db2cd2a9aed 2025-10-16 03:17:16,708 - DEBUG - =>VN ctest-mgmt_vn-90760129 has no policy to be verified 2025-10-16 03:17:16,708 - DEBUG - Verifying the vn in opserver 2025-10-16 03:17:16,708 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129 virtual network link through opserver 10.0.0.19 2025-10-16 03:17:16,708 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-16 03:17:16,731 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129?flat'} 2025-10-16 03:17:16,731 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129 virtual network link through opserver 10.0.0.57 2025-10-16 03:17:16,731 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-10-16 03:17:16,743 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129?flat'} 2025-10-16 03:17:16,743 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129 virtual network link through opserver 10.0.0.23 2025-10-16 03:17:16,743 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-10-16 03:17:16,755 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129?flat'} 2025-10-16 03:17:16,755 - INFO - Validated that VN default-domain:ctest-TestSvcHC-40481843:ctest-mgmt_vn-90760129 is found in opserver 2025-10-16 03:17:16,779 - DEBUG - Do not have enough data to verify VN in agent 2025-10-16 03:17:16,790 - DEBUG - VRF ids for VN ctest-mgmt_vn-90760129: {} 2025-10-16 03:17:17,116 - DEBUG - Response for create_network : {'network': {'id': 'd95cd538-3547-4f3b-891d-f970096b1427', 'name': 'ctest-left_vn-44240308', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'project_id': '66c4edd5ff7741e693df39709ae3fa4b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-40481843', 'ctest-left_vn-44240308'], 'port_security_enabled': True, 'description': ''}} 2025-10-16 03:17:17,304 - DEBUG - Response for create_subnet : {'subnet': {'id': '2c64ca8c-92bd-48a2-b99b-9a27bc90e58a', 'name': '', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'network_id': 'd95cd538-3547-4f3b-891d-f970096b1427', 'ip_version': 4, 'cidr': '164.166.2.192/26', 'allocation_pools': [{'start': '164.166.2.194', 'end': '164.166.2.254'}], 'gateway_ip': '164.166.2.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '164.166.2.194', 'tags': [], 'project_id': '66c4edd5ff7741e693df39709ae3fa4b'}} 2025-10-16 03:17:17,326 - INFO - Created VN ctest-left_vn-44240308 2025-10-16 03:17:17,340 - DEBUG - VN ctest-left_vn-44240308 UUID is d95cd538-3547-4f3b-891d-f970096b1427 2025-10-16 03:17:17,413 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:17,422 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:17,435 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:17,545 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/d95cd538-3547-4f3b-891d-f970096b1427 2025-10-16 03:17:17,573 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/d95cd538-3547-4f3b-891d-f970096b1427 2025-10-16 03:17:17,597 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8cf0ae48-0d71-41ae-b4d4-46dc0ee4a6e5 2025-10-16 03:17:17,606 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8cf0ae48-0d71-41ae-b4d4-46dc0ee4a6e5 2025-10-16 03:17:17,613 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/3b0ab4c6-f8d6-4ad3-aee0-f1a067178fc2 2025-10-16 03:17:17,621 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-16 03:17:17,621 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/d95cd538-3547-4f3b-891d-f970096b1427 2025-10-16 03:17:17,635 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8cf0ae48-0d71-41ae-b4d4-46dc0ee4a6e5 2025-10-16 03:17:17,673 - INFO - Verified VN network id 12 for VN d95cd538-3547-4f3b-891d-f970096b1427 2025-10-16 03:17:17,673 - INFO - Verifications in API Server for VN ctest-left_vn-44240308 passed 2025-10-16 03:17:17,673 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/d95cd538-3547-4f3b-891d-f970096b1427 2025-10-16 03:17:17,690 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8cf0ae48-0d71-41ae-b4d4-46dc0ee4a6e5 2025-10-16 03:17:17,735 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8cf0ae48-0d71-41ae-b4d4-46dc0ee4a6e5 2025-10-16 03:17:17,749 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/3b0ab4c6-f8d6-4ad3-aee0-f1a067178fc2 2025-10-16 03:17:17,769 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15662628041476493115', 'uuid-lslong': '9880327417110402087'}, 'enable': 'true', 'created': '2025-10-16T03:17:17', 'last-modified': '2025-10-16T03:17:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.504493'} 2025-10-16 03:17:17,782 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-16 03:17:17,789 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15662628041476493115', 'uuid-lslong': '9880327417110402087'}, 'enable': 'true', 'created': '2025-10-16T03:17:17', 'last-modified': '2025-10-16T03:17:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.525263'} 2025-10-16 03:17:17,796 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-16 03:17:17,804 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15662628041476493115', 'uuid-lslong': '9880327417110402087'}, 'enable': 'true', 'created': '2025-10-16T03:17:17', 'last-modified': '2025-10-16T03:17:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.544162'} 2025-10-16 03:17:17,821 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-16 03:17:17,821 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-44240308 passed 2025-10-16 03:17:17,823 - DEBUG - ====Verifying policy data for ctest-left_vn-44240308 in API_Server ====== 2025-10-16 03:17:17,824 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:17,839 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:17,853 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:17,958 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/d95cd538-3547-4f3b-891d-f970096b1427 2025-10-16 03:17:17,966 - DEBUG - =>VN ctest-left_vn-44240308 has no policy to be verified 2025-10-16 03:17:17,967 - DEBUG - Verifying the vn in opserver 2025-10-16 03:17:17,967 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308 virtual network link through opserver 10.0.0.19 2025-10-16 03:17:17,967 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-16 03:17:17,983 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308?flat'} 2025-10-16 03:17:17,983 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308 virtual network link through opserver 10.0.0.57 2025-10-16 03:17:17,984 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-10-16 03:17:17,997 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308?flat'} 2025-10-16 03:17:17,997 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308 virtual network link through opserver 10.0.0.23 2025-10-16 03:17:17,997 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-10-16 03:17:18,009 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308?flat'} 2025-10-16 03:17:18,009 - INFO - Validated that VN default-domain:ctest-TestSvcHC-40481843:ctest-left_vn-44240308 is found in opserver 2025-10-16 03:17:18,033 - DEBUG - Do not have enough data to verify VN in agent 2025-10-16 03:17:18,045 - DEBUG - VRF ids for VN ctest-left_vn-44240308: {} 2025-10-16 03:17:18,317 - DEBUG - Response for create_network : {'network': {'id': '399cfcf4-a066-411b-9b5c-d43fd1d03cc6', 'name': 'ctest-right_vn-55687265', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'project_id': '66c4edd5ff7741e693df39709ae3fa4b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-40481843', 'ctest-right_vn-55687265'], 'port_security_enabled': True, 'description': ''}} 2025-10-16 03:17:18,580 - DEBUG - Response for create_subnet : {'subnet': {'id': '2d334700-c0b8-4de1-8fde-5f5529d314e2', 'name': '', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'network_id': '399cfcf4-a066-411b-9b5c-d43fd1d03cc6', 'ip_version': 4, 'cidr': '174.7.247.192/26', 'allocation_pools': [{'start': '174.7.247.194', 'end': '174.7.247.254'}], 'gateway_ip': '174.7.247.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '174.7.247.194', 'tags': [], 'project_id': '66c4edd5ff7741e693df39709ae3fa4b'}} 2025-10-16 03:17:18,602 - INFO - Created VN ctest-right_vn-55687265 2025-10-16 03:17:18,611 - DEBUG - VN ctest-right_vn-55687265 UUID is 399cfcf4-a066-411b-9b5c-d43fd1d03cc6 2025-10-16 03:17:18,686 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:18,693 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:18,706 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:18,806 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/399cfcf4-a066-411b-9b5c-d43fd1d03cc6 2025-10-16 03:17:18,818 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/399cfcf4-a066-411b-9b5c-d43fd1d03cc6 2025-10-16 03:17:18,828 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a0ce70d2-60bd-4e78-9d5f-22b6702b8285 2025-10-16 03:17:18,840 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a0ce70d2-60bd-4e78-9d5f-22b6702b8285 2025-10-16 03:17:18,849 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/88fa7f37-a035-4a10-a4fa-b37815d3bb12 2025-10-16 03:17:18,858 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-16 03:17:18,858 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/399cfcf4-a066-411b-9b5c-d43fd1d03cc6 2025-10-16 03:17:18,872 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a0ce70d2-60bd-4e78-9d5f-22b6702b8285 2025-10-16 03:17:18,888 - INFO - Verified VN network id 13 for VN 399cfcf4-a066-411b-9b5c-d43fd1d03cc6 2025-10-16 03:17:18,889 - INFO - Verifications in API Server for VN ctest-right_vn-55687265 passed 2025-10-16 03:17:18,889 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/399cfcf4-a066-411b-9b5c-d43fd1d03cc6 2025-10-16 03:17:18,901 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a0ce70d2-60bd-4e78-9d5f-22b6702b8285 2025-10-16 03:17:18,909 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a0ce70d2-60bd-4e78-9d5f-22b6702b8285 2025-10-16 03:17:18,917 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/88fa7f37-a035-4a10-a4fa-b37815d3bb12 2025-10-16 03:17:18,928 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4151471084122030363', 'uuid-lslong': '11195056144304323782'}, 'enable': 'true', 'created': '2025-10-16T03:17:18', 'last-modified': '2025-10-16T03:17:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.400475'} 2025-10-16 03:17:18,934 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-16 03:17:18,939 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4151471084122030363', 'uuid-lslong': '11195056144304323782'}, 'enable': 'true', 'created': '2025-10-16T03:17:18', 'last-modified': '2025-10-16T03:17:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.411717'} 2025-10-16 03:17:18,944 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-16 03:17:18,950 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4151471084122030363', 'uuid-lslong': '11195056144304323782'}, 'enable': 'true', 'created': '2025-10-16T03:17:18', 'last-modified': '2025-10-16T03:17:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419047'} 2025-10-16 03:17:18,955 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-16 03:17:18,955 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-55687265 passed 2025-10-16 03:17:18,956 - DEBUG - ====Verifying policy data for ctest-right_vn-55687265 in API_Server ====== 2025-10-16 03:17:18,956 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:18,964 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:18,976 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:19,072 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/399cfcf4-a066-411b-9b5c-d43fd1d03cc6 2025-10-16 03:17:19,081 - DEBUG - =>VN ctest-right_vn-55687265 has no policy to be verified 2025-10-16 03:17:19,081 - DEBUG - Verifying the vn in opserver 2025-10-16 03:17:19,081 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265 virtual network link through opserver 10.0.0.19 2025-10-16 03:17:19,081 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-16 03:17:19,094 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265?flat'} 2025-10-16 03:17:19,094 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265 virtual network link through opserver 10.0.0.57 2025-10-16 03:17:19,094 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-10-16 03:17:19,109 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265?flat'} 2025-10-16 03:17:19,109 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265 virtual network link through opserver 10.0.0.23 2025-10-16 03:17:19,109 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-10-16 03:17:19,122 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265?flat'} 2025-10-16 03:17:19,122 - INFO - Validated that VN default-domain:ctest-TestSvcHC-40481843:ctest-right_vn-55687265 is found in opserver 2025-10-16 03:17:19,146 - DEBUG - Do not have enough data to verify VN in agent 2025-10-16 03:17:19,157 - DEBUG - VRF ids for VN ctest-right_vn-55687265: {} 2025-10-16 03:17:19,413 - DEBUG - Response for create_network : {'network': {'id': '3bc63268-bd21-4942-9c0d-1a9a7d2504a2', 'name': 'ctest-trans_left_vn-38420081', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'project_id': '66c4edd5ff7741e693df39709ae3fa4b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-40481843', 'ctest-trans_left_vn-38420081'], 'port_security_enabled': True, 'description': ''}} 2025-10-16 03:17:19,641 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ea1692b4-6aea-450e-856a-3c61221b8e10', 'name': '', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'network_id': '3bc63268-bd21-4942-9c0d-1a9a7d2504a2', 'ip_version': 4, 'cidr': '179.229.40.0/26', 'allocation_pools': [{'start': '179.229.40.2', 'end': '179.229.40.62'}], 'gateway_ip': '179.229.40.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '179.229.40.2', 'tags': [], 'project_id': '66c4edd5ff7741e693df39709ae3fa4b'}} 2025-10-16 03:17:19,666 - INFO - Created VN ctest-trans_left_vn-38420081 2025-10-16 03:17:19,677 - DEBUG - VN ctest-trans_left_vn-38420081 UUID is 3bc63268-bd21-4942-9c0d-1a9a7d2504a2 2025-10-16 03:17:19,750 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:19,757 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:19,767 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:19,862 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/3bc63268-bd21-4942-9c0d-1a9a7d2504a2 2025-10-16 03:17:19,875 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/3bc63268-bd21-4942-9c0d-1a9a7d2504a2 2025-10-16 03:17:19,885 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/e86ea474-971f-4558-88be-0e8cf562904b 2025-10-16 03:17:19,893 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/e86ea474-971f-4558-88be-0e8cf562904b 2025-10-16 03:17:19,901 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/042183f8-710a-493b-916e-467821df4b17 2025-10-16 03:17:19,909 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-16 03:17:19,909 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/3bc63268-bd21-4942-9c0d-1a9a7d2504a2 2025-10-16 03:17:19,920 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/e86ea474-971f-4558-88be-0e8cf562904b 2025-10-16 03:17:19,935 - INFO - Verified VN network id 14 for VN 3bc63268-bd21-4942-9c0d-1a9a7d2504a2 2025-10-16 03:17:19,935 - INFO - Verifications in API Server for VN ctest-trans_left_vn-38420081 passed 2025-10-16 03:17:19,935 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/3bc63268-bd21-4942-9c0d-1a9a7d2504a2 2025-10-16 03:17:19,946 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/e86ea474-971f-4558-88be-0e8cf562904b 2025-10-16 03:17:19,956 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/e86ea474-971f-4558-88be-0e8cf562904b 2025-10-16 03:17:19,964 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/042183f8-710a-493b-916e-467821df4b17 2025-10-16 03:17:19,978 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4307185519057520962', 'uuid-lslong': '11244673095440860322'}, 'enable': 'true', 'created': '2025-10-16T03:17:19', 'last-modified': '2025-10-16T03:17:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.385188'} 2025-10-16 03:17:19,985 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-16 03:17:19,991 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4307185519057520962', 'uuid-lslong': '11244673095440860322'}, 'enable': 'true', 'created': '2025-10-16T03:17:19', 'last-modified': '2025-10-16T03:17:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.385877'} 2025-10-16 03:17:19,997 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-16 03:17:20,002 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4307185519057520962', 'uuid-lslong': '11244673095440860322'}, 'enable': 'true', 'created': '2025-10-16T03:17:19', 'last-modified': '2025-10-16T03:17:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.411711'} 2025-10-16 03:17:20,009 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-16 03:17:20,009 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-38420081 passed 2025-10-16 03:17:20,009 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-38420081 in API_Server ====== 2025-10-16 03:17:20,009 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:20,019 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:20,031 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:20,135 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/3bc63268-bd21-4942-9c0d-1a9a7d2504a2 2025-10-16 03:17:20,145 - DEBUG - =>VN ctest-trans_left_vn-38420081 has no policy to be verified 2025-10-16 03:17:20,145 - DEBUG - Verifying the vn in opserver 2025-10-16 03:17:20,145 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081 virtual network link through opserver 10.0.0.19 2025-10-16 03:17:20,145 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-16 03:17:20,163 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081?flat'} 2025-10-16 03:17:20,163 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081 virtual network link through opserver 10.0.0.57 2025-10-16 03:17:20,163 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-10-16 03:17:20,203 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081?flat'} 2025-10-16 03:17:20,203 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081 virtual network link through opserver 10.0.0.23 2025-10-16 03:17:20,203 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-10-16 03:17:20,217 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081?flat'} 2025-10-16 03:17:20,217 - INFO - Validated that VN default-domain:ctest-TestSvcHC-40481843:ctest-trans_left_vn-38420081 is found in opserver 2025-10-16 03:17:20,240 - DEBUG - Do not have enough data to verify VN in agent 2025-10-16 03:17:20,252 - DEBUG - VRF ids for VN ctest-trans_left_vn-38420081: {} 2025-10-16 03:17:20,493 - DEBUG - Response for create_network : {'network': {'id': 'bc01a27b-a3a6-4bd0-b61b-ebd1ae091724', 'name': 'ctest-trans_right_vn-99173095', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'project_id': '66c4edd5ff7741e693df39709ae3fa4b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-40481843', 'ctest-trans_right_vn-99173095'], 'port_security_enabled': True, 'description': ''}} 2025-10-16 03:17:20,723 - DEBUG - Response for create_subnet : {'subnet': {'id': '8f1d9336-dec8-4004-b2b4-aee13e08a8a1', 'name': '', 'tenant_id': '66c4edd5ff7741e693df39709ae3fa4b', 'network_id': 'bc01a27b-a3a6-4bd0-b61b-ebd1ae091724', 'ip_version': 4, 'cidr': '148.73.224.128/26', 'allocation_pools': [{'start': '148.73.224.130', 'end': '148.73.224.190'}], 'gateway_ip': '148.73.224.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '148.73.224.130', 'tags': [], 'project_id': '66c4edd5ff7741e693df39709ae3fa4b'}} 2025-10-16 03:17:20,746 - INFO - Created VN ctest-trans_right_vn-99173095 2025-10-16 03:17:20,758 - DEBUG - VN ctest-trans_right_vn-99173095 UUID is bc01a27b-a3a6-4bd0-b61b-ebd1ae091724 2025-10-16 03:17:20,835 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:20,843 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:20,854 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:20,947 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/bc01a27b-a3a6-4bd0-b61b-ebd1ae091724 2025-10-16 03:17:20,961 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/bc01a27b-a3a6-4bd0-b61b-ebd1ae091724 2025-10-16 03:17:20,973 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a950da7f-eaa2-4fe2-9bd9-69ed8ba2b5e4 2025-10-16 03:17:20,980 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a950da7f-eaa2-4fe2-9bd9-69ed8ba2b5e4 2025-10-16 03:17:20,988 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b2163f9e-fc44-44ce-940d-c2fc0f3de412 2025-10-16 03:17:20,996 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-16 03:17:20,996 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/bc01a27b-a3a6-4bd0-b61b-ebd1ae091724 2025-10-16 03:17:21,006 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a950da7f-eaa2-4fe2-9bd9-69ed8ba2b5e4 2025-10-16 03:17:21,021 - INFO - Verified VN network id 15 for VN bc01a27b-a3a6-4bd0-b61b-ebd1ae091724 2025-10-16 03:17:21,021 - INFO - Verifications in API Server for VN ctest-trans_right_vn-99173095 passed 2025-10-16 03:17:21,021 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/bc01a27b-a3a6-4bd0-b61b-ebd1ae091724 2025-10-16 03:17:21,031 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a950da7f-eaa2-4fe2-9bd9-69ed8ba2b5e4 2025-10-16 03:17:21,039 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a950da7f-eaa2-4fe2-9bd9-69ed8ba2b5e4 2025-10-16 03:17:21,046 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b2163f9e-fc44-44ce-940d-c2fc0f3de412 2025-10-16 03:17:21,058 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13547287806017424336', 'uuid-lslong': '13122341225074595620'}, 'enable': 'true', 'created': '2025-10-16T03:17:20', 'last-modified': '2025-10-16T03:17:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.401277'} 2025-10-16 03:17:21,064 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-16 03:17:21,070 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13547287806017424336', 'uuid-lslong': '13122341225074595620'}, 'enable': 'true', 'created': '2025-10-16T03:17:20', 'last-modified': '2025-10-16T03:17:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414921'} 2025-10-16 03:17:21,075 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-16 03:17:21,081 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-40481843', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13547287806017424336', 'uuid-lslong': '13122341225074595620'}, 'enable': 'true', 'created': '2025-10-16T03:17:20', 'last-modified': '2025-10-16T03:17:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423273'} 2025-10-16 03:17:21,087 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-16 03:17:21,087 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-99173095 passed 2025-10-16 03:17:21,087 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-99173095 in API_Server ====== 2025-10-16 03:17:21,087 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:21,094 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:21,106 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:21,199 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/bc01a27b-a3a6-4bd0-b61b-ebd1ae091724 2025-10-16 03:17:21,211 - DEBUG - =>VN ctest-trans_right_vn-99173095 has no policy to be verified 2025-10-16 03:17:21,211 - DEBUG - Verifying the vn in opserver 2025-10-16 03:17:21,211 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095 virtual network link through opserver 10.0.0.19 2025-10-16 03:17:21,211 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-16 03:17:21,223 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095?flat'} 2025-10-16 03:17:21,223 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095 virtual network link through opserver 10.0.0.57 2025-10-16 03:17:21,223 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-10-16 03:17:21,237 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095?flat'} 2025-10-16 03:17:21,237 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095 virtual network link through opserver 10.0.0.23 2025-10-16 03:17:21,238 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-10-16 03:17:21,249 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095?flat'} 2025-10-16 03:17:21,249 - INFO - Validated that VN default-domain:ctest-TestSvcHC-40481843:ctest-trans_right_vn-99173095 is found in opserver 2025-10-16 03:17:21,269 - DEBUG - Do not have enough data to verify VN in agent 2025-10-16 03:17:21,279 - DEBUG - VRF ids for VN ctest-trans_right_vn-99173095: {} 2025-10-16 03:17:22,310 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4339-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4339-2) 2025-10-16 03:17:23,645 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4339-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4339-1) 2025-10-16 03:17:23,646 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-99845355'] 2025-10-16 03:17:23,941 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-99845355'] created succesfully 2025-10-16 03:17:24,242 - DEBUG - Image by name tiny_trans_fw not found 2025-10-16 03:17:24,242 - DEBUG - Installing image tiny_trans_fw 2025-10-16 03:17:24,243 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-10-16 03:17:24,243 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-16 03:17:24,243 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-16 03:17:24,243 - DEBUG - Unzip image 2025-10-16 03:17:24,243 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-16 03:17:24,270 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-10-16 03:17:24,271 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-99845355'] 2025-10-16 03:17:24,358 - INFO - Service template: ['default-domain', 'ctest-service_template_1-99845355'] deleted successfully. 2025-10-16 03:17:24,358 - INFO - Skip interface_detach for VM ctest-right_vm-85475359 in state BUILD 2025-10-16 03:17:24,358 - INFO - Deleting VM ctest-right_vm-85475359 2025-10-16 03:17:24,359 - ERROR - VM ctest-right_vm-85475359 has failed to come up 2025-10-16 03:17:24,359 - ERROR - Nova failed to get host of the VM 2025-10-16 03:17:24,359 - ERROR - VM ctest-right_vm-85475359 has failed to come up 2025-10-16 03:17:24,359 - ERROR - Nova failed to get host of the VM 2025-10-16 03:17:24,509 - INFO - Skip interface_detach for VM ctest-left_vm-05818435 in state BUILD 2025-10-16 03:17:24,510 - INFO - Deleting VM ctest-left_vm-05818435 2025-10-16 03:17:24,511 - ERROR - VM ctest-left_vm-05818435 has failed to come up 2025-10-16 03:17:24,511 - ERROR - Nova failed to get host of the VM 2025-10-16 03:17:24,512 - ERROR - VM ctest-left_vm-05818435 has failed to come up 2025-10-16 03:17:24,513 - ERROR - Nova failed to get host of the VM 2025-10-16 03:17:24,601 - INFO - Deleting VN ctest-trans_right_vn-99173095 2025-10-16 03:17:24,758 - DEBUG - Response for deleting network () 2025-10-16 03:17:24,758 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a950da7f-eaa2-4fe2-9bd9-69ed8ba2b5e4 2025-10-16 03:17:24,770 - DEBUG - Response Code: 404 2025-10-16 03:17:24,771 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:24,786 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:24,843 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:24,933 - INFO - Validated that VN ctest-trans_right_vn-99173095 is not found in API Server 2025-10-16 03:17:24,964 - DEBUG - VN ctest-trans_right_vn-99173095 is not present in Agent 10.0.0.38 2025-10-16 03:17:24,974 - DEBUG - VN ctest-trans_right_vn-99173095 is not present in Agent 10.0.0.129 2025-10-16 03:17:24,974 - INFO - Validated that VN ctest-trans_right_vn-99173095 is not in any agent 2025-10-16 03:17:25,011 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-99173095 info 2025-10-16 03:17:25,011 - INFO - Deleting VN ctest-trans_left_vn-38420081 2025-10-16 03:17:25,142 - DEBUG - Response for deleting network () 2025-10-16 03:17:25,142 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/e86ea474-971f-4558-88be-0e8cf562904b 2025-10-16 03:17:25,150 - DEBUG - Response Code: 404 2025-10-16 03:17:25,150 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:25,159 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:25,172 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:25,269 - INFO - Validated that VN ctest-trans_left_vn-38420081 is not found in API Server 2025-10-16 03:17:25,286 - DEBUG - VN ctest-trans_left_vn-38420081 is not present in Agent 10.0.0.38 2025-10-16 03:17:25,300 - DEBUG - VN ctest-trans_left_vn-38420081 is not present in Agent 10.0.0.129 2025-10-16 03:17:25,300 - INFO - Validated that VN ctest-trans_left_vn-38420081 is not in any agent 2025-10-16 03:17:25,342 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-38420081 info 2025-10-16 03:17:25,342 - INFO - Deleting VN ctest-right_vn-55687265 2025-10-16 03:17:25,380 - DEBUG - VN 399cfcf4-a066-411b-9b5c-d43fd1d03cc6 still in use: Unable to complete operation on network 399cfcf4-a066-411b-9b5c-d43fd1d03cc6. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-8481b22e-ae0b-4df2-98f2-e3a196e57a43'] 2025-10-16 03:17:25,380 - WARNING - Deleting VN ctest-right_vn-55687265 failed..Will retry 2025-10-16 03:17:27,535 - DEBUG - Response for deleting network () 2025-10-16 03:17:27,535 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a0ce70d2-60bd-4e78-9d5f-22b6702b8285 2025-10-16 03:17:27,541 - DEBUG - Response Code: 404 2025-10-16 03:17:27,541 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:27,551 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:27,569 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:27,657 - INFO - Validated that VN ctest-right_vn-55687265 is not found in API Server 2025-10-16 03:17:27,669 - DEBUG - VN ctest-right_vn-55687265 is not present in Agent 10.0.0.38 2025-10-16 03:17:27,680 - DEBUG - VN ctest-right_vn-55687265 is not present in Agent 10.0.0.129 2025-10-16 03:17:27,680 - INFO - Validated that VN ctest-right_vn-55687265 is not in any agent 2025-10-16 03:17:27,713 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-55687265 info 2025-10-16 03:17:27,714 - INFO - Deleting VN ctest-left_vn-44240308 2025-10-16 03:17:27,868 - DEBUG - Response for deleting network () 2025-10-16 03:17:27,868 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8cf0ae48-0d71-41ae-b4d4-46dc0ee4a6e5 2025-10-16 03:17:27,875 - DEBUG - Response Code: 404 2025-10-16 03:17:27,875 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:27,881 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:27,944 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:28,036 - INFO - Validated that VN ctest-left_vn-44240308 is not found in API Server 2025-10-16 03:17:28,048 - DEBUG - VN ctest-left_vn-44240308 is not present in Agent 10.0.0.38 2025-10-16 03:17:28,058 - DEBUG - VN ctest-left_vn-44240308 is not present in Agent 10.0.0.129 2025-10-16 03:17:28,058 - INFO - Validated that VN ctest-left_vn-44240308 is not in any agent 2025-10-16 03:17:28,091 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-44240308 info 2025-10-16 03:17:28,092 - INFO - Deleting VN ctest-mgmt_vn-90760129 2025-10-16 03:17:28,225 - DEBUG - Response for deleting network () 2025-10-16 03:17:28,225 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/45137d31-d098-490e-8071-2a34e5c0229b 2025-10-16 03:17:28,231 - DEBUG - Response Code: 404 2025-10-16 03:17:28,231 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-10-16 03:17:28,237 - DEBUG - Requesting: http://10.0.0.19:8082/domain/446ea2e6-9d96-4973-a55a-3f633ea4d0f9 2025-10-16 03:17:28,252 - DEBUG - Requesting: http://10.0.0.19:8082/project/66c4edd5-ff77-41e6-93df-39709ae3fa4b 2025-10-16 03:17:28,341 - INFO - Validated that VN ctest-mgmt_vn-90760129 is not found in API Server 2025-10-16 03:17:28,351 - DEBUG - VN ctest-mgmt_vn-90760129 is not present in Agent 10.0.0.38 2025-10-16 03:17:28,362 - DEBUG - VN ctest-mgmt_vn-90760129 is not present in Agent 10.0.0.129 2025-10-16 03:17:28,362 - INFO - Validated that VN ctest-mgmt_vn-90760129 is not in any agent 2025-10-16 03:17:28,395 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-90760129 info 2025-10-16 03:17:29,677 - DEBUG - No XMPP flaps were noticed during the test 2025-10-16 03:17:29,677 - INFO -
2025-10-16 03:17:29,677 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15]
2025-10-16 03:17:29,677 - INFO - -------------------------------------------------------------------------------- 2025-10-16 03:17:30,424 - INFO - Deleted project: ctest-TestSvcHC-40481843, ID : 66c4edd5-ff77-41e6-93df-39709ae3fa4b