2025-10-15 16:47:03,433 - INFO - Domain Default found not creating 2025-10-15 16:47:03,579 - INFO - Project ctest-TestSvcHC-67581176 not found, creating it 2025-10-15 16:47:04,095 - INFO - Created Project:ctest-TestSvcHC-67581176, ID : e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:05,478 - INFO - ================================================================================ 2025-10-15 16:47:05,478 - INFO - STARTING TEST : test_svc_hc_basic 2025-10-15 16:47:06,778 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.5': '0', '10.20.0.18': '0'}, '10.0.0.33': {'10.20.0.18': '0', '10.20.0.252': '0'}} with 2025-10-15 16:47:06,778 - INFO - Initial checks done. Running the testcase now 2025-10-15 16:47:06,778 - INFO - 2025-10-15 16:47:07,455 - DEBUG - Response for create_network : {'network': {'id': '79c3c0b8-6dab-4877-84c0-8fa8630a2af7', 'name': 'ctest-mgmt_vn-22059609', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67581176', 'ctest-mgmt_vn-22059609'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:07,765 - DEBUG - Response for create_subnet : {'subnet': {'id': '62c8421c-a013-48c1-97ba-f957899d6991', 'name': '', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'network_id': '79c3c0b8-6dab-4877-84c0-8fa8630a2af7', 'ip_version': 4, 'cidr': '30.101.52.0/26', 'allocation_pools': [{'start': '30.101.52.2', 'end': '30.101.52.62'}], 'gateway_ip': '30.101.52.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.101.52.2', 'tags': [], 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec'}} 2025-10-15 16:47:07,785 - INFO - Created VN ctest-mgmt_vn-22059609 2025-10-15 16:47:07,797 - DEBUG - VN ctest-mgmt_vn-22059609 UUID is 79c3c0b8-6dab-4877-84c0-8fa8630a2af7 2025-10-15 16:47:07,880 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:08,188 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:08,215 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:08,233 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:08,317 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/79c3c0b8-6dab-4877-84c0-8fa8630a2af7 2025-10-15 16:47:08,329 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/79c3c0b8-6dab-4877-84c0-8fa8630a2af7 2025-10-15 16:47:08,338 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/b2e40806-6e79-4e66-b602-6d5fba6fdc1b 2025-10-15 16:47:08,347 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/b2e40806-6e79-4e66-b602-6d5fba6fdc1b 2025-10-15 16:47:08,354 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/24b7ee68-5f32-4248-aa10-ca31ced34e82 2025-10-15 16:47:08,361 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:08,362 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/79c3c0b8-6dab-4877-84c0-8fa8630a2af7 2025-10-15 16:47:08,371 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/b2e40806-6e79-4e66-b602-6d5fba6fdc1b 2025-10-15 16:47:08,388 - INFO - Verified VN network id 15 for VN 79c3c0b8-6dab-4877-84c0-8fa8630a2af7 2025-10-15 16:47:08,388 - INFO - Verifications in API Server for VN ctest-mgmt_vn-22059609 passed 2025-10-15 16:47:08,388 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/79c3c0b8-6dab-4877-84c0-8fa8630a2af7 2025-10-15 16:47:08,399 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/b2e40806-6e79-4e66-b602-6d5fba6fdc1b 2025-10-15 16:47:08,406 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/b2e40806-6e79-4e66-b602-6d5fba6fdc1b 2025-10-15 16:47:08,414 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/24b7ee68-5f32-4248-aa10-ca31ced34e82 2025-10-15 16:47:08,427 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8774068397394315383', 'uuid-lslong': '9565803561913821943'}, 'enable': 'true', 'created': '2025-10-15T16:47:07', 'last-modified': '2025-10-15T16:47:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.697424'} 2025-10-15 16:47:08,434 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:08,443 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8774068397394315383', 'uuid-lslong': '9565803561913821943'}, 'enable': 'true', 'created': '2025-10-15T16:47:07', 'last-modified': '2025-10-15T16:47:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.713999'} 2025-10-15 16:47:08,449 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:08,456 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8774068397394315383', 'uuid-lslong': '9565803561913821943'}, 'enable': 'true', 'created': '2025-10-15T16:47:07', 'last-modified': '2025-10-15T16:47:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.728281'} 2025-10-15 16:47:08,464 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:08,464 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-22059609 passed 2025-10-15 16:47:08,464 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-22059609 in API_Server ====== 2025-10-15 16:47:08,464 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:08,471 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:08,487 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:08,571 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/79c3c0b8-6dab-4877-84c0-8fa8630a2af7 2025-10-15 16:47:08,581 - DEBUG - =>VN ctest-mgmt_vn-22059609 has no policy to be verified 2025-10-15 16:47:08,581 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:08,581 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:08,581 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:08,872 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:08,932 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609?flat'} 2025-10-15 16:47:08,932 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:08,932 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:09,225 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:09,284 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609?flat'} 2025-10-15 16:47:09,284 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:09,285 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:09,591 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:09,653 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609?flat'} 2025-10-15 16:47:09,653 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-22059609 is found in opserver 2025-10-15 16:47:09,672 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:09,680 - DEBUG - VRF ids for VN ctest-mgmt_vn-22059609: {} 2025-10-15 16:47:09,925 - DEBUG - Response for create_network : {'network': {'id': '5d16977e-dd3c-4c12-9b76-77aa12be761b', 'name': 'ctest-left_vn-22342109', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67581176', 'ctest-left_vn-22342109'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:10,124 - DEBUG - Response for create_subnet : {'subnet': {'id': '046baffa-7d84-45ee-9992-4c09943a741d', 'name': '', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'network_id': '5d16977e-dd3c-4c12-9b76-77aa12be761b', 'ip_version': 4, 'cidr': '175.191.161.0/26', 'allocation_pools': [{'start': '175.191.161.2', 'end': '175.191.161.62'}], 'gateway_ip': '175.191.161.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '175.191.161.2', 'tags': [], 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec'}} 2025-10-15 16:47:10,152 - INFO - Created VN ctest-left_vn-22342109 2025-10-15 16:47:10,169 - DEBUG - VN ctest-left_vn-22342109 UUID is 5d16977e-dd3c-4c12-9b76-77aa12be761b 2025-10-15 16:47:10,245 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:10,251 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:10,264 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:10,352 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5d16977e-dd3c-4c12-9b76-77aa12be761b 2025-10-15 16:47:10,363 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5d16977e-dd3c-4c12-9b76-77aa12be761b 2025-10-15 16:47:10,374 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/560dfb26-7df8-4ca5-9618-dd8f86d0d755 2025-10-15 16:47:10,381 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/560dfb26-7df8-4ca5-9618-dd8f86d0d755 2025-10-15 16:47:10,389 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/653767e4-4d2f-4e9e-af23-f0682423c6c8 2025-10-15 16:47:10,398 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:10,399 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5d16977e-dd3c-4c12-9b76-77aa12be761b 2025-10-15 16:47:10,409 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/560dfb26-7df8-4ca5-9618-dd8f86d0d755 2025-10-15 16:47:10,426 - INFO - Verified VN network id 16 for VN 5d16977e-dd3c-4c12-9b76-77aa12be761b 2025-10-15 16:47:10,426 - INFO - Verifications in API Server for VN ctest-left_vn-22342109 passed 2025-10-15 16:47:10,426 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5d16977e-dd3c-4c12-9b76-77aa12be761b 2025-10-15 16:47:10,442 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/560dfb26-7df8-4ca5-9618-dd8f86d0d755 2025-10-15 16:47:10,451 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/560dfb26-7df8-4ca5-9618-dd8f86d0d755 2025-10-15 16:47:10,460 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/653767e4-4d2f-4e9e-af23-f0682423c6c8 2025-10-15 16:47:10,474 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6707715266148322322', 'uuid-lslong': '11202272695473305115'}, 'enable': 'true', 'created': '2025-10-15T16:47:09', 'last-modified': '2025-10-15T16:47:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.398086'} 2025-10-15 16:47:10,482 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:10,490 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6707715266148322322', 'uuid-lslong': '11202272695473305115'}, 'enable': 'true', 'created': '2025-10-15T16:47:09', 'last-modified': '2025-10-15T16:47:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.412989'} 2025-10-15 16:47:10,499 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:10,506 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6707715266148322322', 'uuid-lslong': '11202272695473305115'}, 'enable': 'true', 'created': '2025-10-15T16:47:09', 'last-modified': '2025-10-15T16:47:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.430583'} 2025-10-15 16:47:10,515 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:10,515 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-22342109 passed 2025-10-15 16:47:10,515 - DEBUG - ====Verifying policy data for ctest-left_vn-22342109 in API_Server ====== 2025-10-15 16:47:10,516 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:10,525 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:10,543 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:10,648 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5d16977e-dd3c-4c12-9b76-77aa12be761b 2025-10-15 16:47:10,661 - DEBUG - =>VN ctest-left_vn-22342109 has no policy to be verified 2025-10-15 16:47:10,662 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:10,662 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:10,662 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:10,731 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109?flat'} 2025-10-15 16:47:10,731 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:10,731 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:10,799 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109?flat'} 2025-10-15 16:47:10,799 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:10,799 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:10,856 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109?flat'} 2025-10-15 16:47:10,856 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-22342109 is found in opserver 2025-10-15 16:47:10,877 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:10,888 - DEBUG - VRF ids for VN ctest-left_vn-22342109: {} 2025-10-15 16:47:11,143 - DEBUG - Response for create_network : {'network': {'id': '9109751d-8670-41cf-b1c9-23e414141dcc', 'name': 'ctest-right_vn-98279261', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67581176', 'ctest-right_vn-98279261'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:11,386 - DEBUG - Response for create_subnet : {'subnet': {'id': '5a9960e4-e448-4c41-806e-ba81f76342e0', 'name': '', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'network_id': '9109751d-8670-41cf-b1c9-23e414141dcc', 'ip_version': 4, 'cidr': '146.82.250.64/26', 'allocation_pools': [{'start': '146.82.250.66', 'end': '146.82.250.126'}], 'gateway_ip': '146.82.250.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '146.82.250.66', 'tags': [], 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec'}} 2025-10-15 16:47:11,409 - INFO - Created VN ctest-right_vn-98279261 2025-10-15 16:47:11,422 - DEBUG - VN ctest-right_vn-98279261 UUID is 9109751d-8670-41cf-b1c9-23e414141dcc 2025-10-15 16:47:11,500 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:11,507 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:11,518 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:11,605 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/9109751d-8670-41cf-b1c9-23e414141dcc 2025-10-15 16:47:11,618 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/9109751d-8670-41cf-b1c9-23e414141dcc 2025-10-15 16:47:11,627 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/626e8809-4bf6-44e9-949f-1a203eba0229 2025-10-15 16:47:11,635 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/626e8809-4bf6-44e9-949f-1a203eba0229 2025-10-15 16:47:11,643 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/4156a339-4f64-4412-aace-bce7bd847556 2025-10-15 16:47:11,651 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:11,651 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/9109751d-8670-41cf-b1c9-23e414141dcc 2025-10-15 16:47:11,663 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/626e8809-4bf6-44e9-949f-1a203eba0229 2025-10-15 16:47:11,679 - INFO - Verified VN network id 17 for VN 9109751d-8670-41cf-b1c9-23e414141dcc 2025-10-15 16:47:11,679 - INFO - Verifications in API Server for VN ctest-right_vn-98279261 passed 2025-10-15 16:47:11,680 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/9109751d-8670-41cf-b1c9-23e414141dcc 2025-10-15 16:47:11,690 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/626e8809-4bf6-44e9-949f-1a203eba0229 2025-10-15 16:47:11,701 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/626e8809-4bf6-44e9-949f-1a203eba0229 2025-10-15 16:47:11,717 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/4156a339-4f64-4412-aace-bce7bd847556 2025-10-15 16:47:11,743 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10451013179959951823', 'uuid-lslong': '12810810077528464844'}, 'enable': 'true', 'created': '2025-10-15T16:47:11', 'last-modified': '2025-10-15T16:47:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399494'} 2025-10-15 16:47:11,750 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:11,757 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10451013179959951823', 'uuid-lslong': '12810810077528464844'}, 'enable': 'true', 'created': '2025-10-15T16:47:11', 'last-modified': '2025-10-15T16:47:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414124'} 2025-10-15 16:47:11,764 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:11,770 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10451013179959951823', 'uuid-lslong': '12810810077528464844'}, 'enable': 'true', 'created': '2025-10-15T16:47:11', 'last-modified': '2025-10-15T16:47:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424949'} 2025-10-15 16:47:11,777 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:11,777 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-98279261 passed 2025-10-15 16:47:11,777 - DEBUG - ====Verifying policy data for ctest-right_vn-98279261 in API_Server ====== 2025-10-15 16:47:11,777 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:11,784 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:11,794 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:11,881 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/9109751d-8670-41cf-b1c9-23e414141dcc 2025-10-15 16:47:11,892 - DEBUG - =>VN ctest-right_vn-98279261 has no policy to be verified 2025-10-15 16:47:11,892 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:11,892 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:11,892 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:11,955 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261?flat'} 2025-10-15 16:47:11,955 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:11,955 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:12,025 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261?flat'} 2025-10-15 16:47:12,025 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:12,025 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:12,085 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261?flat'} 2025-10-15 16:47:12,085 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-98279261 is found in opserver 2025-10-15 16:47:12,108 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:12,120 - DEBUG - VRF ids for VN ctest-right_vn-98279261: {} 2025-10-15 16:47:12,174 - DEBUG - Services list from nova: [, , , ] 2025-10-15 16:47:13,146 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-1) 2025-10-15 16:47:14,272 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-2) 2025-10-15 16:47:14,272 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-28613110'] 2025-10-15 16:47:14,583 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-28613110'] created succesfully 2025-10-15 16:47:14,913 - DEBUG - Image by name tiny_nat_fw not found 2025-10-15 16:47:14,913 - DEBUG - Installing image tiny_nat_fw 2025-10-15 16:47:14,913 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-10-15 16:47:14,913 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-15 16:47:14,913 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-15 16:47:14,913 - DEBUG - Unzip image 2025-10-15 16:47:14,913 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-15 16:47:14,932 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-10-15 16:47:14,933 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-28613110'] 2025-10-15 16:47:15,029 - INFO - Service template: ['default-domain', 'ctest-service_template_1-28613110'] deleted successfully. 2025-10-15 16:47:15,029 - INFO - Skip interface_detach for VM ctest-right_vm-86087267 in state BUILD 2025-10-15 16:47:15,029 - INFO - Deleting VM ctest-right_vm-86087267 2025-10-15 16:47:15,057 - ERROR - VM ctest-right_vm-86087267 has failed to come up 2025-10-15 16:47:15,057 - ERROR - Nova failed to get host of the VM 2025-10-15 16:47:15,057 - ERROR - VM ctest-right_vm-86087267 has failed to come up 2025-10-15 16:47:15,057 - ERROR - Nova failed to get host of the VM 2025-10-15 16:47:15,135 - INFO - Skip interface_detach for VM ctest-left_vm-21647821 in state BUILD 2025-10-15 16:47:15,135 - INFO - Deleting VM ctest-left_vm-21647821 2025-10-15 16:47:15,135 - ERROR - VM ctest-left_vm-21647821 has failed to come up 2025-10-15 16:47:15,135 - ERROR - Nova failed to get host of the VM 2025-10-15 16:47:15,135 - ERROR - VM ctest-left_vm-21647821 has failed to come up 2025-10-15 16:47:15,135 - ERROR - Nova failed to get host of the VM 2025-10-15 16:47:15,206 - INFO - Deleting VN ctest-right_vn-98279261 2025-10-15 16:47:15,246 - DEBUG - VN 9109751d-8670-41cf-b1c9-23e414141dcc still in use: Unable to complete operation on network 9109751d-8670-41cf-b1c9-23e414141dcc. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-ceb011a4-6335-4581-9847-06c110802ba0'] 2025-10-15 16:47:15,246 - WARNING - Deleting VN ctest-right_vn-98279261 failed..Will retry 2025-10-15 16:47:17,412 - DEBUG - Response for deleting network () 2025-10-15 16:47:17,412 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/626e8809-4bf6-44e9-949f-1a203eba0229 2025-10-15 16:47:17,421 - DEBUG - Response Code: 404 2025-10-15 16:47:17,421 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:17,433 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:17,489 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:17,586 - INFO - Validated that VN ctest-right_vn-98279261 is not found in API Server 2025-10-15 16:47:17,598 - DEBUG - VN ctest-right_vn-98279261 is not present in Agent 10.0.0.141 2025-10-15 16:47:17,613 - DEBUG - VN ctest-right_vn-98279261 is not present in Agent 10.0.0.33 2025-10-15 16:47:17,613 - INFO - Validated that VN ctest-right_vn-98279261 is not in any agent 2025-10-15 16:47:17,653 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-98279261 info 2025-10-15 16:47:17,653 - INFO - Deleting VN ctest-left_vn-22342109 2025-10-15 16:47:17,828 - DEBUG - Response for deleting network () 2025-10-15 16:47:17,828 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/560dfb26-7df8-4ca5-9618-dd8f86d0d755 2025-10-15 16:47:17,836 - DEBUG - Response Code: 404 2025-10-15 16:47:17,836 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:17,843 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:17,854 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:17,945 - INFO - Validated that VN ctest-left_vn-22342109 is not found in API Server 2025-10-15 16:47:17,955 - DEBUG - VN ctest-left_vn-22342109 is not present in Agent 10.0.0.141 2025-10-15 16:47:17,967 - DEBUG - VN ctest-left_vn-22342109 is not present in Agent 10.0.0.33 2025-10-15 16:47:17,967 - INFO - Validated that VN ctest-left_vn-22342109 is not in any agent 2025-10-15 16:47:18,007 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-22342109 info 2025-10-15 16:47:18,007 - INFO - Deleting VN ctest-mgmt_vn-22059609 2025-10-15 16:47:18,187 - DEBUG - Response for deleting network () 2025-10-15 16:47:18,187 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/b2e40806-6e79-4e66-b602-6d5fba6fdc1b 2025-10-15 16:47:18,194 - DEBUG - Response Code: 404 2025-10-15 16:47:18,194 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:18,214 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:18,227 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:18,315 - INFO - Validated that VN ctest-mgmt_vn-22059609 is not found in API Server 2025-10-15 16:47:18,327 - DEBUG - VN ctest-mgmt_vn-22059609 is not present in Agent 10.0.0.141 2025-10-15 16:47:18,338 - DEBUG - VN ctest-mgmt_vn-22059609 is not present in Agent 10.0.0.33 2025-10-15 16:47:18,338 - INFO - Validated that VN ctest-mgmt_vn-22059609 is not in any agent 2025-10-15 16:47:18,371 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-22059609 info 2025-10-15 16:47:19,688 - DEBUG - No XMPP flaps were noticed during the test 2025-10-15 16:47:19,688 - INFO -
2025-10-15 16:47:19,688 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:14]
2025-10-15 16:47:19,688 - INFO - -------------------------------------------------------------------------------- 2025-10-15 16:47:19,692 - INFO - ================================================================================ 2025-10-15 16:47:19,692 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-10-15 16:47:21,009 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.5': '0', '10.20.0.18': '0'}, '10.0.0.33': {'10.20.0.18': '0', '10.20.0.252': '0'}} with 2025-10-15 16:47:21,009 - INFO - Initial checks done. Running the testcase now 2025-10-15 16:47:21,009 - INFO - 2025-10-15 16:47:21,297 - DEBUG - Response for create_network : {'network': {'id': '1eb9457c-e6ac-428b-a709-aa9d9cef8b3e', 'name': 'ctest-mgmt_vn-36997631', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67581176', 'ctest-mgmt_vn-36997631'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:21,503 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b9513ad1-d53b-47ca-b5c2-fd4c45b8ec60', 'name': '', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'network_id': '1eb9457c-e6ac-428b-a709-aa9d9cef8b3e', 'ip_version': 4, 'cidr': '102.9.90.0/26', 'allocation_pools': [{'start': '102.9.90.2', 'end': '102.9.90.62'}], 'gateway_ip': '102.9.90.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '102.9.90.2', 'tags': [], 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec'}} 2025-10-15 16:47:21,530 - INFO - Created VN ctest-mgmt_vn-36997631 2025-10-15 16:47:21,542 - DEBUG - VN ctest-mgmt_vn-36997631 UUID is 1eb9457c-e6ac-428b-a709-aa9d9cef8b3e 2025-10-15 16:47:21,630 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:21,636 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:21,651 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:21,737 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/1eb9457c-e6ac-428b-a709-aa9d9cef8b3e 2025-10-15 16:47:21,752 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/1eb9457c-e6ac-428b-a709-aa9d9cef8b3e 2025-10-15 16:47:21,763 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/cfeb9563-f29b-46fa-b33c-85f6e05cd4ee 2025-10-15 16:47:21,774 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/cfeb9563-f29b-46fa-b33c-85f6e05cd4ee 2025-10-15 16:47:21,782 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/34cf23a8-3870-480e-8caa-5ef3ade2716c 2025-10-15 16:47:21,790 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:21,790 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/1eb9457c-e6ac-428b-a709-aa9d9cef8b3e 2025-10-15 16:47:21,801 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/cfeb9563-f29b-46fa-b33c-85f6e05cd4ee 2025-10-15 16:47:21,819 - INFO - Verified VN network id 15 for VN 1eb9457c-e6ac-428b-a709-aa9d9cef8b3e 2025-10-15 16:47:21,820 - INFO - Verifications in API Server for VN ctest-mgmt_vn-36997631 passed 2025-10-15 16:47:21,820 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/1eb9457c-e6ac-428b-a709-aa9d9cef8b3e 2025-10-15 16:47:21,833 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/cfeb9563-f29b-46fa-b33c-85f6e05cd4ee 2025-10-15 16:47:21,842 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/cfeb9563-f29b-46fa-b33c-85f6e05cd4ee 2025-10-15 16:47:21,850 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/34cf23a8-3870-480e-8caa-5ef3ade2716c 2025-10-15 16:47:21,863 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2213877094577619595', 'uuid-lslong': '12036339073043893054'}, 'enable': 'true', 'created': '2025-10-15T16:47:21', 'last-modified': '2025-10-15T16:47:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416179'} 2025-10-15 16:47:21,869 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:21,874 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2213877094577619595', 'uuid-lslong': '12036339073043893054'}, 'enable': 'true', 'created': '2025-10-15T16:47:21', 'last-modified': '2025-10-15T16:47:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420142'} 2025-10-15 16:47:21,882 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:21,889 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2213877094577619595', 'uuid-lslong': '12036339073043893054'}, 'enable': 'true', 'created': '2025-10-15T16:47:21', 'last-modified': '2025-10-15T16:47:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433743'} 2025-10-15 16:47:21,897 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:21,897 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-36997631 passed 2025-10-15 16:47:21,897 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-36997631 in API_Server ====== 2025-10-15 16:47:21,897 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:21,904 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:21,914 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:22,005 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/1eb9457c-e6ac-428b-a709-aa9d9cef8b3e 2025-10-15 16:47:22,014 - DEBUG - =>VN ctest-mgmt_vn-36997631 has no policy to be verified 2025-10-15 16:47:22,014 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:22,014 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:22,014 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:22,028 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631?flat'} 2025-10-15 16:47:22,028 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:22,028 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:22,046 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631?flat'} 2025-10-15 16:47:22,046 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:22,046 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:22,062 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631?flat'} 2025-10-15 16:47:22,062 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67581176:ctest-mgmt_vn-36997631 is found in opserver 2025-10-15 16:47:22,084 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:22,094 - DEBUG - VRF ids for VN ctest-mgmt_vn-36997631: {} 2025-10-15 16:47:22,377 - DEBUG - Response for create_network : {'network': {'id': 'e33807be-da60-44cb-83bb-01f45fdc13b1', 'name': 'ctest-left_vn-42134687', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67581176', 'ctest-left_vn-42134687'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:22,641 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fb7c9014-ab8b-4601-b06a-3baa09f777db', 'name': '', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'network_id': 'e33807be-da60-44cb-83bb-01f45fdc13b1', 'ip_version': 4, 'cidr': '119.59.90.128/26', 'allocation_pools': [{'start': '119.59.90.130', 'end': '119.59.90.190'}], 'gateway_ip': '119.59.90.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '119.59.90.130', 'tags': [], 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec'}} 2025-10-15 16:47:22,664 - INFO - Created VN ctest-left_vn-42134687 2025-10-15 16:47:22,676 - DEBUG - VN ctest-left_vn-42134687 UUID is e33807be-da60-44cb-83bb-01f45fdc13b1 2025-10-15 16:47:22,758 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:22,765 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:22,777 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:22,863 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/e33807be-da60-44cb-83bb-01f45fdc13b1 2025-10-15 16:47:22,875 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/e33807be-da60-44cb-83bb-01f45fdc13b1 2025-10-15 16:47:22,885 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/90db1757-7eab-44e5-bd0c-25bc9932ea63 2025-10-15 16:47:22,894 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/90db1757-7eab-44e5-bd0c-25bc9932ea63 2025-10-15 16:47:22,902 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/3fb934dd-f87b-4125-ab48-9d2dbbbc72e4 2025-10-15 16:47:22,909 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:22,909 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/e33807be-da60-44cb-83bb-01f45fdc13b1 2025-10-15 16:47:22,920 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/90db1757-7eab-44e5-bd0c-25bc9932ea63 2025-10-15 16:47:22,938 - INFO - Verified VN network id 16 for VN e33807be-da60-44cb-83bb-01f45fdc13b1 2025-10-15 16:47:22,938 - INFO - Verifications in API Server for VN ctest-left_vn-42134687 passed 2025-10-15 16:47:22,938 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/e33807be-da60-44cb-83bb-01f45fdc13b1 2025-10-15 16:47:22,950 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/90db1757-7eab-44e5-bd0c-25bc9932ea63 2025-10-15 16:47:22,958 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/90db1757-7eab-44e5-bd0c-25bc9932ea63 2025-10-15 16:47:22,966 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/3fb934dd-f87b-4125-ab48-9d2dbbbc72e4 2025-10-15 16:47:22,979 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16372844961594361035', 'uuid-lslong': '9492182788705358769'}, 'enable': 'true', 'created': '2025-10-15T16:47:22', 'last-modified': '2025-10-15T16:47:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.385650'} 2025-10-15 16:47:22,985 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:22,991 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16372844961594361035', 'uuid-lslong': '9492182788705358769'}, 'enable': 'true', 'created': '2025-10-15T16:47:22', 'last-modified': '2025-10-15T16:47:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399308'} 2025-10-15 16:47:22,998 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:23,004 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16372844961594361035', 'uuid-lslong': '9492182788705358769'}, 'enable': 'true', 'created': '2025-10-15T16:47:22', 'last-modified': '2025-10-15T16:47:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410945'} 2025-10-15 16:47:23,011 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:23,011 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-42134687 passed 2025-10-15 16:47:23,011 - DEBUG - ====Verifying policy data for ctest-left_vn-42134687 in API_Server ====== 2025-10-15 16:47:23,011 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:23,018 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:23,030 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:23,120 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/e33807be-da60-44cb-83bb-01f45fdc13b1 2025-10-15 16:47:23,130 - DEBUG - =>VN ctest-left_vn-42134687 has no policy to be verified 2025-10-15 16:47:23,130 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:23,130 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:23,130 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:23,143 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687?flat'} 2025-10-15 16:47:23,143 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:23,143 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:23,157 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687?flat'} 2025-10-15 16:47:23,157 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:23,158 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:23,172 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687?flat'} 2025-10-15 16:47:23,172 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67581176:ctest-left_vn-42134687 is found in opserver 2025-10-15 16:47:23,199 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:23,219 - DEBUG - VRF ids for VN ctest-left_vn-42134687: {} 2025-10-15 16:47:23,462 - DEBUG - Response for create_network : {'network': {'id': 'ce47d91b-5ba2-45ce-9e42-814199bc1b33', 'name': 'ctest-right_vn-93323006', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67581176', 'ctest-right_vn-93323006'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:23,657 - DEBUG - Response for create_subnet : {'subnet': {'id': '5b1fd9b9-4ea6-4115-b88e-8f2909eb4e65', 'name': '', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'network_id': 'ce47d91b-5ba2-45ce-9e42-814199bc1b33', 'ip_version': 4, 'cidr': '187.165.227.0/26', 'allocation_pools': [{'start': '187.165.227.2', 'end': '187.165.227.62'}], 'gateway_ip': '187.165.227.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '187.165.227.2', 'tags': [], 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec'}} 2025-10-15 16:47:23,680 - INFO - Created VN ctest-right_vn-93323006 2025-10-15 16:47:23,693 - DEBUG - VN ctest-right_vn-93323006 UUID is ce47d91b-5ba2-45ce-9e42-814199bc1b33 2025-10-15 16:47:23,765 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:23,771 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:23,781 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:23,863 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/ce47d91b-5ba2-45ce-9e42-814199bc1b33 2025-10-15 16:47:23,874 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/ce47d91b-5ba2-45ce-9e42-814199bc1b33 2025-10-15 16:47:23,882 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7f1b5965-48a2-44a9-84e8-3b3895e556eb 2025-10-15 16:47:23,889 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7f1b5965-48a2-44a9-84e8-3b3895e556eb 2025-10-15 16:47:23,896 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/83b9ce90-ae80-4955-82ef-3254be9b560e 2025-10-15 16:47:23,902 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:23,902 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/ce47d91b-5ba2-45ce-9e42-814199bc1b33 2025-10-15 16:47:23,911 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7f1b5965-48a2-44a9-84e8-3b3895e556eb 2025-10-15 16:47:23,928 - INFO - Verified VN network id 17 for VN ce47d91b-5ba2-45ce-9e42-814199bc1b33 2025-10-15 16:47:23,929 - INFO - Verifications in API Server for VN ctest-right_vn-93323006 passed 2025-10-15 16:47:23,929 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/ce47d91b-5ba2-45ce-9e42-814199bc1b33 2025-10-15 16:47:23,938 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7f1b5965-48a2-44a9-84e8-3b3895e556eb 2025-10-15 16:47:23,946 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7f1b5965-48a2-44a9-84e8-3b3895e556eb 2025-10-15 16:47:23,954 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/83b9ce90-ae80-4955-82ef-3254be9b560e 2025-10-15 16:47:23,967 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14864087806684317134', 'uuid-lslong': '11403819325207616307'}, 'enable': 'true', 'created': '2025-10-15T16:47:23', 'last-modified': '2025-10-15T16:47:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.349033'} 2025-10-15 16:47:23,972 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:23,978 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14864087806684317134', 'uuid-lslong': '11403819325207616307'}, 'enable': 'true', 'created': '2025-10-15T16:47:23', 'last-modified': '2025-10-15T16:47:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.362096'} 2025-10-15 16:47:23,985 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:23,990 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14864087806684317134', 'uuid-lslong': '11403819325207616307'}, 'enable': 'true', 'created': '2025-10-15T16:47:23', 'last-modified': '2025-10-15T16:47:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.374221'} 2025-10-15 16:47:23,995 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:23,995 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-93323006 passed 2025-10-15 16:47:23,995 - DEBUG - ====Verifying policy data for ctest-right_vn-93323006 in API_Server ====== 2025-10-15 16:47:23,995 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:24,003 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:24,017 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:24,114 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/ce47d91b-5ba2-45ce-9e42-814199bc1b33 2025-10-15 16:47:24,128 - DEBUG - =>VN ctest-right_vn-93323006 has no policy to be verified 2025-10-15 16:47:24,128 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:24,128 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:24,128 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:24,147 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006?flat'} 2025-10-15 16:47:24,147 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:24,147 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:24,164 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006?flat'} 2025-10-15 16:47:24,164 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:24,164 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:24,183 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006?flat'} 2025-10-15 16:47:24,183 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67581176:ctest-right_vn-93323006 is found in opserver 2025-10-15 16:47:24,206 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:24,216 - DEBUG - VRF ids for VN ctest-right_vn-93323006: {} 2025-10-15 16:47:24,483 - DEBUG - Response for create_network : {'network': {'id': '63d91d49-1be4-4401-a5d4-a1086691e13b', 'name': 'ctest-trans_left_vn-09667735', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67581176', 'ctest-trans_left_vn-09667735'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:24,731 - DEBUG - Response for create_subnet : {'subnet': {'id': '7bc80cbb-90f3-422c-abf3-70d213d3e7fd', 'name': '', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'network_id': '63d91d49-1be4-4401-a5d4-a1086691e13b', 'ip_version': 4, 'cidr': '95.37.242.192/26', 'allocation_pools': [{'start': '95.37.242.194', 'end': '95.37.242.254'}], 'gateway_ip': '95.37.242.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '95.37.242.194', 'tags': [], 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec'}} 2025-10-15 16:47:24,760 - INFO - Created VN ctest-trans_left_vn-09667735 2025-10-15 16:47:24,777 - DEBUG - VN ctest-trans_left_vn-09667735 UUID is 63d91d49-1be4-4401-a5d4-a1086691e13b 2025-10-15 16:47:24,864 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:24,870 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:24,881 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:24,965 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/63d91d49-1be4-4401-a5d4-a1086691e13b 2025-10-15 16:47:24,976 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/63d91d49-1be4-4401-a5d4-a1086691e13b 2025-10-15 16:47:24,985 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7b742aca-ac63-429e-99d9-c331b4b91395 2025-10-15 16:47:24,995 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7b742aca-ac63-429e-99d9-c331b4b91395 2025-10-15 16:47:25,002 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/418593b6-f241-4dc0-b3e3-d4f68a651c5e 2025-10-15 16:47:25,011 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-15 16:47:25,011 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/63d91d49-1be4-4401-a5d4-a1086691e13b 2025-10-15 16:47:25,022 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7b742aca-ac63-429e-99d9-c331b4b91395 2025-10-15 16:47:25,040 - INFO - Verified VN network id 18 for VN 63d91d49-1be4-4401-a5d4-a1086691e13b 2025-10-15 16:47:25,040 - INFO - Verifications in API Server for VN ctest-trans_left_vn-09667735 passed 2025-10-15 16:47:25,040 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/63d91d49-1be4-4401-a5d4-a1086691e13b 2025-10-15 16:47:25,051 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7b742aca-ac63-429e-99d9-c331b4b91395 2025-10-15 16:47:25,059 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7b742aca-ac63-429e-99d9-c331b4b91395 2025-10-15 16:47:25,066 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/418593b6-f241-4dc0-b3e3-d4f68a651c5e 2025-10-15 16:47:25,079 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7194814079538840577', 'uuid-lslong': '11949352768773415227'}, 'enable': 'true', 'created': '2025-10-15T16:47:24', 'last-modified': '2025-10-15T16:47:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.388246'} 2025-10-15 16:47:25,085 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-15 16:47:25,091 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7194814079538840577', 'uuid-lslong': '11949352768773415227'}, 'enable': 'true', 'created': '2025-10-15T16:47:24', 'last-modified': '2025-10-15T16:47:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.398406'} 2025-10-15 16:47:25,097 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-15 16:47:25,102 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7194814079538840577', 'uuid-lslong': '11949352768773415227'}, 'enable': 'true', 'created': '2025-10-15T16:47:24', 'last-modified': '2025-10-15T16:47:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410305'} 2025-10-15 16:47:25,108 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-15 16:47:25,108 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-09667735 passed 2025-10-15 16:47:25,108 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-09667735 in API_Server ====== 2025-10-15 16:47:25,109 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:25,116 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:25,133 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:25,215 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/63d91d49-1be4-4401-a5d4-a1086691e13b 2025-10-15 16:47:25,224 - DEBUG - =>VN ctest-trans_left_vn-09667735 has no policy to be verified 2025-10-15 16:47:25,224 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:25,224 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:25,224 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:25,235 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735?flat'} 2025-10-15 16:47:25,235 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:25,235 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:25,251 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735?flat'} 2025-10-15 16:47:25,251 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:25,251 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:25,268 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735?flat'} 2025-10-15 16:47:25,268 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67581176:ctest-trans_left_vn-09667735 is found in opserver 2025-10-15 16:47:25,289 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:25,299 - DEBUG - VRF ids for VN ctest-trans_left_vn-09667735: {} 2025-10-15 16:47:25,560 - DEBUG - Response for create_network : {'network': {'id': '045358d2-a964-4bcf-94a5-9cdad79da9a0', 'name': 'ctest-trans_right_vn-88527409', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67581176', 'ctest-trans_right_vn-88527409'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:25,825 - DEBUG - Response for create_subnet : {'subnet': {'id': '1f726e03-5eb4-4c87-9069-28056ff8f1dc', 'name': '', 'tenant_id': 'e74c76ebee094c0c89f5aead3ccafcec', 'network_id': '045358d2-a964-4bcf-94a5-9cdad79da9a0', 'ip_version': 4, 'cidr': '139.138.114.64/26', 'allocation_pools': [{'start': '139.138.114.66', 'end': '139.138.114.126'}], 'gateway_ip': '139.138.114.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '139.138.114.66', 'tags': [], 'project_id': 'e74c76ebee094c0c89f5aead3ccafcec'}} 2025-10-15 16:47:25,845 - INFO - Created VN ctest-trans_right_vn-88527409 2025-10-15 16:47:25,857 - DEBUG - VN ctest-trans_right_vn-88527409 UUID is 045358d2-a964-4bcf-94a5-9cdad79da9a0 2025-10-15 16:47:25,935 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:25,941 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:25,954 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:26,037 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/045358d2-a964-4bcf-94a5-9cdad79da9a0 2025-10-15 16:47:26,048 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/045358d2-a964-4bcf-94a5-9cdad79da9a0 2025-10-15 16:47:26,057 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/c14c8faf-24df-4120-8eae-9ef7274a6e23 2025-10-15 16:47:26,065 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/c14c8faf-24df-4120-8eae-9ef7274a6e23 2025-10-15 16:47:26,071 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/d8dd4752-422b-4c42-a1c7-0f19a8301c05 2025-10-15 16:47:26,078 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-15 16:47:26,078 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/045358d2-a964-4bcf-94a5-9cdad79da9a0 2025-10-15 16:47:26,086 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/c14c8faf-24df-4120-8eae-9ef7274a6e23 2025-10-15 16:47:26,105 - INFO - Verified VN network id 19 for VN 045358d2-a964-4bcf-94a5-9cdad79da9a0 2025-10-15 16:47:26,105 - INFO - Verifications in API Server for VN ctest-trans_right_vn-88527409 passed 2025-10-15 16:47:26,105 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/045358d2-a964-4bcf-94a5-9cdad79da9a0 2025-10-15 16:47:26,116 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/c14c8faf-24df-4120-8eae-9ef7274a6e23 2025-10-15 16:47:26,124 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/c14c8faf-24df-4120-8eae-9ef7274a6e23 2025-10-15 16:47:26,131 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/d8dd4752-422b-4c42-a1c7-0f19a8301c05 2025-10-15 16:47:26,142 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '311690461026995151', 'uuid-lslong': '10711139752504830368'}, 'enable': 'true', 'created': '2025-10-15T16:47:25', 'last-modified': '2025-10-15T16:47:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.357471'} 2025-10-15 16:47:26,147 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-15 16:47:26,153 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '311690461026995151', 'uuid-lslong': '10711139752504830368'}, 'enable': 'true', 'created': '2025-10-15T16:47:25', 'last-modified': '2025-10-15T16:47:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.368270'} 2025-10-15 16:47:26,158 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-15 16:47:26,165 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67581176', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '311690461026995151', 'uuid-lslong': '10711139752504830368'}, 'enable': 'true', 'created': '2025-10-15T16:47:25', 'last-modified': '2025-10-15T16:47:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.380093'} 2025-10-15 16:47:26,172 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-15 16:47:26,172 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-88527409 passed 2025-10-15 16:47:26,172 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-88527409 in API_Server ====== 2025-10-15 16:47:26,172 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:26,178 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:26,189 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:26,277 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/045358d2-a964-4bcf-94a5-9cdad79da9a0 2025-10-15 16:47:26,287 - DEBUG - =>VN ctest-trans_right_vn-88527409 has no policy to be verified 2025-10-15 16:47:26,287 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:26,288 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:26,288 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:26,304 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409?flat'} 2025-10-15 16:47:26,304 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:26,304 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:26,322 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409?flat'} 2025-10-15 16:47:26,322 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:26,322 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:26,338 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409?flat'} 2025-10-15 16:47:26,338 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67581176:ctest-trans_right_vn-88527409 is found in opserver 2025-10-15 16:47:26,360 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:26,370 - DEBUG - VRF ids for VN ctest-trans_right_vn-88527409: {} 2025-10-15 16:47:27,371 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-2) 2025-10-15 16:47:28,491 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-1) 2025-10-15 16:47:28,492 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-91870208'] 2025-10-15 16:47:28,805 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-91870208'] created succesfully 2025-10-15 16:47:29,108 - DEBUG - Image by name tiny_trans_fw not found 2025-10-15 16:47:29,108 - DEBUG - Installing image tiny_trans_fw 2025-10-15 16:47:29,108 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-10-15 16:47:29,109 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-15 16:47:29,109 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-15 16:47:29,109 - DEBUG - Unzip image 2025-10-15 16:47:29,109 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-15 16:47:29,125 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-10-15 16:47:29,126 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-91870208'] 2025-10-15 16:47:29,229 - INFO - Service template: ['default-domain', 'ctest-service_template_1-91870208'] deleted successfully. 2025-10-15 16:47:29,229 - INFO - Skip interface_detach for VM ctest-right_vm-49499278 in state BUILD 2025-10-15 16:47:29,229 - INFO - Deleting VM ctest-right_vm-49499278 2025-10-15 16:47:29,229 - ERROR - VM ctest-right_vm-49499278 has failed to come up 2025-10-15 16:47:29,230 - ERROR - Nova failed to get host of the VM 2025-10-15 16:47:29,230 - ERROR - VM ctest-right_vm-49499278 has failed to come up 2025-10-15 16:47:29,230 - ERROR - Nova failed to get host of the VM 2025-10-15 16:47:29,299 - INFO - Skip interface_detach for VM ctest-left_vm-95586438 in state BUILD 2025-10-15 16:47:29,299 - INFO - Deleting VM ctest-left_vm-95586438 2025-10-15 16:47:29,299 - ERROR - VM ctest-left_vm-95586438 has failed to come up 2025-10-15 16:47:29,299 - ERROR - Nova failed to get host of the VM 2025-10-15 16:47:29,299 - ERROR - VM ctest-left_vm-95586438 has failed to come up 2025-10-15 16:47:29,299 - ERROR - Nova failed to get host of the VM 2025-10-15 16:47:29,402 - INFO - Deleting VN ctest-trans_right_vn-88527409 2025-10-15 16:47:29,551 - DEBUG - Response for deleting network () 2025-10-15 16:47:29,551 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/c14c8faf-24df-4120-8eae-9ef7274a6e23 2025-10-15 16:47:29,559 - DEBUG - Response Code: 404 2025-10-15 16:47:29,559 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:29,567 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:29,584 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:29,675 - INFO - Validated that VN ctest-trans_right_vn-88527409 is not found in API Server 2025-10-15 16:47:29,694 - DEBUG - VN ctest-trans_right_vn-88527409 is not present in Agent 10.0.0.141 2025-10-15 16:47:29,705 - DEBUG - VN ctest-trans_right_vn-88527409 is not present in Agent 10.0.0.33 2025-10-15 16:47:29,705 - INFO - Validated that VN ctest-trans_right_vn-88527409 is not in any agent 2025-10-15 16:47:29,748 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-88527409 info 2025-10-15 16:47:29,748 - INFO - Deleting VN ctest-trans_left_vn-09667735 2025-10-15 16:47:29,906 - DEBUG - Response for deleting network () 2025-10-15 16:47:29,906 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7b742aca-ac63-429e-99d9-c331b4b91395 2025-10-15 16:47:29,912 - DEBUG - Response Code: 404 2025-10-15 16:47:29,912 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:29,924 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:29,978 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:30,080 - INFO - Validated that VN ctest-trans_left_vn-09667735 is not found in API Server 2025-10-15 16:47:30,098 - DEBUG - VN ctest-trans_left_vn-09667735 is not present in Agent 10.0.0.141 2025-10-15 16:47:30,114 - DEBUG - VN ctest-trans_left_vn-09667735 is not present in Agent 10.0.0.33 2025-10-15 16:47:30,114 - INFO - Validated that VN ctest-trans_left_vn-09667735 is not in any agent 2025-10-15 16:47:30,192 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-09667735 info 2025-10-15 16:47:30,193 - INFO - Deleting VN ctest-right_vn-93323006 2025-10-15 16:47:30,242 - DEBUG - VN ce47d91b-5ba2-45ce-9e42-814199bc1b33 still in use: Unable to complete operation on network ce47d91b-5ba2-45ce-9e42-814199bc1b33. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-3747105c-e0ef-48cd-85cc-057519513419'] 2025-10-15 16:47:30,242 - WARNING - Deleting VN ctest-right_vn-93323006 failed..Will retry 2025-10-15 16:47:32,388 - DEBUG - Response for deleting network () 2025-10-15 16:47:32,388 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/7f1b5965-48a2-44a9-84e8-3b3895e556eb 2025-10-15 16:47:32,393 - DEBUG - Response Code: 404 2025-10-15 16:47:32,394 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:32,402 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:32,415 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:32,503 - INFO - Validated that VN ctest-right_vn-93323006 is not found in API Server 2025-10-15 16:47:32,512 - DEBUG - VN ctest-right_vn-93323006 is not present in Agent 10.0.0.141 2025-10-15 16:47:32,522 - DEBUG - VN ctest-right_vn-93323006 is not present in Agent 10.0.0.33 2025-10-15 16:47:32,522 - INFO - Validated that VN ctest-right_vn-93323006 is not in any agent 2025-10-15 16:47:32,552 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-93323006 info 2025-10-15 16:47:32,553 - INFO - Deleting VN ctest-left_vn-42134687 2025-10-15 16:47:32,710 - DEBUG - Response for deleting network () 2025-10-15 16:47:32,710 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/90db1757-7eab-44e5-bd0c-25bc9932ea63 2025-10-15 16:47:32,723 - DEBUG - Response Code: 404 2025-10-15 16:47:32,723 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:32,734 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:32,746 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:32,830 - INFO - Validated that VN ctest-left_vn-42134687 is not found in API Server 2025-10-15 16:47:32,839 - DEBUG - VN ctest-left_vn-42134687 is not present in Agent 10.0.0.141 2025-10-15 16:47:32,851 - DEBUG - VN ctest-left_vn-42134687 is not present in Agent 10.0.0.33 2025-10-15 16:47:32,851 - INFO - Validated that VN ctest-left_vn-42134687 is not in any agent 2025-10-15 16:47:32,887 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-42134687 info 2025-10-15 16:47:32,887 - INFO - Deleting VN ctest-mgmt_vn-36997631 2025-10-15 16:47:33,032 - DEBUG - Response for deleting network () 2025-10-15 16:47:33,032 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/cfeb9563-f29b-46fa-b33c-85f6e05cd4ee 2025-10-15 16:47:33,038 - DEBUG - Response Code: 404 2025-10-15 16:47:33,038 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:33,051 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:33,107 - DEBUG - Requesting: http://10.0.0.130:8082/project/e74c76eb-ee09-4c0c-89f5-aead3ccafcec 2025-10-15 16:47:33,197 - INFO - Validated that VN ctest-mgmt_vn-36997631 is not found in API Server 2025-10-15 16:47:33,208 - DEBUG - VN ctest-mgmt_vn-36997631 is not present in Agent 10.0.0.141 2025-10-15 16:47:33,218 - DEBUG - VN ctest-mgmt_vn-36997631 is not present in Agent 10.0.0.33 2025-10-15 16:47:33,218 - INFO - Validated that VN ctest-mgmt_vn-36997631 is not in any agent 2025-10-15 16:47:33,253 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-36997631 info 2025-10-15 16:47:34,551 - DEBUG - No XMPP flaps were noticed during the test 2025-10-15 16:47:34,551 - INFO -
2025-10-15 16:47:34,551 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15]
2025-10-15 16:47:34,551 - INFO - -------------------------------------------------------------------------------- 2025-10-15 16:47:35,235 - INFO - Deleted project: ctest-TestSvcHC-67581176, ID : e74c76eb-ee09-4c0c-89f5-aead3ccafcec