2025-10-30 00:03:12,454 - INFO - Domain Default found not creating 2025-10-30 00:03:12,585 - INFO - Project ctest-TestSvcHC-25581283 not found, creating it 2025-10-30 00:03:13,071 - INFO - Created Project:ctest-TestSvcHC-25581283, ID : a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:14,534 - INFO - ================================================================================ 2025-10-30 00:03:14,534 - INFO - STARTING TEST : test_svc_hc_basic 2025-10-30 00:03:15,876 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.254': '0', '10.20.0.5': '0'}, '10.0.0.33': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-10-30 00:03:15,876 - INFO - Initial checks done. Running the testcase now 2025-10-30 00:03:15,876 - INFO - 2025-10-30 00:03:16,611 - DEBUG - Response for create_network : {'network': {'id': '82f42725-8864-4e05-b9e4-0d229d40b73a', 'name': 'ctest-mgmt_vn-86149513', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-25581283', 'ctest-mgmt_vn-86149513'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 00:03:16,908 - DEBUG - Response for create_subnet : {'subnet': {'id': '3a22bb56-bff2-4b58-bf12-84186d318b69', 'name': '', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'network_id': '82f42725-8864-4e05-b9e4-0d229d40b73a', 'ip_version': 4, 'cidr': '92.23.153.128/26', 'allocation_pools': [{'start': '92.23.153.130', 'end': '92.23.153.190'}], 'gateway_ip': '92.23.153.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '92.23.153.130', 'tags': [], 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e'}} 2025-10-30 00:03:16,933 - INFO - Created VN ctest-mgmt_vn-86149513 2025-10-30 00:03:16,943 - DEBUG - VN ctest-mgmt_vn-86149513 UUID is 82f42725-8864-4e05-b9e4-0d229d40b73a 2025-10-30 00:03:17,025 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:17,324 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:17,351 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:17,364 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:17,466 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/82f42725-8864-4e05-b9e4-0d229d40b73a 2025-10-30 00:03:17,482 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/82f42725-8864-4e05-b9e4-0d229d40b73a 2025-10-30 00:03:17,493 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7fb18355-b851-4725-b329-6040bc9479dc 2025-10-30 00:03:17,505 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7fb18355-b851-4725-b329-6040bc9479dc 2025-10-30 00:03:17,513 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/7c24539c-3ca1-4991-94b3-de37f8bcf8ee 2025-10-30 00:03:17,521 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:03:17,521 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/82f42725-8864-4e05-b9e4-0d229d40b73a 2025-10-30 00:03:17,531 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7fb18355-b851-4725-b329-6040bc9479dc 2025-10-30 00:03:17,546 - INFO - Verified VN network id 16 for VN 82f42725-8864-4e05-b9e4-0d229d40b73a 2025-10-30 00:03:17,547 - INFO - Verifications in API Server for VN ctest-mgmt_vn-86149513 passed 2025-10-30 00:03:17,547 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/82f42725-8864-4e05-b9e4-0d229d40b73a 2025-10-30 00:03:17,561 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7fb18355-b851-4725-b329-6040bc9479dc 2025-10-30 00:03:17,570 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7fb18355-b851-4725-b329-6040bc9479dc 2025-10-30 00:03:17,578 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/7c24539c-3ca1-4991-94b3-de37f8bcf8ee 2025-10-30 00:03:17,592 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9436210161403579909', 'uuid-lslong': '13394845634025011002'}, 'enable': 'true', 'created': '2025-10-30T00:03:16', 'last-modified': '2025-10-30T00:03:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.732866'} 2025-10-30 00:03:17,599 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:03:17,606 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9436210161403579909', 'uuid-lslong': '13394845634025011002'}, 'enable': 'true', 'created': '2025-10-30T00:03:16', 'last-modified': '2025-10-30T00:03:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.744353'} 2025-10-30 00:03:17,612 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:03:17,617 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9436210161403579909', 'uuid-lslong': '13394845634025011002'}, 'enable': 'true', 'created': '2025-10-30T00:03:16', 'last-modified': '2025-10-30T00:03:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.762132'} 2025-10-30 00:03:17,623 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:03:17,623 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-86149513 passed 2025-10-30 00:03:17,623 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-86149513 in API_Server ====== 2025-10-30 00:03:17,623 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:17,629 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:17,640 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:17,721 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/82f42725-8864-4e05-b9e4-0d229d40b73a 2025-10-30 00:03:17,742 - DEBUG - =>VN ctest-mgmt_vn-86149513 has no policy to be verified 2025-10-30 00:03:17,742 - DEBUG - Verifying the vn in opserver 2025-10-30 00:03:17,742 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513 virtual network link through opserver 10.0.0.254 2025-10-30 00:03:17,742 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 00:03:18,045 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 00:03:18,104 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513?flat'} 2025-10-30 00:03:18,104 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513 virtual network link through opserver 10.0.0.49 2025-10-30 00:03:18,104 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-30 00:03:18,402 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-30 00:03:18,472 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513?flat'} 2025-10-30 00:03:18,472 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513 virtual network link through opserver 10.0.0.38 2025-10-30 00:03:18,472 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-30 00:03:18,772 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-30 00:03:18,850 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513?flat'} 2025-10-30 00:03:18,850 - INFO - Validated that VN default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-86149513 is found in opserver 2025-10-30 00:03:18,876 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 00:03:18,891 - DEBUG - VRF ids for VN ctest-mgmt_vn-86149513: {} 2025-10-30 00:03:19,176 - DEBUG - Response for create_network : {'network': {'id': '89bdffd9-0b17-4c8f-a781-a4ece9d1448d', 'name': 'ctest-left_vn-05670366', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-25581283', 'ctest-left_vn-05670366'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 00:03:19,386 - DEBUG - Response for create_subnet : {'subnet': {'id': '2ab626c4-b37f-43af-900d-8272bf84da7a', 'name': '', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'network_id': '89bdffd9-0b17-4c8f-a781-a4ece9d1448d', 'ip_version': 4, 'cidr': '68.200.59.192/26', 'allocation_pools': [{'start': '68.200.59.194', 'end': '68.200.59.254'}], 'gateway_ip': '68.200.59.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '68.200.59.194', 'tags': [], 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e'}} 2025-10-30 00:03:19,410 - INFO - Created VN ctest-left_vn-05670366 2025-10-30 00:03:19,422 - DEBUG - VN ctest-left_vn-05670366 UUID is 89bdffd9-0b17-4c8f-a781-a4ece9d1448d 2025-10-30 00:03:19,499 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:19,509 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:19,519 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:19,609 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/89bdffd9-0b17-4c8f-a781-a4ece9d1448d 2025-10-30 00:03:19,621 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/89bdffd9-0b17-4c8f-a781-a4ece9d1448d 2025-10-30 00:03:19,634 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/132b613c-a0d1-4d9b-9a45-75bf32bf6fb1 2025-10-30 00:03:19,643 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/132b613c-a0d1-4d9b-9a45-75bf32bf6fb1 2025-10-30 00:03:19,649 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/6656e796-61f0-4f7e-afb4-7941561aabb0 2025-10-30 00:03:19,656 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 00:03:19,656 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/89bdffd9-0b17-4c8f-a781-a4ece9d1448d 2025-10-30 00:03:19,667 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/132b613c-a0d1-4d9b-9a45-75bf32bf6fb1 2025-10-30 00:03:19,683 - INFO - Verified VN network id 17 for VN 89bdffd9-0b17-4c8f-a781-a4ece9d1448d 2025-10-30 00:03:19,683 - INFO - Verifications in API Server for VN ctest-left_vn-05670366 passed 2025-10-30 00:03:19,683 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/89bdffd9-0b17-4c8f-a781-a4ece9d1448d 2025-10-30 00:03:19,692 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/132b613c-a0d1-4d9b-9a45-75bf32bf6fb1 2025-10-30 00:03:19,700 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/132b613c-a0d1-4d9b-9a45-75bf32bf6fb1 2025-10-30 00:03:19,707 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/6656e796-61f0-4f7e-afb4-7941561aabb0 2025-10-30 00:03:19,719 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9925370461453503631', 'uuid-lslong': '12070109813771682957'}, 'enable': 'true', 'created': '2025-10-30T00:03:19', 'last-modified': '2025-10-30T00:03:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.380452'} 2025-10-30 00:03:19,725 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 00:03:19,732 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9925370461453503631', 'uuid-lslong': '12070109813771682957'}, 'enable': 'true', 'created': '2025-10-30T00:03:19', 'last-modified': '2025-10-30T00:03:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.392985'} 2025-10-30 00:03:19,739 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 00:03:19,745 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9925370461453503631', 'uuid-lslong': '12070109813771682957'}, 'enable': 'true', 'created': '2025-10-30T00:03:19', 'last-modified': '2025-10-30T00:03:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405654'} 2025-10-30 00:03:19,750 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 00:03:19,750 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-05670366 passed 2025-10-30 00:03:19,751 - DEBUG - ====Verifying policy data for ctest-left_vn-05670366 in API_Server ====== 2025-10-30 00:03:19,751 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:19,757 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:19,771 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:19,872 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/89bdffd9-0b17-4c8f-a781-a4ece9d1448d 2025-10-30 00:03:19,884 - DEBUG - =>VN ctest-left_vn-05670366 has no policy to be verified 2025-10-30 00:03:19,884 - DEBUG - Verifying the vn in opserver 2025-10-30 00:03:19,884 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366 virtual network link through opserver 10.0.0.254 2025-10-30 00:03:19,884 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 00:03:19,937 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366?flat'} 2025-10-30 00:03:19,937 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366 virtual network link through opserver 10.0.0.49 2025-10-30 00:03:19,937 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-30 00:03:19,986 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366?flat'} 2025-10-30 00:03:19,986 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366 virtual network link through opserver 10.0.0.38 2025-10-30 00:03:19,987 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-30 00:03:20,049 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366?flat'} 2025-10-30 00:03:20,049 - INFO - Validated that VN default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-05670366 is found in opserver 2025-10-30 00:03:20,075 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 00:03:20,089 - DEBUG - VRF ids for VN ctest-left_vn-05670366: {} 2025-10-30 00:03:20,396 - DEBUG - Response for create_network : {'network': {'id': 'd5a9ca40-e2f5-43cd-8e61-59cb70efa5c4', 'name': 'ctest-right_vn-19792685', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-25581283', 'ctest-right_vn-19792685'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 00:03:20,657 - DEBUG - Response for create_subnet : {'subnet': {'id': '5151d379-1751-4840-b036-7b93621ff437', 'name': '', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'network_id': 'd5a9ca40-e2f5-43cd-8e61-59cb70efa5c4', 'ip_version': 4, 'cidr': '126.96.174.192/26', 'allocation_pools': [{'start': '126.96.174.194', 'end': '126.96.174.254'}], 'gateway_ip': '126.96.174.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '126.96.174.194', 'tags': [], 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e'}} 2025-10-30 00:03:20,680 - INFO - Created VN ctest-right_vn-19792685 2025-10-30 00:03:20,692 - DEBUG - VN ctest-right_vn-19792685 UUID is d5a9ca40-e2f5-43cd-8e61-59cb70efa5c4 2025-10-30 00:03:20,756 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:20,761 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:20,771 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:20,863 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d5a9ca40-e2f5-43cd-8e61-59cb70efa5c4 2025-10-30 00:03:20,878 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d5a9ca40-e2f5-43cd-8e61-59cb70efa5c4 2025-10-30 00:03:20,887 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1302e20-fd43-4a8d-b9da-3099bf7e170a 2025-10-30 00:03:20,894 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1302e20-fd43-4a8d-b9da-3099bf7e170a 2025-10-30 00:03:20,903 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/a9e66bcd-5dbd-44d5-b8b1-946000dff8cd 2025-10-30 00:03:20,910 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 00:03:20,910 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d5a9ca40-e2f5-43cd-8e61-59cb70efa5c4 2025-10-30 00:03:20,920 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1302e20-fd43-4a8d-b9da-3099bf7e170a 2025-10-30 00:03:20,934 - INFO - Verified VN network id 18 for VN d5a9ca40-e2f5-43cd-8e61-59cb70efa5c4 2025-10-30 00:03:20,935 - INFO - Verifications in API Server for VN ctest-right_vn-19792685 passed 2025-10-30 00:03:20,935 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d5a9ca40-e2f5-43cd-8e61-59cb70efa5c4 2025-10-30 00:03:20,943 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1302e20-fd43-4a8d-b9da-3099bf7e170a 2025-10-30 00:03:20,949 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1302e20-fd43-4a8d-b9da-3099bf7e170a 2025-10-30 00:03:20,955 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/a9e66bcd-5dbd-44d5-b8b1-946000dff8cd 2025-10-30 00:03:20,964 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15396059181177193421', 'uuid-lslong': '10259580156434687428'}, 'enable': 'true', 'created': '2025-10-30T00:03:20', 'last-modified': '2025-10-30T00:03:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.373022'} 2025-10-30 00:03:20,970 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 00:03:20,976 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15396059181177193421', 'uuid-lslong': '10259580156434687428'}, 'enable': 'true', 'created': '2025-10-30T00:03:20', 'last-modified': '2025-10-30T00:03:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.383478'} 2025-10-30 00:03:20,981 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 00:03:20,986 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15396059181177193421', 'uuid-lslong': '10259580156434687428'}, 'enable': 'true', 'created': '2025-10-30T00:03:20', 'last-modified': '2025-10-30T00:03:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.391866'} 2025-10-30 00:03:20,992 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 00:03:20,992 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-19792685 passed 2025-10-30 00:03:20,992 - DEBUG - ====Verifying policy data for ctest-right_vn-19792685 in API_Server ====== 2025-10-30 00:03:20,992 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:20,998 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:21,008 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:21,111 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d5a9ca40-e2f5-43cd-8e61-59cb70efa5c4 2025-10-30 00:03:21,121 - DEBUG - =>VN ctest-right_vn-19792685 has no policy to be verified 2025-10-30 00:03:21,121 - DEBUG - Verifying the vn in opserver 2025-10-30 00:03:21,121 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685 virtual network link through opserver 10.0.0.254 2025-10-30 00:03:21,121 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 00:03:21,178 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685?flat'} 2025-10-30 00:03:21,178 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685 virtual network link through opserver 10.0.0.49 2025-10-30 00:03:21,178 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-30 00:03:21,246 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685?flat'} 2025-10-30 00:03:21,246 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685 virtual network link through opserver 10.0.0.38 2025-10-30 00:03:21,246 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-30 00:03:21,301 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685?flat'} 2025-10-30 00:03:21,301 - INFO - Validated that VN default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-19792685 is found in opserver 2025-10-30 00:03:21,320 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 00:03:21,330 - DEBUG - VRF ids for VN ctest-right_vn-19792685: {} 2025-10-30 00:03:21,382 - DEBUG - Services list from nova: [, , , ] 2025-10-30 00:03:22,406 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4529-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4529-1) 2025-10-30 00:03:23,681 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4529-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4529-2) 2025-10-30 00:03:23,682 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-41073168'] 2025-10-30 00:03:23,992 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-41073168'] created succesfully 2025-10-30 00:03:24,337 - DEBUG - Image by name tiny_nat_fw not found 2025-10-30 00:03:24,337 - DEBUG - Installing image tiny_nat_fw 2025-10-30 00:03:24,337 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-10-30 00:03:24,337 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-30 00:03:24,337 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-30 00:03:24,337 - DEBUG - Unzip image 2025-10-30 00:03:24,337 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-30 00:03:24,361 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-10-30 00:03:24,362 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-41073168'] 2025-10-30 00:03:24,478 - INFO - Service template: ['default-domain', 'ctest-service_template_1-41073168'] deleted successfully. 2025-10-30 00:03:24,478 - INFO - Skip interface_detach for VM ctest-right_vm-69104712 in state BUILD 2025-10-30 00:03:24,478 - INFO - Deleting VM ctest-right_vm-69104712 2025-10-30 00:03:24,526 - ERROR - VM ctest-right_vm-69104712 has failed to come up 2025-10-30 00:03:24,527 - ERROR - Nova failed to get host of the VM 2025-10-30 00:03:24,527 - ERROR - VM ctest-right_vm-69104712 has failed to come up 2025-10-30 00:03:24,527 - ERROR - Nova failed to get host of the VM 2025-10-30 00:03:24,659 - INFO - Skip interface_detach for VM ctest-left_vm-58118922 in state BUILD 2025-10-30 00:03:24,659 - INFO - Deleting VM ctest-left_vm-58118922 2025-10-30 00:03:24,659 - ERROR - VM ctest-left_vm-58118922 has failed to come up 2025-10-30 00:03:24,659 - ERROR - Nova failed to get host of the VM 2025-10-30 00:03:24,659 - ERROR - VM ctest-left_vm-58118922 has failed to come up 2025-10-30 00:03:24,659 - ERROR - Nova failed to get host of the VM 2025-10-30 00:03:24,717 - INFO - Deleting VN ctest-right_vn-19792685 2025-10-30 00:03:24,761 - DEBUG - VN d5a9ca40-e2f5-43cd-8e61-59cb70efa5c4 still in use: Unable to complete operation on network d5a9ca40-e2f5-43cd-8e61-59cb70efa5c4. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-dd3d8500-d9e5-456b-80bc-ef1e6ef04612'] 2025-10-30 00:03:24,761 - WARNING - Deleting VN ctest-right_vn-19792685 failed..Will retry 2025-10-30 00:03:26,981 - DEBUG - Response for deleting network () 2025-10-30 00:03:26,981 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/d1302e20-fd43-4a8d-b9da-3099bf7e170a 2025-10-30 00:03:26,988 - DEBUG - Response Code: 404 2025-10-30 00:03:26,989 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:26,996 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:27,018 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:27,123 - INFO - Validated that VN ctest-right_vn-19792685 is not found in API Server 2025-10-30 00:03:27,134 - DEBUG - VN ctest-right_vn-19792685 is not present in Agent 10.0.0.65 2025-10-30 00:03:27,170 - DEBUG - VN ctest-right_vn-19792685 is not present in Agent 10.0.0.33 2025-10-30 00:03:27,170 - INFO - Validated that VN ctest-right_vn-19792685 is not in any agent 2025-10-30 00:03:27,211 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-19792685 info 2025-10-30 00:03:27,211 - INFO - Deleting VN ctest-left_vn-05670366 2025-10-30 00:03:27,359 - DEBUG - Response for deleting network () 2025-10-30 00:03:27,360 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/132b613c-a0d1-4d9b-9a45-75bf32bf6fb1 2025-10-30 00:03:27,365 - DEBUG - Response Code: 404 2025-10-30 00:03:27,365 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:27,372 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:27,390 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:27,487 - INFO - Validated that VN ctest-left_vn-05670366 is not found in API Server 2025-10-30 00:03:27,498 - DEBUG - VN ctest-left_vn-05670366 is not present in Agent 10.0.0.65 2025-10-30 00:03:27,525 - DEBUG - VN ctest-left_vn-05670366 is not present in Agent 10.0.0.33 2025-10-30 00:03:27,525 - INFO - Validated that VN ctest-left_vn-05670366 is not in any agent 2025-10-30 00:03:27,563 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-05670366 info 2025-10-30 00:03:27,563 - INFO - Deleting VN ctest-mgmt_vn-86149513 2025-10-30 00:03:27,754 - DEBUG - Response for deleting network () 2025-10-30 00:03:27,754 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7fb18355-b851-4725-b329-6040bc9479dc 2025-10-30 00:03:27,759 - DEBUG - Response Code: 404 2025-10-30 00:03:27,759 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:27,764 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:27,815 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:27,904 - INFO - Validated that VN ctest-mgmt_vn-86149513 is not found in API Server 2025-10-30 00:03:27,917 - DEBUG - VN ctest-mgmt_vn-86149513 is not present in Agent 10.0.0.65 2025-10-30 00:03:27,931 - DEBUG - VN ctest-mgmt_vn-86149513 is not present in Agent 10.0.0.33 2025-10-30 00:03:27,931 - INFO - Validated that VN ctest-mgmt_vn-86149513 is not in any agent 2025-10-30 00:03:27,965 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-86149513 info 2025-10-30 00:03:29,296 - DEBUG - No XMPP flaps were noticed during the test 2025-10-30 00:03:29,296 - INFO - 2025-10-30 00:03:29,296 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15] 2025-10-30 00:03:29,296 - INFO - -------------------------------------------------------------------------------- 2025-10-30 00:03:29,299 - INFO - ================================================================================ 2025-10-30 00:03:29,299 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-10-30 00:03:30,616 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.254': '0', '10.20.0.5': '0'}, '10.0.0.33': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-10-30 00:03:30,616 - INFO - Initial checks done. Running the testcase now 2025-10-30 00:03:30,616 - INFO - 2025-10-30 00:03:30,867 - DEBUG - Response for create_network : {'network': {'id': '9b1d1a88-3e0e-475f-b427-d3cfc13d8403', 'name': 'ctest-mgmt_vn-21676593', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-25581283', 'ctest-mgmt_vn-21676593'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 00:03:31,135 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ff3c6a4f-587a-4112-8482-bd0d967f6234', 'name': '', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'network_id': '9b1d1a88-3e0e-475f-b427-d3cfc13d8403', 'ip_version': 4, 'cidr': '49.166.94.64/26', 'allocation_pools': [{'start': '49.166.94.66', 'end': '49.166.94.126'}], 'gateway_ip': '49.166.94.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '49.166.94.66', 'tags': [], 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e'}} 2025-10-30 00:03:31,163 - INFO - Created VN ctest-mgmt_vn-21676593 2025-10-30 00:03:31,176 - DEBUG - VN ctest-mgmt_vn-21676593 UUID is 9b1d1a88-3e0e-475f-b427-d3cfc13d8403 2025-10-30 00:03:31,246 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:31,252 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:31,263 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:31,356 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9b1d1a88-3e0e-475f-b427-d3cfc13d8403 2025-10-30 00:03:31,369 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9b1d1a88-3e0e-475f-b427-d3cfc13d8403 2025-10-30 00:03:31,378 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b7658dc7-d37c-45be-b6aa-7721159fb5cc 2025-10-30 00:03:31,387 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b7658dc7-d37c-45be-b6aa-7721159fb5cc 2025-10-30 00:03:31,394 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/787c9d76-851c-4ed3-91b4-4f5ddd4d123a 2025-10-30 00:03:31,401 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:03:31,402 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9b1d1a88-3e0e-475f-b427-d3cfc13d8403 2025-10-30 00:03:31,410 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b7658dc7-d37c-45be-b6aa-7721159fb5cc 2025-10-30 00:03:31,426 - INFO - Verified VN network id 16 for VN 9b1d1a88-3e0e-475f-b427-d3cfc13d8403 2025-10-30 00:03:31,426 - INFO - Verifications in API Server for VN ctest-mgmt_vn-21676593 passed 2025-10-30 00:03:31,426 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9b1d1a88-3e0e-475f-b427-d3cfc13d8403 2025-10-30 00:03:31,435 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b7658dc7-d37c-45be-b6aa-7721159fb5cc 2025-10-30 00:03:31,444 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b7658dc7-d37c-45be-b6aa-7721159fb5cc 2025-10-30 00:03:31,451 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/787c9d76-851c-4ed3-91b4-4f5ddd4d123a 2025-10-30 00:03:31,464 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11177119022662436703', 'uuid-lslong': '12981577340172469251'}, 'enable': 'true', 'created': '2025-10-30T00:03:30', 'last-modified': '2025-10-30T00:03:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.380699'} 2025-10-30 00:03:31,471 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:03:31,476 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11177119022662436703', 'uuid-lslong': '12981577340172469251'}, 'enable': 'true', 'created': '2025-10-30T00:03:30', 'last-modified': '2025-10-30T00:03:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.400184'} 2025-10-30 00:03:31,482 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:03:31,487 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11177119022662436703', 'uuid-lslong': '12981577340172469251'}, 'enable': 'true', 'created': '2025-10-30T00:03:30', 'last-modified': '2025-10-30T00:03:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410198'} 2025-10-30 00:03:31,491 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 00:03:31,491 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-21676593 passed 2025-10-30 00:03:31,492 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-21676593 in API_Server ====== 2025-10-30 00:03:31,492 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:31,498 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:31,509 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:31,607 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9b1d1a88-3e0e-475f-b427-d3cfc13d8403 2025-10-30 00:03:31,617 - DEBUG - =>VN ctest-mgmt_vn-21676593 has no policy to be verified 2025-10-30 00:03:31,617 - DEBUG - Verifying the vn in opserver 2025-10-30 00:03:31,617 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593 virtual network link through opserver 10.0.0.254 2025-10-30 00:03:31,617 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 00:03:31,631 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593?flat'} 2025-10-30 00:03:31,631 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593 virtual network link through opserver 10.0.0.49 2025-10-30 00:03:31,631 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-30 00:03:31,644 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593?flat'} 2025-10-30 00:03:31,644 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593 virtual network link through opserver 10.0.0.38 2025-10-30 00:03:31,644 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-30 00:03:31,658 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593?flat'} 2025-10-30 00:03:31,659 - INFO - Validated that VN default-domain:ctest-TestSvcHC-25581283:ctest-mgmt_vn-21676593 is found in opserver 2025-10-30 00:03:31,684 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 00:03:31,696 - DEBUG - VRF ids for VN ctest-mgmt_vn-21676593: {} 2025-10-30 00:03:31,964 - DEBUG - Response for create_network : {'network': {'id': 'b6db3a82-c4db-411f-be13-fe129b88e3fe', 'name': 'ctest-left_vn-21244256', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-25581283', 'ctest-left_vn-21244256'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 00:03:32,184 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e830e8f3-a811-4a99-9c9f-95ce5b38e4bc', 'name': '', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'network_id': 'b6db3a82-c4db-411f-be13-fe129b88e3fe', 'ip_version': 4, 'cidr': '178.127.165.192/26', 'allocation_pools': [{'start': '178.127.165.194', 'end': '178.127.165.254'}], 'gateway_ip': '178.127.165.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '178.127.165.194', 'tags': [], 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e'}} 2025-10-30 00:03:32,205 - INFO - Created VN ctest-left_vn-21244256 2025-10-30 00:03:32,215 - DEBUG - VN ctest-left_vn-21244256 UUID is b6db3a82-c4db-411f-be13-fe129b88e3fe 2025-10-30 00:03:32,281 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:32,287 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:32,297 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:32,379 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b6db3a82-c4db-411f-be13-fe129b88e3fe 2025-10-30 00:03:32,400 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b6db3a82-c4db-411f-be13-fe129b88e3fe 2025-10-30 00:03:32,409 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/33dbac23-4fb6-4146-8c30-5811aa8def97 2025-10-30 00:03:32,419 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/33dbac23-4fb6-4146-8c30-5811aa8def97 2025-10-30 00:03:32,429 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/852a7bb1-0e93-4fbd-a89b-403b7337c355 2025-10-30 00:03:32,437 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 00:03:32,437 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b6db3a82-c4db-411f-be13-fe129b88e3fe 2025-10-30 00:03:32,446 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/33dbac23-4fb6-4146-8c30-5811aa8def97 2025-10-30 00:03:32,463 - INFO - Verified VN network id 17 for VN b6db3a82-c4db-411f-be13-fe129b88e3fe 2025-10-30 00:03:32,463 - INFO - Verifications in API Server for VN ctest-left_vn-21244256 passed 2025-10-30 00:03:32,463 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b6db3a82-c4db-411f-be13-fe129b88e3fe 2025-10-30 00:03:32,475 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/33dbac23-4fb6-4146-8c30-5811aa8def97 2025-10-30 00:03:32,483 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/33dbac23-4fb6-4146-8c30-5811aa8def97 2025-10-30 00:03:32,490 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/852a7bb1-0e93-4fbd-a89b-403b7337c355 2025-10-30 00:03:32,502 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13176189468125380895', 'uuid-lslong': '13696570247636116478'}, 'enable': 'true', 'created': '2025-10-30T00:03:31', 'last-modified': '2025-10-30T00:03:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.361830'} 2025-10-30 00:03:32,507 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 00:03:32,515 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13176189468125380895', 'uuid-lslong': '13696570247636116478'}, 'enable': 'true', 'created': '2025-10-30T00:03:31', 'last-modified': '2025-10-30T00:03:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.378391'} 2025-10-30 00:03:32,522 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 00:03:32,527 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13176189468125380895', 'uuid-lslong': '13696570247636116478'}, 'enable': 'true', 'created': '2025-10-30T00:03:31', 'last-modified': '2025-10-30T00:03:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.384353'} 2025-10-30 00:03:32,532 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 00:03:32,532 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-21244256 passed 2025-10-30 00:03:32,533 - DEBUG - ====Verifying policy data for ctest-left_vn-21244256 in API_Server ====== 2025-10-30 00:03:32,533 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:32,539 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:32,554 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:32,661 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b6db3a82-c4db-411f-be13-fe129b88e3fe 2025-10-30 00:03:32,697 - DEBUG - =>VN ctest-left_vn-21244256 has no policy to be verified 2025-10-30 00:03:32,697 - DEBUG - Verifying the vn in opserver 2025-10-30 00:03:32,697 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256 virtual network link through opserver 10.0.0.254 2025-10-30 00:03:32,697 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 00:03:32,732 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256?flat'} 2025-10-30 00:03:32,732 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256 virtual network link through opserver 10.0.0.49 2025-10-30 00:03:32,732 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-30 00:03:32,749 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256?flat'} 2025-10-30 00:03:32,749 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256 virtual network link through opserver 10.0.0.38 2025-10-30 00:03:32,749 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-30 00:03:32,765 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256?flat'} 2025-10-30 00:03:32,765 - INFO - Validated that VN default-domain:ctest-TestSvcHC-25581283:ctest-left_vn-21244256 is found in opserver 2025-10-30 00:03:32,799 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 00:03:32,819 - DEBUG - VRF ids for VN ctest-left_vn-21244256: {} 2025-10-30 00:03:33,270 - DEBUG - Response for create_network : {'network': {'id': 'c3113201-e5fa-4601-bcbf-01adb55bcc40', 'name': 'ctest-right_vn-27395161', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-25581283', 'ctest-right_vn-27395161'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 00:03:33,539 - DEBUG - Response for create_subnet : {'subnet': {'id': '3d539f68-eaa4-4dce-a4b5-79f9e3bd95dd', 'name': '', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'network_id': 'c3113201-e5fa-4601-bcbf-01adb55bcc40', 'ip_version': 4, 'cidr': '43.81.233.64/26', 'allocation_pools': [{'start': '43.81.233.66', 'end': '43.81.233.126'}], 'gateway_ip': '43.81.233.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '43.81.233.66', 'tags': [], 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e'}} 2025-10-30 00:03:33,561 - INFO - Created VN ctest-right_vn-27395161 2025-10-30 00:03:33,574 - DEBUG - VN ctest-right_vn-27395161 UUID is c3113201-e5fa-4601-bcbf-01adb55bcc40 2025-10-30 00:03:33,648 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:33,653 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:33,668 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:33,772 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c3113201-e5fa-4601-bcbf-01adb55bcc40 2025-10-30 00:03:33,793 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c3113201-e5fa-4601-bcbf-01adb55bcc40 2025-10-30 00:03:33,803 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e24f6b5-1305-4a99-9f82-e59d3c09939b 2025-10-30 00:03:33,814 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e24f6b5-1305-4a99-9f82-e59d3c09939b 2025-10-30 00:03:33,822 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/4a48038e-901c-4042-94cc-293263d1d474 2025-10-30 00:03:33,831 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 00:03:33,831 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c3113201-e5fa-4601-bcbf-01adb55bcc40 2025-10-30 00:03:33,841 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e24f6b5-1305-4a99-9f82-e59d3c09939b 2025-10-30 00:03:33,858 - INFO - Verified VN network id 18 for VN c3113201-e5fa-4601-bcbf-01adb55bcc40 2025-10-30 00:03:33,858 - INFO - Verifications in API Server for VN ctest-right_vn-27395161 passed 2025-10-30 00:03:33,858 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c3113201-e5fa-4601-bcbf-01adb55bcc40 2025-10-30 00:03:33,869 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e24f6b5-1305-4a99-9f82-e59d3c09939b 2025-10-30 00:03:33,876 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e24f6b5-1305-4a99-9f82-e59d3c09939b 2025-10-30 00:03:33,884 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/4a48038e-901c-4042-94cc-293263d1d474 2025-10-30 00:03:33,895 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14056070895734769153', 'uuid-lslong': '13600591245265849408'}, 'enable': 'true', 'created': '2025-10-30T00:03:33', 'last-modified': '2025-10-30T00:03:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404079'} 2025-10-30 00:03:33,899 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 00:03:33,904 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14056070895734769153', 'uuid-lslong': '13600591245265849408'}, 'enable': 'true', 'created': '2025-10-30T00:03:33', 'last-modified': '2025-10-30T00:03:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410789'} 2025-10-30 00:03:33,910 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 00:03:33,914 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14056070895734769153', 'uuid-lslong': '13600591245265849408'}, 'enable': 'true', 'created': '2025-10-30T00:03:33', 'last-modified': '2025-10-30T00:03:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420410'} 2025-10-30 00:03:33,919 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 00:03:33,919 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-27395161 passed 2025-10-30 00:03:33,920 - DEBUG - ====Verifying policy data for ctest-right_vn-27395161 in API_Server ====== 2025-10-30 00:03:33,920 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:33,926 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:33,937 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:34,027 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c3113201-e5fa-4601-bcbf-01adb55bcc40 2025-10-30 00:03:34,038 - DEBUG - =>VN ctest-right_vn-27395161 has no policy to be verified 2025-10-30 00:03:34,038 - DEBUG - Verifying the vn in opserver 2025-10-30 00:03:34,038 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161 virtual network link through opserver 10.0.0.254 2025-10-30 00:03:34,038 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 00:03:34,049 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161?flat'} 2025-10-30 00:03:34,049 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161 virtual network link through opserver 10.0.0.49 2025-10-30 00:03:34,049 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-30 00:03:34,060 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161?flat'} 2025-10-30 00:03:34,060 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161 virtual network link through opserver 10.0.0.38 2025-10-30 00:03:34,060 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-30 00:03:34,072 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161?flat'} 2025-10-30 00:03:34,072 - INFO - Validated that VN default-domain:ctest-TestSvcHC-25581283:ctest-right_vn-27395161 is found in opserver 2025-10-30 00:03:34,100 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 00:03:34,114 - DEBUG - VRF ids for VN ctest-right_vn-27395161: {} 2025-10-30 00:03:34,394 - DEBUG - Response for create_network : {'network': {'id': '50de5e4d-f2f1-47ad-9275-4e9185d57013', 'name': 'ctest-trans_left_vn-75335653', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-25581283', 'ctest-trans_left_vn-75335653'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 00:03:34,683 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e94c7ba1-ba48-4b43-8326-aa1ef662e8a1', 'name': '', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'network_id': '50de5e4d-f2f1-47ad-9275-4e9185d57013', 'ip_version': 4, 'cidr': '175.162.233.192/26', 'allocation_pools': [{'start': '175.162.233.194', 'end': '175.162.233.254'}], 'gateway_ip': '175.162.233.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '175.162.233.194', 'tags': [], 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e'}} 2025-10-30 00:03:34,706 - INFO - Created VN ctest-trans_left_vn-75335653 2025-10-30 00:03:34,718 - DEBUG - VN ctest-trans_left_vn-75335653 UUID is 50de5e4d-f2f1-47ad-9275-4e9185d57013 2025-10-30 00:03:34,791 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:34,799 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:34,812 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:34,920 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/50de5e4d-f2f1-47ad-9275-4e9185d57013 2025-10-30 00:03:34,932 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/50de5e4d-f2f1-47ad-9275-4e9185d57013 2025-10-30 00:03:34,942 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/24aa9e51-9657-4f00-a57b-e29adba3008e 2025-10-30 00:03:34,949 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/24aa9e51-9657-4f00-a57b-e29adba3008e 2025-10-30 00:03:34,956 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e9599883-ef1b-4638-8ab6-c9a3da732a1a 2025-10-30 00:03:34,963 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 00:03:34,963 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/50de5e4d-f2f1-47ad-9275-4e9185d57013 2025-10-30 00:03:34,973 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/24aa9e51-9657-4f00-a57b-e29adba3008e 2025-10-30 00:03:34,989 - INFO - Verified VN network id 19 for VN 50de5e4d-f2f1-47ad-9275-4e9185d57013 2025-10-30 00:03:34,989 - INFO - Verifications in API Server for VN ctest-trans_left_vn-75335653 passed 2025-10-30 00:03:34,989 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/50de5e4d-f2f1-47ad-9275-4e9185d57013 2025-10-30 00:03:34,998 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/24aa9e51-9657-4f00-a57b-e29adba3008e 2025-10-30 00:03:35,006 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/24aa9e51-9657-4f00-a57b-e29adba3008e 2025-10-30 00:03:35,019 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e9599883-ef1b-4638-8ab6-c9a3da732a1a 2025-10-30 00:03:35,029 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5827198656745392045', 'uuid-lslong': '10553427688735207443'}, 'enable': 'true', 'created': '2025-10-30T00:03:34', 'last-modified': '2025-10-30T00:03:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.407268'} 2025-10-30 00:03:35,036 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 00:03:35,042 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5827198656745392045', 'uuid-lslong': '10553427688735207443'}, 'enable': 'true', 'created': '2025-10-30T00:03:34', 'last-modified': '2025-10-30T00:03:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414682'} 2025-10-30 00:03:35,047 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 00:03:35,052 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5827198656745392045', 'uuid-lslong': '10553427688735207443'}, 'enable': 'true', 'created': '2025-10-30T00:03:34', 'last-modified': '2025-10-30T00:03:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423277'} 2025-10-30 00:03:35,057 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 00:03:35,057 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-75335653 passed 2025-10-30 00:03:35,057 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-75335653 in API_Server ====== 2025-10-30 00:03:35,057 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:35,063 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:35,073 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:35,175 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/50de5e4d-f2f1-47ad-9275-4e9185d57013 2025-10-30 00:03:35,184 - DEBUG - =>VN ctest-trans_left_vn-75335653 has no policy to be verified 2025-10-30 00:03:35,184 - DEBUG - Verifying the vn in opserver 2025-10-30 00:03:35,184 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653 virtual network link through opserver 10.0.0.254 2025-10-30 00:03:35,184 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 00:03:35,195 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653?flat'} 2025-10-30 00:03:35,195 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653 virtual network link through opserver 10.0.0.49 2025-10-30 00:03:35,195 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-30 00:03:35,208 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653?flat'} 2025-10-30 00:03:35,208 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653 virtual network link through opserver 10.0.0.38 2025-10-30 00:03:35,208 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-30 00:03:35,220 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653?flat'} 2025-10-30 00:03:35,220 - INFO - Validated that VN default-domain:ctest-TestSvcHC-25581283:ctest-trans_left_vn-75335653 is found in opserver 2025-10-30 00:03:35,247 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 00:03:35,262 - DEBUG - VRF ids for VN ctest-trans_left_vn-75335653: {} 2025-10-30 00:03:35,549 - DEBUG - Response for create_network : {'network': {'id': '2284c5d1-6b23-4616-b5fb-08d8386fa694', 'name': 'ctest-trans_right_vn-91897202', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-25581283', 'ctest-trans_right_vn-91897202'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 00:03:35,797 - DEBUG - Response for create_subnet : {'subnet': {'id': '44e4d18e-8e08-4fce-9512-e9af7a15f3f0', 'name': '', 'tenant_id': 'a1c87372c45d4d54a34d9a360c3f041e', 'network_id': '2284c5d1-6b23-4616-b5fb-08d8386fa694', 'ip_version': 4, 'cidr': '19.104.149.64/26', 'allocation_pools': [{'start': '19.104.149.66', 'end': '19.104.149.126'}], 'gateway_ip': '19.104.149.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '19.104.149.66', 'tags': [], 'project_id': 'a1c87372c45d4d54a34d9a360c3f041e'}} 2025-10-30 00:03:35,821 - INFO - Created VN ctest-trans_right_vn-91897202 2025-10-30 00:03:35,831 - DEBUG - VN ctest-trans_right_vn-91897202 UUID is 2284c5d1-6b23-4616-b5fb-08d8386fa694 2025-10-30 00:03:35,906 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:35,912 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:35,923 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:36,021 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2284c5d1-6b23-4616-b5fb-08d8386fa694 2025-10-30 00:03:36,033 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2284c5d1-6b23-4616-b5fb-08d8386fa694 2025-10-30 00:03:36,043 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ba39da10-08be-4620-94b5-02edf6f96e4b 2025-10-30 00:03:36,053 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ba39da10-08be-4620-94b5-02edf6f96e4b 2025-10-30 00:03:36,060 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/28660826-78f4-47aa-8a38-a7dd64a8fc4b 2025-10-30 00:03:36,067 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 00:03:36,067 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2284c5d1-6b23-4616-b5fb-08d8386fa694 2025-10-30 00:03:36,076 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ba39da10-08be-4620-94b5-02edf6f96e4b 2025-10-30 00:03:36,091 - INFO - Verified VN network id 20 for VN 2284c5d1-6b23-4616-b5fb-08d8386fa694 2025-10-30 00:03:36,091 - INFO - Verifications in API Server for VN ctest-trans_right_vn-91897202 passed 2025-10-30 00:03:36,092 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2284c5d1-6b23-4616-b5fb-08d8386fa694 2025-10-30 00:03:36,101 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ba39da10-08be-4620-94b5-02edf6f96e4b 2025-10-30 00:03:36,108 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ba39da10-08be-4620-94b5-02edf6f96e4b 2025-10-30 00:03:36,115 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/28660826-78f4-47aa-8a38-a7dd64a8fc4b 2025-10-30 00:03:36,127 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2487330397451666966', 'uuid-lslong': '13113084464772130452'}, 'enable': 'true', 'created': '2025-10-30T00:03:35', 'last-modified': '2025-10-30T00:03:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.380516'} 2025-10-30 00:03:36,132 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 00:03:36,137 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2487330397451666966', 'uuid-lslong': '13113084464772130452'}, 'enable': 'true', 'created': '2025-10-30T00:03:35', 'last-modified': '2025-10-30T00:03:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.394031'} 2025-10-30 00:03:36,143 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 00:03:36,148 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-25581283', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2487330397451666966', 'uuid-lslong': '13113084464772130452'}, 'enable': 'true', 'created': '2025-10-30T00:03:35', 'last-modified': '2025-10-30T00:03:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.400057'} 2025-10-30 00:03:36,153 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 00:03:36,154 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-91897202 passed 2025-10-30 00:03:36,154 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-91897202 in API_Server ====== 2025-10-30 00:03:36,154 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:36,160 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:36,171 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:36,266 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2284c5d1-6b23-4616-b5fb-08d8386fa694 2025-10-30 00:03:36,277 - DEBUG - =>VN ctest-trans_right_vn-91897202 has no policy to be verified 2025-10-30 00:03:36,277 - DEBUG - Verifying the vn in opserver 2025-10-30 00:03:36,277 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202 virtual network link through opserver 10.0.0.254 2025-10-30 00:03:36,277 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 00:03:36,290 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202?flat'} 2025-10-30 00:03:36,290 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202 virtual network link through opserver 10.0.0.49 2025-10-30 00:03:36,290 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-30 00:03:36,303 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202?flat'} 2025-10-30 00:03:36,303 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202 virtual network link through opserver 10.0.0.38 2025-10-30 00:03:36,303 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-30 00:03:36,315 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202?flat'} 2025-10-30 00:03:36,315 - INFO - Validated that VN default-domain:ctest-TestSvcHC-25581283:ctest-trans_right_vn-91897202 is found in opserver 2025-10-30 00:03:36,347 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 00:03:36,363 - DEBUG - VRF ids for VN ctest-trans_right_vn-91897202: {} 2025-10-30 00:03:37,385 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4529-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4529-2) 2025-10-30 00:03:38,739 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4529-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4529-1) 2025-10-30 00:03:38,739 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-03681278'] 2025-10-30 00:03:39,033 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-03681278'] created succesfully 2025-10-30 00:03:39,369 - DEBUG - Image by name tiny_trans_fw not found 2025-10-30 00:03:39,369 - DEBUG - Installing image tiny_trans_fw 2025-10-30 00:03:39,369 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-10-30 00:03:39,369 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-30 00:03:39,369 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-30 00:03:39,369 - DEBUG - Unzip image 2025-10-30 00:03:39,369 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-30 00:03:39,389 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-10-30 00:03:39,389 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-03681278'] 2025-10-30 00:03:39,478 - INFO - Service template: ['default-domain', 'ctest-service_template_1-03681278'] deleted successfully. 2025-10-30 00:03:39,478 - INFO - Skip interface_detach for VM ctest-right_vm-51341356 in state BUILD 2025-10-30 00:03:39,478 - INFO - Deleting VM ctest-right_vm-51341356 2025-10-30 00:03:39,478 - ERROR - VM ctest-right_vm-51341356 has failed to come up 2025-10-30 00:03:39,478 - ERROR - Nova failed to get host of the VM 2025-10-30 00:03:39,478 - ERROR - VM ctest-right_vm-51341356 has failed to come up 2025-10-30 00:03:39,478 - ERROR - Nova failed to get host of the VM 2025-10-30 00:03:39,622 - INFO - Skip interface_detach for VM ctest-left_vm-73905303 in state BUILD 2025-10-30 00:03:39,622 - INFO - Deleting VM ctest-left_vm-73905303 2025-10-30 00:03:39,622 - ERROR - VM ctest-left_vm-73905303 has failed to come up 2025-10-30 00:03:39,622 - ERROR - Nova failed to get host of the VM 2025-10-30 00:03:39,622 - ERROR - VM ctest-left_vm-73905303 has failed to come up 2025-10-30 00:03:39,622 - ERROR - Nova failed to get host of the VM 2025-10-30 00:03:39,696 - INFO - Deleting VN ctest-trans_right_vn-91897202 2025-10-30 00:03:39,906 - DEBUG - Response for deleting network () 2025-10-30 00:03:39,906 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ba39da10-08be-4620-94b5-02edf6f96e4b 2025-10-30 00:03:39,912 - DEBUG - Response Code: 404 2025-10-30 00:03:39,913 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:39,919 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:39,977 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:40,077 - INFO - Validated that VN ctest-trans_right_vn-91897202 is not found in API Server 2025-10-30 00:03:40,095 - DEBUG - VN ctest-trans_right_vn-91897202 is not present in Agent 10.0.0.65 2025-10-30 00:03:40,110 - DEBUG - VN ctest-trans_right_vn-91897202 is not present in Agent 10.0.0.33 2025-10-30 00:03:40,110 - INFO - Validated that VN ctest-trans_right_vn-91897202 is not in any agent 2025-10-30 00:03:40,205 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-91897202 info 2025-10-30 00:03:40,205 - INFO - Deleting VN ctest-trans_left_vn-75335653 2025-10-30 00:03:40,374 - DEBUG - Response for deleting network () 2025-10-30 00:03:40,374 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/24aa9e51-9657-4f00-a57b-e29adba3008e 2025-10-30 00:03:40,385 - DEBUG - Response Code: 404 2025-10-30 00:03:40,385 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:40,398 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:40,422 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:40,526 - INFO - Validated that VN ctest-trans_left_vn-75335653 is not found in API Server 2025-10-30 00:03:40,540 - DEBUG - VN ctest-trans_left_vn-75335653 is not present in Agent 10.0.0.65 2025-10-30 00:03:40,572 - DEBUG - VN ctest-trans_left_vn-75335653 is not present in Agent 10.0.0.33 2025-10-30 00:03:40,572 - INFO - Validated that VN ctest-trans_left_vn-75335653 is not in any agent 2025-10-30 00:03:40,610 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-75335653 info 2025-10-30 00:03:40,610 - INFO - Deleting VN ctest-right_vn-27395161 2025-10-30 00:03:40,669 - DEBUG - VN c3113201-e5fa-4601-bcbf-01adb55bcc40 still in use: Unable to complete operation on network c3113201-e5fa-4601-bcbf-01adb55bcc40. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-98179265-4c14-43e2-b6d6-d14dbbc86f30'] 2025-10-30 00:03:40,669 - WARNING - Deleting VN ctest-right_vn-27395161 failed..Will retry 2025-10-30 00:03:42,830 - DEBUG - Response for deleting network () 2025-10-30 00:03:42,831 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e24f6b5-1305-4a99-9f82-e59d3c09939b 2025-10-30 00:03:42,844 - DEBUG - Response Code: 404 2025-10-30 00:03:42,845 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:42,852 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:42,863 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:42,949 - INFO - Validated that VN ctest-right_vn-27395161 is not found in API Server 2025-10-30 00:03:42,961 - DEBUG - VN ctest-right_vn-27395161 is not present in Agent 10.0.0.65 2025-10-30 00:03:42,981 - DEBUG - VN ctest-right_vn-27395161 is not present in Agent 10.0.0.33 2025-10-30 00:03:42,981 - INFO - Validated that VN ctest-right_vn-27395161 is not in any agent 2025-10-30 00:03:43,018 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-27395161 info 2025-10-30 00:03:43,018 - INFO - Deleting VN ctest-left_vn-21244256 2025-10-30 00:03:43,189 - DEBUG - Response for deleting network () 2025-10-30 00:03:43,189 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/33dbac23-4fb6-4146-8c30-5811aa8def97 2025-10-30 00:03:43,203 - DEBUG - Response Code: 404 2025-10-30 00:03:43,203 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:43,210 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:43,222 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:43,296 - INFO - Validated that VN ctest-left_vn-21244256 is not found in API Server 2025-10-30 00:03:43,309 - DEBUG - VN ctest-left_vn-21244256 is not present in Agent 10.0.0.65 2025-10-30 00:03:43,336 - DEBUG - VN ctest-left_vn-21244256 is not present in Agent 10.0.0.33 2025-10-30 00:03:43,336 - INFO - Validated that VN ctest-left_vn-21244256 is not in any agent 2025-10-30 00:03:43,379 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-21244256 info 2025-10-30 00:03:43,380 - INFO - Deleting VN ctest-mgmt_vn-21676593 2025-10-30 00:03:43,557 - DEBUG - Response for deleting network () 2025-10-30 00:03:43,557 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b7658dc7-d37c-45be-b6aa-7721159fb5cc 2025-10-30 00:03:43,570 - DEBUG - Response Code: 404 2025-10-30 00:03:43,570 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-30 00:03:43,585 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0f965a2d-727a-40b2-a2d7-c44e752d08a7 2025-10-30 00:03:43,640 - DEBUG - Requesting: http://10.0.0.254:8082/project/a1c87372-c45d-4d54-a34d-9a360c3f041e 2025-10-30 00:03:43,740 - INFO - Validated that VN ctest-mgmt_vn-21676593 is not found in API Server 2025-10-30 00:03:43,750 - DEBUG - VN ctest-mgmt_vn-21676593 is not present in Agent 10.0.0.65 2025-10-30 00:03:43,765 - DEBUG - VN ctest-mgmt_vn-21676593 is not present in Agent 10.0.0.33 2025-10-30 00:03:43,765 - INFO - Validated that VN ctest-mgmt_vn-21676593 is not in any agent 2025-10-30 00:03:43,798 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-21676593 info 2025-10-30 00:03:45,142 - DEBUG - No XMPP flaps were noticed during the test 2025-10-30 00:03:45,142 - INFO - 2025-10-30 00:03:45,142 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16] 2025-10-30 00:03:45,142 - INFO - -------------------------------------------------------------------------------- 2025-10-30 00:03:45,848 - INFO - Deleted project: ctest-TestSvcHC-25581283, ID : a1c87372-c45d-4d54-a34d-9a360c3f041e