2025-08-08 08:05:06,155 - INFO - Domain Default found not creating 2025-08-08 08:05:06,322 - INFO - Project ctest-TestSvcHC-58112587 not found, creating it 2025-08-08 08:05:06,933 - INFO - Created Project:ctest-TestSvcHC-58112587, ID : dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:08,527 - INFO - ================================================================================ 2025-08-08 08:05:08,527 - INFO - STARTING TEST : test_svc_hc_basic 2025-08-08 08:05:09,829 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.254': '0', '10.20.0.25': '0'}, '10.0.0.27': {'10.20.0.254': '0', '10.20.0.25': '0'}} with 2025-08-08 08:05:09,829 - INFO - Initial checks done. Running the testcase now 2025-08-08 08:05:09,829 - INFO - 2025-08-08 08:05:11,079 - DEBUG - Response for create_network : {'network': {'id': 'f780cf35-1b23-4094-9e28-cc7d893af63c', 'name': 'ctest-mgmt_vn-84515203', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'project_id': 'dac651e2a4dd4e36b86053cb86529d89', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-58112587', 'ctest-mgmt_vn-84515203'], 'port_security_enabled': True, 'description': ''}} 2025-08-08 08:05:11,406 - DEBUG - Response for create_subnet : {'subnet': {'id': '0d3e82e6-484f-40f1-90d0-db8a954acb9e', 'name': '', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'network_id': 'f780cf35-1b23-4094-9e28-cc7d893af63c', 'ip_version': 4, 'cidr': '154.187.66.0/26', 'allocation_pools': [{'start': '154.187.66.2', 'end': '154.187.66.62'}], 'gateway_ip': '154.187.66.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '154.187.66.2', 'tags': [], 'project_id': 'dac651e2a4dd4e36b86053cb86529d89'}} 2025-08-08 08:05:11,434 - INFO - Created VN ctest-mgmt_vn-84515203 2025-08-08 08:05:11,448 - DEBUG - VN ctest-mgmt_vn-84515203 UUID is f780cf35-1b23-4094-9e28-cc7d893af63c 2025-08-08 08:05:11,533 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:11,833 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:11,867 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:11,889 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:12,036 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/f780cf35-1b23-4094-9e28-cc7d893af63c 2025-08-08 08:05:12,056 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/f780cf35-1b23-4094-9e28-cc7d893af63c 2025-08-08 08:05:12,071 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/de9166ec-f336-4082-a810-7e68a3d85b9f 2025-08-08 08:05:12,087 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/de9166ec-f336-4082-a810-7e68a3d85b9f 2025-08-08 08:05:12,099 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/57fe8448-d6ce-46bf-8568-8e78a4a6b9ab 2025-08-08 08:05:12,109 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-08 08:05:12,109 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/f780cf35-1b23-4094-9e28-cc7d893af63c 2025-08-08 08:05:12,121 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/de9166ec-f336-4082-a810-7e68a3d85b9f 2025-08-08 08:05:12,142 - INFO - Verified VN network id 15 for VN f780cf35-1b23-4094-9e28-cc7d893af63c 2025-08-08 08:05:12,143 - INFO - Verifications in API Server for VN ctest-mgmt_vn-84515203 passed 2025-08-08 08:05:12,143 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/f780cf35-1b23-4094-9e28-cc7d893af63c 2025-08-08 08:05:12,162 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/de9166ec-f336-4082-a810-7e68a3d85b9f 2025-08-08 08:05:12,179 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/de9166ec-f336-4082-a810-7e68a3d85b9f 2025-08-08 08:05:12,195 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/57fe8448-d6ce-46bf-8568-8e78a4a6b9ab 2025-08-08 08:05:12,218 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17834482351382675604', 'uuid-lslong': '11396583696606361148'}, 'enable': 'true', 'created': '2025-08-08T08:05:11', 'last-modified': '2025-08-08T08:05:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.873614'} 2025-08-08 08:05:12,229 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-08 08:05:12,237 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17834482351382675604', 'uuid-lslong': '11396583696606361148'}, 'enable': 'true', 'created': '2025-08-08T08:05:11', 'last-modified': '2025-08-08T08:05:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.890289'} 2025-08-08 08:05:12,248 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-08 08:05:12,256 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17834482351382675604', 'uuid-lslong': '11396583696606361148'}, 'enable': 'true', 'created': '2025-08-08T08:05:11', 'last-modified': '2025-08-08T08:05:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.912544'} 2025-08-08 08:05:12,265 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-08 08:05:12,266 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-84515203 passed 2025-08-08 08:05:12,266 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-84515203 in API_Server ====== 2025-08-08 08:05:12,266 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:12,277 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:12,293 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:12,399 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/f780cf35-1b23-4094-9e28-cc7d893af63c 2025-08-08 08:05:12,413 - DEBUG - =>VN ctest-mgmt_vn-84515203 has no policy to be verified 2025-08-08 08:05:12,413 - DEBUG - Verifying the vn in opserver 2025-08-08 08:05:12,413 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203 virtual network link through opserver 10.0.0.50 2025-08-08 08:05:12,413 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-08 08:05:12,714 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-08 08:05:12,782 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203?flat'} 2025-08-08 08:05:12,783 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203 virtual network link through opserver 10.0.0.254 2025-08-08 08:05:12,783 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-08 08:05:13,100 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-08 08:05:13,169 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203?flat'} 2025-08-08 08:05:13,169 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203 virtual network link through opserver 10.0.0.65 2025-08-08 08:05:13,169 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-08-08 08:05:13,493 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-08-08 08:05:13,563 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203?flat'} 2025-08-08 08:05:13,563 - INFO - Validated that VN default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-84515203 is found in opserver 2025-08-08 08:05:13,595 - DEBUG - Do not have enough data to verify VN in agent 2025-08-08 08:05:13,609 - DEBUG - VRF ids for VN ctest-mgmt_vn-84515203: {} 2025-08-08 08:05:13,876 - DEBUG - Response for create_network : {'network': {'id': 'a00df7c0-0fac-4eba-8dbf-03e472f1e8f1', 'name': 'ctest-left_vn-99813365', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'project_id': 'dac651e2a4dd4e36b86053cb86529d89', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-58112587', 'ctest-left_vn-99813365'], 'port_security_enabled': True, 'description': ''}} 2025-08-08 08:05:14,132 - DEBUG - Response for create_subnet : {'subnet': {'id': '0b000f72-9564-4157-86fd-cd91e5af6ab9', 'name': '', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'network_id': 'a00df7c0-0fac-4eba-8dbf-03e472f1e8f1', 'ip_version': 4, 'cidr': '11.52.183.0/26', 'allocation_pools': [{'start': '11.52.183.2', 'end': '11.52.183.62'}], 'gateway_ip': '11.52.183.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.52.183.2', 'tags': [], 'project_id': 'dac651e2a4dd4e36b86053cb86529d89'}} 2025-08-08 08:05:14,162 - INFO - Created VN ctest-left_vn-99813365 2025-08-08 08:05:14,181 - DEBUG - VN ctest-left_vn-99813365 UUID is a00df7c0-0fac-4eba-8dbf-03e472f1e8f1 2025-08-08 08:05:14,263 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:14,271 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:14,289 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:14,393 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/a00df7c0-0fac-4eba-8dbf-03e472f1e8f1 2025-08-08 08:05:14,413 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/a00df7c0-0fac-4eba-8dbf-03e472f1e8f1 2025-08-08 08:05:14,426 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81e2db49-be5b-4369-b56c-392d9dc2a73a 2025-08-08 08:05:14,435 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81e2db49-be5b-4369-b56c-392d9dc2a73a 2025-08-08 08:05:14,444 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/1e4abebb-6790-4cd4-a536-dfc16eacd5d9 2025-08-08 08:05:14,454 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-08 08:05:14,454 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/a00df7c0-0fac-4eba-8dbf-03e472f1e8f1 2025-08-08 08:05:14,466 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81e2db49-be5b-4369-b56c-392d9dc2a73a 2025-08-08 08:05:14,487 - INFO - Verified VN network id 16 for VN a00df7c0-0fac-4eba-8dbf-03e472f1e8f1 2025-08-08 08:05:14,488 - INFO - Verifications in API Server for VN ctest-left_vn-99813365 passed 2025-08-08 08:05:14,488 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/a00df7c0-0fac-4eba-8dbf-03e472f1e8f1 2025-08-08 08:05:14,502 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81e2db49-be5b-4369-b56c-392d9dc2a73a 2025-08-08 08:05:14,516 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81e2db49-be5b-4369-b56c-392d9dc2a73a 2025-08-08 08:05:14,528 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/1e4abebb-6790-4cd4-a536-dfc16eacd5d9 2025-08-08 08:05:14,546 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11533146625034440378', 'uuid-lslong': '10213886759615457521'}, 'enable': 'true', 'created': '2025-08-08T08:05:13', 'last-modified': '2025-08-08T08:05:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.482518'} 2025-08-08 08:05:14,553 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-08 08:05:14,560 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11533146625034440378', 'uuid-lslong': '10213886759615457521'}, 'enable': 'true', 'created': '2025-08-08T08:05:13', 'last-modified': '2025-08-08T08:05:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.498542'} 2025-08-08 08:05:14,568 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-08 08:05:14,579 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11533146625034440378', 'uuid-lslong': '10213886759615457521'}, 'enable': 'true', 'created': '2025-08-08T08:05:13', 'last-modified': '2025-08-08T08:05:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.512095'} 2025-08-08 08:05:14,587 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-08 08:05:14,587 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-99813365 passed 2025-08-08 08:05:14,588 - DEBUG - ====Verifying policy data for ctest-left_vn-99813365 in API_Server ====== 2025-08-08 08:05:14,588 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:14,596 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:14,613 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:14,737 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/a00df7c0-0fac-4eba-8dbf-03e472f1e8f1 2025-08-08 08:05:14,757 - DEBUG - =>VN ctest-left_vn-99813365 has no policy to be verified 2025-08-08 08:05:14,757 - DEBUG - Verifying the vn in opserver 2025-08-08 08:05:14,757 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365 virtual network link through opserver 10.0.0.50 2025-08-08 08:05:14,757 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-08 08:05:14,846 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365?flat'} 2025-08-08 08:05:14,846 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365 virtual network link through opserver 10.0.0.254 2025-08-08 08:05:14,846 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-08 08:05:14,932 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365?flat'} 2025-08-08 08:05:14,932 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365 virtual network link through opserver 10.0.0.65 2025-08-08 08:05:14,932 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-08-08 08:05:14,999 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365?flat'} 2025-08-08 08:05:14,999 - INFO - Validated that VN default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-99813365 is found in opserver 2025-08-08 08:05:15,031 - DEBUG - Do not have enough data to verify VN in agent 2025-08-08 08:05:15,046 - DEBUG - VRF ids for VN ctest-left_vn-99813365: {} 2025-08-08 08:05:15,432 - DEBUG - Response for create_network : {'network': {'id': 'c0faad2e-903e-4a98-89cc-ddb38b7d79ea', 'name': 'ctest-right_vn-35807191', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'project_id': 'dac651e2a4dd4e36b86053cb86529d89', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-58112587', 'ctest-right_vn-35807191'], 'port_security_enabled': True, 'description': ''}} 2025-08-08 08:05:15,698 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fcf20c5e-3f17-4b5f-a727-63f9a99851f0', 'name': '', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'network_id': 'c0faad2e-903e-4a98-89cc-ddb38b7d79ea', 'ip_version': 4, 'cidr': '149.55.217.64/26', 'allocation_pools': [{'start': '149.55.217.66', 'end': '149.55.217.126'}], 'gateway_ip': '149.55.217.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '149.55.217.66', 'tags': [], 'project_id': 'dac651e2a4dd4e36b86053cb86529d89'}} 2025-08-08 08:05:15,727 - INFO - Created VN ctest-right_vn-35807191 2025-08-08 08:05:15,743 - DEBUG - VN ctest-right_vn-35807191 UUID is c0faad2e-903e-4a98-89cc-ddb38b7d79ea 2025-08-08 08:05:15,844 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:15,853 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:15,875 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:16,008 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/c0faad2e-903e-4a98-89cc-ddb38b7d79ea 2025-08-08 08:05:16,050 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/c0faad2e-903e-4a98-89cc-ddb38b7d79ea 2025-08-08 08:05:16,066 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3b5721a6-55b0-4f2d-bc3d-29ac6918cbf5 2025-08-08 08:05:16,080 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3b5721a6-55b0-4f2d-bc3d-29ac6918cbf5 2025-08-08 08:05:16,094 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/53e045d2-1f90-437e-9358-7cf0be1fe416 2025-08-08 08:05:16,102 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-08 08:05:16,102 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/c0faad2e-903e-4a98-89cc-ddb38b7d79ea 2025-08-08 08:05:16,119 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3b5721a6-55b0-4f2d-bc3d-29ac6918cbf5 2025-08-08 08:05:16,153 - INFO - Verified VN network id 17 for VN c0faad2e-903e-4a98-89cc-ddb38b7d79ea 2025-08-08 08:05:16,154 - INFO - Verifications in API Server for VN ctest-right_vn-35807191 passed 2025-08-08 08:05:16,154 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/c0faad2e-903e-4a98-89cc-ddb38b7d79ea 2025-08-08 08:05:16,169 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3b5721a6-55b0-4f2d-bc3d-29ac6918cbf5 2025-08-08 08:05:16,179 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3b5721a6-55b0-4f2d-bc3d-29ac6918cbf5 2025-08-08 08:05:16,191 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/53e045d2-1f90-437e-9358-7cf0be1fe416 2025-08-08 08:05:16,209 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13905617214959930008', 'uuid-lslong': '9929555041654241770'}, 'enable': 'true', 'created': '2025-08-08T08:05:15', 'last-modified': '2025-08-08T08:05:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.573205'} 2025-08-08 08:05:16,219 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-08 08:05:16,226 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13905617214959930008', 'uuid-lslong': '9929555041654241770'}, 'enable': 'true', 'created': '2025-08-08T08:05:15', 'last-modified': '2025-08-08T08:05:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.591672'} 2025-08-08 08:05:16,234 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-08 08:05:16,241 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13905617214959930008', 'uuid-lslong': '9929555041654241770'}, 'enable': 'true', 'created': '2025-08-08T08:05:15', 'last-modified': '2025-08-08T08:05:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.606851'} 2025-08-08 08:05:16,249 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-08 08:05:16,249 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-35807191 passed 2025-08-08 08:05:16,250 - DEBUG - ====Verifying policy data for ctest-right_vn-35807191 in API_Server ====== 2025-08-08 08:05:16,250 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:16,261 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:16,289 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:16,414 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/c0faad2e-903e-4a98-89cc-ddb38b7d79ea 2025-08-08 08:05:16,432 - DEBUG - =>VN ctest-right_vn-35807191 has no policy to be verified 2025-08-08 08:05:16,432 - DEBUG - Verifying the vn in opserver 2025-08-08 08:05:16,432 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191 virtual network link through opserver 10.0.0.50 2025-08-08 08:05:16,433 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-08 08:05:16,681 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191?flat'} 2025-08-08 08:05:16,681 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191 virtual network link through opserver 10.0.0.254 2025-08-08 08:05:16,681 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-08 08:05:16,700 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191?flat'} 2025-08-08 08:05:16,700 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191 virtual network link through opserver 10.0.0.65 2025-08-08 08:05:16,700 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-08-08 08:05:16,723 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191?flat'} 2025-08-08 08:05:16,723 - INFO - Validated that VN default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-35807191 is found in opserver 2025-08-08 08:05:16,762 - DEBUG - Do not have enough data to verify VN in agent 2025-08-08 08:05:16,786 - DEBUG - VRF ids for VN ctest-right_vn-35807191: {} 2025-08-08 08:05:16,872 - DEBUG - Services list from nova: [, , , ] 2025-08-08 08:05:18,088 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3781-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3781-2) 2025-08-08 08:05:19,545 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3781-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3781-1) 2025-08-08 08:05:19,547 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-08767922'] 2025-08-08 08:05:19,859 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-08767922'] created succesfully 2025-08-08 08:05:20,270 - DEBUG - Image by name tiny_nat_fw not found 2025-08-08 08:05:20,270 - DEBUG - Installing image tiny_nat_fw 2025-08-08 08:05:20,270 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-08-08 08:05:20,271 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-08 08:05:20,271 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-08 08:05:20,271 - DEBUG - Unzip image 2025-08-08 08:05:20,271 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-08 08:05:20,300 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-08-08 08:05:20,300 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-08767922'] 2025-08-08 08:05:20,400 - INFO - Service template: ['default-domain', 'ctest-service_template_1-08767922'] deleted successfully. 2025-08-08 08:05:20,401 - INFO - Skip interface_detach for VM ctest-right_vm-48363660 in state BUILD 2025-08-08 08:05:20,401 - INFO - Deleting VM ctest-right_vm-48363660 2025-08-08 08:05:20,440 - ERROR - VM ctest-right_vm-48363660 has failed to come up 2025-08-08 08:05:20,441 - ERROR - Nova failed to get host of the VM 2025-08-08 08:05:20,441 - ERROR - VM ctest-right_vm-48363660 has failed to come up 2025-08-08 08:05:20,441 - ERROR - Nova failed to get host of the VM 2025-08-08 08:05:20,581 - INFO - Skip interface_detach for VM ctest-left_vm-20271113 in state BUILD 2025-08-08 08:05:20,581 - INFO - Deleting VM ctest-left_vm-20271113 2025-08-08 08:05:20,581 - ERROR - VM ctest-left_vm-20271113 has failed to come up 2025-08-08 08:05:20,581 - ERROR - Nova failed to get host of the VM 2025-08-08 08:05:20,581 - ERROR - VM ctest-left_vm-20271113 has failed to come up 2025-08-08 08:05:20,581 - ERROR - Nova failed to get host of the VM 2025-08-08 08:05:20,686 - INFO - Deleting VN ctest-right_vn-35807191 2025-08-08 08:05:20,746 - DEBUG - VN c0faad2e-903e-4a98-89cc-ddb38b7d79ea still in use: Unable to complete operation on network c0faad2e-903e-4a98-89cc-ddb38b7d79ea. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-7f133f2f-487e-4a39-b7d1-73213793ac7c'] 2025-08-08 08:05:20,746 - WARNING - Deleting VN ctest-right_vn-35807191 failed..Will retry 2025-08-08 08:05:22,936 - DEBUG - Response for deleting network () 2025-08-08 08:05:22,936 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3b5721a6-55b0-4f2d-bc3d-29ac6918cbf5 2025-08-08 08:05:22,944 - DEBUG - Response Code: 404 2025-08-08 08:05:22,944 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:22,952 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:22,982 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:23,091 - INFO - Validated that VN ctest-right_vn-35807191 is not found in API Server 2025-08-08 08:05:23,109 - DEBUG - VN ctest-right_vn-35807191 is not present in Agent 10.0.0.41 2025-08-08 08:05:23,126 - DEBUG - VN ctest-right_vn-35807191 is not present in Agent 10.0.0.27 2025-08-08 08:05:23,126 - INFO - Validated that VN ctest-right_vn-35807191 is not in any agent 2025-08-08 08:05:23,168 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-35807191 info 2025-08-08 08:05:23,168 - INFO - Deleting VN ctest-left_vn-99813365 2025-08-08 08:05:23,332 - DEBUG - Response for deleting network () 2025-08-08 08:05:23,332 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81e2db49-be5b-4369-b56c-392d9dc2a73a 2025-08-08 08:05:23,342 - DEBUG - Response Code: 404 2025-08-08 08:05:23,342 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:23,356 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:23,379 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:23,477 - INFO - Validated that VN ctest-left_vn-99813365 is not found in API Server 2025-08-08 08:05:23,492 - DEBUG - VN ctest-left_vn-99813365 is not present in Agent 10.0.0.41 2025-08-08 08:05:23,508 - DEBUG - VN ctest-left_vn-99813365 is not present in Agent 10.0.0.27 2025-08-08 08:05:23,508 - INFO - Validated that VN ctest-left_vn-99813365 is not in any agent 2025-08-08 08:05:23,559 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-99813365 info 2025-08-08 08:05:23,559 - INFO - Deleting VN ctest-mgmt_vn-84515203 2025-08-08 08:05:23,773 - DEBUG - Response for deleting network () 2025-08-08 08:05:23,774 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/de9166ec-f336-4082-a810-7e68a3d85b9f 2025-08-08 08:05:23,783 - DEBUG - Response Code: 404 2025-08-08 08:05:23,783 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:23,801 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:23,826 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:23,928 - INFO - Validated that VN ctest-mgmt_vn-84515203 is not found in API Server 2025-08-08 08:05:23,944 - DEBUG - VN ctest-mgmt_vn-84515203 is not present in Agent 10.0.0.41 2025-08-08 08:05:23,957 - DEBUG - VN ctest-mgmt_vn-84515203 is not present in Agent 10.0.0.27 2025-08-08 08:05:23,958 - INFO - Validated that VN ctest-mgmt_vn-84515203 is not in any agent 2025-08-08 08:05:24,001 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-84515203 info 2025-08-08 08:05:25,284 - DEBUG - No XMPP flaps were noticed during the test 2025-08-08 08:05:25,284 - INFO - 2025-08-08 08:05:25,284 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:17] 2025-08-08 08:05:25,284 - INFO - -------------------------------------------------------------------------------- 2025-08-08 08:05:25,288 - INFO - ================================================================================ 2025-08-08 08:05:25,288 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-08-08 08:05:26,579 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.254': '0', '10.20.0.25': '0'}, '10.0.0.27': {'10.20.0.254': '0', '10.20.0.25': '0'}} with 2025-08-08 08:05:26,579 - INFO - Initial checks done. Running the testcase now 2025-08-08 08:05:26,579 - INFO - 2025-08-08 08:05:26,926 - DEBUG - Response for create_network : {'network': {'id': 'a47e9017-0a94-4359-ada0-ef9128f5d244', 'name': 'ctest-mgmt_vn-96643368', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'project_id': 'dac651e2a4dd4e36b86053cb86529d89', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-58112587', 'ctest-mgmt_vn-96643368'], 'port_security_enabled': True, 'description': ''}} 2025-08-08 08:05:27,194 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fdeb4fc8-d10f-4fe1-993e-ef5fe8de27f9', 'name': '', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'network_id': 'a47e9017-0a94-4359-ada0-ef9128f5d244', 'ip_version': 4, 'cidr': '80.150.49.128/26', 'allocation_pools': [{'start': '80.150.49.130', 'end': '80.150.49.190'}], 'gateway_ip': '80.150.49.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '80.150.49.130', 'tags': [], 'project_id': 'dac651e2a4dd4e36b86053cb86529d89'}} 2025-08-08 08:05:27,217 - INFO - Created VN ctest-mgmt_vn-96643368 2025-08-08 08:05:27,231 - DEBUG - VN ctest-mgmt_vn-96643368 UUID is a47e9017-0a94-4359-ada0-ef9128f5d244 2025-08-08 08:05:27,323 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:27,332 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:27,353 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:27,453 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/a47e9017-0a94-4359-ada0-ef9128f5d244 2025-08-08 08:05:27,471 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/a47e9017-0a94-4359-ada0-ef9128f5d244 2025-08-08 08:05:27,482 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/d85bb02c-a816-4393-8752-ed50a9950940 2025-08-08 08:05:27,494 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/d85bb02c-a816-4393-8752-ed50a9950940 2025-08-08 08:05:27,502 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/09d325e1-0213-4b9f-96e5-cea8bd18f2a0 2025-08-08 08:05:27,510 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-08 08:05:27,510 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/a47e9017-0a94-4359-ada0-ef9128f5d244 2025-08-08 08:05:27,521 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/d85bb02c-a816-4393-8752-ed50a9950940 2025-08-08 08:05:27,541 - INFO - Verified VN network id 15 for VN a47e9017-0a94-4359-ada0-ef9128f5d244 2025-08-08 08:05:27,541 - INFO - Verifications in API Server for VN ctest-mgmt_vn-96643368 passed 2025-08-08 08:05:27,541 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/a47e9017-0a94-4359-ada0-ef9128f5d244 2025-08-08 08:05:27,554 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/d85bb02c-a816-4393-8752-ed50a9950940 2025-08-08 08:05:27,565 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/d85bb02c-a816-4393-8752-ed50a9950940 2025-08-08 08:05:27,577 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/09d325e1-0213-4b9f-96e5-cea8bd18f2a0 2025-08-08 08:05:27,594 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11853069697921860441', 'uuid-lslong': '12511263171571733060'}, 'enable': 'true', 'created': '2025-08-08T08:05:26', 'last-modified': '2025-08-08T08:05:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.450009'} 2025-08-08 08:05:27,604 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-08 08:05:27,611 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11853069697921860441', 'uuid-lslong': '12511263171571733060'}, 'enable': 'true', 'created': '2025-08-08T08:05:26', 'last-modified': '2025-08-08T08:05:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.465567'} 2025-08-08 08:05:27,618 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-08 08:05:27,625 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11853069697921860441', 'uuid-lslong': '12511263171571733060'}, 'enable': 'true', 'created': '2025-08-08T08:05:26', 'last-modified': '2025-08-08T08:05:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.482011'} 2025-08-08 08:05:27,632 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-08 08:05:27,632 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-96643368 passed 2025-08-08 08:05:27,632 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-96643368 in API_Server ====== 2025-08-08 08:05:27,633 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:27,640 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:27,656 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:27,762 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/a47e9017-0a94-4359-ada0-ef9128f5d244 2025-08-08 08:05:27,776 - DEBUG - =>VN ctest-mgmt_vn-96643368 has no policy to be verified 2025-08-08 08:05:27,776 - DEBUG - Verifying the vn in opserver 2025-08-08 08:05:27,776 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368 virtual network link through opserver 10.0.0.50 2025-08-08 08:05:27,776 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-08 08:05:27,794 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368?flat'} 2025-08-08 08:05:27,794 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368 virtual network link through opserver 10.0.0.254 2025-08-08 08:05:27,794 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-08 08:05:27,812 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368?flat'} 2025-08-08 08:05:27,812 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368 virtual network link through opserver 10.0.0.65 2025-08-08 08:05:27,812 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-08-08 08:05:27,829 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368?flat'} 2025-08-08 08:05:27,829 - INFO - Validated that VN default-domain:ctest-TestSvcHC-58112587:ctest-mgmt_vn-96643368 is found in opserver 2025-08-08 08:05:27,863 - DEBUG - Do not have enough data to verify VN in agent 2025-08-08 08:05:27,881 - DEBUG - VRF ids for VN ctest-mgmt_vn-96643368: {} 2025-08-08 08:05:28,204 - DEBUG - Response for create_network : {'network': {'id': 'ff7248ef-c088-4ad8-b004-4bd629690593', 'name': 'ctest-left_vn-81275142', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'project_id': 'dac651e2a4dd4e36b86053cb86529d89', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-58112587', 'ctest-left_vn-81275142'], 'port_security_enabled': True, 'description': ''}} 2025-08-08 08:05:28,456 - DEBUG - Response for create_subnet : {'subnet': {'id': '89ea9d3e-b117-407a-b805-71b7e8fd1ed0', 'name': '', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'network_id': 'ff7248ef-c088-4ad8-b004-4bd629690593', 'ip_version': 4, 'cidr': '143.84.149.64/26', 'allocation_pools': [{'start': '143.84.149.66', 'end': '143.84.149.126'}], 'gateway_ip': '143.84.149.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '143.84.149.66', 'tags': [], 'project_id': 'dac651e2a4dd4e36b86053cb86529d89'}} 2025-08-08 08:05:28,487 - INFO - Created VN ctest-left_vn-81275142 2025-08-08 08:05:28,500 - DEBUG - VN ctest-left_vn-81275142 UUID is ff7248ef-c088-4ad8-b004-4bd629690593 2025-08-08 08:05:28,588 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:28,596 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:28,611 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:28,713 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/ff7248ef-c088-4ad8-b004-4bd629690593 2025-08-08 08:05:28,729 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/ff7248ef-c088-4ad8-b004-4bd629690593 2025-08-08 08:05:28,742 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/7303fbe5-4db3-44ca-9054-1c85fa5405a1 2025-08-08 08:05:28,756 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/7303fbe5-4db3-44ca-9054-1c85fa5405a1 2025-08-08 08:05:28,768 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/1f1fda0a-dc2f-40c6-a4b2-382433d4b6e9 2025-08-08 08:05:28,779 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-08 08:05:28,779 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/ff7248ef-c088-4ad8-b004-4bd629690593 2025-08-08 08:05:28,791 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/7303fbe5-4db3-44ca-9054-1c85fa5405a1 2025-08-08 08:05:28,811 - INFO - Verified VN network id 16 for VN ff7248ef-c088-4ad8-b004-4bd629690593 2025-08-08 08:05:28,811 - INFO - Verifications in API Server for VN ctest-left_vn-81275142 passed 2025-08-08 08:05:28,811 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/ff7248ef-c088-4ad8-b004-4bd629690593 2025-08-08 08:05:28,823 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/7303fbe5-4db3-44ca-9054-1c85fa5405a1 2025-08-08 08:05:28,834 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/7303fbe5-4db3-44ca-9054-1c85fa5405a1 2025-08-08 08:05:28,846 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/1f1fda0a-dc2f-40c6-a4b2-382433d4b6e9 2025-08-08 08:05:28,865 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18406854821581179608', 'uuid-lslong': '12683345833771992467'}, 'enable': 'true', 'created': '2025-08-08T08:05:28', 'last-modified': '2025-08-08T08:05:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.474314'} 2025-08-08 08:05:28,873 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-08 08:05:28,882 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18406854821581179608', 'uuid-lslong': '12683345833771992467'}, 'enable': 'true', 'created': '2025-08-08T08:05:28', 'last-modified': '2025-08-08T08:05:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.495553'} 2025-08-08 08:05:28,895 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-08 08:05:28,904 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18406854821581179608', 'uuid-lslong': '12683345833771992467'}, 'enable': 'true', 'created': '2025-08-08T08:05:28', 'last-modified': '2025-08-08T08:05:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.504819'} 2025-08-08 08:05:28,915 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-08 08:05:28,915 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-81275142 passed 2025-08-08 08:05:28,916 - DEBUG - ====Verifying policy data for ctest-left_vn-81275142 in API_Server ====== 2025-08-08 08:05:28,916 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:28,927 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:28,949 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:29,062 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/ff7248ef-c088-4ad8-b004-4bd629690593 2025-08-08 08:05:29,076 - DEBUG - =>VN ctest-left_vn-81275142 has no policy to be verified 2025-08-08 08:05:29,076 - DEBUG - Verifying the vn in opserver 2025-08-08 08:05:29,076 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142 virtual network link through opserver 10.0.0.50 2025-08-08 08:05:29,076 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-08 08:05:29,092 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142?flat'} 2025-08-08 08:05:29,092 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142 virtual network link through opserver 10.0.0.254 2025-08-08 08:05:29,092 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-08 08:05:29,108 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142?flat'} 2025-08-08 08:05:29,108 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142 virtual network link through opserver 10.0.0.65 2025-08-08 08:05:29,108 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-08-08 08:05:29,122 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142?flat'} 2025-08-08 08:05:29,122 - INFO - Validated that VN default-domain:ctest-TestSvcHC-58112587:ctest-left_vn-81275142 is found in opserver 2025-08-08 08:05:29,149 - DEBUG - Do not have enough data to verify VN in agent 2025-08-08 08:05:29,164 - DEBUG - VRF ids for VN ctest-left_vn-81275142: {} 2025-08-08 08:05:29,586 - DEBUG - Response for create_network : {'network': {'id': '79d881ed-0895-4799-9815-047b7a2b7e87', 'name': 'ctest-right_vn-74718443', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'project_id': 'dac651e2a4dd4e36b86053cb86529d89', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-58112587', 'ctest-right_vn-74718443'], 'port_security_enabled': True, 'description': ''}} 2025-08-08 08:05:29,894 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cf9cad17-951c-46e2-a27a-5e10b4acaf44', 'name': '', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'network_id': '79d881ed-0895-4799-9815-047b7a2b7e87', 'ip_version': 4, 'cidr': '168.53.238.64/26', 'allocation_pools': [{'start': '168.53.238.66', 'end': '168.53.238.126'}], 'gateway_ip': '168.53.238.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '168.53.238.66', 'tags': [], 'project_id': 'dac651e2a4dd4e36b86053cb86529d89'}} 2025-08-08 08:05:29,935 - INFO - Created VN ctest-right_vn-74718443 2025-08-08 08:05:29,967 - DEBUG - VN ctest-right_vn-74718443 UUID is 79d881ed-0895-4799-9815-047b7a2b7e87 2025-08-08 08:05:30,059 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:30,066 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:30,085 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:30,190 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/79d881ed-0895-4799-9815-047b7a2b7e87 2025-08-08 08:05:30,208 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/79d881ed-0895-4799-9815-047b7a2b7e87 2025-08-08 08:05:30,223 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/e40b1e26-b3ed-4fd4-97a9-450ab5b1c00d 2025-08-08 08:05:30,239 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/e40b1e26-b3ed-4fd4-97a9-450ab5b1c00d 2025-08-08 08:05:30,253 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/8f91ab40-20f6-41aa-8418-2664d55b396c 2025-08-08 08:05:30,264 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-08 08:05:30,264 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/79d881ed-0895-4799-9815-047b7a2b7e87 2025-08-08 08:05:30,277 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/e40b1e26-b3ed-4fd4-97a9-450ab5b1c00d 2025-08-08 08:05:30,298 - INFO - Verified VN network id 17 for VN 79d881ed-0895-4799-9815-047b7a2b7e87 2025-08-08 08:05:30,298 - INFO - Verifications in API Server for VN ctest-right_vn-74718443 passed 2025-08-08 08:05:30,298 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/79d881ed-0895-4799-9815-047b7a2b7e87 2025-08-08 08:05:30,313 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/e40b1e26-b3ed-4fd4-97a9-450ab5b1c00d 2025-08-08 08:05:30,325 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/e40b1e26-b3ed-4fd4-97a9-450ab5b1c00d 2025-08-08 08:05:30,335 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/8f91ab40-20f6-41aa-8418-2664d55b396c 2025-08-08 08:05:30,353 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8779910328610015129', 'uuid-lslong': '10958670196653129351'}, 'enable': 'true', 'created': '2025-08-08T08:05:29', 'last-modified': '2025-08-08T08:05:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.539747'} 2025-08-08 08:05:30,360 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-08 08:05:30,369 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8779910328610015129', 'uuid-lslong': '10958670196653129351'}, 'enable': 'true', 'created': '2025-08-08T08:05:29', 'last-modified': '2025-08-08T08:05:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.549414'} 2025-08-08 08:05:30,380 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-08 08:05:30,389 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8779910328610015129', 'uuid-lslong': '10958670196653129351'}, 'enable': 'true', 'created': '2025-08-08T08:05:29', 'last-modified': '2025-08-08T08:05:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.573805'} 2025-08-08 08:05:30,400 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-08 08:05:30,400 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-74718443 passed 2025-08-08 08:05:30,401 - DEBUG - ====Verifying policy data for ctest-right_vn-74718443 in API_Server ====== 2025-08-08 08:05:30,401 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:30,411 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:30,429 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:30,544 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/79d881ed-0895-4799-9815-047b7a2b7e87 2025-08-08 08:05:30,557 - DEBUG - =>VN ctest-right_vn-74718443 has no policy to be verified 2025-08-08 08:05:30,557 - DEBUG - Verifying the vn in opserver 2025-08-08 08:05:30,557 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443 virtual network link through opserver 10.0.0.50 2025-08-08 08:05:30,557 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-08 08:05:30,575 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443?flat'} 2025-08-08 08:05:30,575 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443 virtual network link through opserver 10.0.0.254 2025-08-08 08:05:30,575 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-08 08:05:30,648 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443?flat'} 2025-08-08 08:05:30,648 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443 virtual network link through opserver 10.0.0.65 2025-08-08 08:05:30,648 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-08-08 08:05:30,712 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443?flat'} 2025-08-08 08:05:30,712 - INFO - Validated that VN default-domain:ctest-TestSvcHC-58112587:ctest-right_vn-74718443 is found in opserver 2025-08-08 08:05:30,741 - DEBUG - Do not have enough data to verify VN in agent 2025-08-08 08:05:30,755 - DEBUG - VRF ids for VN ctest-right_vn-74718443: {} 2025-08-08 08:05:31,095 - DEBUG - Response for create_network : {'network': {'id': '6c82cc73-fd62-4d9c-980c-87800073bac2', 'name': 'ctest-trans_left_vn-79484759', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'project_id': 'dac651e2a4dd4e36b86053cb86529d89', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-58112587', 'ctest-trans_left_vn-79484759'], 'port_security_enabled': True, 'description': ''}} 2025-08-08 08:05:31,396 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b228d683-45b9-49e1-af4c-854ac8a3e227', 'name': '', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'network_id': '6c82cc73-fd62-4d9c-980c-87800073bac2', 'ip_version': 4, 'cidr': '71.80.62.192/26', 'allocation_pools': [{'start': '71.80.62.194', 'end': '71.80.62.254'}], 'gateway_ip': '71.80.62.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '71.80.62.194', 'tags': [], 'project_id': 'dac651e2a4dd4e36b86053cb86529d89'}} 2025-08-08 08:05:31,435 - INFO - Created VN ctest-trans_left_vn-79484759 2025-08-08 08:05:31,452 - DEBUG - VN ctest-trans_left_vn-79484759 UUID is 6c82cc73-fd62-4d9c-980c-87800073bac2 2025-08-08 08:05:31,549 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:31,558 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:31,574 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:31,690 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/6c82cc73-fd62-4d9c-980c-87800073bac2 2025-08-08 08:05:31,710 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/6c82cc73-fd62-4d9c-980c-87800073bac2 2025-08-08 08:05:31,725 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/995387b2-8fed-4461-bfe5-7a468f1c5a88 2025-08-08 08:05:31,740 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/995387b2-8fed-4461-bfe5-7a468f1c5a88 2025-08-08 08:05:31,750 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/2482e278-2f5a-4967-9441-8f80fc6a0edb 2025-08-08 08:05:31,761 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-08 08:05:31,761 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/6c82cc73-fd62-4d9c-980c-87800073bac2 2025-08-08 08:05:31,781 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/995387b2-8fed-4461-bfe5-7a468f1c5a88 2025-08-08 08:05:31,806 - INFO - Verified VN network id 18 for VN 6c82cc73-fd62-4d9c-980c-87800073bac2 2025-08-08 08:05:31,806 - INFO - Verifications in API Server for VN ctest-trans_left_vn-79484759 passed 2025-08-08 08:05:31,806 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/6c82cc73-fd62-4d9c-980c-87800073bac2 2025-08-08 08:05:31,822 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/995387b2-8fed-4461-bfe5-7a468f1c5a88 2025-08-08 08:05:31,834 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/995387b2-8fed-4461-bfe5-7a468f1c5a88 2025-08-08 08:05:31,844 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/2482e278-2f5a-4967-9441-8f80fc6a0edb 2025-08-08 08:05:31,864 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7819036701612985756', 'uuid-lslong': '10956280977318722242'}, 'enable': 'true', 'created': '2025-08-08T08:05:31', 'last-modified': '2025-08-08T08:05:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.541117'} 2025-08-08 08:05:31,872 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-08 08:05:31,880 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7819036701612985756', 'uuid-lslong': '10956280977318722242'}, 'enable': 'true', 'created': '2025-08-08T08:05:31', 'last-modified': '2025-08-08T08:05:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.559018'} 2025-08-08 08:05:31,890 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-08 08:05:31,899 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7819036701612985756', 'uuid-lslong': '10956280977318722242'}, 'enable': 'true', 'created': '2025-08-08T08:05:31', 'last-modified': '2025-08-08T08:05:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.575462'} 2025-08-08 08:05:31,907 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-08 08:05:31,907 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-79484759 passed 2025-08-08 08:05:31,907 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-79484759 in API_Server ====== 2025-08-08 08:05:31,907 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:31,916 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:31,938 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:32,053 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/6c82cc73-fd62-4d9c-980c-87800073bac2 2025-08-08 08:05:32,068 - DEBUG - =>VN ctest-trans_left_vn-79484759 has no policy to be verified 2025-08-08 08:05:32,068 - DEBUG - Verifying the vn in opserver 2025-08-08 08:05:32,068 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759 virtual network link through opserver 10.0.0.50 2025-08-08 08:05:32,068 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-08 08:05:32,086 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759?flat'} 2025-08-08 08:05:32,086 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759 virtual network link through opserver 10.0.0.254 2025-08-08 08:05:32,086 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-08 08:05:32,105 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759?flat'} 2025-08-08 08:05:32,105 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759 virtual network link through opserver 10.0.0.65 2025-08-08 08:05:32,105 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-08-08 08:05:32,123 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759?flat'} 2025-08-08 08:05:32,124 - INFO - Validated that VN default-domain:ctest-TestSvcHC-58112587:ctest-trans_left_vn-79484759 is found in opserver 2025-08-08 08:05:32,155 - DEBUG - Do not have enough data to verify VN in agent 2025-08-08 08:05:32,170 - DEBUG - VRF ids for VN ctest-trans_left_vn-79484759: {} 2025-08-08 08:05:32,484 - DEBUG - Response for create_network : {'network': {'id': '22f83293-80ed-47b0-b5b8-064a20587f65', 'name': 'ctest-trans_right_vn-69424580', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'project_id': 'dac651e2a4dd4e36b86053cb86529d89', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-58112587', 'ctest-trans_right_vn-69424580'], 'port_security_enabled': True, 'description': ''}} 2025-08-08 08:05:32,749 - DEBUG - Response for create_subnet : {'subnet': {'id': '533a0bae-4db5-48e6-ad58-665d78a8f416', 'name': '', 'tenant_id': 'dac651e2a4dd4e36b86053cb86529d89', 'network_id': '22f83293-80ed-47b0-b5b8-064a20587f65', 'ip_version': 4, 'cidr': '123.15.190.192/26', 'allocation_pools': [{'start': '123.15.190.194', 'end': '123.15.190.254'}], 'gateway_ip': '123.15.190.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '123.15.190.194', 'tags': [], 'project_id': 'dac651e2a4dd4e36b86053cb86529d89'}} 2025-08-08 08:05:32,782 - INFO - Created VN ctest-trans_right_vn-69424580 2025-08-08 08:05:32,799 - DEBUG - VN ctest-trans_right_vn-69424580 UUID is 22f83293-80ed-47b0-b5b8-064a20587f65 2025-08-08 08:05:32,899 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:32,907 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:32,926 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:33,040 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/22f83293-80ed-47b0-b5b8-064a20587f65 2025-08-08 08:05:33,054 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/22f83293-80ed-47b0-b5b8-064a20587f65 2025-08-08 08:05:33,071 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/92409cd1-b05e-4139-9516-d9303193d1ca 2025-08-08 08:05:33,083 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/92409cd1-b05e-4139-9516-d9303193d1ca 2025-08-08 08:05:33,093 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/38f40813-8bdd-49e4-b95e-07e79d02fda5 2025-08-08 08:05:33,104 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-08-08 08:05:33,104 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/22f83293-80ed-47b0-b5b8-064a20587f65 2025-08-08 08:05:33,115 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/92409cd1-b05e-4139-9516-d9303193d1ca 2025-08-08 08:05:33,134 - INFO - Verified VN network id 19 for VN 22f83293-80ed-47b0-b5b8-064a20587f65 2025-08-08 08:05:33,134 - INFO - Verifications in API Server for VN ctest-trans_right_vn-69424580 passed 2025-08-08 08:05:33,134 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/22f83293-80ed-47b0-b5b8-064a20587f65 2025-08-08 08:05:33,147 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/92409cd1-b05e-4139-9516-d9303193d1ca 2025-08-08 08:05:33,159 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/92409cd1-b05e-4139-9516-d9303193d1ca 2025-08-08 08:05:33,175 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/38f40813-8bdd-49e4-b95e-07e79d02fda5 2025-08-08 08:05:33,193 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2519819600618407856', 'uuid-lslong': '13094222832019734373'}, 'enable': 'true', 'created': '2025-08-08T08:05:32', 'last-modified': '2025-08-08T08:05:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.522582'} 2025-08-08 08:05:33,202 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-08-08 08:05:33,209 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2519819600618407856', 'uuid-lslong': '13094222832019734373'}, 'enable': 'true', 'created': '2025-08-08T08:05:32', 'last-modified': '2025-08-08T08:05:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.537543'} 2025-08-08 08:05:33,216 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-08-08 08:05:33,224 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-58112587', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2519819600618407856', 'uuid-lslong': '13094222832019734373'}, 'enable': 'true', 'created': '2025-08-08T08:05:32', 'last-modified': '2025-08-08T08:05:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.552222'} 2025-08-08 08:05:33,233 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-08-08 08:05:33,233 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-69424580 passed 2025-08-08 08:05:33,233 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-69424580 in API_Server ====== 2025-08-08 08:05:33,234 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:33,242 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:33,265 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:33,366 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/22f83293-80ed-47b0-b5b8-064a20587f65 2025-08-08 08:05:33,379 - DEBUG - =>VN ctest-trans_right_vn-69424580 has no policy to be verified 2025-08-08 08:05:33,379 - DEBUG - Verifying the vn in opserver 2025-08-08 08:05:33,379 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580 virtual network link through opserver 10.0.0.50 2025-08-08 08:05:33,379 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-08 08:05:33,395 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580?flat'} 2025-08-08 08:05:33,395 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580 virtual network link through opserver 10.0.0.254 2025-08-08 08:05:33,396 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-08 08:05:33,417 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580?flat'} 2025-08-08 08:05:33,417 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580 virtual network link through opserver 10.0.0.65 2025-08-08 08:05:33,417 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-08-08 08:05:33,433 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580?flat'} 2025-08-08 08:05:33,433 - INFO - Validated that VN default-domain:ctest-TestSvcHC-58112587:ctest-trans_right_vn-69424580 is found in opserver 2025-08-08 08:05:33,466 - DEBUG - Do not have enough data to verify VN in agent 2025-08-08 08:05:33,482 - DEBUG - VRF ids for VN ctest-trans_right_vn-69424580: {} 2025-08-08 08:05:34,614 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3781-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3781-1) 2025-08-08 08:05:35,960 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3781-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3781-2) 2025-08-08 08:05:35,961 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-04848191'] 2025-08-08 08:05:36,280 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-04848191'] created succesfully 2025-08-08 08:05:36,685 - DEBUG - Image by name tiny_trans_fw not found 2025-08-08 08:05:36,685 - DEBUG - Installing image tiny_trans_fw 2025-08-08 08:05:36,686 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-08-08 08:05:36,686 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-08 08:05:36,686 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-08 08:05:36,686 - DEBUG - Unzip image 2025-08-08 08:05:36,686 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-08 08:05:36,707 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-08-08 08:05:36,708 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-04848191'] 2025-08-08 08:05:36,876 - INFO - Service template: ['default-domain', 'ctest-service_template_1-04848191'] deleted successfully. 2025-08-08 08:05:36,876 - INFO - Skip interface_detach for VM ctest-right_vm-37871472 in state BUILD 2025-08-08 08:05:36,876 - INFO - Deleting VM ctest-right_vm-37871472 2025-08-08 08:05:36,876 - ERROR - VM ctest-right_vm-37871472 has failed to come up 2025-08-08 08:05:36,876 - ERROR - Nova failed to get host of the VM 2025-08-08 08:05:36,876 - ERROR - VM ctest-right_vm-37871472 has failed to come up 2025-08-08 08:05:36,876 - ERROR - Nova failed to get host of the VM 2025-08-08 08:05:36,958 - INFO - Skip interface_detach for VM ctest-left_vm-75607494 in state BUILD 2025-08-08 08:05:36,958 - INFO - Deleting VM ctest-left_vm-75607494 2025-08-08 08:05:36,958 - ERROR - VM ctest-left_vm-75607494 has failed to come up 2025-08-08 08:05:36,958 - ERROR - Nova failed to get host of the VM 2025-08-08 08:05:36,958 - ERROR - VM ctest-left_vm-75607494 has failed to come up 2025-08-08 08:05:36,958 - ERROR - Nova failed to get host of the VM 2025-08-08 08:05:37,096 - INFO - Deleting VN ctest-trans_right_vn-69424580 2025-08-08 08:05:37,309 - DEBUG - Response for deleting network () 2025-08-08 08:05:37,309 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/92409cd1-b05e-4139-9516-d9303193d1ca 2025-08-08 08:05:37,317 - DEBUG - Response Code: 404 2025-08-08 08:05:37,317 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:37,329 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:37,393 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:37,510 - INFO - Validated that VN ctest-trans_right_vn-69424580 is not found in API Server 2025-08-08 08:05:37,527 - DEBUG - VN ctest-trans_right_vn-69424580 is not present in Agent 10.0.0.41 2025-08-08 08:05:37,554 - DEBUG - VN ctest-trans_right_vn-69424580 is not present in Agent 10.0.0.27 2025-08-08 08:05:37,554 - INFO - Validated that VN ctest-trans_right_vn-69424580 is not in any agent 2025-08-08 08:05:37,616 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-69424580 info 2025-08-08 08:05:37,617 - INFO - Deleting VN ctest-trans_left_vn-79484759 2025-08-08 08:05:37,833 - DEBUG - Response for deleting network () 2025-08-08 08:05:37,833 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/995387b2-8fed-4461-bfe5-7a468f1c5a88 2025-08-08 08:05:37,862 - DEBUG - Response Code: 404 2025-08-08 08:05:37,863 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:37,886 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:37,914 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:38,091 - INFO - Validated that VN ctest-trans_left_vn-79484759 is not found in API Server 2025-08-08 08:05:38,109 - DEBUG - VN ctest-trans_left_vn-79484759 is not present in Agent 10.0.0.41 2025-08-08 08:05:38,140 - DEBUG - VN ctest-trans_left_vn-79484759 is not present in Agent 10.0.0.27 2025-08-08 08:05:38,140 - INFO - Validated that VN ctest-trans_left_vn-79484759 is not in any agent 2025-08-08 08:05:38,200 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-79484759 info 2025-08-08 08:05:38,200 - INFO - Deleting VN ctest-right_vn-74718443 2025-08-08 08:05:38,272 - DEBUG - VN 79d881ed-0895-4799-9815-047b7a2b7e87 still in use: Unable to complete operation on network 79d881ed-0895-4799-9815-047b7a2b7e87. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-d7f50b4c-f4bc-4325-91ab-33402f6499cf'] 2025-08-08 08:05:38,272 - WARNING - Deleting VN ctest-right_vn-74718443 failed..Will retry 2025-08-08 08:05:40,474 - DEBUG - Response for deleting network () 2025-08-08 08:05:40,474 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/e40b1e26-b3ed-4fd4-97a9-450ab5b1c00d 2025-08-08 08:05:40,485 - DEBUG - Response Code: 404 2025-08-08 08:05:40,485 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:40,493 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:40,522 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:40,627 - INFO - Validated that VN ctest-right_vn-74718443 is not found in API Server 2025-08-08 08:05:40,640 - DEBUG - VN ctest-right_vn-74718443 is not present in Agent 10.0.0.41 2025-08-08 08:05:40,657 - DEBUG - VN ctest-right_vn-74718443 is not present in Agent 10.0.0.27 2025-08-08 08:05:40,657 - INFO - Validated that VN ctest-right_vn-74718443 is not in any agent 2025-08-08 08:05:40,705 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-74718443 info 2025-08-08 08:05:40,705 - INFO - Deleting VN ctest-left_vn-81275142 2025-08-08 08:05:40,904 - DEBUG - Response for deleting network () 2025-08-08 08:05:40,904 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/7303fbe5-4db3-44ca-9054-1c85fa5405a1 2025-08-08 08:05:40,911 - DEBUG - Response Code: 404 2025-08-08 08:05:40,911 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:40,927 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:40,945 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:41,078 - INFO - Validated that VN ctest-left_vn-81275142 is not found in API Server 2025-08-08 08:05:41,098 - DEBUG - VN ctest-left_vn-81275142 is not present in Agent 10.0.0.41 2025-08-08 08:05:41,116 - DEBUG - VN ctest-left_vn-81275142 is not present in Agent 10.0.0.27 2025-08-08 08:05:41,116 - INFO - Validated that VN ctest-left_vn-81275142 is not in any agent 2025-08-08 08:05:41,162 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-81275142 info 2025-08-08 08:05:41,164 - INFO - Deleting VN ctest-mgmt_vn-96643368 2025-08-08 08:05:41,363 - DEBUG - Response for deleting network () 2025-08-08 08:05:41,363 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/d85bb02c-a816-4393-8752-ed50a9950940 2025-08-08 08:05:41,371 - DEBUG - Response Code: 404 2025-08-08 08:05:41,372 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-08 08:05:41,380 - DEBUG - Requesting: http://10.0.0.50:8082/domain/0a1f62a0-4b7c-4f3b-81ab-d2813942820b 2025-08-08 08:05:41,414 - DEBUG - Requesting: http://10.0.0.50:8082/project/dac651e2-a4dd-4e36-b860-53cb86529d89 2025-08-08 08:05:41,528 - INFO - Validated that VN ctest-mgmt_vn-96643368 is not found in API Server 2025-08-08 08:05:41,557 - DEBUG - VN ctest-mgmt_vn-96643368 is not present in Agent 10.0.0.41 2025-08-08 08:05:41,572 - DEBUG - VN ctest-mgmt_vn-96643368 is not present in Agent 10.0.0.27 2025-08-08 08:05:41,572 - INFO - Validated that VN ctest-mgmt_vn-96643368 is not in any agent 2025-08-08 08:05:41,611 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-96643368 info 2025-08-08 08:05:42,913 - DEBUG - No XMPP flaps were noticed during the test 2025-08-08 08:05:42,913 - INFO - 2025-08-08 08:05:42,913 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:17] 2025-08-08 08:05:42,913 - INFO - -------------------------------------------------------------------------------- 2025-08-08 08:05:43,717 - INFO - Deleted project: ctest-TestSvcHC-58112587, ID : dac651e2-a4dd-4e36-b860-53cb86529d89