2025-11-13 03:11:58,800 - INFO - Domain Default found not creating 2025-11-13 03:11:58,973 - INFO - Project ctest-TestSvcHC-77840650 not found, creating it 2025-11-13 03:11:59,508 - INFO - Created Project:ctest-TestSvcHC-77840650, ID : 61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:01,114 - INFO - ================================================================================ 2025-11-13 03:12:01,114 - INFO - STARTING TEST : test_svc_hc_basic 2025-11-13 03:12:02,396 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.25': '0', '10.20.0.254': '0'}, '10.0.0.23': {'10.20.0.25': '0', '10.20.0.193': '0'}} with 2025-11-13 03:12:02,396 - INFO - Initial checks done. Running the testcase now 2025-11-13 03:12:02,396 - INFO - 2025-11-13 03:12:03,083 - DEBUG - Response for create_network : {'network': {'id': 'd0f51731-0286-4ce6-a3c5-3bc43deb1a7f', 'name': 'ctest-mgmt_vn-28673271', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'project_id': '61e99fa727994dc28243c05a0336fef1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-77840650', 'ctest-mgmt_vn-28673271'], 'port_security_enabled': True, 'description': ''}} 2025-11-13 03:12:03,351 - DEBUG - Response for create_subnet : {'subnet': {'id': '6339de29-9336-450c-a30e-79506549998c', 'name': '', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'network_id': 'd0f51731-0286-4ce6-a3c5-3bc43deb1a7f', 'ip_version': 4, 'cidr': '46.198.32.192/26', 'allocation_pools': [{'start': '46.198.32.194', 'end': '46.198.32.254'}], 'gateway_ip': '46.198.32.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '46.198.32.194', 'tags': [], 'project_id': '61e99fa727994dc28243c05a0336fef1'}} 2025-11-13 03:12:03,371 - INFO - Created VN ctest-mgmt_vn-28673271 2025-11-13 03:12:03,384 - DEBUG - VN ctest-mgmt_vn-28673271 UUID is d0f51731-0286-4ce6-a3c5-3bc43deb1a7f 2025-11-13 03:12:03,454 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:03,791 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:03,818 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:03,835 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:03,943 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0f51731-0286-4ce6-a3c5-3bc43deb1a7f 2025-11-13 03:12:03,964 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0f51731-0286-4ce6-a3c5-3bc43deb1a7f 2025-11-13 03:12:03,978 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cf3b53c3-e8ee-46bf-8d66-c2ba9adade64 2025-11-13 03:12:03,989 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cf3b53c3-e8ee-46bf-8d66-c2ba9adade64 2025-11-13 03:12:04,000 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/bee9c248-0a1f-48af-9469-8969782168cf 2025-11-13 03:12:04,012 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-13 03:12:04,012 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0f51731-0286-4ce6-a3c5-3bc43deb1a7f 2025-11-13 03:12:04,026 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cf3b53c3-e8ee-46bf-8d66-c2ba9adade64 2025-11-13 03:12:04,046 - INFO - Verified VN network id 11 for VN d0f51731-0286-4ce6-a3c5-3bc43deb1a7f 2025-11-13 03:12:04,047 - INFO - Verifications in API Server for VN ctest-mgmt_vn-28673271 passed 2025-11-13 03:12:04,047 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0f51731-0286-4ce6-a3c5-3bc43deb1a7f 2025-11-13 03:12:04,061 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cf3b53c3-e8ee-46bf-8d66-c2ba9adade64 2025-11-13 03:12:04,071 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cf3b53c3-e8ee-46bf-8d66-c2ba9adade64 2025-11-13 03:12:04,085 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/bee9c248-0a1f-48af-9469-8969782168cf 2025-11-13 03:12:04,100 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15056966428446313702', 'uuid-lslong': '11800904112632699519'}, 'enable': 'true', 'created': '2025-11-13T03:12:03', 'last-modified': '2025-11-13T03:12:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.792756'} 2025-11-13 03:12:04,108 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-13 03:12:04,114 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15056966428446313702', 'uuid-lslong': '11800904112632699519'}, 'enable': 'true', 'created': '2025-11-13T03:12:03', 'last-modified': '2025-11-13T03:12:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.808787'} 2025-11-13 03:12:04,120 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-13 03:12:04,126 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15056966428446313702', 'uuid-lslong': '11800904112632699519'}, 'enable': 'true', 'created': '2025-11-13T03:12:03', 'last-modified': '2025-11-13T03:12:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.819778'} 2025-11-13 03:12:04,132 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-13 03:12:04,132 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-28673271 passed 2025-11-13 03:12:04,133 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-28673271 in API_Server ====== 2025-11-13 03:12:04,133 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:04,139 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:04,149 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:04,236 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d0f51731-0286-4ce6-a3c5-3bc43deb1a7f 2025-11-13 03:12:04,254 - DEBUG - =>VN ctest-mgmt_vn-28673271 has no policy to be verified 2025-11-13 03:12:04,254 - DEBUG - Verifying the vn in opserver 2025-11-13 03:12:04,254 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271 virtual network link through opserver 10.0.0.141 2025-11-13 03:12:04,254 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2025-11-13 03:12:04,587 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2025-11-13 03:12:04,640 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271?flat'} 2025-11-13 03:12:04,640 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271 virtual network link through opserver 10.0.0.56 2025-11-13 03:12:04,640 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-11-13 03:12:04,973 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-11-13 03:12:05,030 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271?flat'} 2025-11-13 03:12:05,030 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271 virtual network link through opserver 10.0.0.61 2025-11-13 03:12:05,030 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-13 03:12:05,362 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-13 03:12:05,415 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271?flat'} 2025-11-13 03:12:05,415 - INFO - Validated that VN default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-28673271 is found in opserver 2025-11-13 03:12:05,435 - DEBUG - Do not have enough data to verify VN in agent 2025-11-13 03:12:05,445 - DEBUG - VRF ids for VN ctest-mgmt_vn-28673271: {} 2025-11-13 03:12:05,711 - DEBUG - Response for create_network : {'network': {'id': 'faf48b80-6c63-457e-a79c-4c77260206ee', 'name': 'ctest-left_vn-43208351', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'project_id': '61e99fa727994dc28243c05a0336fef1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-77840650', 'ctest-left_vn-43208351'], 'port_security_enabled': True, 'description': ''}} 2025-11-13 03:12:06,005 - DEBUG - Response for create_subnet : {'subnet': {'id': '32b96b66-385f-4564-8178-dea436eefe07', 'name': '', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'network_id': 'faf48b80-6c63-457e-a79c-4c77260206ee', 'ip_version': 4, 'cidr': '6.225.63.0/26', 'allocation_pools': [{'start': '6.225.63.2', 'end': '6.225.63.62'}], 'gateway_ip': '6.225.63.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '6.225.63.2', 'tags': [], 'project_id': '61e99fa727994dc28243c05a0336fef1'}} 2025-11-13 03:12:06,029 - INFO - Created VN ctest-left_vn-43208351 2025-11-13 03:12:06,043 - DEBUG - VN ctest-left_vn-43208351 UUID is faf48b80-6c63-457e-a79c-4c77260206ee 2025-11-13 03:12:06,113 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:06,119 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:06,130 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:06,232 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/faf48b80-6c63-457e-a79c-4c77260206ee 2025-11-13 03:12:06,245 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/faf48b80-6c63-457e-a79c-4c77260206ee 2025-11-13 03:12:06,254 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/fe195911-4f35-4424-98c1-ea1c39478130 2025-11-13 03:12:06,262 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/fe195911-4f35-4424-98c1-ea1c39478130 2025-11-13 03:12:06,269 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/be59d54b-7a23-45e4-96bd-29e9bd568144 2025-11-13 03:12:06,277 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-13 03:12:06,277 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/faf48b80-6c63-457e-a79c-4c77260206ee 2025-11-13 03:12:06,286 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/fe195911-4f35-4424-98c1-ea1c39478130 2025-11-13 03:12:06,302 - INFO - Verified VN network id 12 for VN faf48b80-6c63-457e-a79c-4c77260206ee 2025-11-13 03:12:06,302 - INFO - Verifications in API Server for VN ctest-left_vn-43208351 passed 2025-11-13 03:12:06,303 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/faf48b80-6c63-457e-a79c-4c77260206ee 2025-11-13 03:12:06,313 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/fe195911-4f35-4424-98c1-ea1c39478130 2025-11-13 03:12:06,321 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/fe195911-4f35-4424-98c1-ea1c39478130 2025-11-13 03:12:06,328 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/be59d54b-7a23-45e4-96bd-29e9bd568144 2025-11-13 03:12:06,340 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18083231787489903998', 'uuid-lslong': '12077612375323313902'}, 'enable': 'true', 'created': '2025-11-13T03:12:05', 'last-modified': '2025-11-13T03:12:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404270'} 2025-11-13 03:12:06,345 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-13 03:12:06,350 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18083231787489903998', 'uuid-lslong': '12077612375323313902'}, 'enable': 'true', 'created': '2025-11-13T03:12:05', 'last-modified': '2025-11-13T03:12:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420422'} 2025-11-13 03:12:06,356 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-13 03:12:06,362 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18083231787489903998', 'uuid-lslong': '12077612375323313902'}, 'enable': 'true', 'created': '2025-11-13T03:12:05', 'last-modified': '2025-11-13T03:12:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.434989'} 2025-11-13 03:12:06,368 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-13 03:12:06,368 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-43208351 passed 2025-11-13 03:12:06,368 - DEBUG - ====Verifying policy data for ctest-left_vn-43208351 in API_Server ====== 2025-11-13 03:12:06,368 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:06,378 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:06,389 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:06,489 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/faf48b80-6c63-457e-a79c-4c77260206ee 2025-11-13 03:12:06,501 - DEBUG - =>VN ctest-left_vn-43208351 has no policy to be verified 2025-11-13 03:12:06,501 - DEBUG - Verifying the vn in opserver 2025-11-13 03:12:06,501 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351 virtual network link through opserver 10.0.0.141 2025-11-13 03:12:06,501 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2025-11-13 03:12:06,569 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351?flat'} 2025-11-13 03:12:06,569 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351 virtual network link through opserver 10.0.0.56 2025-11-13 03:12:06,569 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-11-13 03:12:06,621 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351?flat'} 2025-11-13 03:12:06,621 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351 virtual network link through opserver 10.0.0.61 2025-11-13 03:12:06,622 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-13 03:12:06,672 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351?flat'} 2025-11-13 03:12:06,672 - INFO - Validated that VN default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-43208351 is found in opserver 2025-11-13 03:12:06,691 - DEBUG - Do not have enough data to verify VN in agent 2025-11-13 03:12:06,700 - DEBUG - VRF ids for VN ctest-left_vn-43208351: {} 2025-11-13 03:12:06,936 - DEBUG - Response for create_network : {'network': {'id': 'b78e5075-a586-49fa-ae12-064bb686e7ee', 'name': 'ctest-right_vn-44170495', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'project_id': '61e99fa727994dc28243c05a0336fef1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-77840650', 'ctest-right_vn-44170495'], 'port_security_enabled': True, 'description': ''}} 2025-11-13 03:12:07,165 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd25dad25-555f-417f-8910-fa2fb30ce939', 'name': '', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'network_id': 'b78e5075-a586-49fa-ae12-064bb686e7ee', 'ip_version': 4, 'cidr': '218.12.16.192/26', 'allocation_pools': [{'start': '218.12.16.194', 'end': '218.12.16.254'}], 'gateway_ip': '218.12.16.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '218.12.16.194', 'tags': [], 'project_id': '61e99fa727994dc28243c05a0336fef1'}} 2025-11-13 03:12:07,187 - INFO - Created VN ctest-right_vn-44170495 2025-11-13 03:12:07,198 - DEBUG - VN ctest-right_vn-44170495 UUID is b78e5075-a586-49fa-ae12-064bb686e7ee 2025-11-13 03:12:07,279 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:07,286 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:07,302 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:07,402 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/b78e5075-a586-49fa-ae12-064bb686e7ee 2025-11-13 03:12:07,417 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/b78e5075-a586-49fa-ae12-064bb686e7ee 2025-11-13 03:12:07,428 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/e98215ff-9b96-4756-beb6-4bfac432b269 2025-11-13 03:12:07,436 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/e98215ff-9b96-4756-beb6-4bfac432b269 2025-11-13 03:12:07,444 - DEBUG - Route Targets: [] 2025-11-13 03:12:07,444 - DEBUG - RT names not yet present for VN ctest-right_vn-44170495 2025-11-13 03:12:12,445 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:12,454 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:12,473 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:12,584 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/b78e5075-a586-49fa-ae12-064bb686e7ee 2025-11-13 03:12:12,598 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/b78e5075-a586-49fa-ae12-064bb686e7ee 2025-11-13 03:12:12,607 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/e98215ff-9b96-4756-beb6-4bfac432b269 2025-11-13 03:12:12,618 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/e98215ff-9b96-4756-beb6-4bfac432b269 2025-11-13 03:12:12,628 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/64dba09a-7862-4086-b245-46b69555a7bd 2025-11-13 03:12:12,645 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-13 03:12:12,645 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/b78e5075-a586-49fa-ae12-064bb686e7ee 2025-11-13 03:12:12,656 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/e98215ff-9b96-4756-beb6-4bfac432b269 2025-11-13 03:12:12,675 - INFO - Verified VN network id 13 for VN b78e5075-a586-49fa-ae12-064bb686e7ee 2025-11-13 03:12:12,675 - INFO - Verifications in API Server for VN ctest-right_vn-44170495 passed 2025-11-13 03:12:12,675 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/b78e5075-a586-49fa-ae12-064bb686e7ee 2025-11-13 03:12:12,686 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/e98215ff-9b96-4756-beb6-4bfac432b269 2025-11-13 03:12:12,693 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/e98215ff-9b96-4756-beb6-4bfac432b269 2025-11-13 03:12:12,700 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/64dba09a-7862-4086-b245-46b69555a7bd 2025-11-13 03:12:12,712 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13226597621852162554', 'uuid-lslong': '12543094834434861038'}, 'enable': 'true', 'created': '2025-11-13T03:12:06', 'last-modified': '2025-11-13T03:12:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.609489'} 2025-11-13 03:12:12,720 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-13 03:12:12,725 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13226597621852162554', 'uuid-lslong': '12543094834434861038'}, 'enable': 'true', 'created': '2025-11-13T03:12:06', 'last-modified': '2025-11-13T03:12:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.621965'} 2025-11-13 03:12:12,730 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-13 03:12:12,736 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13226597621852162554', 'uuid-lslong': '12543094834434861038'}, 'enable': 'true', 'created': '2025-11-13T03:12:06', 'last-modified': '2025-11-13T03:12:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.631240'} 2025-11-13 03:12:12,743 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-13 03:12:12,743 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-44170495 passed 2025-11-13 03:12:12,743 - DEBUG - ====Verifying policy data for ctest-right_vn-44170495 in API_Server ====== 2025-11-13 03:12:12,743 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:12,749 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:12,762 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:12,854 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/b78e5075-a586-49fa-ae12-064bb686e7ee 2025-11-13 03:12:12,866 - DEBUG - =>VN ctest-right_vn-44170495 has no policy to be verified 2025-11-13 03:12:12,866 - DEBUG - Verifying the vn in opserver 2025-11-13 03:12:12,866 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495 virtual network link through opserver 10.0.0.141 2025-11-13 03:12:12,866 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2025-11-13 03:12:12,933 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495?flat'} 2025-11-13 03:12:12,933 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495 virtual network link through opserver 10.0.0.56 2025-11-13 03:12:12,933 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-11-13 03:12:12,993 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495?flat'} 2025-11-13 03:12:12,994 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495 virtual network link through opserver 10.0.0.61 2025-11-13 03:12:12,994 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-13 03:12:13,049 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495?flat'} 2025-11-13 03:12:13,049 - INFO - Validated that VN default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-44170495 is found in opserver 2025-11-13 03:12:13,069 - DEBUG - Do not have enough data to verify VN in agent 2025-11-13 03:12:13,079 - DEBUG - VRF ids for VN ctest-right_vn-44170495: {} 2025-11-13 03:12:13,140 - DEBUG - Services list from nova: [, , , ] 2025-11-13 03:12:14,311 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4712-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4712-2) 2025-11-13 03:12:15,819 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4712-1) 2025-11-13 03:12:15,819 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-31293615'] 2025-11-13 03:12:16,114 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-31293615'] created succesfully 2025-11-13 03:12:16,455 - DEBUG - Image by name tiny_nat_fw not found 2025-11-13 03:12:16,456 - DEBUG - Installing image tiny_nat_fw 2025-11-13 03:12:16,456 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-11-13 03:12:16,456 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-13 03:12:16,456 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-13 03:12:16,456 - DEBUG - Unzip image 2025-11-13 03:12:16,456 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-13 03:12:16,495 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-11-13 03:12:16,498 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-31293615'] 2025-11-13 03:12:16,603 - INFO - Service template: ['default-domain', 'ctest-service_template_1-31293615'] deleted successfully. 2025-11-13 03:12:16,604 - INFO - Skip interface_detach for VM ctest-right_vm-20129159 in state BUILD 2025-11-13 03:12:16,605 - INFO - Deleting VM ctest-right_vm-20129159 2025-11-13 03:12:16,661 - ERROR - VM ctest-right_vm-20129159 has failed to come up 2025-11-13 03:12:16,661 - ERROR - Nova failed to get host of the VM 2025-11-13 03:12:16,661 - ERROR - VM ctest-right_vm-20129159 has failed to come up 2025-11-13 03:12:16,661 - ERROR - Nova failed to get host of the VM 2025-11-13 03:12:16,777 - INFO - Skip interface_detach for VM ctest-left_vm-92002962 in state BUILD 2025-11-13 03:12:16,777 - INFO - Deleting VM ctest-left_vm-92002962 2025-11-13 03:12:16,777 - ERROR - VM ctest-left_vm-92002962 has failed to come up 2025-11-13 03:12:16,777 - ERROR - Nova failed to get host of the VM 2025-11-13 03:12:16,777 - ERROR - VM ctest-left_vm-92002962 has failed to come up 2025-11-13 03:12:16,777 - ERROR - Nova failed to get host of the VM 2025-11-13 03:12:16,850 - INFO - Deleting VN ctest-right_vn-44170495 2025-11-13 03:12:16,912 - DEBUG - VN b78e5075-a586-49fa-ae12-064bb686e7ee still in use: Unable to complete operation on network b78e5075-a586-49fa-ae12-064bb686e7ee. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-e7fb1712-c73e-42f7-a659-35d2282eebe4'] 2025-11-13 03:12:16,912 - WARNING - Deleting VN ctest-right_vn-44170495 failed..Will retry 2025-11-13 03:12:19,059 - DEBUG - Response for deleting network () 2025-11-13 03:12:19,059 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/e98215ff-9b96-4756-beb6-4bfac432b269 2025-11-13 03:12:19,066 - DEBUG - Response Code: 404 2025-11-13 03:12:19,067 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:19,075 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:19,131 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:19,229 - INFO - Validated that VN ctest-right_vn-44170495 is not found in API Server 2025-11-13 03:12:19,239 - DEBUG - VN ctest-right_vn-44170495 is not present in Agent 10.0.0.19 2025-11-13 03:12:19,250 - DEBUG - VN ctest-right_vn-44170495 is not present in Agent 10.0.0.23 2025-11-13 03:12:19,250 - INFO - Validated that VN ctest-right_vn-44170495 is not in any agent 2025-11-13 03:12:19,283 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-44170495 info 2025-11-13 03:12:19,283 - INFO - Deleting VN ctest-left_vn-43208351 2025-11-13 03:12:19,414 - DEBUG - Response for deleting network () 2025-11-13 03:12:19,415 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/fe195911-4f35-4424-98c1-ea1c39478130 2025-11-13 03:12:19,423 - DEBUG - Response Code: 404 2025-11-13 03:12:19,423 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:19,428 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:19,440 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:19,525 - INFO - Validated that VN ctest-left_vn-43208351 is not found in API Server 2025-11-13 03:12:19,537 - DEBUG - VN ctest-left_vn-43208351 is not present in Agent 10.0.0.19 2025-11-13 03:12:19,550 - DEBUG - VN ctest-left_vn-43208351 is not present in Agent 10.0.0.23 2025-11-13 03:12:19,550 - INFO - Validated that VN ctest-left_vn-43208351 is not in any agent 2025-11-13 03:12:19,584 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-43208351 info 2025-11-13 03:12:19,585 - INFO - Deleting VN ctest-mgmt_vn-28673271 2025-11-13 03:12:19,710 - DEBUG - Response for deleting network () 2025-11-13 03:12:19,711 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cf3b53c3-e8ee-46bf-8d66-c2ba9adade64 2025-11-13 03:12:19,716 - DEBUG - Response Code: 404 2025-11-13 03:12:19,716 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:19,722 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:19,742 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:19,826 - INFO - Validated that VN ctest-mgmt_vn-28673271 is not found in API Server 2025-11-13 03:12:19,841 - DEBUG - VN ctest-mgmt_vn-28673271 is not present in Agent 10.0.0.19 2025-11-13 03:12:19,851 - DEBUG - VN ctest-mgmt_vn-28673271 is not present in Agent 10.0.0.23 2025-11-13 03:12:19,851 - INFO - Validated that VN ctest-mgmt_vn-28673271 is not in any agent 2025-11-13 03:12:19,879 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-28673271 info 2025-11-13 03:12:21,147 - DEBUG - No XMPP flaps were noticed during the test 2025-11-13 03:12:21,147 - INFO - 2025-11-13 03:12:21,147 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:20] 2025-11-13 03:12:21,147 - INFO - -------------------------------------------------------------------------------- 2025-11-13 03:12:21,150 - INFO - ================================================================================ 2025-11-13 03:12:21,150 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-11-13 03:12:22,421 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.25': '0', '10.20.0.254': '0'}, '10.0.0.23': {'10.20.0.25': '0', '10.20.0.193': '0'}} with 2025-11-13 03:12:22,421 - INFO - Initial checks done. Running the testcase now 2025-11-13 03:12:22,421 - INFO - 2025-11-13 03:12:22,662 - DEBUG - Response for create_network : {'network': {'id': '8361c70d-c6b8-46c9-95f3-22a7a3d729ed', 'name': 'ctest-mgmt_vn-22391436', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'project_id': '61e99fa727994dc28243c05a0336fef1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-77840650', 'ctest-mgmt_vn-22391436'], 'port_security_enabled': True, 'description': ''}} 2025-11-13 03:12:22,929 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd3cc8b4a-d403-44c9-a517-7ca4fab82eb2', 'name': '', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'network_id': '8361c70d-c6b8-46c9-95f3-22a7a3d729ed', 'ip_version': 4, 'cidr': '65.225.164.192/26', 'allocation_pools': [{'start': '65.225.164.194', 'end': '65.225.164.254'}], 'gateway_ip': '65.225.164.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '65.225.164.194', 'tags': [], 'project_id': '61e99fa727994dc28243c05a0336fef1'}} 2025-11-13 03:12:22,951 - INFO - Created VN ctest-mgmt_vn-22391436 2025-11-13 03:12:22,961 - DEBUG - VN ctest-mgmt_vn-22391436 UUID is 8361c70d-c6b8-46c9-95f3-22a7a3d729ed 2025-11-13 03:12:23,036 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:23,043 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:23,055 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:23,165 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/8361c70d-c6b8-46c9-95f3-22a7a3d729ed 2025-11-13 03:12:23,180 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/8361c70d-c6b8-46c9-95f3-22a7a3d729ed 2025-11-13 03:12:23,190 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/864a31a6-73b5-42bd-b3ef-0016a2151804 2025-11-13 03:12:23,203 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/864a31a6-73b5-42bd-b3ef-0016a2151804 2025-11-13 03:12:23,213 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/9cf719ee-f36f-442b-9671-a0baef4fcc2c 2025-11-13 03:12:23,221 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-13 03:12:23,221 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/8361c70d-c6b8-46c9-95f3-22a7a3d729ed 2025-11-13 03:12:23,232 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/864a31a6-73b5-42bd-b3ef-0016a2151804 2025-11-13 03:12:23,249 - INFO - Verified VN network id 11 for VN 8361c70d-c6b8-46c9-95f3-22a7a3d729ed 2025-11-13 03:12:23,249 - INFO - Verifications in API Server for VN ctest-mgmt_vn-22391436 passed 2025-11-13 03:12:23,249 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/8361c70d-c6b8-46c9-95f3-22a7a3d729ed 2025-11-13 03:12:23,260 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/864a31a6-73b5-42bd-b3ef-0016a2151804 2025-11-13 03:12:23,269 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/864a31a6-73b5-42bd-b3ef-0016a2151804 2025-11-13 03:12:23,277 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/9cf719ee-f36f-442b-9671-a0baef4fcc2c 2025-11-13 03:12:23,288 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9467066753691961033', 'uuid-lslong': '10805018034395621869'}, 'enable': 'true', 'created': '2025-11-13T03:12:22', 'last-modified': '2025-11-13T03:12:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.417192'} 2025-11-13 03:12:23,294 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-13 03:12:23,300 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9467066753691961033', 'uuid-lslong': '10805018034395621869'}, 'enable': 'true', 'created': '2025-11-13T03:12:22', 'last-modified': '2025-11-13T03:12:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.436024'} 2025-11-13 03:12:23,308 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-13 03:12:23,313 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9467066753691961033', 'uuid-lslong': '10805018034395621869'}, 'enable': 'true', 'created': '2025-11-13T03:12:22', 'last-modified': '2025-11-13T03:12:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.449236'} 2025-11-13 03:12:23,319 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-13 03:12:23,319 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-22391436 passed 2025-11-13 03:12:23,320 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-22391436 in API_Server ====== 2025-11-13 03:12:23,320 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:23,327 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:23,337 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:23,440 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/8361c70d-c6b8-46c9-95f3-22a7a3d729ed 2025-11-13 03:12:23,452 - DEBUG - =>VN ctest-mgmt_vn-22391436 has no policy to be verified 2025-11-13 03:12:23,452 - DEBUG - Verifying the vn in opserver 2025-11-13 03:12:23,452 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436 virtual network link through opserver 10.0.0.141 2025-11-13 03:12:23,452 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2025-11-13 03:12:23,465 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436?flat'} 2025-11-13 03:12:23,465 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436 virtual network link through opserver 10.0.0.56 2025-11-13 03:12:23,465 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-11-13 03:12:23,478 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436?flat'} 2025-11-13 03:12:23,478 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436 virtual network link through opserver 10.0.0.61 2025-11-13 03:12:23,478 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-13 03:12:23,493 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436?flat'} 2025-11-13 03:12:23,493 - INFO - Validated that VN default-domain:ctest-TestSvcHC-77840650:ctest-mgmt_vn-22391436 is found in opserver 2025-11-13 03:12:23,515 - DEBUG - Do not have enough data to verify VN in agent 2025-11-13 03:12:23,526 - DEBUG - VRF ids for VN ctest-mgmt_vn-22391436: {} 2025-11-13 03:12:23,801 - DEBUG - Response for create_network : {'network': {'id': '3c1faeb5-0f88-4a8c-9ee1-f353b6be92c1', 'name': 'ctest-left_vn-34133706', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'project_id': '61e99fa727994dc28243c05a0336fef1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-77840650', 'ctest-left_vn-34133706'], 'port_security_enabled': True, 'description': ''}} 2025-11-13 03:12:23,987 - DEBUG - Response for create_subnet : {'subnet': {'id': '09bac38c-b982-4aa7-bc95-f28f4453e063', 'name': '', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'network_id': '3c1faeb5-0f88-4a8c-9ee1-f353b6be92c1', 'ip_version': 4, 'cidr': '198.206.21.64/26', 'allocation_pools': [{'start': '198.206.21.66', 'end': '198.206.21.126'}], 'gateway_ip': '198.206.21.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '198.206.21.66', 'tags': [], 'project_id': '61e99fa727994dc28243c05a0336fef1'}} 2025-11-13 03:12:24,013 - INFO - Created VN ctest-left_vn-34133706 2025-11-13 03:12:24,023 - DEBUG - VN ctest-left_vn-34133706 UUID is 3c1faeb5-0f88-4a8c-9ee1-f353b6be92c1 2025-11-13 03:12:24,093 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:24,099 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:24,109 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:24,191 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/3c1faeb5-0f88-4a8c-9ee1-f353b6be92c1 2025-11-13 03:12:24,214 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/3c1faeb5-0f88-4a8c-9ee1-f353b6be92c1 2025-11-13 03:12:24,223 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/76dac618-9639-4ba2-b8f2-d2fbc26b53e4 2025-11-13 03:12:24,230 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/76dac618-9639-4ba2-b8f2-d2fbc26b53e4 2025-11-13 03:12:24,237 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/9a9c209a-d299-42be-8ffb-2f1a4d31c01c 2025-11-13 03:12:24,244 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-13 03:12:24,244 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/3c1faeb5-0f88-4a8c-9ee1-f353b6be92c1 2025-11-13 03:12:24,253 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/76dac618-9639-4ba2-b8f2-d2fbc26b53e4 2025-11-13 03:12:24,268 - INFO - Verified VN network id 12 for VN 3c1faeb5-0f88-4a8c-9ee1-f353b6be92c1 2025-11-13 03:12:24,268 - INFO - Verifications in API Server for VN ctest-left_vn-34133706 passed 2025-11-13 03:12:24,268 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/3c1faeb5-0f88-4a8c-9ee1-f353b6be92c1 2025-11-13 03:12:24,277 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/76dac618-9639-4ba2-b8f2-d2fbc26b53e4 2025-11-13 03:12:24,284 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/76dac618-9639-4ba2-b8f2-d2fbc26b53e4 2025-11-13 03:12:24,292 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/9a9c209a-d299-42be-8ffb-2f1a4d31c01c 2025-11-13 03:12:24,303 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4332373459226610316', 'uuid-lslong': '11448699268626289345'}, 'enable': 'true', 'created': '2025-11-13T03:12:23', 'last-modified': '2025-11-13T03:12:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.364868'} 2025-11-13 03:12:24,309 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-13 03:12:24,314 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4332373459226610316', 'uuid-lslong': '11448699268626289345'}, 'enable': 'true', 'created': '2025-11-13T03:12:23', 'last-modified': '2025-11-13T03:12:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.375877'} 2025-11-13 03:12:24,320 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-13 03:12:24,325 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4332373459226610316', 'uuid-lslong': '11448699268626289345'}, 'enable': 'true', 'created': '2025-11-13T03:12:23', 'last-modified': '2025-11-13T03:12:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.382167'} 2025-11-13 03:12:24,331 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-13 03:12:24,331 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-34133706 passed 2025-11-13 03:12:24,331 - DEBUG - ====Verifying policy data for ctest-left_vn-34133706 in API_Server ====== 2025-11-13 03:12:24,331 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:24,337 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:24,349 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:24,464 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/3c1faeb5-0f88-4a8c-9ee1-f353b6be92c1 2025-11-13 03:12:24,476 - DEBUG - =>VN ctest-left_vn-34133706 has no policy to be verified 2025-11-13 03:12:24,476 - DEBUG - Verifying the vn in opserver 2025-11-13 03:12:24,476 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706 virtual network link through opserver 10.0.0.141 2025-11-13 03:12:24,476 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2025-11-13 03:12:24,493 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706?flat'} 2025-11-13 03:12:24,493 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706 virtual network link through opserver 10.0.0.56 2025-11-13 03:12:24,493 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-11-13 03:12:24,508 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706?flat'} 2025-11-13 03:12:24,508 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706 virtual network link through opserver 10.0.0.61 2025-11-13 03:12:24,508 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-13 03:12:24,522 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706?flat'} 2025-11-13 03:12:24,522 - INFO - Validated that VN default-domain:ctest-TestSvcHC-77840650:ctest-left_vn-34133706 is found in opserver 2025-11-13 03:12:24,544 - DEBUG - Do not have enough data to verify VN in agent 2025-11-13 03:12:24,554 - DEBUG - VRF ids for VN ctest-left_vn-34133706: {} 2025-11-13 03:12:24,816 - DEBUG - Response for create_network : {'network': {'id': 'd6ecd018-37f8-4f27-a082-b0af5304a4fe', 'name': 'ctest-right_vn-51764186', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'project_id': '61e99fa727994dc28243c05a0336fef1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-77840650', 'ctest-right_vn-51764186'], 'port_security_enabled': True, 'description': ''}} 2025-11-13 03:12:25,068 - DEBUG - Response for create_subnet : {'subnet': {'id': '7669be86-dff7-474b-84c7-87341b273453', 'name': '', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'network_id': 'd6ecd018-37f8-4f27-a082-b0af5304a4fe', 'ip_version': 4, 'cidr': '35.176.99.64/26', 'allocation_pools': [{'start': '35.176.99.66', 'end': '35.176.99.126'}], 'gateway_ip': '35.176.99.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '35.176.99.66', 'tags': [], 'project_id': '61e99fa727994dc28243c05a0336fef1'}} 2025-11-13 03:12:25,087 - INFO - Created VN ctest-right_vn-51764186 2025-11-13 03:12:25,100 - DEBUG - VN ctest-right_vn-51764186 UUID is d6ecd018-37f8-4f27-a082-b0af5304a4fe 2025-11-13 03:12:25,173 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:25,179 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:25,191 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:25,286 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d6ecd018-37f8-4f27-a082-b0af5304a4fe 2025-11-13 03:12:25,298 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d6ecd018-37f8-4f27-a082-b0af5304a4fe 2025-11-13 03:12:25,307 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cc61b3e8-cf78-48c7-a7e6-f9f51c3291bd 2025-11-13 03:12:25,315 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cc61b3e8-cf78-48c7-a7e6-f9f51c3291bd 2025-11-13 03:12:25,324 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/8f15ad1f-a1f6-44c7-98c6-948e7b42c14a 2025-11-13 03:12:25,332 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-13 03:12:25,332 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d6ecd018-37f8-4f27-a082-b0af5304a4fe 2025-11-13 03:12:25,343 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cc61b3e8-cf78-48c7-a7e6-f9f51c3291bd 2025-11-13 03:12:25,358 - INFO - Verified VN network id 13 for VN d6ecd018-37f8-4f27-a082-b0af5304a4fe 2025-11-13 03:12:25,359 - INFO - Verifications in API Server for VN ctest-right_vn-51764186 passed 2025-11-13 03:12:25,359 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d6ecd018-37f8-4f27-a082-b0af5304a4fe 2025-11-13 03:12:25,368 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cc61b3e8-cf78-48c7-a7e6-f9f51c3291bd 2025-11-13 03:12:25,378 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cc61b3e8-cf78-48c7-a7e6-f9f51c3291bd 2025-11-13 03:12:25,386 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/8f15ad1f-a1f6-44c7-98c6-948e7b42c14a 2025-11-13 03:12:25,398 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15486982021057105703', 'uuid-lslong': '11566001060099433726'}, 'enable': 'true', 'created': '2025-11-13T03:12:24', 'last-modified': '2025-11-13T03:12:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.388906'} 2025-11-13 03:12:25,404 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-13 03:12:25,409 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15486982021057105703', 'uuid-lslong': '11566001060099433726'}, 'enable': 'true', 'created': '2025-11-13T03:12:24', 'last-modified': '2025-11-13T03:12:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.393964'} 2025-11-13 03:12:25,414 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-13 03:12:25,420 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15486982021057105703', 'uuid-lslong': '11566001060099433726'}, 'enable': 'true', 'created': '2025-11-13T03:12:24', 'last-modified': '2025-11-13T03:12:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.411832'} 2025-11-13 03:12:25,425 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-13 03:12:25,425 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-51764186 passed 2025-11-13 03:12:25,425 - DEBUG - ====Verifying policy data for ctest-right_vn-51764186 in API_Server ====== 2025-11-13 03:12:25,425 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:25,431 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:25,441 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:25,531 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/d6ecd018-37f8-4f27-a082-b0af5304a4fe 2025-11-13 03:12:25,549 - DEBUG - =>VN ctest-right_vn-51764186 has no policy to be verified 2025-11-13 03:12:25,549 - DEBUG - Verifying the vn in opserver 2025-11-13 03:12:25,549 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186 virtual network link through opserver 10.0.0.141 2025-11-13 03:12:25,549 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2025-11-13 03:12:25,560 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186?flat'} 2025-11-13 03:12:25,560 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186 virtual network link through opserver 10.0.0.56 2025-11-13 03:12:25,560 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-11-13 03:12:25,572 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186?flat'} 2025-11-13 03:12:25,572 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186 virtual network link through opserver 10.0.0.61 2025-11-13 03:12:25,572 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-13 03:12:25,582 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186?flat'} 2025-11-13 03:12:25,582 - INFO - Validated that VN default-domain:ctest-TestSvcHC-77840650:ctest-right_vn-51764186 is found in opserver 2025-11-13 03:12:25,602 - DEBUG - Do not have enough data to verify VN in agent 2025-11-13 03:12:25,611 - DEBUG - VRF ids for VN ctest-right_vn-51764186: {} 2025-11-13 03:12:25,859 - DEBUG - Response for create_network : {'network': {'id': '2d8d765d-8481-4d2f-b036-2f92371af7f0', 'name': 'ctest-trans_left_vn-57297653', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'project_id': '61e99fa727994dc28243c05a0336fef1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-77840650', 'ctest-trans_left_vn-57297653'], 'port_security_enabled': True, 'description': ''}} 2025-11-13 03:12:26,080 - DEBUG - Response for create_subnet : {'subnet': {'id': '287e5156-f8c6-4eae-836b-e30a34188a84', 'name': '', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'network_id': '2d8d765d-8481-4d2f-b036-2f92371af7f0', 'ip_version': 4, 'cidr': '30.203.185.128/26', 'allocation_pools': [{'start': '30.203.185.130', 'end': '30.203.185.190'}], 'gateway_ip': '30.203.185.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.203.185.130', 'tags': [], 'project_id': '61e99fa727994dc28243c05a0336fef1'}} 2025-11-13 03:12:26,100 - INFO - Created VN ctest-trans_left_vn-57297653 2025-11-13 03:12:26,109 - DEBUG - VN ctest-trans_left_vn-57297653 UUID is 2d8d765d-8481-4d2f-b036-2f92371af7f0 2025-11-13 03:12:26,178 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:26,184 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:26,199 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:26,293 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/2d8d765d-8481-4d2f-b036-2f92371af7f0 2025-11-13 03:12:26,305 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/2d8d765d-8481-4d2f-b036-2f92371af7f0 2025-11-13 03:12:26,315 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6d951a83-f46e-4db1-b56b-2c8621cc8494 2025-11-13 03:12:26,324 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6d951a83-f46e-4db1-b56b-2c8621cc8494 2025-11-13 03:12:26,331 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/b719988f-b057-4b99-873a-9c578f1a04e4 2025-11-13 03:12:26,337 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-13 03:12:26,338 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/2d8d765d-8481-4d2f-b036-2f92371af7f0 2025-11-13 03:12:26,346 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6d951a83-f46e-4db1-b56b-2c8621cc8494 2025-11-13 03:12:26,360 - INFO - Verified VN network id 14 for VN 2d8d765d-8481-4d2f-b036-2f92371af7f0 2025-11-13 03:12:26,360 - INFO - Verifications in API Server for VN ctest-trans_left_vn-57297653 passed 2025-11-13 03:12:26,360 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/2d8d765d-8481-4d2f-b036-2f92371af7f0 2025-11-13 03:12:26,369 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6d951a83-f46e-4db1-b56b-2c8621cc8494 2025-11-13 03:12:26,375 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6d951a83-f46e-4db1-b56b-2c8621cc8494 2025-11-13 03:12:26,381 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/b719988f-b057-4b99-873a-9c578f1a04e4 2025-11-13 03:12:26,391 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3282409847450062127', 'uuid-lslong': '12697388504453937136'}, 'enable': 'true', 'created': '2025-11-13T03:12:25', 'last-modified': '2025-11-13T03:12:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.362262'} 2025-11-13 03:12:26,397 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-13 03:12:26,402 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3282409847450062127', 'uuid-lslong': '12697388504453937136'}, 'enable': 'true', 'created': '2025-11-13T03:12:25', 'last-modified': '2025-11-13T03:12:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.372708'} 2025-11-13 03:12:26,408 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-13 03:12:26,413 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3282409847450062127', 'uuid-lslong': '12697388504453937136'}, 'enable': 'true', 'created': '2025-11-13T03:12:25', 'last-modified': '2025-11-13T03:12:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.383462'} 2025-11-13 03:12:26,418 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-13 03:12:26,418 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-57297653 passed 2025-11-13 03:12:26,418 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-57297653 in API_Server ====== 2025-11-13 03:12:26,418 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:26,424 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:26,435 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:26,527 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/2d8d765d-8481-4d2f-b036-2f92371af7f0 2025-11-13 03:12:26,536 - DEBUG - =>VN ctest-trans_left_vn-57297653 has no policy to be verified 2025-11-13 03:12:26,536 - DEBUG - Verifying the vn in opserver 2025-11-13 03:12:26,537 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653 virtual network link through opserver 10.0.0.141 2025-11-13 03:12:26,537 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2025-11-13 03:12:26,547 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653?flat'} 2025-11-13 03:12:26,547 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653 virtual network link through opserver 10.0.0.56 2025-11-13 03:12:26,547 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-11-13 03:12:26,558 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653?flat'} 2025-11-13 03:12:26,558 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653 virtual network link through opserver 10.0.0.61 2025-11-13 03:12:26,558 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-13 03:12:26,569 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653?flat'} 2025-11-13 03:12:26,569 - INFO - Validated that VN default-domain:ctest-TestSvcHC-77840650:ctest-trans_left_vn-57297653 is found in opserver 2025-11-13 03:12:26,589 - DEBUG - Do not have enough data to verify VN in agent 2025-11-13 03:12:26,598 - DEBUG - VRF ids for VN ctest-trans_left_vn-57297653: {} 2025-11-13 03:12:26,849 - DEBUG - Response for create_network : {'network': {'id': '74a5a254-a8fa-48db-854c-61b71bb98464', 'name': 'ctest-trans_right_vn-19483553', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'project_id': '61e99fa727994dc28243c05a0336fef1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-77840650', 'ctest-trans_right_vn-19483553'], 'port_security_enabled': True, 'description': ''}} 2025-11-13 03:12:27,130 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b7e33a82-7b41-4573-bd0f-ed6d8ed2b01c', 'name': '', 'tenant_id': '61e99fa727994dc28243c05a0336fef1', 'network_id': '74a5a254-a8fa-48db-854c-61b71bb98464', 'ip_version': 4, 'cidr': '15.241.198.192/26', 'allocation_pools': [{'start': '15.241.198.194', 'end': '15.241.198.254'}], 'gateway_ip': '15.241.198.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '15.241.198.194', 'tags': [], 'project_id': '61e99fa727994dc28243c05a0336fef1'}} 2025-11-13 03:12:27,152 - INFO - Created VN ctest-trans_right_vn-19483553 2025-11-13 03:12:27,163 - DEBUG - VN ctest-trans_right_vn-19483553 UUID is 74a5a254-a8fa-48db-854c-61b71bb98464 2025-11-13 03:12:27,233 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:27,239 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:27,250 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:27,344 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/74a5a254-a8fa-48db-854c-61b71bb98464 2025-11-13 03:12:27,364 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/74a5a254-a8fa-48db-854c-61b71bb98464 2025-11-13 03:12:27,373 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/17ca873a-bfaa-470c-85ca-e9a337d7fabe 2025-11-13 03:12:27,386 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/17ca873a-bfaa-470c-85ca-e9a337d7fabe 2025-11-13 03:12:27,395 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/765e355d-868c-4026-9d52-5b10d361dd41 2025-11-13 03:12:27,404 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-13 03:12:27,404 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/74a5a254-a8fa-48db-854c-61b71bb98464 2025-11-13 03:12:27,416 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/17ca873a-bfaa-470c-85ca-e9a337d7fabe 2025-11-13 03:12:27,435 - INFO - Verified VN network id 15 for VN 74a5a254-a8fa-48db-854c-61b71bb98464 2025-11-13 03:12:27,435 - INFO - Verifications in API Server for VN ctest-trans_right_vn-19483553 passed 2025-11-13 03:12:27,435 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/74a5a254-a8fa-48db-854c-61b71bb98464 2025-11-13 03:12:27,448 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/17ca873a-bfaa-470c-85ca-e9a337d7fabe 2025-11-13 03:12:27,456 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/17ca873a-bfaa-470c-85ca-e9a337d7fabe 2025-11-13 03:12:27,464 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/765e355d-868c-4026-9d52-5b10d361dd41 2025-11-13 03:12:27,478 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8405302764052826331', 'uuid-lslong': '9605159544346477668'}, 'enable': 'true', 'created': '2025-11-13T03:12:26', 'last-modified': '2025-11-13T03:12:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402158'} 2025-11-13 03:12:27,489 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-13 03:12:27,495 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8405302764052826331', 'uuid-lslong': '9605159544346477668'}, 'enable': 'true', 'created': '2025-11-13T03:12:26', 'last-modified': '2025-11-13T03:12:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414327'} 2025-11-13 03:12:27,501 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-13 03:12:27,508 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-77840650', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8405302764052826331', 'uuid-lslong': '9605159544346477668'}, 'enable': 'true', 'created': '2025-11-13T03:12:26', 'last-modified': '2025-11-13T03:12:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433330'} 2025-11-13 03:12:27,514 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-13 03:12:27,514 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-19483553 passed 2025-11-13 03:12:27,515 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-19483553 in API_Server ====== 2025-11-13 03:12:27,515 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:27,521 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:27,531 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:27,619 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/74a5a254-a8fa-48db-854c-61b71bb98464 2025-11-13 03:12:27,632 - DEBUG - =>VN ctest-trans_right_vn-19483553 has no policy to be verified 2025-11-13 03:12:27,632 - DEBUG - Verifying the vn in opserver 2025-11-13 03:12:27,632 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553 virtual network link through opserver 10.0.0.141 2025-11-13 03:12:27,632 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2025-11-13 03:12:27,644 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553?flat'} 2025-11-13 03:12:27,644 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553 virtual network link through opserver 10.0.0.56 2025-11-13 03:12:27,644 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-11-13 03:12:27,657 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553?flat'} 2025-11-13 03:12:27,657 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553 virtual network link through opserver 10.0.0.61 2025-11-13 03:12:27,657 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-13 03:12:27,668 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553?flat'} 2025-11-13 03:12:27,668 - INFO - Validated that VN default-domain:ctest-TestSvcHC-77840650:ctest-trans_right_vn-19483553 is found in opserver 2025-11-13 03:12:27,689 - DEBUG - Do not have enough data to verify VN in agent 2025-11-13 03:12:27,698 - DEBUG - VRF ids for VN ctest-trans_right_vn-19483553: {} 2025-11-13 03:12:28,808 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4712-1) 2025-11-13 03:12:30,229 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4712-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4712-2) 2025-11-13 03:12:30,230 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-25454902'] 2025-11-13 03:12:30,537 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-25454902'] created succesfully 2025-11-13 03:12:30,976 - DEBUG - Image by name tiny_trans_fw not found 2025-11-13 03:12:30,977 - DEBUG - Installing image tiny_trans_fw 2025-11-13 03:12:30,977 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-11-13 03:12:30,977 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-13 03:12:30,977 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-13 03:12:30,977 - DEBUG - Unzip image 2025-11-13 03:12:30,977 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-13 03:12:31,003 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-11-13 03:12:31,004 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-25454902'] 2025-11-13 03:12:31,100 - INFO - Service template: ['default-domain', 'ctest-service_template_1-25454902'] deleted successfully. 2025-11-13 03:12:31,100 - INFO - Skip interface_detach for VM ctest-right_vm-84063969 in state BUILD 2025-11-13 03:12:31,100 - INFO - Deleting VM ctest-right_vm-84063969 2025-11-13 03:12:31,100 - ERROR - VM ctest-right_vm-84063969 has failed to come up 2025-11-13 03:12:31,100 - ERROR - Nova failed to get host of the VM 2025-11-13 03:12:31,100 - ERROR - VM ctest-right_vm-84063969 has failed to come up 2025-11-13 03:12:31,101 - ERROR - Nova failed to get host of the VM 2025-11-13 03:12:31,245 - INFO - Skip interface_detach for VM ctest-left_vm-76628488 in state BUILD 2025-11-13 03:12:31,245 - INFO - Deleting VM ctest-left_vm-76628488 2025-11-13 03:12:31,245 - ERROR - VM ctest-left_vm-76628488 has failed to come up 2025-11-13 03:12:31,245 - ERROR - Nova failed to get host of the VM 2025-11-13 03:12:31,245 - ERROR - VM ctest-left_vm-76628488 has failed to come up 2025-11-13 03:12:31,245 - ERROR - Nova failed to get host of the VM 2025-11-13 03:12:31,341 - INFO - Deleting VN ctest-trans_right_vn-19483553 2025-11-13 03:12:31,559 - DEBUG - Response for deleting network () 2025-11-13 03:12:31,559 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/17ca873a-bfaa-470c-85ca-e9a337d7fabe 2025-11-13 03:12:31,570 - DEBUG - Response Code: 404 2025-11-13 03:12:31,570 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:31,588 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:31,612 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:31,718 - INFO - Validated that VN ctest-trans_right_vn-19483553 is not found in API Server 2025-11-13 03:12:31,729 - DEBUG - VN ctest-trans_right_vn-19483553 is not present in Agent 10.0.0.19 2025-11-13 03:12:31,742 - DEBUG - VN ctest-trans_right_vn-19483553 is not present in Agent 10.0.0.23 2025-11-13 03:12:31,743 - INFO - Validated that VN ctest-trans_right_vn-19483553 is not in any agent 2025-11-13 03:12:31,790 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-19483553 info 2025-11-13 03:12:31,791 - INFO - Deleting VN ctest-trans_left_vn-57297653 2025-11-13 03:12:32,006 - DEBUG - Response for deleting network () 2025-11-13 03:12:32,007 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/6d951a83-f46e-4db1-b56b-2c8621cc8494 2025-11-13 03:12:32,018 - DEBUG - Response Code: 404 2025-11-13 03:12:32,019 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:32,028 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:32,099 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:32,204 - INFO - Validated that VN ctest-trans_left_vn-57297653 is not found in API Server 2025-11-13 03:12:32,216 - DEBUG - VN ctest-trans_left_vn-57297653 is not present in Agent 10.0.0.19 2025-11-13 03:12:32,228 - DEBUG - VN ctest-trans_left_vn-57297653 is not present in Agent 10.0.0.23 2025-11-13 03:12:32,228 - INFO - Validated that VN ctest-trans_left_vn-57297653 is not in any agent 2025-11-13 03:12:32,299 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-57297653 info 2025-11-13 03:12:32,299 - INFO - Deleting VN ctest-right_vn-51764186 2025-11-13 03:12:32,493 - DEBUG - VN d6ecd018-37f8-4f27-a082-b0af5304a4fe still in use: Unable to complete operation on network d6ecd018-37f8-4f27-a082-b0af5304a4fe. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-482f8664-7217-49c7-9baf-d58d60c45492'] 2025-11-13 03:12:32,493 - WARNING - Deleting VN ctest-right_vn-51764186 failed..Will retry 2025-11-13 03:12:34,649 - DEBUG - Response for deleting network () 2025-11-13 03:12:34,649 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/cc61b3e8-cf78-48c7-a7e6-f9f51c3291bd 2025-11-13 03:12:34,654 - DEBUG - Response Code: 404 2025-11-13 03:12:34,654 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:34,660 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:34,672 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:34,788 - INFO - Validated that VN ctest-right_vn-51764186 is not found in API Server 2025-11-13 03:12:34,799 - DEBUG - VN ctest-right_vn-51764186 is not present in Agent 10.0.0.19 2025-11-13 03:12:34,808 - DEBUG - VN ctest-right_vn-51764186 is not present in Agent 10.0.0.23 2025-11-13 03:12:34,808 - INFO - Validated that VN ctest-right_vn-51764186 is not in any agent 2025-11-13 03:12:34,840 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-51764186 info 2025-11-13 03:12:34,840 - INFO - Deleting VN ctest-left_vn-34133706 2025-11-13 03:12:35,014 - DEBUG - Response for deleting network () 2025-11-13 03:12:35,014 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/76dac618-9639-4ba2-b8f2-d2fbc26b53e4 2025-11-13 03:12:35,031 - DEBUG - Response Code: 404 2025-11-13 03:12:35,031 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:35,038 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:35,053 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:35,162 - INFO - Validated that VN ctest-left_vn-34133706 is not found in API Server 2025-11-13 03:12:35,172 - DEBUG - VN ctest-left_vn-34133706 is not present in Agent 10.0.0.19 2025-11-13 03:12:35,183 - DEBUG - VN ctest-left_vn-34133706 is not present in Agent 10.0.0.23 2025-11-13 03:12:35,183 - INFO - Validated that VN ctest-left_vn-34133706 is not in any agent 2025-11-13 03:12:35,216 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-34133706 info 2025-11-13 03:12:35,216 - INFO - Deleting VN ctest-mgmt_vn-22391436 2025-11-13 03:12:35,414 - DEBUG - Response for deleting network () 2025-11-13 03:12:35,414 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/864a31a6-73b5-42bd-b3ef-0016a2151804 2025-11-13 03:12:35,426 - DEBUG - Response Code: 404 2025-11-13 03:12:35,426 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-11-13 03:12:35,434 - DEBUG - Requesting: http://10.0.0.141:8082/domain/7e609647-c42c-403c-b0dd-6b1bfaefbd00 2025-11-13 03:12:35,448 - DEBUG - Requesting: http://10.0.0.141:8082/project/61e99fa7-2799-4dc2-8243-c05a0336fef1 2025-11-13 03:12:35,550 - INFO - Validated that VN ctest-mgmt_vn-22391436 is not found in API Server 2025-11-13 03:12:35,562 - DEBUG - VN ctest-mgmt_vn-22391436 is not present in Agent 10.0.0.19 2025-11-13 03:12:35,573 - DEBUG - VN ctest-mgmt_vn-22391436 is not present in Agent 10.0.0.23 2025-11-13 03:12:35,573 - INFO - Validated that VN ctest-mgmt_vn-22391436 is not in any agent 2025-11-13 03:12:35,603 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-22391436 info 2025-11-13 03:12:36,867 - DEBUG - No XMPP flaps were noticed during the test 2025-11-13 03:12:36,867 - INFO - 2025-11-13 03:12:36,867 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15] 2025-11-13 03:12:36,867 - INFO - -------------------------------------------------------------------------------- 2025-11-13 03:12:37,582 - INFO - Deleted project: ctest-TestSvcHC-77840650, ID : 61e99fa7-2799-4dc2-8243-c05a0336fef1