2025-09-22 03:02:57,084 - INFO - Domain Default found not creating 2025-09-22 03:02:57,208 - INFO - Project ctest-TestSvcHC-53321636 not found, creating it 2025-09-22 03:02:57,743 - INFO - Created Project:ctest-TestSvcHC-53321636, ID : 559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:02:59,131 - INFO - ================================================================================ 2025-09-22 03:02:59,132 - INFO - STARTING TEST : test_svc_hc_basic 2025-09-22 03:03:00,436 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.254': '0', '10.20.0.25': '0'}, '10.0.0.23': {'10.20.0.254': '0', '10.20.0.193': '0'}} with 2025-09-22 03:03:00,436 - INFO - Initial checks done. Running the testcase now 2025-09-22 03:03:00,436 - INFO - 2025-09-22 03:03:01,092 - DEBUG - Response for create_network : {'network': {'id': 'c62bec30-c1d3-4a48-b93f-6db2b8a8da3c', 'name': 'ctest-mgmt_vn-05518485', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53321636', 'ctest-mgmt_vn-05518485'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 03:03:01,405 - DEBUG - Response for create_subnet : {'subnet': {'id': '7df78837-c154-4c1d-b8ee-77c8a3dded06', 'name': '', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'network_id': 'c62bec30-c1d3-4a48-b93f-6db2b8a8da3c', 'ip_version': 4, 'cidr': '121.129.203.192/26', 'allocation_pools': [{'start': '121.129.203.194', 'end': '121.129.203.254'}], 'gateway_ip': '121.129.203.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '121.129.203.194', 'tags': [], 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc'}} 2025-09-22 03:03:01,429 - INFO - Created VN ctest-mgmt_vn-05518485 2025-09-22 03:03:01,443 - DEBUG - VN ctest-mgmt_vn-05518485 UUID is c62bec30-c1d3-4a48-b93f-6db2b8a8da3c 2025-09-22 03:03:01,510 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:01,799 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:01,823 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:01,838 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:01,927 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c62bec30-c1d3-4a48-b93f-6db2b8a8da3c 2025-09-22 03:03:01,938 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c62bec30-c1d3-4a48-b93f-6db2b8a8da3c 2025-09-22 03:03:01,946 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/3156c224-f650-4da2-83d7-8b19d938a479 2025-09-22 03:03:01,952 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/3156c224-f650-4da2-83d7-8b19d938a479 2025-09-22 03:03:01,958 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/fe217eab-3b0c-497f-916f-61c192f49a30 2025-09-22 03:03:01,963 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-22 03:03:01,963 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c62bec30-c1d3-4a48-b93f-6db2b8a8da3c 2025-09-22 03:03:01,970 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/3156c224-f650-4da2-83d7-8b19d938a479 2025-09-22 03:03:01,985 - INFO - Verified VN network id 11 for VN c62bec30-c1d3-4a48-b93f-6db2b8a8da3c 2025-09-22 03:03:01,985 - INFO - Verifications in API Server for VN ctest-mgmt_vn-05518485 passed 2025-09-22 03:03:01,985 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c62bec30-c1d3-4a48-b93f-6db2b8a8da3c 2025-09-22 03:03:01,993 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/3156c224-f650-4da2-83d7-8b19d938a479 2025-09-22 03:03:01,999 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/3156c224-f650-4da2-83d7-8b19d938a479 2025-09-22 03:03:02,012 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/fe217eab-3b0c-497f-916f-61c192f49a30 2025-09-22 03:03:02,024 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14279766737662724680', 'uuid-lslong': '13348508434919119420'}, 'enable': 'true', 'created': '2025-09-22T03:03:01', 'last-modified': '2025-09-22T03:03:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.671768'} 2025-09-22 03:03:02,030 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-22 03:03:02,035 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14279766737662724680', 'uuid-lslong': '13348508434919119420'}, 'enable': 'true', 'created': '2025-09-22T03:03:01', 'last-modified': '2025-09-22T03:03:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.686979'} 2025-09-22 03:03:02,040 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-22 03:03:02,045 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14279766737662724680', 'uuid-lslong': '13348508434919119420'}, 'enable': 'true', 'created': '2025-09-22T03:03:01', 'last-modified': '2025-09-22T03:03:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.697579'} 2025-09-22 03:03:02,051 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-22 03:03:02,051 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-05518485 passed 2025-09-22 03:03:02,051 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-05518485 in API_Server ====== 2025-09-22 03:03:02,051 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:02,056 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:02,066 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:02,158 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c62bec30-c1d3-4a48-b93f-6db2b8a8da3c 2025-09-22 03:03:02,168 - DEBUG - =>VN ctest-mgmt_vn-05518485 has no policy to be verified 2025-09-22 03:03:02,168 - DEBUG - Verifying the vn in opserver 2025-09-22 03:03:02,168 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485 virtual network link through opserver 10.0.0.56 2025-09-22 03:03:02,168 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-09-22 03:03:02,459 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-09-22 03:03:02,512 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485?flat'} 2025-09-22 03:03:02,512 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485 virtual network link through opserver 10.0.0.38 2025-09-22 03:03:02,512 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-22 03:03:02,802 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-22 03:03:02,854 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485?flat'} 2025-09-22 03:03:02,854 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485 virtual network link through opserver 10.0.0.27 2025-09-22 03:03:02,854 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-22 03:03:03,140 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-22 03:03:03,192 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485?flat'} 2025-09-22 03:03:03,192 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-05518485 is found in opserver 2025-09-22 03:03:03,213 - DEBUG - Do not have enough data to verify VN in agent 2025-09-22 03:03:03,224 - DEBUG - VRF ids for VN ctest-mgmt_vn-05518485: {} 2025-09-22 03:03:03,522 - DEBUG - Response for create_network : {'network': {'id': 'fc2158f2-a0b0-4986-be58-ee90b31c0ae9', 'name': 'ctest-left_vn-80575147', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53321636', 'ctest-left_vn-80575147'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 03:03:03,784 - DEBUG - Response for create_subnet : {'subnet': {'id': '1cfdb14c-78b6-43ab-a749-6e767c3533c9', 'name': '', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'network_id': 'fc2158f2-a0b0-4986-be58-ee90b31c0ae9', 'ip_version': 4, 'cidr': '155.227.251.64/26', 'allocation_pools': [{'start': '155.227.251.66', 'end': '155.227.251.126'}], 'gateway_ip': '155.227.251.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '155.227.251.66', 'tags': [], 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc'}} 2025-09-22 03:03:03,813 - INFO - Created VN ctest-left_vn-80575147 2025-09-22 03:03:03,824 - DEBUG - VN ctest-left_vn-80575147 UUID is fc2158f2-a0b0-4986-be58-ee90b31c0ae9 2025-09-22 03:03:03,897 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:03,903 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:03,912 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:04,008 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/fc2158f2-a0b0-4986-be58-ee90b31c0ae9 2025-09-22 03:03:04,021 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/fc2158f2-a0b0-4986-be58-ee90b31c0ae9 2025-09-22 03:03:04,031 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/01d92960-685a-49b7-9ee6-54583dd9a455 2025-09-22 03:03:04,040 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/01d92960-685a-49b7-9ee6-54583dd9a455 2025-09-22 03:03:04,046 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/f38c4174-0cd5-4296-b3fb-121f13a44f79 2025-09-22 03:03:04,051 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-22 03:03:04,051 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/fc2158f2-a0b0-4986-be58-ee90b31c0ae9 2025-09-22 03:03:04,058 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/01d92960-685a-49b7-9ee6-54583dd9a455 2025-09-22 03:03:04,072 - INFO - Verified VN network id 12 for VN fc2158f2-a0b0-4986-be58-ee90b31c0ae9 2025-09-22 03:03:04,073 - INFO - Verifications in API Server for VN ctest-left_vn-80575147 passed 2025-09-22 03:03:04,073 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/fc2158f2-a0b0-4986-be58-ee90b31c0ae9 2025-09-22 03:03:04,080 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/01d92960-685a-49b7-9ee6-54583dd9a455 2025-09-22 03:03:04,087 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/01d92960-685a-49b7-9ee6-54583dd9a455 2025-09-22 03:03:04,093 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/f38c4174-0cd5-4296-b3fb-121f13a44f79 2025-09-22 03:03:04,103 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18167900170890529158', 'uuid-lslong': '13715974970404506345'}, 'enable': 'true', 'created': '2025-09-22T03:03:03', 'last-modified': '2025-09-22T03:03:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.377877'} 2025-09-22 03:03:04,109 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-22 03:03:04,115 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18167900170890529158', 'uuid-lslong': '13715974970404506345'}, 'enable': 'true', 'created': '2025-09-22T03:03:03', 'last-modified': '2025-09-22T03:03:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.384676'} 2025-09-22 03:03:04,121 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-22 03:03:04,126 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18167900170890529158', 'uuid-lslong': '13715974970404506345'}, 'enable': 'true', 'created': '2025-09-22T03:03:03', 'last-modified': '2025-09-22T03:03:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.395181'} 2025-09-22 03:03:04,132 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-22 03:03:04,132 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-80575147 passed 2025-09-22 03:03:04,132 - DEBUG - ====Verifying policy data for ctest-left_vn-80575147 in API_Server ====== 2025-09-22 03:03:04,132 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:04,138 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:04,148 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:04,237 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/fc2158f2-a0b0-4986-be58-ee90b31c0ae9 2025-09-22 03:03:04,248 - DEBUG - =>VN ctest-left_vn-80575147 has no policy to be verified 2025-09-22 03:03:04,248 - DEBUG - Verifying the vn in opserver 2025-09-22 03:03:04,249 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147 virtual network link through opserver 10.0.0.56 2025-09-22 03:03:04,249 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-09-22 03:03:04,301 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147?flat'} 2025-09-22 03:03:04,301 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147 virtual network link through opserver 10.0.0.38 2025-09-22 03:03:04,301 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-22 03:03:04,351 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147?flat'} 2025-09-22 03:03:04,351 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147 virtual network link through opserver 10.0.0.27 2025-09-22 03:03:04,351 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-22 03:03:04,401 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147?flat'} 2025-09-22 03:03:04,401 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-80575147 is found in opserver 2025-09-22 03:03:04,420 - DEBUG - Do not have enough data to verify VN in agent 2025-09-22 03:03:04,429 - DEBUG - VRF ids for VN ctest-left_vn-80575147: {} 2025-09-22 03:03:04,717 - DEBUG - Response for create_network : {'network': {'id': 'ee57b5b1-5106-4079-9504-72cc9b9876a2', 'name': 'ctest-right_vn-07594744', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53321636', 'ctest-right_vn-07594744'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 03:03:04,954 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c4755e45-14c1-400d-a3d9-7c31d7fe2fd6', 'name': '', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'network_id': 'ee57b5b1-5106-4079-9504-72cc9b9876a2', 'ip_version': 4, 'cidr': '142.227.53.128/26', 'allocation_pools': [{'start': '142.227.53.130', 'end': '142.227.53.190'}], 'gateway_ip': '142.227.53.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '142.227.53.130', 'tags': [], 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc'}} 2025-09-22 03:03:04,976 - INFO - Created VN ctest-right_vn-07594744 2025-09-22 03:03:04,987 - DEBUG - VN ctest-right_vn-07594744 UUID is ee57b5b1-5106-4079-9504-72cc9b9876a2 2025-09-22 03:03:05,055 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:05,060 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:05,069 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:05,163 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/ee57b5b1-5106-4079-9504-72cc9b9876a2 2025-09-22 03:03:05,174 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/ee57b5b1-5106-4079-9504-72cc9b9876a2 2025-09-22 03:03:05,183 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7b640db2-570d-4b14-82ad-0d5c3c67fc5c 2025-09-22 03:03:05,190 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7b640db2-570d-4b14-82ad-0d5c3c67fc5c 2025-09-22 03:03:05,196 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8884bd36-07b3-4b11-95a5-d7b1e6a070b1 2025-09-22 03:03:05,202 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-22 03:03:05,202 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/ee57b5b1-5106-4079-9504-72cc9b9876a2 2025-09-22 03:03:05,209 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7b640db2-570d-4b14-82ad-0d5c3c67fc5c 2025-09-22 03:03:05,224 - INFO - Verified VN network id 13 for VN ee57b5b1-5106-4079-9504-72cc9b9876a2 2025-09-22 03:03:05,224 - INFO - Verifications in API Server for VN ctest-right_vn-07594744 passed 2025-09-22 03:03:05,224 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/ee57b5b1-5106-4079-9504-72cc9b9876a2 2025-09-22 03:03:05,233 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7b640db2-570d-4b14-82ad-0d5c3c67fc5c 2025-09-22 03:03:05,239 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7b640db2-570d-4b14-82ad-0d5c3c67fc5c 2025-09-22 03:03:05,245 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8884bd36-07b3-4b11-95a5-d7b1e6a070b1 2025-09-22 03:03:05,255 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17174395477173878905', 'uuid-lslong': '10737833634667460258'}, 'enable': 'true', 'created': '2025-09-22T03:03:04', 'last-modified': '2025-09-22T03:03:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.354883'} 2025-09-22 03:03:05,260 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-22 03:03:05,265 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17174395477173878905', 'uuid-lslong': '10737833634667460258'}, 'enable': 'true', 'created': '2025-09-22T03:03:04', 'last-modified': '2025-09-22T03:03:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.367728'} 2025-09-22 03:03:05,270 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-22 03:03:05,275 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17174395477173878905', 'uuid-lslong': '10737833634667460258'}, 'enable': 'true', 'created': '2025-09-22T03:03:04', 'last-modified': '2025-09-22T03:03:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.380029'} 2025-09-22 03:03:05,280 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-22 03:03:05,280 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-07594744 passed 2025-09-22 03:03:05,281 - DEBUG - ====Verifying policy data for ctest-right_vn-07594744 in API_Server ====== 2025-09-22 03:03:05,281 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:05,286 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:05,296 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:05,390 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/ee57b5b1-5106-4079-9504-72cc9b9876a2 2025-09-22 03:03:05,399 - DEBUG - =>VN ctest-right_vn-07594744 has no policy to be verified 2025-09-22 03:03:05,399 - DEBUG - Verifying the vn in opserver 2025-09-22 03:03:05,399 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744 virtual network link through opserver 10.0.0.56 2025-09-22 03:03:05,399 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-09-22 03:03:05,447 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744?flat'} 2025-09-22 03:03:05,447 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744 virtual network link through opserver 10.0.0.38 2025-09-22 03:03:05,447 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-22 03:03:05,494 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744?flat'} 2025-09-22 03:03:05,494 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744 virtual network link through opserver 10.0.0.27 2025-09-22 03:03:05,494 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-22 03:03:05,538 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744?flat'} 2025-09-22 03:03:05,538 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-07594744 is found in opserver 2025-09-22 03:03:05,556 - DEBUG - Do not have enough data to verify VN in agent 2025-09-22 03:03:05,565 - DEBUG - VRF ids for VN ctest-right_vn-07594744: {} 2025-09-22 03:03:05,616 - DEBUG - Services list from nova: [, , , ] 2025-09-22 03:03:06,593 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-2) 2025-09-22 03:03:07,787 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-1) 2025-09-22 03:03:07,788 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-02613076'] 2025-09-22 03:03:08,110 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-02613076'] created succesfully 2025-09-22 03:03:08,445 - DEBUG - Image by name tiny_nat_fw not found 2025-09-22 03:03:08,445 - DEBUG - Installing image tiny_nat_fw 2025-09-22 03:03:08,445 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-09-22 03:03:08,445 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-22 03:03:08,445 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-22 03:03:08,445 - DEBUG - Unzip image 2025-09-22 03:03:08,446 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-22 03:03:08,464 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-09-22 03:03:08,464 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-02613076'] 2025-09-22 03:03:08,576 - INFO - Service template: ['default-domain', 'ctest-service_template_1-02613076'] deleted successfully. 2025-09-22 03:03:08,576 - INFO - Skip interface_detach for VM ctest-right_vm-14271258 in state BUILD 2025-09-22 03:03:08,576 - INFO - Deleting VM ctest-right_vm-14271258 2025-09-22 03:03:08,616 - ERROR - VM ctest-right_vm-14271258 has failed to come up 2025-09-22 03:03:08,616 - ERROR - Nova failed to get host of the VM 2025-09-22 03:03:08,616 - ERROR - VM ctest-right_vm-14271258 has failed to come up 2025-09-22 03:03:08,616 - ERROR - Nova failed to get host of the VM 2025-09-22 03:03:08,683 - INFO - Skip interface_detach for VM ctest-left_vm-41961620 in state BUILD 2025-09-22 03:03:08,683 - INFO - Deleting VM ctest-left_vm-41961620 2025-09-22 03:03:08,684 - ERROR - VM ctest-left_vm-41961620 has failed to come up 2025-09-22 03:03:08,684 - ERROR - Nova failed to get host of the VM 2025-09-22 03:03:08,684 - ERROR - VM ctest-left_vm-41961620 has failed to come up 2025-09-22 03:03:08,684 - ERROR - Nova failed to get host of the VM 2025-09-22 03:03:08,753 - INFO - Deleting VN ctest-right_vn-07594744 2025-09-22 03:03:08,799 - DEBUG - VN ee57b5b1-5106-4079-9504-72cc9b9876a2 still in use: Unable to complete operation on network ee57b5b1-5106-4079-9504-72cc9b9876a2. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-487c0321-a5c7-4316-ab41-5fbc853b9434'] 2025-09-22 03:03:08,799 - WARNING - Deleting VN ctest-right_vn-07594744 failed..Will retry 2025-09-22 03:03:11,006 - DEBUG - Response for deleting network () 2025-09-22 03:03:11,006 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7b640db2-570d-4b14-82ad-0d5c3c67fc5c 2025-09-22 03:03:11,016 - DEBUG - Response Code: 404 2025-09-22 03:03:11,016 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:11,029 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:11,057 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:11,172 - INFO - Validated that VN ctest-right_vn-07594744 is not found in API Server 2025-09-22 03:03:11,183 - DEBUG - VN ctest-right_vn-07594744 is not present in Agent 10.0.0.33 2025-09-22 03:03:11,192 - DEBUG - VN ctest-right_vn-07594744 is not present in Agent 10.0.0.23 2025-09-22 03:03:11,192 - INFO - Validated that VN ctest-right_vn-07594744 is not in any agent 2025-09-22 03:03:11,228 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-07594744 info 2025-09-22 03:03:11,228 - INFO - Deleting VN ctest-left_vn-80575147 2025-09-22 03:03:11,408 - DEBUG - Response for deleting network () 2025-09-22 03:03:11,408 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/01d92960-685a-49b7-9ee6-54583dd9a455 2025-09-22 03:03:11,414 - DEBUG - Response Code: 404 2025-09-22 03:03:11,414 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:11,421 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:11,432 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:11,559 - INFO - Validated that VN ctest-left_vn-80575147 is not found in API Server 2025-09-22 03:03:11,571 - DEBUG - VN ctest-left_vn-80575147 is not present in Agent 10.0.0.33 2025-09-22 03:03:11,584 - DEBUG - VN ctest-left_vn-80575147 is not present in Agent 10.0.0.23 2025-09-22 03:03:11,584 - INFO - Validated that VN ctest-left_vn-80575147 is not in any agent 2025-09-22 03:03:11,612 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-80575147 info 2025-09-22 03:03:11,612 - INFO - Deleting VN ctest-mgmt_vn-05518485 2025-09-22 03:03:11,799 - DEBUG - Response for deleting network () 2025-09-22 03:03:11,799 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/3156c224-f650-4da2-83d7-8b19d938a479 2025-09-22 03:03:11,806 - DEBUG - Response Code: 404 2025-09-22 03:03:11,806 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:11,813 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:11,869 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:11,989 - INFO - Validated that VN ctest-mgmt_vn-05518485 is not found in API Server 2025-09-22 03:03:11,999 - DEBUG - VN ctest-mgmt_vn-05518485 is not present in Agent 10.0.0.33 2025-09-22 03:03:12,010 - DEBUG - VN ctest-mgmt_vn-05518485 is not present in Agent 10.0.0.23 2025-09-22 03:03:12,010 - INFO - Validated that VN ctest-mgmt_vn-05518485 is not in any agent 2025-09-22 03:03:12,040 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-05518485 info 2025-09-22 03:03:13,334 - DEBUG - No XMPP flaps were noticed during the test 2025-09-22 03:03:13,334 - INFO - 2025-09-22 03:03:13,334 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:14] 2025-09-22 03:03:13,334 - INFO - -------------------------------------------------------------------------------- 2025-09-22 03:03:13,337 - INFO - ================================================================================ 2025-09-22 03:03:13,337 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-09-22 03:03:14,606 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.254': '0', '10.20.0.25': '0'}, '10.0.0.23': {'10.20.0.254': '0', '10.20.0.193': '0'}} with 2025-09-22 03:03:14,607 - INFO - Initial checks done. Running the testcase now 2025-09-22 03:03:14,607 - INFO - 2025-09-22 03:03:14,926 - DEBUG - Response for create_network : {'network': {'id': '36150247-e614-4443-9ad2-5a4e181b8edb', 'name': 'ctest-mgmt_vn-30052800', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53321636', 'ctest-mgmt_vn-30052800'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 03:03:15,147 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ddab1296-c85e-44bd-bf4c-198576b70ef2', 'name': '', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'network_id': '36150247-e614-4443-9ad2-5a4e181b8edb', 'ip_version': 4, 'cidr': '22.69.206.0/26', 'allocation_pools': [{'start': '22.69.206.2', 'end': '22.69.206.62'}], 'gateway_ip': '22.69.206.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '22.69.206.2', 'tags': [], 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc'}} 2025-09-22 03:03:15,173 - INFO - Created VN ctest-mgmt_vn-30052800 2025-09-22 03:03:15,188 - DEBUG - VN ctest-mgmt_vn-30052800 UUID is 36150247-e614-4443-9ad2-5a4e181b8edb 2025-09-22 03:03:15,254 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:15,259 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:15,268 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:15,363 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/36150247-e614-4443-9ad2-5a4e181b8edb 2025-09-22 03:03:15,377 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/36150247-e614-4443-9ad2-5a4e181b8edb 2025-09-22 03:03:15,387 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c2349c72-bc78-4c81-af46-c8ef2b80b675 2025-09-22 03:03:15,394 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c2349c72-bc78-4c81-af46-c8ef2b80b675 2025-09-22 03:03:15,402 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/5c11b634-4e8e-4bf6-a29d-8bfbfc16b13a 2025-09-22 03:03:15,412 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-22 03:03:15,412 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/36150247-e614-4443-9ad2-5a4e181b8edb 2025-09-22 03:03:15,421 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c2349c72-bc78-4c81-af46-c8ef2b80b675 2025-09-22 03:03:15,437 - INFO - Verified VN network id 11 for VN 36150247-e614-4443-9ad2-5a4e181b8edb 2025-09-22 03:03:15,437 - INFO - Verifications in API Server for VN ctest-mgmt_vn-30052800 passed 2025-09-22 03:03:15,437 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/36150247-e614-4443-9ad2-5a4e181b8edb 2025-09-22 03:03:15,446 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c2349c72-bc78-4c81-af46-c8ef2b80b675 2025-09-22 03:03:15,458 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c2349c72-bc78-4c81-af46-c8ef2b80b675 2025-09-22 03:03:15,465 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/5c11b634-4e8e-4bf6-a29d-8bfbfc16b13a 2025-09-22 03:03:15,478 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3897023560385053763', 'uuid-lslong': '11156078518408548059'}, 'enable': 'true', 'created': '2025-09-22T03:03:14', 'last-modified': '2025-09-22T03:03:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.390000'} 2025-09-22 03:03:15,484 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-22 03:03:15,491 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3897023560385053763', 'uuid-lslong': '11156078518408548059'}, 'enable': 'true', 'created': '2025-09-22T03:03:14', 'last-modified': '2025-09-22T03:03:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.408508'} 2025-09-22 03:03:15,500 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-22 03:03:15,506 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3897023560385053763', 'uuid-lslong': '11156078518408548059'}, 'enable': 'true', 'created': '2025-09-22T03:03:14', 'last-modified': '2025-09-22T03:03:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422916'} 2025-09-22 03:03:15,512 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-22 03:03:15,512 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-30052800 passed 2025-09-22 03:03:15,512 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-30052800 in API_Server ====== 2025-09-22 03:03:15,512 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:15,520 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:15,531 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:15,627 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/36150247-e614-4443-9ad2-5a4e181b8edb 2025-09-22 03:03:15,640 - DEBUG - =>VN ctest-mgmt_vn-30052800 has no policy to be verified 2025-09-22 03:03:15,640 - DEBUG - Verifying the vn in opserver 2025-09-22 03:03:15,640 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800 virtual network link through opserver 10.0.0.56 2025-09-22 03:03:15,640 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-09-22 03:03:15,654 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800?flat'} 2025-09-22 03:03:15,654 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800 virtual network link through opserver 10.0.0.38 2025-09-22 03:03:15,655 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-22 03:03:15,667 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800?flat'} 2025-09-22 03:03:15,668 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800 virtual network link through opserver 10.0.0.27 2025-09-22 03:03:15,668 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-22 03:03:15,680 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800?flat'} 2025-09-22 03:03:15,680 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53321636:ctest-mgmt_vn-30052800 is found in opserver 2025-09-22 03:03:15,702 - DEBUG - Do not have enough data to verify VN in agent 2025-09-22 03:03:15,713 - DEBUG - VRF ids for VN ctest-mgmt_vn-30052800: {} 2025-09-22 03:03:16,007 - DEBUG - Response for create_network : {'network': {'id': 'b93735d7-2da7-462e-9dd9-5d5a3809f9d4', 'name': 'ctest-left_vn-73170326', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53321636', 'ctest-left_vn-73170326'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 03:03:16,302 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ab846f7a-0477-46f7-9618-35ca0f7e463b', 'name': '', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'network_id': 'b93735d7-2da7-462e-9dd9-5d5a3809f9d4', 'ip_version': 4, 'cidr': '147.187.12.64/26', 'allocation_pools': [{'start': '147.187.12.66', 'end': '147.187.12.126'}], 'gateway_ip': '147.187.12.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '147.187.12.66', 'tags': [], 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc'}} 2025-09-22 03:03:16,327 - INFO - Created VN ctest-left_vn-73170326 2025-09-22 03:03:16,339 - DEBUG - VN ctest-left_vn-73170326 UUID is b93735d7-2da7-462e-9dd9-5d5a3809f9d4 2025-09-22 03:03:16,413 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:16,421 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:16,432 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:16,528 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b93735d7-2da7-462e-9dd9-5d5a3809f9d4 2025-09-22 03:03:16,541 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b93735d7-2da7-462e-9dd9-5d5a3809f9d4 2025-09-22 03:03:16,550 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/18398d98-fe6a-42fe-a5a7-b4650a669977 2025-09-22 03:03:16,558 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/18398d98-fe6a-42fe-a5a7-b4650a669977 2025-09-22 03:03:16,564 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/6b13d8a5-ee16-4182-89d5-27871f721ebf 2025-09-22 03:03:16,569 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-22 03:03:16,569 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b93735d7-2da7-462e-9dd9-5d5a3809f9d4 2025-09-22 03:03:16,577 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/18398d98-fe6a-42fe-a5a7-b4650a669977 2025-09-22 03:03:16,592 - INFO - Verified VN network id 12 for VN b93735d7-2da7-462e-9dd9-5d5a3809f9d4 2025-09-22 03:03:16,592 - INFO - Verifications in API Server for VN ctest-left_vn-73170326 passed 2025-09-22 03:03:16,592 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b93735d7-2da7-462e-9dd9-5d5a3809f9d4 2025-09-22 03:03:16,600 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/18398d98-fe6a-42fe-a5a7-b4650a669977 2025-09-22 03:03:16,609 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/18398d98-fe6a-42fe-a5a7-b4650a669977 2025-09-22 03:03:16,615 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/6b13d8a5-ee16-4182-89d5-27871f721ebf 2025-09-22 03:03:16,628 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13346195219035932206', 'uuid-lslong': '11374224975969515988'}, 'enable': 'true', 'created': '2025-09-22T03:03:15', 'last-modified': '2025-09-22T03:03:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399032'} 2025-09-22 03:03:16,633 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-22 03:03:16,639 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13346195219035932206', 'uuid-lslong': '11374224975969515988'}, 'enable': 'true', 'created': '2025-09-22T03:03:15', 'last-modified': '2025-09-22T03:03:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405656'} 2025-09-22 03:03:16,646 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-22 03:03:16,651 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13346195219035932206', 'uuid-lslong': '11374224975969515988'}, 'enable': 'true', 'created': '2025-09-22T03:03:15', 'last-modified': '2025-09-22T03:03:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415325'} 2025-09-22 03:03:16,656 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-22 03:03:16,656 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-73170326 passed 2025-09-22 03:03:16,657 - DEBUG - ====Verifying policy data for ctest-left_vn-73170326 in API_Server ====== 2025-09-22 03:03:16,657 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:16,663 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:16,673 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:16,766 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b93735d7-2da7-462e-9dd9-5d5a3809f9d4 2025-09-22 03:03:16,779 - DEBUG - =>VN ctest-left_vn-73170326 has no policy to be verified 2025-09-22 03:03:16,779 - DEBUG - Verifying the vn in opserver 2025-09-22 03:03:16,779 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326 virtual network link through opserver 10.0.0.56 2025-09-22 03:03:16,779 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-09-22 03:03:16,791 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326?flat'} 2025-09-22 03:03:16,791 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326 virtual network link through opserver 10.0.0.38 2025-09-22 03:03:16,791 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-22 03:03:16,804 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326?flat'} 2025-09-22 03:03:16,804 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326 virtual network link through opserver 10.0.0.27 2025-09-22 03:03:16,804 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-22 03:03:16,818 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326?flat'} 2025-09-22 03:03:16,818 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53321636:ctest-left_vn-73170326 is found in opserver 2025-09-22 03:03:16,841 - DEBUG - Do not have enough data to verify VN in agent 2025-09-22 03:03:16,850 - DEBUG - VRF ids for VN ctest-left_vn-73170326: {} 2025-09-22 03:03:17,112 - DEBUG - Response for create_network : {'network': {'id': '078c06e6-81f1-4e05-8777-b4fb312c1855', 'name': 'ctest-right_vn-90725183', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53321636', 'ctest-right_vn-90725183'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 03:03:17,397 - DEBUG - Response for create_subnet : {'subnet': {'id': '1d50ee93-1900-4361-a66d-691a40992e5f', 'name': '', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'network_id': '078c06e6-81f1-4e05-8777-b4fb312c1855', 'ip_version': 4, 'cidr': '208.81.47.128/26', 'allocation_pools': [{'start': '208.81.47.130', 'end': '208.81.47.190'}], 'gateway_ip': '208.81.47.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '208.81.47.130', 'tags': [], 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc'}} 2025-09-22 03:03:17,419 - INFO - Created VN ctest-right_vn-90725183 2025-09-22 03:03:17,430 - DEBUG - VN ctest-right_vn-90725183 UUID is 078c06e6-81f1-4e05-8777-b4fb312c1855 2025-09-22 03:03:17,505 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:17,511 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:17,521 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:17,621 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/078c06e6-81f1-4e05-8777-b4fb312c1855 2025-09-22 03:03:17,632 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/078c06e6-81f1-4e05-8777-b4fb312c1855 2025-09-22 03:03:17,642 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a1bb67c7-6852-43f8-bb3e-326b47bd08f6 2025-09-22 03:03:17,648 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a1bb67c7-6852-43f8-bb3e-326b47bd08f6 2025-09-22 03:03:17,654 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8155c6f7-c5f9-45dd-ae9c-b7a5083f579d 2025-09-22 03:03:17,659 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-22 03:03:17,659 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/078c06e6-81f1-4e05-8777-b4fb312c1855 2025-09-22 03:03:17,666 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a1bb67c7-6852-43f8-bb3e-326b47bd08f6 2025-09-22 03:03:17,684 - INFO - Verified VN network id 13 for VN 078c06e6-81f1-4e05-8777-b4fb312c1855 2025-09-22 03:03:17,685 - INFO - Verifications in API Server for VN ctest-right_vn-90725183 passed 2025-09-22 03:03:17,685 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/078c06e6-81f1-4e05-8777-b4fb312c1855 2025-09-22 03:03:17,694 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a1bb67c7-6852-43f8-bb3e-326b47bd08f6 2025-09-22 03:03:17,703 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a1bb67c7-6852-43f8-bb3e-326b47bd08f6 2025-09-22 03:03:17,712 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8155c6f7-c5f9-45dd-ae9c-b7a5083f579d 2025-09-22 03:03:17,724 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '543817242097307141', 'uuid-lslong': '9761469708303603797'}, 'enable': 'true', 'created': '2025-09-22T03:03:17', 'last-modified': '2025-09-22T03:03:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.390296'} 2025-09-22 03:03:17,730 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-22 03:03:17,735 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '543817242097307141', 'uuid-lslong': '9761469708303603797'}, 'enable': 'true', 'created': '2025-09-22T03:03:17', 'last-modified': '2025-09-22T03:03:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405297'} 2025-09-22 03:03:17,741 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-22 03:03:17,747 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '543817242097307141', 'uuid-lslong': '9761469708303603797'}, 'enable': 'true', 'created': '2025-09-22T03:03:17', 'last-modified': '2025-09-22T03:03:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422139'} 2025-09-22 03:03:17,754 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-22 03:03:17,754 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-90725183 passed 2025-09-22 03:03:17,754 - DEBUG - ====Verifying policy data for ctest-right_vn-90725183 in API_Server ====== 2025-09-22 03:03:17,754 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:17,761 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:17,773 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:17,874 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/078c06e6-81f1-4e05-8777-b4fb312c1855 2025-09-22 03:03:17,883 - DEBUG - =>VN ctest-right_vn-90725183 has no policy to be verified 2025-09-22 03:03:17,883 - DEBUG - Verifying the vn in opserver 2025-09-22 03:03:17,883 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183 virtual network link through opserver 10.0.0.56 2025-09-22 03:03:17,883 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-09-22 03:03:17,892 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183?flat'} 2025-09-22 03:03:17,892 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183 virtual network link through opserver 10.0.0.38 2025-09-22 03:03:17,892 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-22 03:03:17,905 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183?flat'} 2025-09-22 03:03:17,905 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183 virtual network link through opserver 10.0.0.27 2025-09-22 03:03:17,905 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-22 03:03:17,919 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183?flat'} 2025-09-22 03:03:17,919 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53321636:ctest-right_vn-90725183 is found in opserver 2025-09-22 03:03:17,939 - DEBUG - Do not have enough data to verify VN in agent 2025-09-22 03:03:17,949 - DEBUG - VRF ids for VN ctest-right_vn-90725183: {} 2025-09-22 03:03:18,234 - DEBUG - Response for create_network : {'network': {'id': 'b9d68826-0d14-4d71-bc07-82d04431cd6a', 'name': 'ctest-trans_left_vn-38452741', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53321636', 'ctest-trans_left_vn-38452741'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 03:03:18,437 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e9283104-76f5-45c7-881d-45edca549b9c', 'name': '', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'network_id': 'b9d68826-0d14-4d71-bc07-82d04431cd6a', 'ip_version': 4, 'cidr': '146.96.104.64/26', 'allocation_pools': [{'start': '146.96.104.66', 'end': '146.96.104.126'}], 'gateway_ip': '146.96.104.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '146.96.104.66', 'tags': [], 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc'}} 2025-09-22 03:03:18,471 - INFO - Created VN ctest-trans_left_vn-38452741 2025-09-22 03:03:18,487 - DEBUG - VN ctest-trans_left_vn-38452741 UUID is b9d68826-0d14-4d71-bc07-82d04431cd6a 2025-09-22 03:03:18,566 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:18,571 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:18,582 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:18,676 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b9d68826-0d14-4d71-bc07-82d04431cd6a 2025-09-22 03:03:18,691 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b9d68826-0d14-4d71-bc07-82d04431cd6a 2025-09-22 03:03:18,700 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46a8c089-bcf5-48ff-9ce5-f0929578fe04 2025-09-22 03:03:18,706 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46a8c089-bcf5-48ff-9ce5-f0929578fe04 2025-09-22 03:03:18,713 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/353c84e4-a11b-4c89-b7d5-7cb85224666c 2025-09-22 03:03:18,718 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-22 03:03:18,718 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b9d68826-0d14-4d71-bc07-82d04431cd6a 2025-09-22 03:03:18,726 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46a8c089-bcf5-48ff-9ce5-f0929578fe04 2025-09-22 03:03:18,739 - INFO - Verified VN network id 14 for VN b9d68826-0d14-4d71-bc07-82d04431cd6a 2025-09-22 03:03:18,739 - INFO - Verifications in API Server for VN ctest-trans_left_vn-38452741 passed 2025-09-22 03:03:18,739 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b9d68826-0d14-4d71-bc07-82d04431cd6a 2025-09-22 03:03:18,748 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46a8c089-bcf5-48ff-9ce5-f0929578fe04 2025-09-22 03:03:18,754 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46a8c089-bcf5-48ff-9ce5-f0929578fe04 2025-09-22 03:03:18,759 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/353c84e4-a11b-4c89-b7d5-7cb85224666c 2025-09-22 03:03:18,772 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13391040239042317681', 'uuid-lslong': '13548941834976349546'}, 'enable': 'true', 'created': '2025-09-22T03:03:18', 'last-modified': '2025-09-22T03:03:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.383605'} 2025-09-22 03:03:18,778 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-22 03:03:18,783 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13391040239042317681', 'uuid-lslong': '13548941834976349546'}, 'enable': 'true', 'created': '2025-09-22T03:03:18', 'last-modified': '2025-09-22T03:03:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.393526'} 2025-09-22 03:03:18,791 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-22 03:03:18,796 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13391040239042317681', 'uuid-lslong': '13548941834976349546'}, 'enable': 'true', 'created': '2025-09-22T03:03:18', 'last-modified': '2025-09-22T03:03:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404807'} 2025-09-22 03:03:18,801 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-22 03:03:18,801 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-38452741 passed 2025-09-22 03:03:18,801 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-38452741 in API_Server ====== 2025-09-22 03:03:18,801 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:18,807 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:18,817 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:18,920 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b9d68826-0d14-4d71-bc07-82d04431cd6a 2025-09-22 03:03:18,931 - DEBUG - =>VN ctest-trans_left_vn-38452741 has no policy to be verified 2025-09-22 03:03:18,931 - DEBUG - Verifying the vn in opserver 2025-09-22 03:03:18,931 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741 virtual network link through opserver 10.0.0.56 2025-09-22 03:03:18,931 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-09-22 03:03:18,943 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741?flat'} 2025-09-22 03:03:18,943 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741 virtual network link through opserver 10.0.0.38 2025-09-22 03:03:18,943 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-22 03:03:18,956 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741?flat'} 2025-09-22 03:03:18,956 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741 virtual network link through opserver 10.0.0.27 2025-09-22 03:03:18,956 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-22 03:03:18,968 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741?flat'} 2025-09-22 03:03:18,968 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53321636:ctest-trans_left_vn-38452741 is found in opserver 2025-09-22 03:03:18,989 - DEBUG - Do not have enough data to verify VN in agent 2025-09-22 03:03:18,999 - DEBUG - VRF ids for VN ctest-trans_left_vn-38452741: {} 2025-09-22 03:03:19,268 - DEBUG - Response for create_network : {'network': {'id': 'c6d178c8-ff2b-405c-ae49-c4eb59f33a21', 'name': 'ctest-trans_right_vn-10936108', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53321636', 'ctest-trans_right_vn-10936108'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 03:03:19,487 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c94cf120-03ec-49e8-8600-860a6161b226', 'name': '', 'tenant_id': '559bb47c1a2042f1aaf2f982b886dfdc', 'network_id': 'c6d178c8-ff2b-405c-ae49-c4eb59f33a21', 'ip_version': 4, 'cidr': '49.8.119.192/26', 'allocation_pools': [{'start': '49.8.119.194', 'end': '49.8.119.254'}], 'gateway_ip': '49.8.119.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '49.8.119.194', 'tags': [], 'project_id': '559bb47c1a2042f1aaf2f982b886dfdc'}} 2025-09-22 03:03:19,509 - INFO - Created VN ctest-trans_right_vn-10936108 2025-09-22 03:03:19,520 - DEBUG - VN ctest-trans_right_vn-10936108 UUID is c6d178c8-ff2b-405c-ae49-c4eb59f33a21 2025-09-22 03:03:19,590 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:19,595 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:19,605 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:19,697 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c6d178c8-ff2b-405c-ae49-c4eb59f33a21 2025-09-22 03:03:19,707 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c6d178c8-ff2b-405c-ae49-c4eb59f33a21 2025-09-22 03:03:19,717 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0b1f892a-516b-44c2-b432-49f98b0bb632 2025-09-22 03:03:19,725 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0b1f892a-516b-44c2-b432-49f98b0bb632 2025-09-22 03:03:19,730 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/3b628427-1eda-4144-9e9e-f8e9a75ffea6 2025-09-22 03:03:19,736 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-22 03:03:19,736 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c6d178c8-ff2b-405c-ae49-c4eb59f33a21 2025-09-22 03:03:19,743 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0b1f892a-516b-44c2-b432-49f98b0bb632 2025-09-22 03:03:19,758 - INFO - Verified VN network id 15 for VN c6d178c8-ff2b-405c-ae49-c4eb59f33a21 2025-09-22 03:03:19,758 - INFO - Verifications in API Server for VN ctest-trans_right_vn-10936108 passed 2025-09-22 03:03:19,758 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c6d178c8-ff2b-405c-ae49-c4eb59f33a21 2025-09-22 03:03:19,766 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0b1f892a-516b-44c2-b432-49f98b0bb632 2025-09-22 03:03:19,771 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0b1f892a-516b-44c2-b432-49f98b0bb632 2025-09-22 03:03:19,777 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/3b628427-1eda-4144-9e9e-f8e9a75ffea6 2025-09-22 03:03:19,786 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14326364694312075356', 'uuid-lslong': '12558785551004809761'}, 'enable': 'true', 'created': '2025-09-22T03:03:19', 'last-modified': '2025-09-22T03:03:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.352639'} 2025-09-22 03:03:19,791 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-22 03:03:19,797 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14326364694312075356', 'uuid-lslong': '12558785551004809761'}, 'enable': 'true', 'created': '2025-09-22T03:03:19', 'last-modified': '2025-09-22T03:03:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.363719'} 2025-09-22 03:03:19,802 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-22 03:03:19,807 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53321636', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14326364694312075356', 'uuid-lslong': '12558785551004809761'}, 'enable': 'true', 'created': '2025-09-22T03:03:19', 'last-modified': '2025-09-22T03:03:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.373911'} 2025-09-22 03:03:19,812 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-22 03:03:19,812 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-10936108 passed 2025-09-22 03:03:19,813 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-10936108 in API_Server ====== 2025-09-22 03:03:19,813 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:19,818 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:19,827 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:19,912 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c6d178c8-ff2b-405c-ae49-c4eb59f33a21 2025-09-22 03:03:19,921 - DEBUG - =>VN ctest-trans_right_vn-10936108 has no policy to be verified 2025-09-22 03:03:19,921 - DEBUG - Verifying the vn in opserver 2025-09-22 03:03:19,921 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108 virtual network link through opserver 10.0.0.56 2025-09-22 03:03:19,921 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-09-22 03:03:19,933 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108?flat'} 2025-09-22 03:03:19,933 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108 virtual network link through opserver 10.0.0.38 2025-09-22 03:03:19,933 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-22 03:03:19,947 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108?flat'} 2025-09-22 03:03:19,947 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108 virtual network link through opserver 10.0.0.27 2025-09-22 03:03:19,947 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-22 03:03:19,961 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108?flat'} 2025-09-22 03:03:19,961 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53321636:ctest-trans_right_vn-10936108 is found in opserver 2025-09-22 03:03:19,981 - DEBUG - Do not have enough data to verify VN in agent 2025-09-22 03:03:19,989 - DEBUG - VRF ids for VN ctest-trans_right_vn-10936108: {} 2025-09-22 03:03:21,393 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-1) 2025-09-22 03:03:22,740 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-2) 2025-09-22 03:03:22,741 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-96886328'] 2025-09-22 03:03:23,088 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-96886328'] created succesfully 2025-09-22 03:03:23,421 - DEBUG - Image by name tiny_trans_fw not found 2025-09-22 03:03:23,421 - DEBUG - Installing image tiny_trans_fw 2025-09-22 03:03:23,421 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-09-22 03:03:23,421 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-22 03:03:23,421 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-22 03:03:23,421 - DEBUG - Unzip image 2025-09-22 03:03:23,421 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-22 03:03:23,442 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-09-22 03:03:23,442 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-96886328'] 2025-09-22 03:03:23,535 - INFO - Service template: ['default-domain', 'ctest-service_template_1-96886328'] deleted successfully. 2025-09-22 03:03:23,536 - INFO - Skip interface_detach for VM ctest-right_vm-50354918 in state BUILD 2025-09-22 03:03:23,536 - INFO - Deleting VM ctest-right_vm-50354918 2025-09-22 03:03:23,536 - ERROR - VM ctest-right_vm-50354918 has failed to come up 2025-09-22 03:03:23,536 - ERROR - Nova failed to get host of the VM 2025-09-22 03:03:23,536 - ERROR - VM ctest-right_vm-50354918 has failed to come up 2025-09-22 03:03:23,536 - ERROR - Nova failed to get host of the VM 2025-09-22 03:03:23,642 - INFO - Skip interface_detach for VM ctest-left_vm-88174811 in state BUILD 2025-09-22 03:03:23,642 - INFO - Deleting VM ctest-left_vm-88174811 2025-09-22 03:03:23,642 - ERROR - VM ctest-left_vm-88174811 has failed to come up 2025-09-22 03:03:23,642 - ERROR - Nova failed to get host of the VM 2025-09-22 03:03:23,642 - ERROR - VM ctest-left_vm-88174811 has failed to come up 2025-09-22 03:03:23,642 - ERROR - Nova failed to get host of the VM 2025-09-22 03:03:23,710 - INFO - Deleting VN ctest-trans_right_vn-10936108 2025-09-22 03:03:23,877 - DEBUG - Response for deleting network () 2025-09-22 03:03:23,877 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0b1f892a-516b-44c2-b432-49f98b0bb632 2025-09-22 03:03:23,883 - DEBUG - Response Code: 404 2025-09-22 03:03:23,883 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:23,889 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:23,901 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:24,002 - INFO - Validated that VN ctest-trans_right_vn-10936108 is not found in API Server 2025-09-22 03:03:24,013 - DEBUG - VN ctest-trans_right_vn-10936108 is not present in Agent 10.0.0.33 2025-09-22 03:03:24,034 - DEBUG - VN ctest-trans_right_vn-10936108 is not present in Agent 10.0.0.23 2025-09-22 03:03:24,035 - INFO - Validated that VN ctest-trans_right_vn-10936108 is not in any agent 2025-09-22 03:03:24,074 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-10936108 info 2025-09-22 03:03:24,074 - INFO - Deleting VN ctest-trans_left_vn-38452741 2025-09-22 03:03:24,225 - DEBUG - Response for deleting network () 2025-09-22 03:03:24,225 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46a8c089-bcf5-48ff-9ce5-f0929578fe04 2025-09-22 03:03:24,230 - DEBUG - Response Code: 404 2025-09-22 03:03:24,230 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:24,251 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:24,268 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:24,376 - INFO - Validated that VN ctest-trans_left_vn-38452741 is not found in API Server 2025-09-22 03:03:24,388 - DEBUG - VN ctest-trans_left_vn-38452741 is not present in Agent 10.0.0.33 2025-09-22 03:03:24,407 - DEBUG - VN ctest-trans_left_vn-38452741 is not present in Agent 10.0.0.23 2025-09-22 03:03:24,407 - INFO - Validated that VN ctest-trans_left_vn-38452741 is not in any agent 2025-09-22 03:03:24,462 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-38452741 info 2025-09-22 03:03:24,463 - INFO - Deleting VN ctest-right_vn-90725183 2025-09-22 03:03:24,513 - DEBUG - VN 078c06e6-81f1-4e05-8777-b4fb312c1855 still in use: Unable to complete operation on network 078c06e6-81f1-4e05-8777-b4fb312c1855. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-699c8ab0-7047-47f5-b6ec-c0890ca78246'] 2025-09-22 03:03:24,513 - WARNING - Deleting VN ctest-right_vn-90725183 failed..Will retry 2025-09-22 03:03:26,673 - DEBUG - Response for deleting network () 2025-09-22 03:03:26,673 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a1bb67c7-6852-43f8-bb3e-326b47bd08f6 2025-09-22 03:03:26,679 - DEBUG - Response Code: 404 2025-09-22 03:03:26,679 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:26,691 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:26,712 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:26,813 - INFO - Validated that VN ctest-right_vn-90725183 is not found in API Server 2025-09-22 03:03:26,825 - DEBUG - VN ctest-right_vn-90725183 is not present in Agent 10.0.0.33 2025-09-22 03:03:26,834 - DEBUG - VN ctest-right_vn-90725183 is not present in Agent 10.0.0.23 2025-09-22 03:03:26,834 - INFO - Validated that VN ctest-right_vn-90725183 is not in any agent 2025-09-22 03:03:26,867 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-90725183 info 2025-09-22 03:03:26,867 - INFO - Deleting VN ctest-left_vn-73170326 2025-09-22 03:03:27,053 - DEBUG - Response for deleting network () 2025-09-22 03:03:27,053 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/18398d98-fe6a-42fe-a5a7-b4650a669977 2025-09-22 03:03:27,058 - DEBUG - Response Code: 404 2025-09-22 03:03:27,058 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:27,065 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:27,118 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:27,203 - INFO - Validated that VN ctest-left_vn-73170326 is not found in API Server 2025-09-22 03:03:27,217 - DEBUG - VN ctest-left_vn-73170326 is not present in Agent 10.0.0.33 2025-09-22 03:03:27,228 - DEBUG - VN ctest-left_vn-73170326 is not present in Agent 10.0.0.23 2025-09-22 03:03:27,228 - INFO - Validated that VN ctest-left_vn-73170326 is not in any agent 2025-09-22 03:03:27,262 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-73170326 info 2025-09-22 03:03:27,262 - INFO - Deleting VN ctest-mgmt_vn-30052800 2025-09-22 03:03:27,433 - DEBUG - Response for deleting network () 2025-09-22 03:03:27,433 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c2349c72-bc78-4c81-af46-c8ef2b80b675 2025-09-22 03:03:27,439 - DEBUG - Response Code: 404 2025-09-22 03:03:27,439 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-22 03:03:27,445 - DEBUG - Requesting: http://10.0.0.56:8082/domain/ccce3d88-d117-4380-892c-193ef8fcc90d 2025-09-22 03:03:27,457 - DEBUG - Requesting: http://10.0.0.56:8082/project/559bb47c-1a20-42f1-aaf2-f982b886dfdc 2025-09-22 03:03:27,562 - INFO - Validated that VN ctest-mgmt_vn-30052800 is not found in API Server 2025-09-22 03:03:27,573 - DEBUG - VN ctest-mgmt_vn-30052800 is not present in Agent 10.0.0.33 2025-09-22 03:03:27,582 - DEBUG - VN ctest-mgmt_vn-30052800 is not present in Agent 10.0.0.23 2025-09-22 03:03:27,582 - INFO - Validated that VN ctest-mgmt_vn-30052800 is not in any agent 2025-09-22 03:03:27,611 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-30052800 info 2025-09-22 03:03:28,880 - DEBUG - No XMPP flaps were noticed during the test 2025-09-22 03:03:28,880 - INFO - 2025-09-22 03:03:28,880 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15] 2025-09-22 03:03:28,880 - INFO - -------------------------------------------------------------------------------- 2025-09-22 03:03:29,632 - INFO - Deleted project: ctest-TestSvcHC-53321636, ID : 559bb47c-1a20-42f1-aaf2-f982b886dfdc