2025-10-08 17:30:18,740 - INFO - Domain Default found not creating 2025-10-08 17:30:18,874 - INFO - Project ctest-TestSvcHC-49682729 not found, creating it 2025-10-08 17:30:19,384 - INFO - Created Project:ctest-TestSvcHC-49682729, ID : 360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:20,744 - INFO - ================================================================================ 2025-10-08 17:30:20,744 - INFO - STARTING TEST : test_svc_hc_basic 2025-10-08 17:30:22,290 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.192': '0', '10.20.0.19': '0'}, '10.0.0.19': {'10.20.0.192': '0', '10.20.0.19': '0'}} with 2025-10-08 17:30:22,290 - INFO - Initial checks done. Running the testcase now 2025-10-08 17:30:22,290 - INFO - 2025-10-08 17:30:23,452 - DEBUG - Response for create_network : {'network': {'id': '2d30b75e-a88d-4461-8d4c-d3617afb9c90', 'name': 'ctest-mgmt_vn-83131793', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'project_id': '360992cd51404ec5b1890fd9b5e83d5e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-49682729', 'ctest-mgmt_vn-83131793'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 17:30:23,981 - DEBUG - Response for create_subnet : {'subnet': {'id': '50e3083b-80a2-4193-8a69-0309df2b5ca6', 'name': '', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'network_id': '2d30b75e-a88d-4461-8d4c-d3617afb9c90', 'ip_version': 4, 'cidr': '25.61.117.64/26', 'allocation_pools': [{'start': '25.61.117.66', 'end': '25.61.117.126'}], 'gateway_ip': '25.61.117.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '25.61.117.66', 'tags': [], 'project_id': '360992cd51404ec5b1890fd9b5e83d5e'}} 2025-10-08 17:30:24,221 - INFO - Created VN ctest-mgmt_vn-83131793 2025-10-08 17:30:24,248 - DEBUG - VN ctest-mgmt_vn-83131793 UUID is 2d30b75e-a88d-4461-8d4c-d3617afb9c90 2025-10-08 17:30:24,837 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:25,129 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:25,159 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:25,200 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:25,304 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2d30b75e-a88d-4461-8d4c-d3617afb9c90 2025-10-08 17:30:25,319 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2d30b75e-a88d-4461-8d4c-d3617afb9c90 2025-10-08 17:30:25,333 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/40ed9644-4850-4f15-8e75-d5bcd7d49a91 2025-10-08 17:30:25,341 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/40ed9644-4850-4f15-8e75-d5bcd7d49a91 2025-10-08 17:30:25,348 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/180bdb19-2c28-486b-adda-402b0c110084 2025-10-08 17:30:25,355 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 17:30:25,355 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2d30b75e-a88d-4461-8d4c-d3617afb9c90 2025-10-08 17:30:25,364 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/40ed9644-4850-4f15-8e75-d5bcd7d49a91 2025-10-08 17:30:25,381 - INFO - Verified VN network id 13 for VN 2d30b75e-a88d-4461-8d4c-d3617afb9c90 2025-10-08 17:30:25,381 - INFO - Verifications in API Server for VN ctest-mgmt_vn-83131793 passed 2025-10-08 17:30:25,381 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2d30b75e-a88d-4461-8d4c-d3617afb9c90 2025-10-08 17:30:25,394 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/40ed9644-4850-4f15-8e75-d5bcd7d49a91 2025-10-08 17:30:25,402 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/40ed9644-4850-4f15-8e75-d5bcd7d49a91 2025-10-08 17:30:25,409 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/180bdb19-2c28-486b-adda-402b0c110084 2025-10-08 17:30:25,421 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3256304147771507809', 'uuid-lslong': '10181745273206447248'}, 'enable': 'true', 'created': '2025-10-08T17:30:23', 'last-modified': '2025-10-08T17:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.509502'} 2025-10-08 17:30:25,426 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 17:30:26,453 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3256304147771507809', 'uuid-lslong': '10181745273206447248'}, 'enable': 'true', 'created': '2025-10-08T17:30:23', 'last-modified': '2025-10-08T17:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.534121'} 2025-10-08 17:30:26,464 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 17:30:26,474 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3256304147771507809', 'uuid-lslong': '10181745273206447248'}, 'enable': 'true', 'created': '2025-10-08T17:30:23', 'last-modified': '2025-10-08T17:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.556002'} 2025-10-08 17:30:26,481 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 17:30:26,481 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-83131793 passed 2025-10-08 17:30:26,481 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-83131793 in API_Server ====== 2025-10-08 17:30:26,481 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:26,487 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:26,498 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:26,601 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2d30b75e-a88d-4461-8d4c-d3617afb9c90 2025-10-08 17:30:26,612 - DEBUG - =>VN ctest-mgmt_vn-83131793 has no policy to be verified 2025-10-08 17:30:26,612 - DEBUG - Verifying the vn in opserver 2025-10-08 17:30:26,613 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793 virtual network link through opserver 10.0.0.56 2025-10-08 17:30:26,613 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-08 17:30:26,902 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-08 17:30:26,965 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793?flat'} 2025-10-08 17:30:26,966 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793 virtual network link through opserver 10.0.0.249 2025-10-08 17:30:26,966 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-08 17:30:27,272 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-08 17:30:27,334 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793?flat'} 2025-10-08 17:30:27,334 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793 virtual network link through opserver 10.0.0.41 2025-10-08 17:30:27,334 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-08 17:30:27,630 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-08 17:30:27,713 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793?flat'} 2025-10-08 17:30:27,713 - INFO - Validated that VN default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-83131793 is found in opserver 2025-10-08 17:30:27,739 - DEBUG - Do not have enough data to verify VN in agent 2025-10-08 17:30:27,752 - DEBUG - VRF ids for VN ctest-mgmt_vn-83131793: {} 2025-10-08 17:30:28,038 - DEBUG - Response for create_network : {'network': {'id': 'e7ea2c53-f215-4f92-a5e1-c32dfcfafe28', 'name': 'ctest-left_vn-13045546', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'project_id': '360992cd51404ec5b1890fd9b5e83d5e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-49682729', 'ctest-left_vn-13045546'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 17:30:28,310 - DEBUG - Response for create_subnet : {'subnet': {'id': '3b9d4240-a09c-4f8a-b8d1-059719c5b49e', 'name': '', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'network_id': 'e7ea2c53-f215-4f92-a5e1-c32dfcfafe28', 'ip_version': 4, 'cidr': '194.226.45.0/26', 'allocation_pools': [{'start': '194.226.45.2', 'end': '194.226.45.62'}], 'gateway_ip': '194.226.45.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '194.226.45.2', 'tags': [], 'project_id': '360992cd51404ec5b1890fd9b5e83d5e'}} 2025-10-08 17:30:28,336 - INFO - Created VN ctest-left_vn-13045546 2025-10-08 17:30:28,349 - DEBUG - VN ctest-left_vn-13045546 UUID is e7ea2c53-f215-4f92-a5e1-c32dfcfafe28 2025-10-08 17:30:28,443 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:28,455 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:28,467 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:28,576 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/e7ea2c53-f215-4f92-a5e1-c32dfcfafe28 2025-10-08 17:30:28,595 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/e7ea2c53-f215-4f92-a5e1-c32dfcfafe28 2025-10-08 17:30:28,605 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a648fe8-7541-43a2-83a0-e52efc184573 2025-10-08 17:30:28,613 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a648fe8-7541-43a2-83a0-e52efc184573 2025-10-08 17:30:28,622 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/10e16256-37d3-4613-b453-85beb5ce5772 2025-10-08 17:30:28,630 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 17:30:28,630 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/e7ea2c53-f215-4f92-a5e1-c32dfcfafe28 2025-10-08 17:30:28,645 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a648fe8-7541-43a2-83a0-e52efc184573 2025-10-08 17:30:28,669 - INFO - Verified VN network id 14 for VN e7ea2c53-f215-4f92-a5e1-c32dfcfafe28 2025-10-08 17:30:28,669 - INFO - Verifications in API Server for VN ctest-left_vn-13045546 passed 2025-10-08 17:30:28,669 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/e7ea2c53-f215-4f92-a5e1-c32dfcfafe28 2025-10-08 17:30:28,682 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a648fe8-7541-43a2-83a0-e52efc184573 2025-10-08 17:30:28,689 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a648fe8-7541-43a2-83a0-e52efc184573 2025-10-08 17:30:28,696 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/10e16256-37d3-4613-b453-85beb5ce5772 2025-10-08 17:30:28,708 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16711218106367037330', 'uuid-lslong': '11953049488303259176'}, 'enable': 'true', 'created': '2025-10-08T17:30:27', 'last-modified': '2025-10-08T17:30:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.454094'} 2025-10-08 17:30:28,713 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 17:30:28,720 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16711218106367037330', 'uuid-lslong': '11953049488303259176'}, 'enable': 'true', 'created': '2025-10-08T17:30:27', 'last-modified': '2025-10-08T17:30:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.468286'} 2025-10-08 17:30:28,726 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 17:30:28,737 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16711218106367037330', 'uuid-lslong': '11953049488303259176'}, 'enable': 'true', 'created': '2025-10-08T17:30:27', 'last-modified': '2025-10-08T17:30:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.487058'} 2025-10-08 17:30:28,743 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 17:30:28,743 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-13045546 passed 2025-10-08 17:30:28,743 - DEBUG - ====Verifying policy data for ctest-left_vn-13045546 in API_Server ====== 2025-10-08 17:30:28,744 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:28,750 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:28,762 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:28,871 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/e7ea2c53-f215-4f92-a5e1-c32dfcfafe28 2025-10-08 17:30:28,884 - DEBUG - =>VN ctest-left_vn-13045546 has no policy to be verified 2025-10-08 17:30:28,884 - DEBUG - Verifying the vn in opserver 2025-10-08 17:30:28,884 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546 virtual network link through opserver 10.0.0.56 2025-10-08 17:30:28,884 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-08 17:30:28,935 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546?flat'} 2025-10-08 17:30:28,935 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546 virtual network link through opserver 10.0.0.249 2025-10-08 17:30:28,935 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-08 17:30:29,007 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546?flat'} 2025-10-08 17:30:29,007 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546 virtual network link through opserver 10.0.0.41 2025-10-08 17:30:29,007 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-08 17:30:29,076 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546?flat'} 2025-10-08 17:30:29,076 - INFO - Validated that VN default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-13045546 is found in opserver 2025-10-08 17:30:29,105 - DEBUG - Do not have enough data to verify VN in agent 2025-10-08 17:30:29,116 - DEBUG - VRF ids for VN ctest-left_vn-13045546: {} 2025-10-08 17:30:29,443 - DEBUG - Response for create_network : {'network': {'id': '8b990b38-fc24-456f-960b-b834ec4052c2', 'name': 'ctest-right_vn-17170224', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'project_id': '360992cd51404ec5b1890fd9b5e83d5e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-49682729', 'ctest-right_vn-17170224'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 17:30:29,660 - DEBUG - Response for create_subnet : {'subnet': {'id': '2b9efcbe-a62e-4c1a-9a17-0339e91727ad', 'name': '', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'network_id': '8b990b38-fc24-456f-960b-b834ec4052c2', 'ip_version': 4, 'cidr': '33.245.248.0/26', 'allocation_pools': [{'start': '33.245.248.2', 'end': '33.245.248.62'}], 'gateway_ip': '33.245.248.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '33.245.248.2', 'tags': [], 'project_id': '360992cd51404ec5b1890fd9b5e83d5e'}} 2025-10-08 17:30:29,683 - INFO - Created VN ctest-right_vn-17170224 2025-10-08 17:30:29,698 - DEBUG - VN ctest-right_vn-17170224 UUID is 8b990b38-fc24-456f-960b-b834ec4052c2 2025-10-08 17:30:29,771 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:29,777 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:29,788 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:29,899 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/8b990b38-fc24-456f-960b-b834ec4052c2 2025-10-08 17:30:29,916 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/8b990b38-fc24-456f-960b-b834ec4052c2 2025-10-08 17:30:29,926 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/8185d79d-5b66-4063-8898-2c273e7ea1fd 2025-10-08 17:30:29,936 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/8185d79d-5b66-4063-8898-2c273e7ea1fd 2025-10-08 17:30:29,948 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/11bb1bdd-43a4-4493-a79b-ba97da8fccff 2025-10-08 17:30:29,956 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 17:30:29,956 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/8b990b38-fc24-456f-960b-b834ec4052c2 2025-10-08 17:30:29,966 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/8185d79d-5b66-4063-8898-2c273e7ea1fd 2025-10-08 17:30:29,983 - INFO - Verified VN network id 15 for VN 8b990b38-fc24-456f-960b-b834ec4052c2 2025-10-08 17:30:29,983 - INFO - Verifications in API Server for VN ctest-right_vn-17170224 passed 2025-10-08 17:30:29,983 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/8b990b38-fc24-456f-960b-b834ec4052c2 2025-10-08 17:30:29,992 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/8185d79d-5b66-4063-8898-2c273e7ea1fd 2025-10-08 17:30:30,000 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/8185d79d-5b66-4063-8898-2c273e7ea1fd 2025-10-08 17:30:30,008 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/11bb1bdd-43a4-4493-a79b-ba97da8fccff 2025-10-08 17:30:30,020 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10059083582085023087', 'uuid-lslong': '10811937867874456258'}, 'enable': 'true', 'created': '2025-10-08T17:30:29', 'last-modified': '2025-10-08T17:30:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423204'} 2025-10-08 17:30:30,025 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 17:30:30,033 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10059083582085023087', 'uuid-lslong': '10811937867874456258'}, 'enable': 'true', 'created': '2025-10-08T17:30:29', 'last-modified': '2025-10-08T17:30:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.436880'} 2025-10-08 17:30:30,039 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 17:30:30,048 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10059083582085023087', 'uuid-lslong': '10811937867874456258'}, 'enable': 'true', 'created': '2025-10-08T17:30:29', 'last-modified': '2025-10-08T17:30:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.447822'} 2025-10-08 17:30:30,054 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 17:30:30,054 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-17170224 passed 2025-10-08 17:30:30,054 - DEBUG - ====Verifying policy data for ctest-right_vn-17170224 in API_Server ====== 2025-10-08 17:30:30,054 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:30,062 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:30,073 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:30,181 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/8b990b38-fc24-456f-960b-b834ec4052c2 2025-10-08 17:30:30,410 - DEBUG - =>VN ctest-right_vn-17170224 has no policy to be verified 2025-10-08 17:30:30,410 - DEBUG - Verifying the vn in opserver 2025-10-08 17:30:30,410 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224 virtual network link through opserver 10.0.0.56 2025-10-08 17:30:30,410 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-08 17:30:30,473 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224?flat'} 2025-10-08 17:30:30,473 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224 virtual network link through opserver 10.0.0.249 2025-10-08 17:30:30,473 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-08 17:30:30,531 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224?flat'} 2025-10-08 17:30:30,531 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224 virtual network link through opserver 10.0.0.41 2025-10-08 17:30:30,531 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-08 17:30:30,591 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224?flat'} 2025-10-08 17:30:30,591 - INFO - Validated that VN default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-17170224 is found in opserver 2025-10-08 17:30:30,613 - DEBUG - Do not have enough data to verify VN in agent 2025-10-08 17:30:31,644 - DEBUG - VRF ids for VN ctest-right_vn-17170224: {} 2025-10-08 17:30:31,699 - DEBUG - Services list from nova: [, , , ] 2025-10-08 17:30:32,688 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4239-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4239-1) 2025-10-08 17:30:34,045 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4239-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4239-2) 2025-10-08 17:30:34,045 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-49001699'] 2025-10-08 17:30:34,372 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-49001699'] created succesfully 2025-10-08 17:30:34,914 - DEBUG - Image by name tiny_nat_fw not found 2025-10-08 17:30:34,914 - DEBUG - Installing image tiny_nat_fw 2025-10-08 17:30:34,914 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-10-08 17:30:34,914 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-08 17:30:34,914 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-08 17:30:34,914 - DEBUG - Unzip image 2025-10-08 17:30:34,914 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-08 17:30:34,944 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-10-08 17:30:34,944 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-49001699'] 2025-10-08 17:30:35,284 - INFO - Service template: ['default-domain', 'ctest-service_template_1-49001699'] deleted successfully. 2025-10-08 17:30:35,284 - INFO - Skip interface_detach for VM ctest-right_vm-67910446 in state BUILD 2025-10-08 17:30:35,285 - INFO - Deleting VM ctest-right_vm-67910446 2025-10-08 17:30:35,311 - ERROR - VM ctest-right_vm-67910446 has failed to come up 2025-10-08 17:30:35,311 - ERROR - Nova failed to get host of the VM 2025-10-08 17:30:35,311 - ERROR - VM ctest-right_vm-67910446 has failed to come up 2025-10-08 17:30:35,311 - ERROR - Nova failed to get host of the VM 2025-10-08 17:30:35,379 - INFO - Skip interface_detach for VM ctest-left_vm-81007538 in state BUILD 2025-10-08 17:30:35,380 - INFO - Deleting VM ctest-left_vm-81007538 2025-10-08 17:30:35,380 - ERROR - VM ctest-left_vm-81007538 has failed to come up 2025-10-08 17:30:35,380 - ERROR - Nova failed to get host of the VM 2025-10-08 17:30:35,380 - ERROR - VM ctest-left_vm-81007538 has failed to come up 2025-10-08 17:30:35,380 - ERROR - Nova failed to get host of the VM 2025-10-08 17:30:35,440 - INFO - Deleting VN ctest-right_vn-17170224 2025-10-08 17:30:35,696 - DEBUG - VN 8b990b38-fc24-456f-960b-b834ec4052c2 still in use: Unable to complete operation on network 8b990b38-fc24-456f-960b-b834ec4052c2. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-21b0c524-9072-4f83-a6f9-f17fdc5a960a'] 2025-10-08 17:30:35,696 - WARNING - Deleting VN ctest-right_vn-17170224 failed..Will retry 2025-10-08 17:30:38,137 - DEBUG - Response for deleting network () 2025-10-08 17:30:38,137 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/8185d79d-5b66-4063-8898-2c273e7ea1fd 2025-10-08 17:30:38,148 - DEBUG - Response Code: 404 2025-10-08 17:30:38,148 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:38,169 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:38,190 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:38,290 - INFO - Validated that VN ctest-right_vn-17170224 is not found in API Server 2025-10-08 17:30:38,301 - DEBUG - VN ctest-right_vn-17170224 is not present in Agent 10.0.0.33 2025-10-08 17:30:38,312 - DEBUG - VN ctest-right_vn-17170224 is not present in Agent 10.0.0.19 2025-10-08 17:30:38,313 - INFO - Validated that VN ctest-right_vn-17170224 is not in any agent 2025-10-08 17:30:38,352 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-17170224 info 2025-10-08 17:30:38,352 - INFO - Deleting VN ctest-left_vn-13045546 2025-10-08 17:30:38,534 - DEBUG - Response for deleting network () 2025-10-08 17:30:38,534 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a648fe8-7541-43a2-83a0-e52efc184573 2025-10-08 17:30:38,541 - DEBUG - Response Code: 404 2025-10-08 17:30:38,541 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:38,549 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:38,605 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:38,699 - INFO - Validated that VN ctest-left_vn-13045546 is not found in API Server 2025-10-08 17:30:38,912 - DEBUG - VN ctest-left_vn-13045546 is not present in Agent 10.0.0.33 2025-10-08 17:30:38,927 - DEBUG - VN ctest-left_vn-13045546 is not present in Agent 10.0.0.19 2025-10-08 17:30:38,927 - INFO - Validated that VN ctest-left_vn-13045546 is not in any agent 2025-10-08 17:30:38,966 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-13045546 info 2025-10-08 17:30:38,966 - INFO - Deleting VN ctest-mgmt_vn-83131793 2025-10-08 17:30:39,161 - DEBUG - Response for deleting network () 2025-10-08 17:30:39,161 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/40ed9644-4850-4f15-8e75-d5bcd7d49a91 2025-10-08 17:30:39,167 - DEBUG - Response Code: 404 2025-10-08 17:30:39,167 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:39,174 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:39,185 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:39,278 - INFO - Validated that VN ctest-mgmt_vn-83131793 is not found in API Server 2025-10-08 17:30:39,289 - DEBUG - VN ctest-mgmt_vn-83131793 is not present in Agent 10.0.0.33 2025-10-08 17:30:39,302 - DEBUG - VN ctest-mgmt_vn-83131793 is not present in Agent 10.0.0.19 2025-10-08 17:30:39,302 - INFO - Validated that VN ctest-mgmt_vn-83131793 is not in any agent 2025-10-08 17:30:39,333 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-83131793 info 2025-10-08 17:30:40,650 - DEBUG - No XMPP flaps were noticed during the test 2025-10-08 17:30:40,650 - INFO - 2025-10-08 17:30:40,650 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:20] 2025-10-08 17:30:40,650 - INFO - -------------------------------------------------------------------------------- 2025-10-08 17:30:40,653 - INFO - ================================================================================ 2025-10-08 17:30:40,653 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-10-08 17:30:41,961 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.192': '0', '10.20.0.19': '0'}, '10.0.0.19': {'10.20.0.192': '0', '10.20.0.19': '0'}} with 2025-10-08 17:30:41,961 - INFO - Initial checks done. Running the testcase now 2025-10-08 17:30:41,961 - INFO - 2025-10-08 17:30:42,254 - DEBUG - Response for create_network : {'network': {'id': '2c5bd352-ce76-4248-b2e2-9f420318b40d', 'name': 'ctest-mgmt_vn-00356324', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'project_id': '360992cd51404ec5b1890fd9b5e83d5e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-49682729', 'ctest-mgmt_vn-00356324'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 17:30:42,549 - DEBUG - Response for create_subnet : {'subnet': {'id': '53b75420-184f-4c9c-9914-0a79626d79f2', 'name': '', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'network_id': '2c5bd352-ce76-4248-b2e2-9f420318b40d', 'ip_version': 4, 'cidr': '208.109.183.0/26', 'allocation_pools': [{'start': '208.109.183.2', 'end': '208.109.183.62'}], 'gateway_ip': '208.109.183.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '208.109.183.2', 'tags': [], 'project_id': '360992cd51404ec5b1890fd9b5e83d5e'}} 2025-10-08 17:30:42,575 - INFO - Created VN ctest-mgmt_vn-00356324 2025-10-08 17:30:42,591 - DEBUG - VN ctest-mgmt_vn-00356324 UUID is 2c5bd352-ce76-4248-b2e2-9f420318b40d 2025-10-08 17:30:42,667 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:42,673 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:42,686 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:42,784 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2c5bd352-ce76-4248-b2e2-9f420318b40d 2025-10-08 17:30:42,801 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2c5bd352-ce76-4248-b2e2-9f420318b40d 2025-10-08 17:30:42,810 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/79213be2-37e5-4057-8739-d3426c43a247 2025-10-08 17:30:42,820 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/79213be2-37e5-4057-8739-d3426c43a247 2025-10-08 17:30:42,827 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/697eb2fc-3eaf-4d45-b9c0-c0ffee0fd06b 2025-10-08 17:30:42,834 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 17:30:42,834 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2c5bd352-ce76-4248-b2e2-9f420318b40d 2025-10-08 17:30:42,846 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/79213be2-37e5-4057-8739-d3426c43a247 2025-10-08 17:30:42,863 - INFO - Verified VN network id 13 for VN 2c5bd352-ce76-4248-b2e2-9f420318b40d 2025-10-08 17:30:42,863 - INFO - Verifications in API Server for VN ctest-mgmt_vn-00356324 passed 2025-10-08 17:30:42,863 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2c5bd352-ce76-4248-b2e2-9f420318b40d 2025-10-08 17:30:42,872 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/79213be2-37e5-4057-8739-d3426c43a247 2025-10-08 17:30:42,880 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/79213be2-37e5-4057-8739-d3426c43a247 2025-10-08 17:30:42,888 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/697eb2fc-3eaf-4d45-b9c0-c0ffee0fd06b 2025-10-08 17:30:42,906 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3196380713154134600', 'uuid-lslong': '12890040189356389389'}, 'enable': 'true', 'created': '2025-10-08T17:30:42', 'last-modified': '2025-10-08T17:30:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.440648'} 2025-10-08 17:30:42,914 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 17:30:42,927 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3196380713154134600', 'uuid-lslong': '12890040189356389389'}, 'enable': 'true', 'created': '2025-10-08T17:30:42', 'last-modified': '2025-10-08T17:30:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.454647'} 2025-10-08 17:30:42,932 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 17:30:42,942 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3196380713154134600', 'uuid-lslong': '12890040189356389389'}, 'enable': 'true', 'created': '2025-10-08T17:30:42', 'last-modified': '2025-10-08T17:30:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.477933'} 2025-10-08 17:30:42,954 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-08 17:30:42,954 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-00356324 passed 2025-10-08 17:30:42,954 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-00356324 in API_Server ====== 2025-10-08 17:30:42,954 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:42,961 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:42,971 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:43,078 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/2c5bd352-ce76-4248-b2e2-9f420318b40d 2025-10-08 17:30:43,090 - DEBUG - =>VN ctest-mgmt_vn-00356324 has no policy to be verified 2025-10-08 17:30:43,090 - DEBUG - Verifying the vn in opserver 2025-10-08 17:30:43,090 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324 virtual network link through opserver 10.0.0.56 2025-10-08 17:30:43,090 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-08 17:30:43,106 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324?flat'} 2025-10-08 17:30:43,106 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324 virtual network link through opserver 10.0.0.249 2025-10-08 17:30:43,106 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-08 17:30:43,120 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324?flat'} 2025-10-08 17:30:43,121 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324 virtual network link through opserver 10.0.0.41 2025-10-08 17:30:43,121 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-08 17:30:43,136 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324?flat'} 2025-10-08 17:30:43,136 - INFO - Validated that VN default-domain:ctest-TestSvcHC-49682729:ctest-mgmt_vn-00356324 is found in opserver 2025-10-08 17:30:43,159 - DEBUG - Do not have enough data to verify VN in agent 2025-10-08 17:30:43,169 - DEBUG - VRF ids for VN ctest-mgmt_vn-00356324: {} 2025-10-08 17:30:43,471 - DEBUG - Response for create_network : {'network': {'id': '66905051-c2e7-42d4-9bdd-6a72d5002c71', 'name': 'ctest-left_vn-81572607', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'project_id': '360992cd51404ec5b1890fd9b5e83d5e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-49682729', 'ctest-left_vn-81572607'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 17:30:43,759 - DEBUG - Response for create_subnet : {'subnet': {'id': '17eda29e-0816-4b5c-ada3-b6c2e4b0258f', 'name': '', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'network_id': '66905051-c2e7-42d4-9bdd-6a72d5002c71', 'ip_version': 4, 'cidr': '27.53.176.0/26', 'allocation_pools': [{'start': '27.53.176.2', 'end': '27.53.176.62'}], 'gateway_ip': '27.53.176.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '27.53.176.2', 'tags': [], 'project_id': '360992cd51404ec5b1890fd9b5e83d5e'}} 2025-10-08 17:30:43,782 - INFO - Created VN ctest-left_vn-81572607 2025-10-08 17:30:43,799 - DEBUG - VN ctest-left_vn-81572607 UUID is 66905051-c2e7-42d4-9bdd-6a72d5002c71 2025-10-08 17:30:44,006 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:44,015 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:44,036 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:44,133 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/66905051-c2e7-42d4-9bdd-6a72d5002c71 2025-10-08 17:30:44,149 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/66905051-c2e7-42d4-9bdd-6a72d5002c71 2025-10-08 17:30:44,159 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/62fbe1d9-8f9c-444c-8e8f-3f37d83fc442 2025-10-08 17:30:44,167 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/62fbe1d9-8f9c-444c-8e8f-3f37d83fc442 2025-10-08 17:30:44,176 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/e4159851-d85a-4409-acd6-3b9fd34530f0 2025-10-08 17:30:44,183 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 17:30:44,183 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/66905051-c2e7-42d4-9bdd-6a72d5002c71 2025-10-08 17:30:44,193 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/62fbe1d9-8f9c-444c-8e8f-3f37d83fc442 2025-10-08 17:30:44,222 - INFO - Verified VN network id 14 for VN 66905051-c2e7-42d4-9bdd-6a72d5002c71 2025-10-08 17:30:44,222 - INFO - Verifications in API Server for VN ctest-left_vn-81572607 passed 2025-10-08 17:30:44,222 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/66905051-c2e7-42d4-9bdd-6a72d5002c71 2025-10-08 17:30:44,237 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/62fbe1d9-8f9c-444c-8e8f-3f37d83fc442 2025-10-08 17:30:44,247 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/62fbe1d9-8f9c-444c-8e8f-3f37d83fc442 2025-10-08 17:30:44,257 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/e4159851-d85a-4409-acd6-3b9fd34530f0 2025-10-08 17:30:44,270 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7390495300607492820', 'uuid-lslong': '11231250087164259441'}, 'enable': 'true', 'created': '2025-10-08T17:30:43', 'last-modified': '2025-10-08T17:30:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.562836'} 2025-10-08 17:30:44,277 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 17:30:44,283 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7390495300607492820', 'uuid-lslong': '11231250087164259441'}, 'enable': 'true', 'created': '2025-10-08T17:30:43', 'last-modified': '2025-10-08T17:30:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.575551'} 2025-10-08 17:30:44,289 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 17:30:44,298 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7390495300607492820', 'uuid-lslong': '11231250087164259441'}, 'enable': 'true', 'created': '2025-10-08T17:30:43', 'last-modified': '2025-10-08T17:30:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.584238'} 2025-10-08 17:30:44,304 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-08 17:30:44,304 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-81572607 passed 2025-10-08 17:30:44,304 - DEBUG - ====Verifying policy data for ctest-left_vn-81572607 in API_Server ====== 2025-10-08 17:30:44,304 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:44,311 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:44,323 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:44,429 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/66905051-c2e7-42d4-9bdd-6a72d5002c71 2025-10-08 17:30:44,441 - DEBUG - =>VN ctest-left_vn-81572607 has no policy to be verified 2025-10-08 17:30:44,441 - DEBUG - Verifying the vn in opserver 2025-10-08 17:30:44,441 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607 virtual network link through opserver 10.0.0.56 2025-10-08 17:30:44,441 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-08 17:30:44,454 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607?flat'} 2025-10-08 17:30:44,454 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607 virtual network link through opserver 10.0.0.249 2025-10-08 17:30:44,454 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-08 17:30:44,470 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607?flat'} 2025-10-08 17:30:44,470 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607 virtual network link through opserver 10.0.0.41 2025-10-08 17:30:44,470 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-08 17:30:44,484 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607?flat'} 2025-10-08 17:30:44,484 - INFO - Validated that VN default-domain:ctest-TestSvcHC-49682729:ctest-left_vn-81572607 is found in opserver 2025-10-08 17:30:44,505 - DEBUG - Do not have enough data to verify VN in agent 2025-10-08 17:30:44,517 - DEBUG - VRF ids for VN ctest-left_vn-81572607: {} 2025-10-08 17:30:45,210 - DEBUG - Response for create_network : {'network': {'id': '9f09ae89-1352-491c-be0c-61f47ebc4451', 'name': 'ctest-right_vn-64273286', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'project_id': '360992cd51404ec5b1890fd9b5e83d5e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-49682729', 'ctest-right_vn-64273286'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 17:30:45,468 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cb34f5d7-cae6-4df3-956a-53dcdc4b95df', 'name': '', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'network_id': '9f09ae89-1352-491c-be0c-61f47ebc4451', 'ip_version': 4, 'cidr': '81.190.134.192/26', 'allocation_pools': [{'start': '81.190.134.194', 'end': '81.190.134.254'}], 'gateway_ip': '81.190.134.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '81.190.134.194', 'tags': [], 'project_id': '360992cd51404ec5b1890fd9b5e83d5e'}} 2025-10-08 17:30:45,490 - INFO - Created VN ctest-right_vn-64273286 2025-10-08 17:30:45,501 - DEBUG - VN ctest-right_vn-64273286 UUID is 9f09ae89-1352-491c-be0c-61f47ebc4451 2025-10-08 17:30:45,575 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:45,583 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:45,594 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:45,685 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9f09ae89-1352-491c-be0c-61f47ebc4451 2025-10-08 17:30:45,697 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9f09ae89-1352-491c-be0c-61f47ebc4451 2025-10-08 17:30:45,706 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c131a11e-b860-49b7-828b-941763e60eae 2025-10-08 17:30:45,715 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c131a11e-b860-49b7-828b-941763e60eae 2025-10-08 17:30:45,723 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/840d374e-9715-4c0e-85e0-2a40a0d08470 2025-10-08 17:30:45,730 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 17:30:45,730 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9f09ae89-1352-491c-be0c-61f47ebc4451 2025-10-08 17:30:45,738 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c131a11e-b860-49b7-828b-941763e60eae 2025-10-08 17:30:45,755 - INFO - Verified VN network id 15 for VN 9f09ae89-1352-491c-be0c-61f47ebc4451 2025-10-08 17:30:45,756 - INFO - Verifications in API Server for VN ctest-right_vn-64273286 passed 2025-10-08 17:30:45,756 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9f09ae89-1352-491c-be0c-61f47ebc4451 2025-10-08 17:30:45,766 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c131a11e-b860-49b7-828b-941763e60eae 2025-10-08 17:30:45,773 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c131a11e-b860-49b7-828b-941763e60eae 2025-10-08 17:30:45,783 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/840d374e-9715-4c0e-85e0-2a40a0d08470 2025-10-08 17:30:45,795 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11459882630578850076', 'uuid-lslong': '13694428269653017681'}, 'enable': 'true', 'created': '2025-10-08T17:30:45', 'last-modified': '2025-10-08T17:30:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.382380'} 2025-10-08 17:30:45,799 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 17:30:45,806 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11459882630578850076', 'uuid-lslong': '13694428269653017681'}, 'enable': 'true', 'created': '2025-10-08T17:30:45', 'last-modified': '2025-10-08T17:30:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.391185'} 2025-10-08 17:30:45,816 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 17:30:45,822 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11459882630578850076', 'uuid-lslong': '13694428269653017681'}, 'enable': 'true', 'created': '2025-10-08T17:30:45', 'last-modified': '2025-10-08T17:30:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.409122'} 2025-10-08 17:30:45,828 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-08 17:30:45,828 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-64273286 passed 2025-10-08 17:30:45,828 - DEBUG - ====Verifying policy data for ctest-right_vn-64273286 in API_Server ====== 2025-10-08 17:30:45,828 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:45,834 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:45,846 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:46,160 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9f09ae89-1352-491c-be0c-61f47ebc4451 2025-10-08 17:30:46,178 - DEBUG - =>VN ctest-right_vn-64273286 has no policy to be verified 2025-10-08 17:30:46,178 - DEBUG - Verifying the vn in opserver 2025-10-08 17:30:46,178 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286 virtual network link through opserver 10.0.0.56 2025-10-08 17:30:46,178 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-08 17:30:46,190 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286?flat'} 2025-10-08 17:30:46,190 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286 virtual network link through opserver 10.0.0.249 2025-10-08 17:30:46,190 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-08 17:30:46,424 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286?flat'} 2025-10-08 17:30:46,424 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286 virtual network link through opserver 10.0.0.41 2025-10-08 17:30:46,424 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-08 17:30:46,439 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286?flat'} 2025-10-08 17:30:46,440 - INFO - Validated that VN default-domain:ctest-TestSvcHC-49682729:ctest-right_vn-64273286 is found in opserver 2025-10-08 17:30:46,464 - DEBUG - Do not have enough data to verify VN in agent 2025-10-08 17:30:46,476 - DEBUG - VRF ids for VN ctest-right_vn-64273286: {} 2025-10-08 17:30:46,734 - DEBUG - Response for create_network : {'network': {'id': 'f7d07f2c-9cf6-47e8-8235-3321a8780d85', 'name': 'ctest-trans_left_vn-34552798', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'project_id': '360992cd51404ec5b1890fd9b5e83d5e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-49682729', 'ctest-trans_left_vn-34552798'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 17:30:46,940 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd0f9a5d1-4450-4dfd-b983-9f6869fff2d6', 'name': '', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'network_id': 'f7d07f2c-9cf6-47e8-8235-3321a8780d85', 'ip_version': 4, 'cidr': '218.62.198.64/26', 'allocation_pools': [{'start': '218.62.198.66', 'end': '218.62.198.126'}], 'gateway_ip': '218.62.198.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '218.62.198.66', 'tags': [], 'project_id': '360992cd51404ec5b1890fd9b5e83d5e'}} 2025-10-08 17:30:46,966 - INFO - Created VN ctest-trans_left_vn-34552798 2025-10-08 17:30:46,985 - DEBUG - VN ctest-trans_left_vn-34552798 UUID is f7d07f2c-9cf6-47e8-8235-3321a8780d85 2025-10-08 17:30:47,085 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:47,095 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:47,107 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:47,419 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f7d07f2c-9cf6-47e8-8235-3321a8780d85 2025-10-08 17:30:47,440 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f7d07f2c-9cf6-47e8-8235-3321a8780d85 2025-10-08 17:30:47,451 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a79e9e0-61a4-40b1-97b9-614dc27528c0 2025-10-08 17:30:47,459 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a79e9e0-61a4-40b1-97b9-614dc27528c0 2025-10-08 17:30:47,465 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8b2f12c5-b5dd-4079-b80c-d6f1a5d13455 2025-10-08 17:30:47,473 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-08 17:30:47,473 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f7d07f2c-9cf6-47e8-8235-3321a8780d85 2025-10-08 17:30:47,482 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a79e9e0-61a4-40b1-97b9-614dc27528c0 2025-10-08 17:30:47,500 - INFO - Verified VN network id 16 for VN f7d07f2c-9cf6-47e8-8235-3321a8780d85 2025-10-08 17:30:47,500 - INFO - Verifications in API Server for VN ctest-trans_left_vn-34552798 passed 2025-10-08 17:30:47,500 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f7d07f2c-9cf6-47e8-8235-3321a8780d85 2025-10-08 17:30:47,509 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a79e9e0-61a4-40b1-97b9-614dc27528c0 2025-10-08 17:30:47,515 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a79e9e0-61a4-40b1-97b9-614dc27528c0 2025-10-08 17:30:47,521 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/8b2f12c5-b5dd-4079-b80c-d6f1a5d13455 2025-10-08 17:30:47,535 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17856912352112691176', 'uuid-lslong': '9382461618349673861'}, 'enable': 'true', 'created': '2025-10-08T17:30:46', 'last-modified': '2025-10-08T17:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.654369'} 2025-10-08 17:30:47,540 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-08 17:30:47,548 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17856912352112691176', 'uuid-lslong': '9382461618349673861'}, 'enable': 'true', 'created': '2025-10-08T17:30:46', 'last-modified': '2025-10-08T17:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.667770'} 2025-10-08 17:30:47,556 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-08 17:30:47,564 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17856912352112691176', 'uuid-lslong': '9382461618349673861'}, 'enable': 'true', 'created': '2025-10-08T17:30:46', 'last-modified': '2025-10-08T17:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.680662'} 2025-10-08 17:30:47,572 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-08 17:30:47,572 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-34552798 passed 2025-10-08 17:30:47,572 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-34552798 in API_Server ====== 2025-10-08 17:30:47,572 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:47,578 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:47,588 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:47,922 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f7d07f2c-9cf6-47e8-8235-3321a8780d85 2025-10-08 17:30:47,932 - DEBUG - =>VN ctest-trans_left_vn-34552798 has no policy to be verified 2025-10-08 17:30:47,932 - DEBUG - Verifying the vn in opserver 2025-10-08 17:30:47,932 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798 virtual network link through opserver 10.0.0.56 2025-10-08 17:30:47,932 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-08 17:30:47,947 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798?flat'} 2025-10-08 17:30:47,947 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798 virtual network link through opserver 10.0.0.249 2025-10-08 17:30:47,947 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-08 17:30:47,960 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798?flat'} 2025-10-08 17:30:47,960 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798 virtual network link through opserver 10.0.0.41 2025-10-08 17:30:47,960 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-08 17:30:47,980 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798?flat'} 2025-10-08 17:30:47,980 - INFO - Validated that VN default-domain:ctest-TestSvcHC-49682729:ctest-trans_left_vn-34552798 is found in opserver 2025-10-08 17:30:48,011 - DEBUG - Do not have enough data to verify VN in agent 2025-10-08 17:30:48,028 - DEBUG - VRF ids for VN ctest-trans_left_vn-34552798: {} 2025-10-08 17:30:48,314 - DEBUG - Response for create_network : {'network': {'id': 'fc414fc2-1d2a-47c0-afa7-e0ffe7dd6766', 'name': 'ctest-trans_right_vn-18626523', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'project_id': '360992cd51404ec5b1890fd9b5e83d5e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-49682729', 'ctest-trans_right_vn-18626523'], 'port_security_enabled': True, 'description': ''}} 2025-10-08 17:30:48,825 - DEBUG - Response for create_subnet : {'subnet': {'id': '1320a8f6-e60a-48a9-817d-539f6f92b8fa', 'name': '', 'tenant_id': '360992cd51404ec5b1890fd9b5e83d5e', 'network_id': 'fc414fc2-1d2a-47c0-afa7-e0ffe7dd6766', 'ip_version': 4, 'cidr': '30.71.115.64/26', 'allocation_pools': [{'start': '30.71.115.66', 'end': '30.71.115.126'}], 'gateway_ip': '30.71.115.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.71.115.66', 'tags': [], 'project_id': '360992cd51404ec5b1890fd9b5e83d5e'}} 2025-10-08 17:30:48,850 - INFO - Created VN ctest-trans_right_vn-18626523 2025-10-08 17:30:48,866 - DEBUG - VN ctest-trans_right_vn-18626523 UUID is fc414fc2-1d2a-47c0-afa7-e0ffe7dd6766 2025-10-08 17:30:48,966 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:48,972 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:48,984 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:49,083 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/fc414fc2-1d2a-47c0-afa7-e0ffe7dd6766 2025-10-08 17:30:49,095 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/fc414fc2-1d2a-47c0-afa7-e0ffe7dd6766 2025-10-08 17:30:49,103 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7ff19a48-37b2-46ad-b2c1-5137d9ae1772 2025-10-08 17:30:49,111 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7ff19a48-37b2-46ad-b2c1-5137d9ae1772 2025-10-08 17:30:49,120 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/6dc37d16-fad1-4d1e-91f6-59325cad7122 2025-10-08 17:30:49,125 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-08 17:30:49,125 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/fc414fc2-1d2a-47c0-afa7-e0ffe7dd6766 2025-10-08 17:30:49,134 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7ff19a48-37b2-46ad-b2c1-5137d9ae1772 2025-10-08 17:30:49,150 - INFO - Verified VN network id 17 for VN fc414fc2-1d2a-47c0-afa7-e0ffe7dd6766 2025-10-08 17:30:49,150 - INFO - Verifications in API Server for VN ctest-trans_right_vn-18626523 passed 2025-10-08 17:30:49,150 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/fc414fc2-1d2a-47c0-afa7-e0ffe7dd6766 2025-10-08 17:30:49,158 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7ff19a48-37b2-46ad-b2c1-5137d9ae1772 2025-10-08 17:30:49,165 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7ff19a48-37b2-46ad-b2c1-5137d9ae1772 2025-10-08 17:30:49,173 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/6dc37d16-fad1-4d1e-91f6-59325cad7122 2025-10-08 17:30:49,185 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18176897266175592384', 'uuid-lslong': '12657332667459397478'}, 'enable': 'true', 'created': '2025-10-08T17:30:48', 'last-modified': '2025-10-08T17:30:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420279'} 2025-10-08 17:30:49,190 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-08 17:30:49,195 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18176897266175592384', 'uuid-lslong': '12657332667459397478'}, 'enable': 'true', 'created': '2025-10-08T17:30:48', 'last-modified': '2025-10-08T17:30:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426224'} 2025-10-08 17:30:49,203 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-08 17:30:49,208 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-49682729', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18176897266175592384', 'uuid-lslong': '12657332667459397478'}, 'enable': 'true', 'created': '2025-10-08T17:30:48', 'last-modified': '2025-10-08T17:30:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443160'} 2025-10-08 17:30:49,214 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-08 17:30:49,214 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-18626523 passed 2025-10-08 17:30:49,214 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-18626523 in API_Server ====== 2025-10-08 17:30:49,214 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:49,221 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:49,231 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:49,337 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/fc414fc2-1d2a-47c0-afa7-e0ffe7dd6766 2025-10-08 17:30:49,348 - DEBUG - =>VN ctest-trans_right_vn-18626523 has no policy to be verified 2025-10-08 17:30:49,348 - DEBUG - Verifying the vn in opserver 2025-10-08 17:30:49,348 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523 virtual network link through opserver 10.0.0.56 2025-10-08 17:30:49,348 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-08 17:30:49,361 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523?flat'} 2025-10-08 17:30:49,361 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523 virtual network link through opserver 10.0.0.249 2025-10-08 17:30:49,361 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-08 17:30:49,376 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523?flat'} 2025-10-08 17:30:49,376 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523 virtual network link through opserver 10.0.0.41 2025-10-08 17:30:49,376 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-08 17:30:49,391 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523?flat'} 2025-10-08 17:30:49,391 - INFO - Validated that VN default-domain:ctest-TestSvcHC-49682729:ctest-trans_right_vn-18626523 is found in opserver 2025-10-08 17:30:49,414 - DEBUG - Do not have enough data to verify VN in agent 2025-10-08 17:30:49,425 - DEBUG - VRF ids for VN ctest-trans_right_vn-18626523: {} 2025-10-08 17:30:50,417 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4239-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4239-2) 2025-10-08 17:30:51,726 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4239-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4239-1) 2025-10-08 17:30:51,726 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-62910184'] 2025-10-08 17:30:52,070 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-62910184'] created succesfully 2025-10-08 17:30:52,581 - DEBUG - Image by name tiny_trans_fw not found 2025-10-08 17:30:52,581 - DEBUG - Installing image tiny_trans_fw 2025-10-08 17:30:52,581 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-10-08 17:30:52,581 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-08 17:30:52,581 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-08 17:30:52,582 - DEBUG - Unzip image 2025-10-08 17:30:52,582 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-08 17:30:52,599 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-10-08 17:30:52,599 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-62910184'] 2025-10-08 17:30:52,907 - INFO - Service template: ['default-domain', 'ctest-service_template_1-62910184'] deleted successfully. 2025-10-08 17:30:52,907 - INFO - Skip interface_detach for VM ctest-right_vm-18221835 in state BUILD 2025-10-08 17:30:52,907 - INFO - Deleting VM ctest-right_vm-18221835 2025-10-08 17:30:52,907 - ERROR - VM ctest-right_vm-18221835 has failed to come up 2025-10-08 17:30:52,907 - ERROR - Nova failed to get host of the VM 2025-10-08 17:30:52,907 - ERROR - VM ctest-right_vm-18221835 has failed to come up 2025-10-08 17:30:52,907 - ERROR - Nova failed to get host of the VM 2025-10-08 17:30:53,050 - INFO - Skip interface_detach for VM ctest-left_vm-85725809 in state BUILD 2025-10-08 17:30:53,051 - INFO - Deleting VM ctest-left_vm-85725809 2025-10-08 17:30:53,051 - ERROR - VM ctest-left_vm-85725809 has failed to come up 2025-10-08 17:30:53,051 - ERROR - Nova failed to get host of the VM 2025-10-08 17:30:53,051 - ERROR - VM ctest-left_vm-85725809 has failed to come up 2025-10-08 17:30:53,051 - ERROR - Nova failed to get host of the VM 2025-10-08 17:30:53,141 - INFO - Deleting VN ctest-trans_right_vn-18626523 2025-10-08 17:30:53,510 - DEBUG - Response for deleting network () 2025-10-08 17:30:53,510 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/7ff19a48-37b2-46ad-b2c1-5137d9ae1772 2025-10-08 17:30:53,515 - DEBUG - Response Code: 404 2025-10-08 17:30:53,516 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:53,526 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:53,545 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:53,636 - INFO - Validated that VN ctest-trans_right_vn-18626523 is not found in API Server 2025-10-08 17:30:53,663 - DEBUG - VN ctest-trans_right_vn-18626523 is not present in Agent 10.0.0.33 2025-10-08 17:30:53,679 - DEBUG - VN ctest-trans_right_vn-18626523 is not present in Agent 10.0.0.19 2025-10-08 17:30:53,679 - INFO - Validated that VN ctest-trans_right_vn-18626523 is not in any agent 2025-10-08 17:30:53,720 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-18626523 info 2025-10-08 17:30:53,721 - INFO - Deleting VN ctest-trans_left_vn-34552798 2025-10-08 17:30:53,946 - DEBUG - Response for deleting network () 2025-10-08 17:30:53,946 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/6a79e9e0-61a4-40b1-97b9-614dc27528c0 2025-10-08 17:30:53,955 - DEBUG - Response Code: 404 2025-10-08 17:30:53,955 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:53,962 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:53,975 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:54,077 - INFO - Validated that VN ctest-trans_left_vn-34552798 is not found in API Server 2025-10-08 17:30:54,101 - DEBUG - VN ctest-trans_left_vn-34552798 is not present in Agent 10.0.0.33 2025-10-08 17:30:54,116 - DEBUG - VN ctest-trans_left_vn-34552798 is not present in Agent 10.0.0.19 2025-10-08 17:30:54,117 - INFO - Validated that VN ctest-trans_left_vn-34552798 is not in any agent 2025-10-08 17:30:54,158 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-34552798 info 2025-10-08 17:30:54,158 - INFO - Deleting VN ctest-right_vn-64273286 2025-10-08 17:30:54,197 - DEBUG - VN 9f09ae89-1352-491c-be0c-61f47ebc4451 still in use: Unable to complete operation on network 9f09ae89-1352-491c-be0c-61f47ebc4451. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-3e47691c-6d1f-4175-a08d-88bbc8ba9039'] 2025-10-08 17:30:54,197 - WARNING - Deleting VN ctest-right_vn-64273286 failed..Will retry 2025-10-08 17:30:56,370 - DEBUG - Response for deleting network () 2025-10-08 17:30:56,370 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c131a11e-b860-49b7-828b-941763e60eae 2025-10-08 17:30:56,384 - DEBUG - Response Code: 404 2025-10-08 17:30:56,384 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:56,392 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:56,406 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:56,518 - INFO - Validated that VN ctest-right_vn-64273286 is not found in API Server 2025-10-08 17:30:56,531 - DEBUG - VN ctest-right_vn-64273286 is not present in Agent 10.0.0.33 2025-10-08 17:30:56,544 - DEBUG - VN ctest-right_vn-64273286 is not present in Agent 10.0.0.19 2025-10-08 17:30:56,544 - INFO - Validated that VN ctest-right_vn-64273286 is not in any agent 2025-10-08 17:30:56,584 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-64273286 info 2025-10-08 17:30:56,584 - INFO - Deleting VN ctest-left_vn-81572607 2025-10-08 17:30:56,805 - DEBUG - Response for deleting network () 2025-10-08 17:30:56,805 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/62fbe1d9-8f9c-444c-8e8f-3f37d83fc442 2025-10-08 17:30:56,816 - DEBUG - Response Code: 404 2025-10-08 17:30:56,817 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:56,823 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:56,878 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:56,986 - INFO - Validated that VN ctest-left_vn-81572607 is not found in API Server 2025-10-08 17:30:56,998 - DEBUG - VN ctest-left_vn-81572607 is not present in Agent 10.0.0.33 2025-10-08 17:30:57,012 - DEBUG - VN ctest-left_vn-81572607 is not present in Agent 10.0.0.19 2025-10-08 17:30:57,012 - INFO - Validated that VN ctest-left_vn-81572607 is not in any agent 2025-10-08 17:30:57,045 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-81572607 info 2025-10-08 17:30:57,046 - INFO - Deleting VN ctest-mgmt_vn-00356324 2025-10-08 17:30:57,433 - DEBUG - Response for deleting network () 2025-10-08 17:30:57,434 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/79213be2-37e5-4057-8739-d3426c43a247 2025-10-08 17:30:57,440 - DEBUG - Response Code: 404 2025-10-08 17:30:57,440 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-08 17:30:57,447 - DEBUG - Requesting: http://10.0.0.56:8082/domain/1d11f468-2e8f-4a79-a987-f452a249cd6b 2025-10-08 17:30:57,475 - DEBUG - Requesting: http://10.0.0.56:8082/project/360992cd-5140-4ec5-b189-0fd9b5e83d5e 2025-10-08 17:30:57,562 - INFO - Validated that VN ctest-mgmt_vn-00356324 is not found in API Server 2025-10-08 17:30:57,573 - DEBUG - VN ctest-mgmt_vn-00356324 is not present in Agent 10.0.0.33 2025-10-08 17:30:57,586 - DEBUG - VN ctest-mgmt_vn-00356324 is not present in Agent 10.0.0.19 2025-10-08 17:30:57,586 - INFO - Validated that VN ctest-mgmt_vn-00356324 is not in any agent 2025-10-08 17:30:57,620 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-00356324 info 2025-10-08 17:30:59,113 - DEBUG - No XMPP flaps were noticed during the test 2025-10-08 17:30:59,113 - INFO - 2025-10-08 17:30:59,113 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:19] 2025-10-08 17:30:59,113 - INFO - -------------------------------------------------------------------------------- 2025-10-08 17:30:59,792 - INFO - Deleted project: ctest-TestSvcHC-49682729, ID : 360992cd-5140-4ec5-b189-0fd9b5e83d5e