2026-05-11 03:25:27,232 - INFO - Domain Default found not creating 2026-05-11 03:25:27,397 - INFO - Project ctest-TestSvcHC-90890178 not found, creating it 2026-05-11 03:25:27,978 - INFO - Created Project:ctest-TestSvcHC-90890178, ID : c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:29,521 - INFO - ================================================================================ 2026-05-11 03:25:29,522 - INFO - STARTING TEST : test_svc_hc_basic 2026-05-11 03:25:30,814 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.129': '0', '10.20.0.193': '0'}, '10.0.0.240': {'10.20.0.129': '0', '10.20.0.18': '0'}} with 2026-05-11 03:25:30,815 - INFO - Initial checks done. Running the testcase now 2026-05-11 03:25:30,815 - INFO - 2026-05-11 03:25:31,760 - DEBUG - Response for create_network : {'network': {'id': '7c1e27ad-54cf-4d2e-b199-c50ed27af81c', 'name': 'ctest-mgmt_vn-30021584', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'project_id': 'c68b2ee651534e45a5b4a25002161bdb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-90890178', 'ctest-mgmt_vn-30021584'], 'port_security_enabled': True, 'description': ''}} 2026-05-11 03:25:32,030 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b890d224-fe6e-4065-b8f4-12ff5784a44b', 'name': '', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'network_id': '7c1e27ad-54cf-4d2e-b199-c50ed27af81c', 'ip_version': 4, 'cidr': '66.9.67.128/26', 'allocation_pools': [{'start': '66.9.67.130', 'end': '66.9.67.190'}], 'gateway_ip': '66.9.67.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '66.9.67.130', 'tags': [], 'project_id': 'c68b2ee651534e45a5b4a25002161bdb'}} 2026-05-11 03:25:32,052 - INFO - Created VN ctest-mgmt_vn-30021584 2026-05-11 03:25:32,063 - DEBUG - VN ctest-mgmt_vn-30021584 UUID is 7c1e27ad-54cf-4d2e-b199-c50ed27af81c 2026-05-11 03:25:32,144 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:32,438 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:32,474 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:32,489 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:32,582 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/7c1e27ad-54cf-4d2e-b199-c50ed27af81c 2026-05-11 03:25:32,604 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/7c1e27ad-54cf-4d2e-b199-c50ed27af81c 2026-05-11 03:25:32,616 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/082a96d0-47cf-4fd2-a6a1-e47855ecaa6b 2026-05-11 03:25:32,626 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/082a96d0-47cf-4fd2-a6a1-e47855ecaa6b 2026-05-11 03:25:32,634 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/aedc1ce7-3c1f-47ca-953c-50d792b98d1b 2026-05-11 03:25:32,641 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 03:25:32,641 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/7c1e27ad-54cf-4d2e-b199-c50ed27af81c 2026-05-11 03:25:32,653 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/082a96d0-47cf-4fd2-a6a1-e47855ecaa6b 2026-05-11 03:25:32,670 - INFO - Verified VN network id 15 for VN 7c1e27ad-54cf-4d2e-b199-c50ed27af81c 2026-05-11 03:25:32,671 - INFO - Verifications in API Server for VN ctest-mgmt_vn-30021584 passed 2026-05-11 03:25:32,671 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/7c1e27ad-54cf-4d2e-b199-c50ed27af81c 2026-05-11 03:25:32,681 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/082a96d0-47cf-4fd2-a6a1-e47855ecaa6b 2026-05-11 03:25:32,689 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/082a96d0-47cf-4fd2-a6a1-e47855ecaa6b 2026-05-11 03:25:32,697 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/aedc1ce7-3c1f-47ca-953c-50d792b98d1b 2026-05-11 03:25:32,708 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8943629535410081070', 'uuid-lslong': '12797476483601463324'}, 'enable': 'true', 'created': '2026-05-11T03:25:31', 'last-modified': '2026-05-11T03:25:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.748090'} 2026-05-11 03:25:32,714 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 03:25:32,721 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8943629535410081070', 'uuid-lslong': '12797476483601463324'}, 'enable': 'true', 'created': '2026-05-11T03:25:31', 'last-modified': '2026-05-11T03:25:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.758884'} 2026-05-11 03:25:32,728 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 03:25:32,733 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8943629535410081070', 'uuid-lslong': '12797476483601463324'}, 'enable': 'true', 'created': '2026-05-11T03:25:31', 'last-modified': '2026-05-11T03:25:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.768757'} 2026-05-11 03:25:32,741 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 03:25:32,741 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-30021584 passed 2026-05-11 03:25:32,741 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-30021584 in API_Server ====== 2026-05-11 03:25:32,741 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:32,747 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:32,759 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:32,845 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/7c1e27ad-54cf-4d2e-b199-c50ed27af81c 2026-05-11 03:25:32,857 - DEBUG - =>VN ctest-mgmt_vn-30021584 has no policy to be verified 2026-05-11 03:25:32,857 - DEBUG - Verifying the vn in opserver 2026-05-11 03:25:32,857 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584 virtual network link through opserver 10.0.0.141 2026-05-11 03:25:32,858 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 03:25:33,154 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 03:25:33,217 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584?flat'} 2026-05-11 03:25:33,217 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584 virtual network link through opserver 10.0.0.249 2026-05-11 03:25:33,217 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 03:25:33,517 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 03:25:33,583 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584?flat'} 2026-05-11 03:25:33,583 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584 virtual network link through opserver 10.0.0.27 2026-05-11 03:25:33,583 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 03:25:33,885 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 03:25:33,968 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584?flat'} 2026-05-11 03:25:33,968 - INFO - Validated that VN default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-30021584 is found in opserver 2026-05-11 03:25:33,992 - DEBUG - Do not have enough data to verify VN in agent 2026-05-11 03:25:34,005 - DEBUG - VRF ids for VN ctest-mgmt_vn-30021584: {} 2026-05-11 03:25:34,288 - DEBUG - Response for create_network : {'network': {'id': 'ed4313bb-3053-4dac-a649-860eb5d1b9fd', 'name': 'ctest-left_vn-28368904', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'project_id': 'c68b2ee651534e45a5b4a25002161bdb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-90890178', 'ctest-left_vn-28368904'], 'port_security_enabled': True, 'description': ''}} 2026-05-11 03:25:34,579 - DEBUG - Response for create_subnet : {'subnet': {'id': '77b60279-867e-4683-93ba-f609f9d1cb0c', 'name': '', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'network_id': 'ed4313bb-3053-4dac-a649-860eb5d1b9fd', 'ip_version': 4, 'cidr': '219.124.210.128/26', 'allocation_pools': [{'start': '219.124.210.130', 'end': '219.124.210.190'}], 'gateway_ip': '219.124.210.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '219.124.210.130', 'tags': [], 'project_id': 'c68b2ee651534e45a5b4a25002161bdb'}} 2026-05-11 03:25:34,599 - INFO - Created VN ctest-left_vn-28368904 2026-05-11 03:25:34,611 - DEBUG - VN ctest-left_vn-28368904 UUID is ed4313bb-3053-4dac-a649-860eb5d1b9fd 2026-05-11 03:25:34,687 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:34,694 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:34,707 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:34,817 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/ed4313bb-3053-4dac-a649-860eb5d1b9fd 2026-05-11 03:25:34,828 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/ed4313bb-3053-4dac-a649-860eb5d1b9fd 2026-05-11 03:25:34,838 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/598f8972-ad67-4bbd-a7e8-fd968d97aa8b 2026-05-11 03:25:34,847 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/598f8972-ad67-4bbd-a7e8-fd968d97aa8b 2026-05-11 03:25:34,855 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/59ee6a06-1262-4fd5-add3-fdd55a64084c 2026-05-11 03:25:34,861 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 03:25:34,862 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/ed4313bb-3053-4dac-a649-860eb5d1b9fd 2026-05-11 03:25:34,871 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/598f8972-ad67-4bbd-a7e8-fd968d97aa8b 2026-05-11 03:25:34,886 - INFO - Verified VN network id 16 for VN ed4313bb-3053-4dac-a649-860eb5d1b9fd 2026-05-11 03:25:34,886 - INFO - Verifications in API Server for VN ctest-left_vn-28368904 passed 2026-05-11 03:25:34,886 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/ed4313bb-3053-4dac-a649-860eb5d1b9fd 2026-05-11 03:25:34,898 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/598f8972-ad67-4bbd-a7e8-fd968d97aa8b 2026-05-11 03:25:34,910 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/598f8972-ad67-4bbd-a7e8-fd968d97aa8b 2026-05-11 03:25:34,921 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/59ee6a06-1262-4fd5-add3-fdd55a64084c 2026-05-11 03:25:34,934 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17096530305119112620', 'uuid-lslong': '11982255681334000125'}, 'enable': 'true', 'created': '2026-05-11T03:25:34', 'last-modified': '2026-05-11T03:25:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.407791'} 2026-05-11 03:25:34,940 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 03:25:34,948 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17096530305119112620', 'uuid-lslong': '11982255681334000125'}, 'enable': 'true', 'created': '2026-05-11T03:25:34', 'last-modified': '2026-05-11T03:25:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.429055'} 2026-05-11 03:25:34,954 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 03:25:34,961 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17096530305119112620', 'uuid-lslong': '11982255681334000125'}, 'enable': 'true', 'created': '2026-05-11T03:25:34', 'last-modified': '2026-05-11T03:25:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444058'} 2026-05-11 03:25:34,967 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 03:25:34,967 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-28368904 passed 2026-05-11 03:25:34,967 - DEBUG - ====Verifying policy data for ctest-left_vn-28368904 in API_Server ====== 2026-05-11 03:25:34,968 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:34,973 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:34,984 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:35,087 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/ed4313bb-3053-4dac-a649-860eb5d1b9fd 2026-05-11 03:25:35,104 - DEBUG - =>VN ctest-left_vn-28368904 has no policy to be verified 2026-05-11 03:25:35,104 - DEBUG - Verifying the vn in opserver 2026-05-11 03:25:35,104 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904 virtual network link through opserver 10.0.0.141 2026-05-11 03:25:35,104 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 03:25:35,173 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904?flat'} 2026-05-11 03:25:35,173 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904 virtual network link through opserver 10.0.0.249 2026-05-11 03:25:35,173 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 03:25:35,240 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904?flat'} 2026-05-11 03:25:35,240 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904 virtual network link through opserver 10.0.0.27 2026-05-11 03:25:35,240 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 03:25:35,302 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904?flat'} 2026-05-11 03:25:35,302 - INFO - Validated that VN default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-28368904 is found in opserver 2026-05-11 03:25:35,327 - DEBUG - Do not have enough data to verify VN in agent 2026-05-11 03:25:35,339 - DEBUG - VRF ids for VN ctest-left_vn-28368904: {} 2026-05-11 03:25:35,652 - DEBUG - Response for create_network : {'network': {'id': 'f4c18bf5-ce36-46f5-9a79-7b361854b44d', 'name': 'ctest-right_vn-89058635', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'project_id': 'c68b2ee651534e45a5b4a25002161bdb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-90890178', 'ctest-right_vn-89058635'], 'port_security_enabled': True, 'description': ''}} 2026-05-11 03:25:35,922 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ddd289b8-502e-42f6-8a8a-8e5f4e2e4879', 'name': '', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'network_id': 'f4c18bf5-ce36-46f5-9a79-7b361854b44d', 'ip_version': 4, 'cidr': '111.197.6.128/26', 'allocation_pools': [{'start': '111.197.6.130', 'end': '111.197.6.190'}], 'gateway_ip': '111.197.6.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '111.197.6.130', 'tags': [], 'project_id': 'c68b2ee651534e45a5b4a25002161bdb'}} 2026-05-11 03:25:35,948 - INFO - Created VN ctest-right_vn-89058635 2026-05-11 03:25:35,961 - DEBUG - VN ctest-right_vn-89058635 UUID is f4c18bf5-ce36-46f5-9a79-7b361854b44d 2026-05-11 03:25:36,033 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:36,040 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:36,052 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:36,148 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/f4c18bf5-ce36-46f5-9a79-7b361854b44d 2026-05-11 03:25:36,163 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/f4c18bf5-ce36-46f5-9a79-7b361854b44d 2026-05-11 03:25:36,173 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72dd1f89-0168-4f87-9b76-cb7d4723ab85 2026-05-11 03:25:36,184 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72dd1f89-0168-4f87-9b76-cb7d4723ab85 2026-05-11 03:25:36,193 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/72c7d361-842b-4f7b-abbc-b2c4fcf20ee7 2026-05-11 03:25:36,200 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 03:25:36,201 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/f4c18bf5-ce36-46f5-9a79-7b361854b44d 2026-05-11 03:25:36,210 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72dd1f89-0168-4f87-9b76-cb7d4723ab85 2026-05-11 03:25:36,224 - INFO - Verified VN network id 17 for VN f4c18bf5-ce36-46f5-9a79-7b361854b44d 2026-05-11 03:25:36,225 - INFO - Verifications in API Server for VN ctest-right_vn-89058635 passed 2026-05-11 03:25:36,225 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/f4c18bf5-ce36-46f5-9a79-7b361854b44d 2026-05-11 03:25:36,234 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72dd1f89-0168-4f87-9b76-cb7d4723ab85 2026-05-11 03:25:36,242 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72dd1f89-0168-4f87-9b76-cb7d4723ab85 2026-05-11 03:25:36,250 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/72c7d361-842b-4f7b-abbc-b2c4fcf20ee7 2026-05-11 03:25:36,262 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17636531503602484981', 'uuid-lslong': '11131063426289546317'}, 'enable': 'true', 'created': '2026-05-11T03:25:35', 'last-modified': '2026-05-11T03:25:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402085'} 2026-05-11 03:25:36,267 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 03:25:36,275 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17636531503602484981', 'uuid-lslong': '11131063426289546317'}, 'enable': 'true', 'created': '2026-05-11T03:25:35', 'last-modified': '2026-05-11T03:25:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414284'} 2026-05-11 03:25:36,282 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 03:25:36,288 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17636531503602484981', 'uuid-lslong': '11131063426289546317'}, 'enable': 'true', 'created': '2026-05-11T03:25:35', 'last-modified': '2026-05-11T03:25:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426379'} 2026-05-11 03:25:36,295 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 03:25:36,295 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-89058635 passed 2026-05-11 03:25:36,295 - DEBUG - ====Verifying policy data for ctest-right_vn-89058635 in API_Server ====== 2026-05-11 03:25:36,295 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:36,303 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:36,318 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:36,427 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/f4c18bf5-ce36-46f5-9a79-7b361854b44d 2026-05-11 03:25:36,436 - DEBUG - =>VN ctest-right_vn-89058635 has no policy to be verified 2026-05-11 03:25:36,436 - DEBUG - Verifying the vn in opserver 2026-05-11 03:25:36,436 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635 virtual network link through opserver 10.0.0.141 2026-05-11 03:25:36,436 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 03:25:36,498 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635?flat'} 2026-05-11 03:25:36,498 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635 virtual network link through opserver 10.0.0.249 2026-05-11 03:25:36,498 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 03:25:36,560 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635?flat'} 2026-05-11 03:25:36,560 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635 virtual network link through opserver 10.0.0.27 2026-05-11 03:25:36,560 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 03:25:36,625 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635?flat'} 2026-05-11 03:25:36,625 - INFO - Validated that VN default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-89058635 is found in opserver 2026-05-11 03:25:36,645 - DEBUG - Do not have enough data to verify VN in agent 2026-05-11 03:25:36,656 - DEBUG - VRF ids for VN ctest-right_vn-89058635: {} 2026-05-11 03:25:36,791 - DEBUG - Services list from nova: [, , , ] 2026-05-11 03:25:37,925 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5767-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5767-2) 2026-05-11 03:25:39,380 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5767-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5767-1) 2026-05-11 03:25:39,380 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-84005153'] 2026-05-11 03:25:39,676 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-84005153'] created succesfully 2026-05-11 03:25:40,110 - DEBUG - Image by name tiny_nat_fw not found 2026-05-11 03:25:40,111 - DEBUG - Installing image tiny_nat_fw 2026-05-11 03:25:40,111 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-05-11 03:25:40,111 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-05-11 03:25:40,111 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-05-11 03:25:40,111 - DEBUG - Unzip image 2026-05-11 03:25:40,111 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-05-11 03:25:40,143 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2026-05-11 03:25:40,143 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-84005153'] 2026-05-11 03:25:40,249 - INFO - Service template: ['default-domain', 'ctest-service_template_1-84005153'] deleted successfully. 2026-05-11 03:25:40,249 - INFO - Skip interface_detach for VM ctest-right_vm-58155965 in state BUILD 2026-05-11 03:25:40,250 - INFO - Deleting VM ctest-right_vm-58155965 2026-05-11 03:25:40,298 - ERROR - VM ctest-right_vm-58155965 has failed to come up 2026-05-11 03:25:40,299 - ERROR - Nova failed to get host of the VM 2026-05-11 03:25:40,299 - ERROR - VM ctest-right_vm-58155965 has failed to come up 2026-05-11 03:25:40,299 - ERROR - Nova failed to get host of the VM 2026-05-11 03:25:40,377 - INFO - Skip interface_detach for VM ctest-left_vm-98972395 in state BUILD 2026-05-11 03:25:40,378 - INFO - Deleting VM ctest-left_vm-98972395 2026-05-11 03:25:40,378 - ERROR - VM ctest-left_vm-98972395 has failed to come up 2026-05-11 03:25:40,378 - ERROR - Nova failed to get host of the VM 2026-05-11 03:25:40,378 - ERROR - VM ctest-left_vm-98972395 has failed to come up 2026-05-11 03:25:40,378 - ERROR - Nova failed to get host of the VM 2026-05-11 03:25:40,468 - INFO - Deleting VN ctest-right_vn-89058635 2026-05-11 03:25:40,526 - DEBUG - VN f4c18bf5-ce36-46f5-9a79-7b361854b44d still in use: Unable to complete operation on network f4c18bf5-ce36-46f5-9a79-7b361854b44d. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-23821690-91ef-4164-acbc-98c4c4c78194'] 2026-05-11 03:25:40,526 - WARNING - Deleting VN ctest-right_vn-89058635 failed..Will retry 2026-05-11 03:25:42,740 - DEBUG - Response for deleting network () 2026-05-11 03:25:42,741 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72dd1f89-0168-4f87-9b76-cb7d4723ab85 2026-05-11 03:25:42,747 - DEBUG - Response Code: 404 2026-05-11 03:25:42,747 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:42,773 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:42,789 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:42,883 - INFO - Validated that VN ctest-right_vn-89058635 is not found in API Server 2026-05-11 03:25:42,897 - DEBUG - VN ctest-right_vn-89058635 is not present in Agent 10.0.0.23 2026-05-11 03:25:42,907 - DEBUG - VN ctest-right_vn-89058635 is not present in Agent 10.0.0.240 2026-05-11 03:25:42,907 - INFO - Validated that VN ctest-right_vn-89058635 is not in any agent 2026-05-11 03:25:42,939 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-89058635 info 2026-05-11 03:25:42,940 - INFO - Deleting VN ctest-left_vn-28368904 2026-05-11 03:25:43,121 - DEBUG - Response for deleting network () 2026-05-11 03:25:43,121 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/598f8972-ad67-4bbd-a7e8-fd968d97aa8b 2026-05-11 03:25:43,128 - DEBUG - Response Code: 404 2026-05-11 03:25:43,128 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:43,135 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:43,169 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:43,269 - INFO - Validated that VN ctest-left_vn-28368904 is not found in API Server 2026-05-11 03:25:43,282 - DEBUG - VN ctest-left_vn-28368904 is not present in Agent 10.0.0.23 2026-05-11 03:25:43,298 - DEBUG - VN ctest-left_vn-28368904 is not present in Agent 10.0.0.240 2026-05-11 03:25:43,298 - INFO - Validated that VN ctest-left_vn-28368904 is not in any agent 2026-05-11 03:25:43,336 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-28368904 info 2026-05-11 03:25:43,337 - INFO - Deleting VN ctest-mgmt_vn-30021584 2026-05-11 03:25:43,499 - DEBUG - Response for deleting network () 2026-05-11 03:25:43,499 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/082a96d0-47cf-4fd2-a6a1-e47855ecaa6b 2026-05-11 03:25:43,506 - DEBUG - Response Code: 404 2026-05-11 03:25:43,506 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:43,515 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:43,541 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:43,642 - INFO - Validated that VN ctest-mgmt_vn-30021584 is not found in API Server 2026-05-11 03:25:43,657 - DEBUG - VN ctest-mgmt_vn-30021584 is not present in Agent 10.0.0.23 2026-05-11 03:25:43,671 - DEBUG - VN ctest-mgmt_vn-30021584 is not present in Agent 10.0.0.240 2026-05-11 03:25:43,671 - INFO - Validated that VN ctest-mgmt_vn-30021584 is not in any agent 2026-05-11 03:25:43,709 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-30021584 info 2026-05-11 03:25:45,024 - DEBUG - No XMPP flaps were noticed during the test 2026-05-11 03:25:45,024 - INFO -
2026-05-11 03:25:45,025 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:16]
2026-05-11 03:25:45,025 - INFO - -------------------------------------------------------------------------------- 2026-05-11 03:25:45,029 - INFO - ================================================================================ 2026-05-11 03:25:45,029 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2026-05-11 03:25:46,329 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.129': '0', '10.20.0.193': '0'}, '10.0.0.240': {'10.20.0.129': '0', '10.20.0.18': '0'}} with 2026-05-11 03:25:46,329 - INFO - Initial checks done. Running the testcase now 2026-05-11 03:25:46,329 - INFO - 2026-05-11 03:25:46,591 - DEBUG - Response for create_network : {'network': {'id': 'e262ce48-8ce0-4014-b580-b940665c2844', 'name': 'ctest-mgmt_vn-38138223', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'project_id': 'c68b2ee651534e45a5b4a25002161bdb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-90890178', 'ctest-mgmt_vn-38138223'], 'port_security_enabled': True, 'description': ''}} 2026-05-11 03:25:46,878 - DEBUG - Response for create_subnet : {'subnet': {'id': '6cc8647e-eef7-40de-95d4-d06b11fe4905', 'name': '', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'network_id': 'e262ce48-8ce0-4014-b580-b940665c2844', 'ip_version': 4, 'cidr': '3.202.232.192/26', 'allocation_pools': [{'start': '3.202.232.194', 'end': '3.202.232.254'}], 'gateway_ip': '3.202.232.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3.202.232.194', 'tags': [], 'project_id': 'c68b2ee651534e45a5b4a25002161bdb'}} 2026-05-11 03:25:46,903 - INFO - Created VN ctest-mgmt_vn-38138223 2026-05-11 03:25:46,918 - DEBUG - VN ctest-mgmt_vn-38138223 UUID is e262ce48-8ce0-4014-b580-b940665c2844 2026-05-11 03:25:46,998 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:47,008 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:47,020 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:47,116 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/e262ce48-8ce0-4014-b580-b940665c2844 2026-05-11 03:25:47,133 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/e262ce48-8ce0-4014-b580-b940665c2844 2026-05-11 03:25:47,143 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c405b9e2-e595-42cc-984d-7e1b8dbdee23 2026-05-11 03:25:47,153 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c405b9e2-e595-42cc-984d-7e1b8dbdee23 2026-05-11 03:25:47,161 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/e4b3016e-85a1-43ae-b7ed-8e23176d9171 2026-05-11 03:25:47,169 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 03:25:47,170 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/e262ce48-8ce0-4014-b580-b940665c2844 2026-05-11 03:25:47,180 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c405b9e2-e595-42cc-984d-7e1b8dbdee23 2026-05-11 03:25:47,198 - INFO - Verified VN network id 15 for VN e262ce48-8ce0-4014-b580-b940665c2844 2026-05-11 03:25:47,198 - INFO - Verifications in API Server for VN ctest-mgmt_vn-38138223 passed 2026-05-11 03:25:47,198 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/e262ce48-8ce0-4014-b580-b940665c2844 2026-05-11 03:25:47,209 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c405b9e2-e595-42cc-984d-7e1b8dbdee23 2026-05-11 03:25:47,217 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c405b9e2-e595-42cc-984d-7e1b8dbdee23 2026-05-11 03:25:47,225 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/e4b3016e-85a1-43ae-b7ed-8e23176d9171 2026-05-11 03:25:47,238 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16312827611285831700', 'uuid-lslong': '13078657004130281540'}, 'enable': 'true', 'created': '2026-05-11T03:25:46', 'last-modified': '2026-05-11T03:25:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433353'} 2026-05-11 03:25:47,244 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 03:25:47,250 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16312827611285831700', 'uuid-lslong': '13078657004130281540'}, 'enable': 'true', 'created': '2026-05-11T03:25:46', 'last-modified': '2026-05-11T03:25:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.445413'} 2026-05-11 03:25:47,256 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 03:25:47,262 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16312827611285831700', 'uuid-lslong': '13078657004130281540'}, 'enable': 'true', 'created': '2026-05-11T03:25:46', 'last-modified': '2026-05-11T03:25:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.460657'} 2026-05-11 03:25:47,274 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 03:25:47,274 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-38138223 passed 2026-05-11 03:25:47,274 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-38138223 in API_Server ====== 2026-05-11 03:25:47,274 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:47,283 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:47,294 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:47,385 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/e262ce48-8ce0-4014-b580-b940665c2844 2026-05-11 03:25:47,394 - DEBUG - =>VN ctest-mgmt_vn-38138223 has no policy to be verified 2026-05-11 03:25:47,394 - DEBUG - Verifying the vn in opserver 2026-05-11 03:25:47,394 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223 virtual network link through opserver 10.0.0.141 2026-05-11 03:25:47,394 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 03:25:47,406 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223?flat'} 2026-05-11 03:25:47,406 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223 virtual network link through opserver 10.0.0.249 2026-05-11 03:25:47,406 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 03:25:47,419 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223?flat'} 2026-05-11 03:25:47,419 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223 virtual network link through opserver 10.0.0.27 2026-05-11 03:25:47,419 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 03:25:47,433 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223?flat'} 2026-05-11 03:25:47,433 - INFO - Validated that VN default-domain:ctest-TestSvcHC-90890178:ctest-mgmt_vn-38138223 is found in opserver 2026-05-11 03:25:47,456 - DEBUG - Do not have enough data to verify VN in agent 2026-05-11 03:25:47,467 - DEBUG - VRF ids for VN ctest-mgmt_vn-38138223: {} 2026-05-11 03:25:47,795 - DEBUG - Response for create_network : {'network': {'id': '873493df-8f0d-46fb-a327-f2df1fdd65dc', 'name': 'ctest-left_vn-34089788', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'project_id': 'c68b2ee651534e45a5b4a25002161bdb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-90890178', 'ctest-left_vn-34089788'], 'port_security_enabled': True, 'description': ''}} 2026-05-11 03:25:48,152 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cd9b3b55-4d4c-45a0-873d-710c48bc7c2e', 'name': '', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'network_id': '873493df-8f0d-46fb-a327-f2df1fdd65dc', 'ip_version': 4, 'cidr': '203.32.202.128/26', 'allocation_pools': [{'start': '203.32.202.130', 'end': '203.32.202.190'}], 'gateway_ip': '203.32.202.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '203.32.202.130', 'tags': [], 'project_id': 'c68b2ee651534e45a5b4a25002161bdb'}} 2026-05-11 03:25:48,177 - INFO - Created VN ctest-left_vn-34089788 2026-05-11 03:25:48,190 - DEBUG - VN ctest-left_vn-34089788 UUID is 873493df-8f0d-46fb-a327-f2df1fdd65dc 2026-05-11 03:25:48,278 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:48,286 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:48,299 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:48,412 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/873493df-8f0d-46fb-a327-f2df1fdd65dc 2026-05-11 03:25:48,426 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/873493df-8f0d-46fb-a327-f2df1fdd65dc 2026-05-11 03:25:48,438 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/000ecfca-3e39-4859-ac5b-ea0dae9e85a2 2026-05-11 03:25:48,450 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/000ecfca-3e39-4859-ac5b-ea0dae9e85a2 2026-05-11 03:25:48,459 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/562cde33-fcf1-458e-9ab0-d10c807e3742 2026-05-11 03:25:48,467 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 03:25:48,467 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/873493df-8f0d-46fb-a327-f2df1fdd65dc 2026-05-11 03:25:48,477 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/000ecfca-3e39-4859-ac5b-ea0dae9e85a2 2026-05-11 03:25:48,494 - INFO - Verified VN network id 16 for VN 873493df-8f0d-46fb-a327-f2df1fdd65dc 2026-05-11 03:25:48,494 - INFO - Verifications in API Server for VN ctest-left_vn-34089788 passed 2026-05-11 03:25:48,494 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/873493df-8f0d-46fb-a327-f2df1fdd65dc 2026-05-11 03:25:48,505 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/000ecfca-3e39-4859-ac5b-ea0dae9e85a2 2026-05-11 03:25:48,513 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/000ecfca-3e39-4859-ac5b-ea0dae9e85a2 2026-05-11 03:25:48,521 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/562cde33-fcf1-458e-9ab0-d10c807e3742 2026-05-11 03:25:48,533 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9742574482296227579', 'uuid-lslong': '11756632392400201180'}, 'enable': 'true', 'created': '2026-05-11T03:25:47', 'last-modified': '2026-05-11T03:25:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.457807'} 2026-05-11 03:25:48,539 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 03:25:48,545 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9742574482296227579', 'uuid-lslong': '11756632392400201180'}, 'enable': 'true', 'created': '2026-05-11T03:25:47', 'last-modified': '2026-05-11T03:25:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.468103'} 2026-05-11 03:25:48,552 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 03:25:48,559 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9742574482296227579', 'uuid-lslong': '11756632392400201180'}, 'enable': 'true', 'created': '2026-05-11T03:25:47', 'last-modified': '2026-05-11T03:25:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.487926'} 2026-05-11 03:25:48,567 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 03:25:48,567 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-34089788 passed 2026-05-11 03:25:48,568 - DEBUG - ====Verifying policy data for ctest-left_vn-34089788 in API_Server ====== 2026-05-11 03:25:48,568 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:48,575 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:48,588 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:48,689 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/873493df-8f0d-46fb-a327-f2df1fdd65dc 2026-05-11 03:25:48,701 - DEBUG - =>VN ctest-left_vn-34089788 has no policy to be verified 2026-05-11 03:25:48,701 - DEBUG - Verifying the vn in opserver 2026-05-11 03:25:48,701 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788 virtual network link through opserver 10.0.0.141 2026-05-11 03:25:48,701 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 03:25:48,751 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788?flat'} 2026-05-11 03:25:48,751 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788 virtual network link through opserver 10.0.0.249 2026-05-11 03:25:48,751 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 03:25:48,769 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788?flat'} 2026-05-11 03:25:48,769 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788 virtual network link through opserver 10.0.0.27 2026-05-11 03:25:48,769 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 03:25:48,786 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788?flat'} 2026-05-11 03:25:48,787 - INFO - Validated that VN default-domain:ctest-TestSvcHC-90890178:ctest-left_vn-34089788 is found in opserver 2026-05-11 03:25:48,812 - DEBUG - Do not have enough data to verify VN in agent 2026-05-11 03:25:48,824 - DEBUG - VRF ids for VN ctest-left_vn-34089788: {} 2026-05-11 03:25:49,128 - DEBUG - Response for create_network : {'network': {'id': 'fd4da6aa-c36d-409a-a8a9-08aa6530930c', 'name': 'ctest-right_vn-01965673', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'project_id': 'c68b2ee651534e45a5b4a25002161bdb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-90890178', 'ctest-right_vn-01965673'], 'port_security_enabled': True, 'description': ''}} 2026-05-11 03:25:49,356 - DEBUG - Response for create_subnet : {'subnet': {'id': '173a8d58-4860-431c-ae96-81fb66fce5e2', 'name': '', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'network_id': 'fd4da6aa-c36d-409a-a8a9-08aa6530930c', 'ip_version': 4, 'cidr': '111.228.203.128/26', 'allocation_pools': [{'start': '111.228.203.130', 'end': '111.228.203.190'}], 'gateway_ip': '111.228.203.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '111.228.203.130', 'tags': [], 'project_id': 'c68b2ee651534e45a5b4a25002161bdb'}} 2026-05-11 03:25:49,384 - INFO - Created VN ctest-right_vn-01965673 2026-05-11 03:25:49,397 - DEBUG - VN ctest-right_vn-01965673 UUID is fd4da6aa-c36d-409a-a8a9-08aa6530930c 2026-05-11 03:25:49,482 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:49,489 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:49,501 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:49,601 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/fd4da6aa-c36d-409a-a8a9-08aa6530930c 2026-05-11 03:25:49,618 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/fd4da6aa-c36d-409a-a8a9-08aa6530930c 2026-05-11 03:25:49,629 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b3efcc1a-30df-4a1c-9292-302f33159a06 2026-05-11 03:25:49,640 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b3efcc1a-30df-4a1c-9292-302f33159a06 2026-05-11 03:25:49,650 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/e584b788-b7b6-40ef-b1f7-5de03719d6f5 2026-05-11 03:25:49,659 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 03:25:49,659 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/fd4da6aa-c36d-409a-a8a9-08aa6530930c 2026-05-11 03:25:49,670 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b3efcc1a-30df-4a1c-9292-302f33159a06 2026-05-11 03:25:49,688 - INFO - Verified VN network id 17 for VN fd4da6aa-c36d-409a-a8a9-08aa6530930c 2026-05-11 03:25:49,688 - INFO - Verifications in API Server for VN ctest-right_vn-01965673 passed 2026-05-11 03:25:49,688 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/fd4da6aa-c36d-409a-a8a9-08aa6530930c 2026-05-11 03:25:49,700 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b3efcc1a-30df-4a1c-9292-302f33159a06 2026-05-11 03:25:49,708 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b3efcc1a-30df-4a1c-9292-302f33159a06 2026-05-11 03:25:49,717 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/e584b788-b7b6-40ef-b1f7-5de03719d6f5 2026-05-11 03:25:49,731 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18252428117155856538', 'uuid-lslong': '12153254597371138828'}, 'enable': 'true', 'created': '2026-05-11T03:25:49', 'last-modified': '2026-05-11T03:25:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422598'} 2026-05-11 03:25:49,739 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 03:25:49,748 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18252428117155856538', 'uuid-lslong': '12153254597371138828'}, 'enable': 'true', 'created': '2026-05-11T03:25:49', 'last-modified': '2026-05-11T03:25:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.438222'} 2026-05-11 03:25:49,755 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 03:25:49,761 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18252428117155856538', 'uuid-lslong': '12153254597371138828'}, 'enable': 'true', 'created': '2026-05-11T03:25:49', 'last-modified': '2026-05-11T03:25:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.455737'} 2026-05-11 03:25:49,767 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 03:25:49,767 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-01965673 passed 2026-05-11 03:25:49,767 - DEBUG - ====Verifying policy data for ctest-right_vn-01965673 in API_Server ====== 2026-05-11 03:25:49,767 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:49,774 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:49,787 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:49,891 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/fd4da6aa-c36d-409a-a8a9-08aa6530930c 2026-05-11 03:25:49,903 - DEBUG - =>VN ctest-right_vn-01965673 has no policy to be verified 2026-05-11 03:25:49,903 - DEBUG - Verifying the vn in opserver 2026-05-11 03:25:49,903 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673 virtual network link through opserver 10.0.0.141 2026-05-11 03:25:49,903 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 03:25:49,929 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673?flat'} 2026-05-11 03:25:49,929 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673 virtual network link through opserver 10.0.0.249 2026-05-11 03:25:49,929 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 03:25:49,946 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673?flat'} 2026-05-11 03:25:49,946 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673 virtual network link through opserver 10.0.0.27 2026-05-11 03:25:49,946 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 03:25:49,962 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673?flat'} 2026-05-11 03:25:49,963 - INFO - Validated that VN default-domain:ctest-TestSvcHC-90890178:ctest-right_vn-01965673 is found in opserver 2026-05-11 03:25:49,987 - DEBUG - Do not have enough data to verify VN in agent 2026-05-11 03:25:49,998 - DEBUG - VRF ids for VN ctest-right_vn-01965673: {} 2026-05-11 03:25:50,346 - DEBUG - Response for create_network : {'network': {'id': '8383ed54-367e-4d61-ad59-086ce07c91b8', 'name': 'ctest-trans_left_vn-73639367', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'project_id': 'c68b2ee651534e45a5b4a25002161bdb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-90890178', 'ctest-trans_left_vn-73639367'], 'port_security_enabled': True, 'description': ''}} 2026-05-11 03:25:50,626 - DEBUG - Response for create_subnet : {'subnet': {'id': '71ae7667-ef3b-40d9-afb5-ad81a653bbdf', 'name': '', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'network_id': '8383ed54-367e-4d61-ad59-086ce07c91b8', 'ip_version': 4, 'cidr': '124.240.49.64/26', 'allocation_pools': [{'start': '124.240.49.66', 'end': '124.240.49.126'}], 'gateway_ip': '124.240.49.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '124.240.49.66', 'tags': [], 'project_id': 'c68b2ee651534e45a5b4a25002161bdb'}} 2026-05-11 03:25:50,650 - INFO - Created VN ctest-trans_left_vn-73639367 2026-05-11 03:25:50,664 - DEBUG - VN ctest-trans_left_vn-73639367 UUID is 8383ed54-367e-4d61-ad59-086ce07c91b8 2026-05-11 03:25:50,734 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:50,741 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:50,753 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:50,852 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/8383ed54-367e-4d61-ad59-086ce07c91b8 2026-05-11 03:25:50,866 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/8383ed54-367e-4d61-ad59-086ce07c91b8 2026-05-11 03:25:50,882 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3c8be7b8-c4b0-419a-966e-313375d2c735 2026-05-11 03:25:50,891 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3c8be7b8-c4b0-419a-966e-313375d2c735 2026-05-11 03:25:50,901 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/7982f293-af2b-41b6-a3e9-23b96ba15f85 2026-05-11 03:25:50,911 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-11 03:25:50,911 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/8383ed54-367e-4d61-ad59-086ce07c91b8 2026-05-11 03:25:50,926 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3c8be7b8-c4b0-419a-966e-313375d2c735 2026-05-11 03:25:50,947 - INFO - Verified VN network id 18 for VN 8383ed54-367e-4d61-ad59-086ce07c91b8 2026-05-11 03:25:50,947 - INFO - Verifications in API Server for VN ctest-trans_left_vn-73639367 passed 2026-05-11 03:25:50,947 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/8383ed54-367e-4d61-ad59-086ce07c91b8 2026-05-11 03:25:50,958 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3c8be7b8-c4b0-419a-966e-313375d2c735 2026-05-11 03:25:50,967 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3c8be7b8-c4b0-419a-966e-313375d2c735 2026-05-11 03:25:50,975 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/7982f293-af2b-41b6-a3e9-23b96ba15f85 2026-05-11 03:25:50,988 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9476678986864938337', 'uuid-lslong': '12491024305204531640'}, 'enable': 'true', 'created': '2026-05-11T03:25:50', 'last-modified': '2026-05-11T03:25:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419379'} 2026-05-11 03:25:50,993 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-11 03:25:51,000 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9476678986864938337', 'uuid-lslong': '12491024305204531640'}, 'enable': 'true', 'created': '2026-05-11T03:25:50', 'last-modified': '2026-05-11T03:25:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.430127'} 2026-05-11 03:25:51,007 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-11 03:25:51,013 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9476678986864938337', 'uuid-lslong': '12491024305204531640'}, 'enable': 'true', 'created': '2026-05-11T03:25:50', 'last-modified': '2026-05-11T03:25:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.445127'} 2026-05-11 03:25:51,020 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-11 03:25:51,020 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-73639367 passed 2026-05-11 03:25:51,020 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-73639367 in API_Server ====== 2026-05-11 03:25:51,020 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:51,026 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:51,039 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:51,140 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/8383ed54-367e-4d61-ad59-086ce07c91b8 2026-05-11 03:25:51,150 - DEBUG - =>VN ctest-trans_left_vn-73639367 has no policy to be verified 2026-05-11 03:25:51,150 - DEBUG - Verifying the vn in opserver 2026-05-11 03:25:51,150 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367 virtual network link through opserver 10.0.0.141 2026-05-11 03:25:51,150 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 03:25:51,164 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367?flat'} 2026-05-11 03:25:51,164 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367 virtual network link through opserver 10.0.0.249 2026-05-11 03:25:51,164 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 03:25:51,179 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367?flat'} 2026-05-11 03:25:51,179 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367 virtual network link through opserver 10.0.0.27 2026-05-11 03:25:51,180 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 03:25:51,195 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367?flat'} 2026-05-11 03:25:51,195 - INFO - Validated that VN default-domain:ctest-TestSvcHC-90890178:ctest-trans_left_vn-73639367 is found in opserver 2026-05-11 03:25:51,218 - DEBUG - Do not have enough data to verify VN in agent 2026-05-11 03:25:51,231 - DEBUG - VRF ids for VN ctest-trans_left_vn-73639367: {} 2026-05-11 03:25:51,531 - DEBUG - Response for create_network : {'network': {'id': 'c2155ba3-a609-40f6-ba02-79393d8cdaf8', 'name': 'ctest-trans_right_vn-83242767', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'project_id': 'c68b2ee651534e45a5b4a25002161bdb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-90890178', 'ctest-trans_right_vn-83242767'], 'port_security_enabled': True, 'description': ''}} 2026-05-11 03:25:51,794 - DEBUG - Response for create_subnet : {'subnet': {'id': '93e83b9c-4522-4c30-ac95-1a48ed100d62', 'name': '', 'tenant_id': 'c68b2ee651534e45a5b4a25002161bdb', 'network_id': 'c2155ba3-a609-40f6-ba02-79393d8cdaf8', 'ip_version': 4, 'cidr': '72.220.157.64/26', 'allocation_pools': [{'start': '72.220.157.66', 'end': '72.220.157.126'}], 'gateway_ip': '72.220.157.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '72.220.157.66', 'tags': [], 'project_id': 'c68b2ee651534e45a5b4a25002161bdb'}} 2026-05-11 03:25:51,818 - INFO - Created VN ctest-trans_right_vn-83242767 2026-05-11 03:25:51,829 - DEBUG - VN ctest-trans_right_vn-83242767 UUID is c2155ba3-a609-40f6-ba02-79393d8cdaf8 2026-05-11 03:25:51,912 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:51,920 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:51,940 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:52,060 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/c2155ba3-a609-40f6-ba02-79393d8cdaf8 2026-05-11 03:25:52,080 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/c2155ba3-a609-40f6-ba02-79393d8cdaf8 2026-05-11 03:25:52,093 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/852b8c33-42fc-4d56-9b55-14f73335dee2 2026-05-11 03:25:52,105 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/852b8c33-42fc-4d56-9b55-14f73335dee2 2026-05-11 03:25:52,115 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/99f536e4-6782-4221-b29a-d4125fdbd6e1 2026-05-11 03:25:52,124 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-11 03:25:52,124 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/c2155ba3-a609-40f6-ba02-79393d8cdaf8 2026-05-11 03:25:52,136 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/852b8c33-42fc-4d56-9b55-14f73335dee2 2026-05-11 03:25:52,156 - INFO - Verified VN network id 19 for VN c2155ba3-a609-40f6-ba02-79393d8cdaf8 2026-05-11 03:25:52,156 - INFO - Verifications in API Server for VN ctest-trans_right_vn-83242767 passed 2026-05-11 03:25:52,156 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/c2155ba3-a609-40f6-ba02-79393d8cdaf8 2026-05-11 03:25:52,170 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/852b8c33-42fc-4d56-9b55-14f73335dee2 2026-05-11 03:25:52,181 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/852b8c33-42fc-4d56-9b55-14f73335dee2 2026-05-11 03:25:52,190 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/99f536e4-6782-4221-b29a-d4125fdbd6e1 2026-05-11 03:25:52,205 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13985184976292364534', 'uuid-lslong': '13403408727760755448'}, 'enable': 'true', 'created': '2026-05-11T03:25:51', 'last-modified': '2026-05-11T03:25:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.495210'} 2026-05-11 03:25:52,211 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-11 03:25:52,219 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13985184976292364534', 'uuid-lslong': '13403408727760755448'}, 'enable': 'true', 'created': '2026-05-11T03:25:51', 'last-modified': '2026-05-11T03:25:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.508169'} 2026-05-11 03:25:52,227 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-11 03:25:52,234 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-90890178', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13985184976292364534', 'uuid-lslong': '13403408727760755448'}, 'enable': 'true', 'created': '2026-05-11T03:25:51', 'last-modified': '2026-05-11T03:25:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.510533'} 2026-05-11 03:25:52,240 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-11 03:25:52,240 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-83242767 passed 2026-05-11 03:25:52,240 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-83242767 in API_Server ====== 2026-05-11 03:25:52,240 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:52,248 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:52,264 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:52,369 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/c2155ba3-a609-40f6-ba02-79393d8cdaf8 2026-05-11 03:25:52,381 - DEBUG - =>VN ctest-trans_right_vn-83242767 has no policy to be verified 2026-05-11 03:25:52,381 - DEBUG - Verifying the vn in opserver 2026-05-11 03:25:52,381 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767 virtual network link through opserver 10.0.0.141 2026-05-11 03:25:52,381 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 03:25:52,396 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767?flat'} 2026-05-11 03:25:52,396 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767 virtual network link through opserver 10.0.0.249 2026-05-11 03:25:52,396 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 03:25:52,413 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767?flat'} 2026-05-11 03:25:52,413 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767 virtual network link through opserver 10.0.0.27 2026-05-11 03:25:52,413 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 03:25:52,425 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767?flat'} 2026-05-11 03:25:52,425 - INFO - Validated that VN default-domain:ctest-TestSvcHC-90890178:ctest-trans_right_vn-83242767 is found in opserver 2026-05-11 03:25:52,450 - DEBUG - Do not have enough data to verify VN in agent 2026-05-11 03:25:52,466 - DEBUG - VRF ids for VN ctest-trans_right_vn-83242767: {} 2026-05-11 03:25:53,870 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5767-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5767-1) 2026-05-11 03:25:55,500 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5767-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5767-2) 2026-05-11 03:25:55,501 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-79518821'] 2026-05-11 03:25:55,822 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-79518821'] created succesfully 2026-05-11 03:25:56,283 - DEBUG - Image by name tiny_trans_fw not found 2026-05-11 03:25:56,284 - DEBUG - Installing image tiny_trans_fw 2026-05-11 03:25:56,285 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-05-11 03:25:56,286 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-05-11 03:25:56,286 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-05-11 03:25:56,286 - DEBUG - Unzip image 2026-05-11 03:25:56,286 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-05-11 03:25:56,307 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2026-05-11 03:25:56,308 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-79518821'] 2026-05-11 03:25:56,445 - INFO - Service template: ['default-domain', 'ctest-service_template_1-79518821'] deleted successfully. 2026-05-11 03:25:56,445 - INFO - Skip interface_detach for VM ctest-right_vm-06452509 in state BUILD 2026-05-11 03:25:56,445 - INFO - Deleting VM ctest-right_vm-06452509 2026-05-11 03:25:56,445 - ERROR - VM ctest-right_vm-06452509 has failed to come up 2026-05-11 03:25:56,445 - ERROR - Nova failed to get host of the VM 2026-05-11 03:25:56,445 - ERROR - VM ctest-right_vm-06452509 has failed to come up 2026-05-11 03:25:56,445 - ERROR - Nova failed to get host of the VM 2026-05-11 03:25:56,539 - INFO - Skip interface_detach for VM ctest-left_vm-12321924 in state BUILD 2026-05-11 03:25:56,540 - INFO - Deleting VM ctest-left_vm-12321924 2026-05-11 03:25:56,540 - ERROR - VM ctest-left_vm-12321924 has failed to come up 2026-05-11 03:25:56,540 - ERROR - Nova failed to get host of the VM 2026-05-11 03:25:56,540 - ERROR - VM ctest-left_vm-12321924 has failed to come up 2026-05-11 03:25:56,540 - ERROR - Nova failed to get host of the VM 2026-05-11 03:25:56,624 - INFO - Deleting VN ctest-trans_right_vn-83242767 2026-05-11 03:25:56,879 - DEBUG - Response for deleting network () 2026-05-11 03:25:56,879 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/852b8c33-42fc-4d56-9b55-14f73335dee2 2026-05-11 03:25:56,891 - DEBUG - Response Code: 404 2026-05-11 03:25:56,892 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:56,898 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:56,923 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:57,023 - INFO - Validated that VN ctest-trans_right_vn-83242767 is not found in API Server 2026-05-11 03:25:57,047 - DEBUG - VN ctest-trans_right_vn-83242767 is not present in Agent 10.0.0.23 2026-05-11 03:25:57,074 - DEBUG - VN ctest-trans_right_vn-83242767 is not present in Agent 10.0.0.240 2026-05-11 03:25:57,074 - INFO - Validated that VN ctest-trans_right_vn-83242767 is not in any agent 2026-05-11 03:25:57,130 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-83242767 info 2026-05-11 03:25:57,130 - INFO - Deleting VN ctest-trans_left_vn-73639367 2026-05-11 03:25:57,484 - DEBUG - Response for deleting network () 2026-05-11 03:25:57,484 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3c8be7b8-c4b0-419a-966e-313375d2c735 2026-05-11 03:25:57,494 - DEBUG - Response Code: 404 2026-05-11 03:25:57,494 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:57,511 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:25:57,546 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:25:57,665 - INFO - Validated that VN ctest-trans_left_vn-73639367 is not found in API Server 2026-05-11 03:25:57,680 - DEBUG - VN ctest-trans_left_vn-73639367 is not present in Agent 10.0.0.23 2026-05-11 03:25:57,699 - DEBUG - VN ctest-trans_left_vn-73639367 is not present in Agent 10.0.0.240 2026-05-11 03:25:57,699 - INFO - Validated that VN ctest-trans_left_vn-73639367 is not in any agent 2026-05-11 03:25:57,751 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-73639367 info 2026-05-11 03:25:57,752 - INFO - Deleting VN ctest-right_vn-01965673 2026-05-11 03:25:57,813 - DEBUG - VN fd4da6aa-c36d-409a-a8a9-08aa6530930c still in use: Unable to complete operation on network fd4da6aa-c36d-409a-a8a9-08aa6530930c. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-acbf37cf-5b33-42da-af7f-5b8db8cac5d7'] 2026-05-11 03:25:57,813 - WARNING - Deleting VN ctest-right_vn-01965673 failed..Will retry 2026-05-11 03:25:59,973 - DEBUG - Response for deleting network () 2026-05-11 03:25:59,973 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b3efcc1a-30df-4a1c-9292-302f33159a06 2026-05-11 03:25:59,981 - DEBUG - Response Code: 404 2026-05-11 03:25:59,982 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:25:59,988 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:26:00,021 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:26:00,122 - INFO - Validated that VN ctest-right_vn-01965673 is not found in API Server 2026-05-11 03:26:00,136 - DEBUG - VN ctest-right_vn-01965673 is not present in Agent 10.0.0.23 2026-05-11 03:26:00,149 - DEBUG - VN ctest-right_vn-01965673 is not present in Agent 10.0.0.240 2026-05-11 03:26:00,149 - INFO - Validated that VN ctest-right_vn-01965673 is not in any agent 2026-05-11 03:26:00,195 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-01965673 info 2026-05-11 03:26:00,195 - INFO - Deleting VN ctest-left_vn-34089788 2026-05-11 03:26:00,399 - DEBUG - Response for deleting network () 2026-05-11 03:26:00,399 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/000ecfca-3e39-4859-ac5b-ea0dae9e85a2 2026-05-11 03:26:00,406 - DEBUG - Response Code: 404 2026-05-11 03:26:00,406 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:26:00,414 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:26:00,440 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:26:00,552 - INFO - Validated that VN ctest-left_vn-34089788 is not found in API Server 2026-05-11 03:26:00,567 - DEBUG - VN ctest-left_vn-34089788 is not present in Agent 10.0.0.23 2026-05-11 03:26:00,584 - DEBUG - VN ctest-left_vn-34089788 is not present in Agent 10.0.0.240 2026-05-11 03:26:00,584 - INFO - Validated that VN ctest-left_vn-34089788 is not in any agent 2026-05-11 03:26:00,627 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-34089788 info 2026-05-11 03:26:00,627 - INFO - Deleting VN ctest-mgmt_vn-38138223 2026-05-11 03:26:00,825 - DEBUG - Response for deleting network () 2026-05-11 03:26:00,825 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c405b9e2-e595-42cc-984d-7e1b8dbdee23 2026-05-11 03:26:00,833 - DEBUG - Response Code: 404 2026-05-11 03:26:00,833 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 03:26:00,843 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 03:26:00,903 - DEBUG - Requesting: http://10.0.0.141:8082/project/c68b2ee6-5153-4e45-a5b4-a25002161bdb 2026-05-11 03:26:01,016 - INFO - Validated that VN ctest-mgmt_vn-38138223 is not found in API Server 2026-05-11 03:26:01,029 - DEBUG - VN ctest-mgmt_vn-38138223 is not present in Agent 10.0.0.23 2026-05-11 03:26:01,045 - DEBUG - VN ctest-mgmt_vn-38138223 is not present in Agent 10.0.0.240 2026-05-11 03:26:01,046 - INFO - Validated that VN ctest-mgmt_vn-38138223 is not in any agent 2026-05-11 03:26:01,086 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-38138223 info 2026-05-11 03:26:02,407 - DEBUG - No XMPP flaps were noticed during the test 2026-05-11 03:26:02,407 - INFO -
2026-05-11 03:26:02,407 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:17]
2026-05-11 03:26:02,407 - INFO - -------------------------------------------------------------------------------- 2026-05-11 03:26:03,121 - INFO - Deleted project: ctest-TestSvcHC-90890178, ID : c68b2ee6-5153-4e45-a5b4-a25002161bdb