2025-09-29 02:54:49,486 - INFO - Domain Default found not creating 2025-09-29 02:54:49,636 - INFO - Project ctest-TestSvcHC-84201910 not found, creating it 2025-09-29 02:54:50,221 - INFO - Created Project:ctest-TestSvcHC-84201910, ID : 205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:54:51,849 - INFO - ================================================================================ 2025-09-29 02:54:51,850 - INFO - STARTING TEST : test_svc_hc_basic 2025-09-29 02:54:53,141 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.129': '0', '10.20.0.17': '0'}, '10.0.0.131': {'10.20.0.129': '0', '10.20.0.17': '0'}} with 2025-09-29 02:54:53,141 - INFO - Initial checks done. Running the testcase now 2025-09-29 02:54:53,141 - INFO - 2025-09-29 02:54:53,904 - DEBUG - Response for create_network : {'network': {'id': 'af0c72b9-6c63-40be-9718-bceafb2a2ef4', 'name': 'ctest-mgmt_vn-02697380', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'project_id': '205884c5e3134121baa7a7cb62453f70', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-84201910', 'ctest-mgmt_vn-02697380'], 'port_security_enabled': True, 'description': ''}} 2025-09-29 02:54:54,225 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dfe7890c-f185-4dff-a369-d9d6d6dbff8a', 'name': '', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'network_id': 'af0c72b9-6c63-40be-9718-bceafb2a2ef4', 'ip_version': 4, 'cidr': '201.112.235.64/26', 'allocation_pools': [{'start': '201.112.235.66', 'end': '201.112.235.126'}], 'gateway_ip': '201.112.235.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '201.112.235.66', 'tags': [], 'project_id': '205884c5e3134121baa7a7cb62453f70'}} 2025-09-29 02:54:54,246 - INFO - Created VN ctest-mgmt_vn-02697380 2025-09-29 02:54:54,263 - DEBUG - VN ctest-mgmt_vn-02697380 UUID is af0c72b9-6c63-40be-9718-bceafb2a2ef4 2025-09-29 02:54:54,331 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:54:54,626 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:54:54,661 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:54:54,678 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:54:54,785 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/af0c72b9-6c63-40be-9718-bceafb2a2ef4 2025-09-29 02:54:54,797 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/af0c72b9-6c63-40be-9718-bceafb2a2ef4 2025-09-29 02:54:54,806 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/86f242b6-94de-4560-b358-b784b66eafb2 2025-09-29 02:54:54,813 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/86f242b6-94de-4560-b358-b784b66eafb2 2025-09-29 02:54:54,821 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/aca9fbf2-1bda-45c0-ba7a-90c467c4668b 2025-09-29 02:54:54,828 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-29 02:54:54,828 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/af0c72b9-6c63-40be-9718-bceafb2a2ef4 2025-09-29 02:54:54,837 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/86f242b6-94de-4560-b358-b784b66eafb2 2025-09-29 02:54:54,860 - INFO - Verified VN network id 15 for VN af0c72b9-6c63-40be-9718-bceafb2a2ef4 2025-09-29 02:54:54,861 - INFO - Verifications in API Server for VN ctest-mgmt_vn-02697380 passed 2025-09-29 02:54:54,861 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/af0c72b9-6c63-40be-9718-bceafb2a2ef4 2025-09-29 02:54:54,870 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/86f242b6-94de-4560-b358-b784b66eafb2 2025-09-29 02:54:54,878 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/86f242b6-94de-4560-b358-b784b66eafb2 2025-09-29 02:54:54,886 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/aca9fbf2-1bda-45c0-ba7a-90c467c4668b 2025-09-29 02:54:54,898 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12613582797070876862', 'uuid-lslong': '10887659816590388980'}, 'enable': 'true', 'created': '2025-09-29T02:54:53', 'last-modified': '2025-09-29T02:54:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.733166'} 2025-09-29 02:54:54,904 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-29 02:54:54,909 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12613582797070876862', 'uuid-lslong': '10887659816590388980'}, 'enable': 'true', 'created': '2025-09-29T02:54:53', 'last-modified': '2025-09-29T02:54:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.730379'} 2025-09-29 02:54:54,915 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-29 02:54:54,925 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12613582797070876862', 'uuid-lslong': '10887659816590388980'}, 'enable': 'true', 'created': '2025-09-29T02:54:53', 'last-modified': '2025-09-29T02:54:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.751881'} 2025-09-29 02:54:54,933 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-29 02:54:54,934 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-02697380 passed 2025-09-29 02:54:54,934 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-02697380 in API_Server ====== 2025-09-29 02:54:54,934 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:54:54,940 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:54:54,953 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:54:55,059 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/af0c72b9-6c63-40be-9718-bceafb2a2ef4 2025-09-29 02:54:55,072 - DEBUG - =>VN ctest-mgmt_vn-02697380 has no policy to be verified 2025-09-29 02:54:55,072 - DEBUG - Verifying the vn in opserver 2025-09-29 02:54:55,072 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380 virtual network link through opserver 10.0.0.38 2025-09-29 02:54:55,072 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-29 02:54:55,363 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-29 02:54:55,446 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380?flat'} 2025-09-29 02:54:55,446 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380 virtual network link through opserver 10.0.0.33 2025-09-29 02:54:55,446 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-09-29 02:54:55,833 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-09-29 02:54:55,901 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380?flat'} 2025-09-29 02:54:55,901 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380 virtual network link through opserver 10.0.0.249 2025-09-29 02:54:55,901 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-29 02:54:56,195 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-29 02:54:56,251 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380?flat'} 2025-09-29 02:54:56,251 - INFO - Validated that VN default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-02697380 is found in opserver 2025-09-29 02:54:56,271 - DEBUG - Do not have enough data to verify VN in agent 2025-09-29 02:54:56,280 - DEBUG - VRF ids for VN ctest-mgmt_vn-02697380: {} 2025-09-29 02:54:56,734 - DEBUG - Response for create_network : {'network': {'id': '51b6f336-d999-4784-926b-d9ee737ec079', 'name': 'ctest-left_vn-86025577', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'project_id': '205884c5e3134121baa7a7cb62453f70', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-84201910', 'ctest-left_vn-86025577'], 'port_security_enabled': True, 'description': ''}} 2025-09-29 02:54:56,989 - DEBUG - Response for create_subnet : {'subnet': {'id': '4cbcb697-0efc-487b-9888-1334fc0b9f42', 'name': '', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'network_id': '51b6f336-d999-4784-926b-d9ee737ec079', 'ip_version': 4, 'cidr': '207.80.163.128/26', 'allocation_pools': [{'start': '207.80.163.130', 'end': '207.80.163.190'}], 'gateway_ip': '207.80.163.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '207.80.163.130', 'tags': [], 'project_id': '205884c5e3134121baa7a7cb62453f70'}} 2025-09-29 02:54:57,015 - INFO - Created VN ctest-left_vn-86025577 2025-09-29 02:54:57,026 - DEBUG - VN ctest-left_vn-86025577 UUID is 51b6f336-d999-4784-926b-d9ee737ec079 2025-09-29 02:54:57,107 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:54:57,113 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:54:57,129 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:54:57,241 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/51b6f336-d999-4784-926b-d9ee737ec079 2025-09-29 02:54:57,256 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/51b6f336-d999-4784-926b-d9ee737ec079 2025-09-29 02:54:57,266 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2e37b523-cd4d-430c-bdc7-37d6de7ddfd0 2025-09-29 02:54:57,273 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2e37b523-cd4d-430c-bdc7-37d6de7ddfd0 2025-09-29 02:54:57,280 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/270222f6-807b-4a12-bc7d-c0de2f770f98 2025-09-29 02:54:57,286 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-29 02:54:57,286 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/51b6f336-d999-4784-926b-d9ee737ec079 2025-09-29 02:54:57,295 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2e37b523-cd4d-430c-bdc7-37d6de7ddfd0 2025-09-29 02:54:57,310 - INFO - Verified VN network id 16 for VN 51b6f336-d999-4784-926b-d9ee737ec079 2025-09-29 02:54:57,310 - INFO - Verifications in API Server for VN ctest-left_vn-86025577 passed 2025-09-29 02:54:57,310 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/51b6f336-d999-4784-926b-d9ee737ec079 2025-09-29 02:54:57,320 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2e37b523-cd4d-430c-bdc7-37d6de7ddfd0 2025-09-29 02:54:57,327 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2e37b523-cd4d-430c-bdc7-37d6de7ddfd0 2025-09-29 02:54:57,334 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/270222f6-807b-4a12-bc7d-c0de2f770f98 2025-09-29 02:54:57,347 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5888160979737986948', 'uuid-lslong': '10550766170208649337'}, 'enable': 'true', 'created': '2025-09-29T02:54:56', 'last-modified': '2025-09-29T02:54:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410341'} 2025-09-29 02:54:57,352 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-29 02:54:57,358 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5888160979737986948', 'uuid-lslong': '10550766170208649337'}, 'enable': 'true', 'created': '2025-09-29T02:54:56', 'last-modified': '2025-09-29T02:54:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423711'} 2025-09-29 02:54:57,364 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-29 02:54:57,369 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5888160979737986948', 'uuid-lslong': '10550766170208649337'}, 'enable': 'true', 'created': '2025-09-29T02:54:56', 'last-modified': '2025-09-29T02:54:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432481'} 2025-09-29 02:54:57,383 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-29 02:54:57,383 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-86025577 passed 2025-09-29 02:54:57,383 - DEBUG - ====Verifying policy data for ctest-left_vn-86025577 in API_Server ====== 2025-09-29 02:54:57,383 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:54:57,389 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:54:57,401 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:54:57,499 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/51b6f336-d999-4784-926b-d9ee737ec079 2025-09-29 02:54:57,524 - DEBUG - =>VN ctest-left_vn-86025577 has no policy to be verified 2025-09-29 02:54:57,524 - DEBUG - Verifying the vn in opserver 2025-09-29 02:54:57,524 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577 virtual network link through opserver 10.0.0.38 2025-09-29 02:54:57,524 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-29 02:54:57,580 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577?flat'} 2025-09-29 02:54:57,580 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577 virtual network link through opserver 10.0.0.33 2025-09-29 02:54:57,580 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-09-29 02:54:57,643 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577?flat'} 2025-09-29 02:54:57,643 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577 virtual network link through opserver 10.0.0.249 2025-09-29 02:54:57,643 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-29 02:54:57,709 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577?flat'} 2025-09-29 02:54:57,709 - INFO - Validated that VN default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-86025577 is found in opserver 2025-09-29 02:54:57,731 - DEBUG - Do not have enough data to verify VN in agent 2025-09-29 02:54:57,741 - DEBUG - VRF ids for VN ctest-left_vn-86025577: {} 2025-09-29 02:54:58,045 - DEBUG - Response for create_network : {'network': {'id': 'e0b24525-0f2f-4611-a09d-6e2bfa1dd53b', 'name': 'ctest-right_vn-22604400', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'project_id': '205884c5e3134121baa7a7cb62453f70', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-84201910', 'ctest-right_vn-22604400'], 'port_security_enabled': True, 'description': ''}} 2025-09-29 02:54:58,306 - DEBUG - Response for create_subnet : {'subnet': {'id': '383562f6-661e-4f2f-bdd9-f6804e05bbfb', 'name': '', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'network_id': 'e0b24525-0f2f-4611-a09d-6e2bfa1dd53b', 'ip_version': 4, 'cidr': '5.55.37.64/26', 'allocation_pools': [{'start': '5.55.37.66', 'end': '5.55.37.126'}], 'gateway_ip': '5.55.37.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '5.55.37.66', 'tags': [], 'project_id': '205884c5e3134121baa7a7cb62453f70'}} 2025-09-29 02:54:58,334 - INFO - Created VN ctest-right_vn-22604400 2025-09-29 02:54:58,347 - DEBUG - VN ctest-right_vn-22604400 UUID is e0b24525-0f2f-4611-a09d-6e2bfa1dd53b 2025-09-29 02:54:58,449 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:54:58,456 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:54:58,471 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:54:58,558 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e0b24525-0f2f-4611-a09d-6e2bfa1dd53b 2025-09-29 02:54:58,578 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e0b24525-0f2f-4611-a09d-6e2bfa1dd53b 2025-09-29 02:54:58,587 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/fb6c1eb8-5648-4f63-996d-1d0cf1677fbc 2025-09-29 02:54:58,597 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/fb6c1eb8-5648-4f63-996d-1d0cf1677fbc 2025-09-29 02:54:58,605 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/caa759cb-fe67-4b63-a5d4-993bab93e02a 2025-09-29 02:54:58,612 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-29 02:54:58,613 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e0b24525-0f2f-4611-a09d-6e2bfa1dd53b 2025-09-29 02:54:58,623 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/fb6c1eb8-5648-4f63-996d-1d0cf1677fbc 2025-09-29 02:54:58,639 - INFO - Verified VN network id 17 for VN e0b24525-0f2f-4611-a09d-6e2bfa1dd53b 2025-09-29 02:54:58,640 - INFO - Verifications in API Server for VN ctest-right_vn-22604400 passed 2025-09-29 02:54:58,640 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e0b24525-0f2f-4611-a09d-6e2bfa1dd53b 2025-09-29 02:54:58,649 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/fb6c1eb8-5648-4f63-996d-1d0cf1677fbc 2025-09-29 02:54:58,659 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/fb6c1eb8-5648-4f63-996d-1d0cf1677fbc 2025-09-29 02:54:58,668 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/caa759cb-fe67-4b63-a5d4-993bab93e02a 2025-09-29 02:54:58,681 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16191079635821217297', 'uuid-lslong': '11573527752570950971'}, 'enable': 'true', 'created': '2025-09-29T02:54:57', 'last-modified': '2025-09-29T02:54:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423825'} 2025-09-29 02:54:58,687 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-29 02:54:58,694 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16191079635821217297', 'uuid-lslong': '11573527752570950971'}, 'enable': 'true', 'created': '2025-09-29T02:54:57', 'last-modified': '2025-09-29T02:54:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.438997'} 2025-09-29 02:54:58,700 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-29 02:54:58,705 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16191079635821217297', 'uuid-lslong': '11573527752570950971'}, 'enable': 'true', 'created': '2025-09-29T02:54:57', 'last-modified': '2025-09-29T02:54:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.447542'} 2025-09-29 02:54:58,713 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-29 02:54:58,713 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-22604400 passed 2025-09-29 02:54:58,713 - DEBUG - ====Verifying policy data for ctest-right_vn-22604400 in API_Server ====== 2025-09-29 02:54:58,713 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:54:58,719 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:54:58,729 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:54:58,823 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e0b24525-0f2f-4611-a09d-6e2bfa1dd53b 2025-09-29 02:54:58,834 - DEBUG - =>VN ctest-right_vn-22604400 has no policy to be verified 2025-09-29 02:54:58,834 - DEBUG - Verifying the vn in opserver 2025-09-29 02:54:58,834 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400 virtual network link through opserver 10.0.0.38 2025-09-29 02:54:58,834 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-29 02:54:58,896 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400?flat'} 2025-09-29 02:54:58,896 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400 virtual network link through opserver 10.0.0.33 2025-09-29 02:54:58,896 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-09-29 02:54:58,948 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400?flat'} 2025-09-29 02:54:58,948 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400 virtual network link through opserver 10.0.0.249 2025-09-29 02:54:58,948 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-29 02:54:59,007 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400?flat'} 2025-09-29 02:54:59,007 - INFO - Validated that VN default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-22604400 is found in opserver 2025-09-29 02:54:59,026 - DEBUG - Do not have enough data to verify VN in agent 2025-09-29 02:54:59,034 - DEBUG - VRF ids for VN ctest-right_vn-22604400: {} 2025-09-29 02:54:59,089 - DEBUG - Services list from nova: [, , , ] 2025-09-29 02:55:00,175 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4203-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4203-2) 2025-09-29 02:55:01,452 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4203-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4203-1) 2025-09-29 02:55:01,452 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-62546966'] 2025-09-29 02:55:01,780 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-62546966'] created succesfully 2025-09-29 02:55:02,239 - DEBUG - Image by name tiny_nat_fw not found 2025-09-29 02:55:02,239 - DEBUG - Installing image tiny_nat_fw 2025-09-29 02:55:02,239 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-09-29 02:55:02,240 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-29 02:55:02,240 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-29 02:55:02,240 - DEBUG - Unzip image 2025-09-29 02:55:02,240 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-29 02:55:02,296 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-09-29 02:55:02,296 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-62546966'] 2025-09-29 02:55:02,463 - INFO - Service template: ['default-domain', 'ctest-service_template_1-62546966'] deleted successfully. 2025-09-29 02:55:02,464 - INFO - Skip interface_detach for VM ctest-right_vm-74536038 in state BUILD 2025-09-29 02:55:02,464 - INFO - Deleting VM ctest-right_vm-74536038 2025-09-29 02:55:02,518 - ERROR - VM ctest-right_vm-74536038 has failed to come up 2025-09-29 02:55:02,518 - ERROR - Nova failed to get host of the VM 2025-09-29 02:55:02,518 - ERROR - VM ctest-right_vm-74536038 has failed to come up 2025-09-29 02:55:02,518 - ERROR - Nova failed to get host of the VM 2025-09-29 02:55:02,616 - INFO - Skip interface_detach for VM ctest-left_vm-79134934 in state BUILD 2025-09-29 02:55:02,616 - INFO - Deleting VM ctest-left_vm-79134934 2025-09-29 02:55:02,616 - ERROR - VM ctest-left_vm-79134934 has failed to come up 2025-09-29 02:55:02,616 - ERROR - Nova failed to get host of the VM 2025-09-29 02:55:02,617 - ERROR - VM ctest-left_vm-79134934 has failed to come up 2025-09-29 02:55:02,617 - ERROR - Nova failed to get host of the VM 2025-09-29 02:55:02,690 - INFO - Deleting VN ctest-right_vn-22604400 2025-09-29 02:55:02,738 - DEBUG - VN e0b24525-0f2f-4611-a09d-6e2bfa1dd53b still in use: Unable to complete operation on network e0b24525-0f2f-4611-a09d-6e2bfa1dd53b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-62ce353d-54b1-44e5-b719-c8ea3d07a083'] 2025-09-29 02:55:02,738 - WARNING - Deleting VN ctest-right_vn-22604400 failed..Will retry 2025-09-29 02:55:04,899 - DEBUG - Response for deleting network () 2025-09-29 02:55:04,899 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/fb6c1eb8-5648-4f63-996d-1d0cf1677fbc 2025-09-29 02:55:04,906 - DEBUG - Response Code: 404 2025-09-29 02:55:04,906 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:04,915 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:04,932 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:05,021 - INFO - Validated that VN ctest-right_vn-22604400 is not found in API Server 2025-09-29 02:55:05,032 - DEBUG - VN ctest-right_vn-22604400 is not present in Agent 10.0.0.27 2025-09-29 02:55:05,043 - DEBUG - VN ctest-right_vn-22604400 is not present in Agent 10.0.0.131 2025-09-29 02:55:05,043 - INFO - Validated that VN ctest-right_vn-22604400 is not in any agent 2025-09-29 02:55:05,073 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-22604400 info 2025-09-29 02:55:05,073 - INFO - Deleting VN ctest-left_vn-86025577 2025-09-29 02:55:05,257 - DEBUG - Response for deleting network () 2025-09-29 02:55:05,257 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/2e37b523-cd4d-430c-bdc7-37d6de7ddfd0 2025-09-29 02:55:05,276 - DEBUG - Response Code: 404 2025-09-29 02:55:05,276 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:05,284 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:05,296 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:05,393 - INFO - Validated that VN ctest-left_vn-86025577 is not found in API Server 2025-09-29 02:55:05,403 - DEBUG - VN ctest-left_vn-86025577 is not present in Agent 10.0.0.27 2025-09-29 02:55:05,413 - DEBUG - VN ctest-left_vn-86025577 is not present in Agent 10.0.0.131 2025-09-29 02:55:05,414 - INFO - Validated that VN ctest-left_vn-86025577 is not in any agent 2025-09-29 02:55:05,442 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-86025577 info 2025-09-29 02:55:05,442 - INFO - Deleting VN ctest-mgmt_vn-02697380 2025-09-29 02:55:05,599 - DEBUG - Response for deleting network () 2025-09-29 02:55:05,599 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/86f242b6-94de-4560-b358-b784b66eafb2 2025-09-29 02:55:05,607 - DEBUG - Response Code: 404 2025-09-29 02:55:05,608 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:05,616 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:05,628 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:05,787 - INFO - Validated that VN ctest-mgmt_vn-02697380 is not found in API Server 2025-09-29 02:55:05,798 - DEBUG - VN ctest-mgmt_vn-02697380 is not present in Agent 10.0.0.27 2025-09-29 02:55:05,808 - DEBUG - VN ctest-mgmt_vn-02697380 is not present in Agent 10.0.0.131 2025-09-29 02:55:05,808 - INFO - Validated that VN ctest-mgmt_vn-02697380 is not in any agent 2025-09-29 02:55:05,838 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-02697380 info 2025-09-29 02:55:07,147 - DEBUG - No XMPP flaps were noticed during the test 2025-09-29 02:55:07,148 - INFO - 2025-09-29 02:55:07,148 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:16] 2025-09-29 02:55:07,148 - INFO - -------------------------------------------------------------------------------- 2025-09-29 02:55:07,151 - INFO - ================================================================================ 2025-09-29 02:55:07,151 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-09-29 02:55:08,476 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.129': '0', '10.20.0.17': '0'}, '10.0.0.131': {'10.20.0.129': '0', '10.20.0.17': '0'}} with 2025-09-29 02:55:08,476 - INFO - Initial checks done. Running the testcase now 2025-09-29 02:55:08,476 - INFO - 2025-09-29 02:55:08,817 - DEBUG - Response for create_network : {'network': {'id': 'dd3a1280-6dac-4b6d-9fd7-b2b5de81fe61', 'name': 'ctest-mgmt_vn-08000462', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'project_id': '205884c5e3134121baa7a7cb62453f70', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-84201910', 'ctest-mgmt_vn-08000462'], 'port_security_enabled': True, 'description': ''}} 2025-09-29 02:55:09,039 - DEBUG - Response for create_subnet : {'subnet': {'id': '8a8479d5-2442-42f7-921e-d8a9f4e99651', 'name': '', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'network_id': 'dd3a1280-6dac-4b6d-9fd7-b2b5de81fe61', 'ip_version': 4, 'cidr': '63.103.80.192/26', 'allocation_pools': [{'start': '63.103.80.194', 'end': '63.103.80.254'}], 'gateway_ip': '63.103.80.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '63.103.80.194', 'tags': [], 'project_id': '205884c5e3134121baa7a7cb62453f70'}} 2025-09-29 02:55:09,062 - INFO - Created VN ctest-mgmt_vn-08000462 2025-09-29 02:55:09,076 - DEBUG - VN ctest-mgmt_vn-08000462 UUID is dd3a1280-6dac-4b6d-9fd7-b2b5de81fe61 2025-09-29 02:55:09,144 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:09,150 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:09,160 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:09,255 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/dd3a1280-6dac-4b6d-9fd7-b2b5de81fe61 2025-09-29 02:55:09,270 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/dd3a1280-6dac-4b6d-9fd7-b2b5de81fe61 2025-09-29 02:55:09,281 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/50450082-d37b-4e47-bfa8-4e1e53d9e2ec 2025-09-29 02:55:09,289 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/50450082-d37b-4e47-bfa8-4e1e53d9e2ec 2025-09-29 02:55:09,297 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/98398c0d-6a9c-4a84-b7ed-41705c65d6fa 2025-09-29 02:55:09,304 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-29 02:55:09,304 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/dd3a1280-6dac-4b6d-9fd7-b2b5de81fe61 2025-09-29 02:55:09,312 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/50450082-d37b-4e47-bfa8-4e1e53d9e2ec 2025-09-29 02:55:09,328 - INFO - Verified VN network id 15 for VN dd3a1280-6dac-4b6d-9fd7-b2b5de81fe61 2025-09-29 02:55:09,328 - INFO - Verifications in API Server for VN ctest-mgmt_vn-08000462 passed 2025-09-29 02:55:09,328 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/dd3a1280-6dac-4b6d-9fd7-b2b5de81fe61 2025-09-29 02:55:09,338 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/50450082-d37b-4e47-bfa8-4e1e53d9e2ec 2025-09-29 02:55:09,345 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/50450082-d37b-4e47-bfa8-4e1e53d9e2ec 2025-09-29 02:55:09,351 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/98398c0d-6a9c-4a84-b7ed-41705c65d6fa 2025-09-29 02:55:09,362 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15941074173836413805', 'uuid-lslong': '11517871066215218785'}, 'enable': 'true', 'created': '2025-09-29T02:55:08', 'last-modified': '2025-09-29T02:55:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.384182'} 2025-09-29 02:55:09,367 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-29 02:55:09,372 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15941074173836413805', 'uuid-lslong': '11517871066215218785'}, 'enable': 'true', 'created': '2025-09-29T02:55:08', 'last-modified': '2025-09-29T02:55:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.395905'} 2025-09-29 02:55:09,378 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-29 02:55:09,392 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15941074173836413805', 'uuid-lslong': '11517871066215218785'}, 'enable': 'true', 'created': '2025-09-29T02:55:08', 'last-modified': '2025-09-29T02:55:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.411735'} 2025-09-29 02:55:09,406 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-29 02:55:09,406 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-08000462 passed 2025-09-29 02:55:09,406 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-08000462 in API_Server ====== 2025-09-29 02:55:09,406 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:09,413 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:09,423 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:09,537 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/dd3a1280-6dac-4b6d-9fd7-b2b5de81fe61 2025-09-29 02:55:09,547 - DEBUG - =>VN ctest-mgmt_vn-08000462 has no policy to be verified 2025-09-29 02:55:09,547 - DEBUG - Verifying the vn in opserver 2025-09-29 02:55:09,547 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462 virtual network link through opserver 10.0.0.38 2025-09-29 02:55:09,547 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-29 02:55:09,561 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462?flat'} 2025-09-29 02:55:09,561 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462 virtual network link through opserver 10.0.0.33 2025-09-29 02:55:09,561 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-09-29 02:55:09,575 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462?flat'} 2025-09-29 02:55:09,575 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462 virtual network link through opserver 10.0.0.249 2025-09-29 02:55:09,575 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-29 02:55:09,596 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462?flat'} 2025-09-29 02:55:09,597 - INFO - Validated that VN default-domain:ctest-TestSvcHC-84201910:ctest-mgmt_vn-08000462 is found in opserver 2025-09-29 02:55:09,618 - DEBUG - Do not have enough data to verify VN in agent 2025-09-29 02:55:09,629 - DEBUG - VRF ids for VN ctest-mgmt_vn-08000462: {} 2025-09-29 02:55:09,913 - DEBUG - Response for create_network : {'network': {'id': 'cfa0c2c5-3129-4b5a-a626-3a08f051e842', 'name': 'ctest-left_vn-52985187', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'project_id': '205884c5e3134121baa7a7cb62453f70', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-84201910', 'ctest-left_vn-52985187'], 'port_security_enabled': True, 'description': ''}} 2025-09-29 02:55:10,122 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e888d22e-5639-4756-ade9-06730b1b1833', 'name': '', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'network_id': 'cfa0c2c5-3129-4b5a-a626-3a08f051e842', 'ip_version': 4, 'cidr': '35.216.249.192/26', 'allocation_pools': [{'start': '35.216.249.194', 'end': '35.216.249.254'}], 'gateway_ip': '35.216.249.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '35.216.249.194', 'tags': [], 'project_id': '205884c5e3134121baa7a7cb62453f70'}} 2025-09-29 02:55:10,144 - INFO - Created VN ctest-left_vn-52985187 2025-09-29 02:55:10,157 - DEBUG - VN ctest-left_vn-52985187 UUID is cfa0c2c5-3129-4b5a-a626-3a08f051e842 2025-09-29 02:55:10,223 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:10,230 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:10,242 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:10,355 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/cfa0c2c5-3129-4b5a-a626-3a08f051e842 2025-09-29 02:55:10,376 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/cfa0c2c5-3129-4b5a-a626-3a08f051e842 2025-09-29 02:55:10,386 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f2af0264-2fd7-49e9-b4a7-884f973012eb 2025-09-29 02:55:10,394 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f2af0264-2fd7-49e9-b4a7-884f973012eb 2025-09-29 02:55:10,405 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/0f4937c4-9dd6-4f10-adc6-0002f41ffafb 2025-09-29 02:55:10,412 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-29 02:55:10,412 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/cfa0c2c5-3129-4b5a-a626-3a08f051e842 2025-09-29 02:55:10,421 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f2af0264-2fd7-49e9-b4a7-884f973012eb 2025-09-29 02:55:10,441 - INFO - Verified VN network id 16 for VN cfa0c2c5-3129-4b5a-a626-3a08f051e842 2025-09-29 02:55:10,441 - INFO - Verifications in API Server for VN ctest-left_vn-52985187 passed 2025-09-29 02:55:10,441 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/cfa0c2c5-3129-4b5a-a626-3a08f051e842 2025-09-29 02:55:10,452 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f2af0264-2fd7-49e9-b4a7-884f973012eb 2025-09-29 02:55:10,461 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f2af0264-2fd7-49e9-b4a7-884f973012eb 2025-09-29 02:55:10,469 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/0f4937c4-9dd6-4f10-adc6-0002f41ffafb 2025-09-29 02:55:10,479 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14961172114313923418', 'uuid-lslong': '11972320469477091394'}, 'enable': 'true', 'created': '2025-09-29T02:55:09', 'last-modified': '2025-09-29T02:55:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415626'} 2025-09-29 02:55:10,484 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-29 02:55:10,489 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14961172114313923418', 'uuid-lslong': '11972320469477091394'}, 'enable': 'true', 'created': '2025-09-29T02:55:09', 'last-modified': '2025-09-29T02:55:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424317'} 2025-09-29 02:55:10,494 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-29 02:55:10,499 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14961172114313923418', 'uuid-lslong': '11972320469477091394'}, 'enable': 'true', 'created': '2025-09-29T02:55:09', 'last-modified': '2025-09-29T02:55:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428390'} 2025-09-29 02:55:10,505 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-29 02:55:10,505 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-52985187 passed 2025-09-29 02:55:10,505 - DEBUG - ====Verifying policy data for ctest-left_vn-52985187 in API_Server ====== 2025-09-29 02:55:10,505 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:10,511 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:10,523 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:10,624 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/cfa0c2c5-3129-4b5a-a626-3a08f051e842 2025-09-29 02:55:10,636 - DEBUG - =>VN ctest-left_vn-52985187 has no policy to be verified 2025-09-29 02:55:10,636 - DEBUG - Verifying the vn in opserver 2025-09-29 02:55:10,636 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187 virtual network link through opserver 10.0.0.38 2025-09-29 02:55:10,636 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-29 02:55:10,648 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187?flat'} 2025-09-29 02:55:10,648 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187 virtual network link through opserver 10.0.0.33 2025-09-29 02:55:10,648 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-09-29 02:55:10,661 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187?flat'} 2025-09-29 02:55:10,661 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187 virtual network link through opserver 10.0.0.249 2025-09-29 02:55:10,661 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-29 02:55:10,675 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187?flat'} 2025-09-29 02:55:10,675 - INFO - Validated that VN default-domain:ctest-TestSvcHC-84201910:ctest-left_vn-52985187 is found in opserver 2025-09-29 02:55:10,696 - DEBUG - Do not have enough data to verify VN in agent 2025-09-29 02:55:10,706 - DEBUG - VRF ids for VN ctest-left_vn-52985187: {} 2025-09-29 02:55:10,977 - DEBUG - Response for create_network : {'network': {'id': 'def9311b-f8bb-47ce-a113-49542c2dcecd', 'name': 'ctest-right_vn-27639614', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'project_id': '205884c5e3134121baa7a7cb62453f70', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-84201910', 'ctest-right_vn-27639614'], 'port_security_enabled': True, 'description': ''}} 2025-09-29 02:55:11,199 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e49a7df4-a0f1-4df3-9ffc-2b9bbc5719d7', 'name': '', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'network_id': 'def9311b-f8bb-47ce-a113-49542c2dcecd', 'ip_version': 4, 'cidr': '45.55.81.64/26', 'allocation_pools': [{'start': '45.55.81.66', 'end': '45.55.81.126'}], 'gateway_ip': '45.55.81.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '45.55.81.66', 'tags': [], 'project_id': '205884c5e3134121baa7a7cb62453f70'}} 2025-09-29 02:55:11,226 - INFO - Created VN ctest-right_vn-27639614 2025-09-29 02:55:11,236 - DEBUG - VN ctest-right_vn-27639614 UUID is def9311b-f8bb-47ce-a113-49542c2dcecd 2025-09-29 02:55:11,302 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:11,309 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:11,320 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:11,416 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/def9311b-f8bb-47ce-a113-49542c2dcecd 2025-09-29 02:55:11,430 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/def9311b-f8bb-47ce-a113-49542c2dcecd 2025-09-29 02:55:11,440 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/044baa7a-33fc-4981-8f92-b915351aa399 2025-09-29 02:55:11,448 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/044baa7a-33fc-4981-8f92-b915351aa399 2025-09-29 02:55:11,456 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/fffe2520-be23-4879-ba8d-738deef458f2 2025-09-29 02:55:11,462 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-29 02:55:11,462 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/def9311b-f8bb-47ce-a113-49542c2dcecd 2025-09-29 02:55:11,472 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/044baa7a-33fc-4981-8f92-b915351aa399 2025-09-29 02:55:11,492 - INFO - Verified VN network id 17 for VN def9311b-f8bb-47ce-a113-49542c2dcecd 2025-09-29 02:55:11,492 - INFO - Verifications in API Server for VN ctest-right_vn-27639614 passed 2025-09-29 02:55:11,493 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/def9311b-f8bb-47ce-a113-49542c2dcecd 2025-09-29 02:55:11,503 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/044baa7a-33fc-4981-8f92-b915351aa399 2025-09-29 02:55:11,511 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/044baa7a-33fc-4981-8f92-b915351aa399 2025-09-29 02:55:11,521 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/fffe2520-be23-4879-ba8d-738deef458f2 2025-09-29 02:55:11,532 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16066927141827856334', 'uuid-lslong': '11606701290531180237'}, 'enable': 'true', 'created': '2025-09-29T02:55:10', 'last-modified': '2025-09-29T02:55:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.393451'} 2025-09-29 02:55:11,537 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-29 02:55:11,543 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16066927141827856334', 'uuid-lslong': '11606701290531180237'}, 'enable': 'true', 'created': '2025-09-29T02:55:10', 'last-modified': '2025-09-29T02:55:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402655'} 2025-09-29 02:55:11,549 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-29 02:55:11,555 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16066927141827856334', 'uuid-lslong': '11606701290531180237'}, 'enable': 'true', 'created': '2025-09-29T02:55:10', 'last-modified': '2025-09-29T02:55:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415943'} 2025-09-29 02:55:11,565 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-29 02:55:11,565 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-27639614 passed 2025-09-29 02:55:11,565 - DEBUG - ====Verifying policy data for ctest-right_vn-27639614 in API_Server ====== 2025-09-29 02:55:11,565 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:11,571 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:11,582 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:11,681 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/def9311b-f8bb-47ce-a113-49542c2dcecd 2025-09-29 02:55:11,693 - DEBUG - =>VN ctest-right_vn-27639614 has no policy to be verified 2025-09-29 02:55:11,693 - DEBUG - Verifying the vn in opserver 2025-09-29 02:55:11,693 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614 virtual network link through opserver 10.0.0.38 2025-09-29 02:55:11,693 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-29 02:55:11,705 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614?flat'} 2025-09-29 02:55:11,705 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614 virtual network link through opserver 10.0.0.33 2025-09-29 02:55:11,705 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-09-29 02:55:11,717 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614?flat'} 2025-09-29 02:55:11,717 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614 virtual network link through opserver 10.0.0.249 2025-09-29 02:55:11,717 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-29 02:55:11,733 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614?flat'} 2025-09-29 02:55:11,733 - INFO - Validated that VN default-domain:ctest-TestSvcHC-84201910:ctest-right_vn-27639614 is found in opserver 2025-09-29 02:55:11,753 - DEBUG - Do not have enough data to verify VN in agent 2025-09-29 02:55:11,767 - DEBUG - VRF ids for VN ctest-right_vn-27639614: {} 2025-09-29 02:55:12,104 - DEBUG - Response for create_network : {'network': {'id': 'e6853175-2230-40e6-b6c2-b3b48daf7ecb', 'name': 'ctest-trans_left_vn-91960265', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'project_id': '205884c5e3134121baa7a7cb62453f70', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-84201910', 'ctest-trans_left_vn-91960265'], 'port_security_enabled': True, 'description': ''}} 2025-09-29 02:55:12,448 - DEBUG - Response for create_subnet : {'subnet': {'id': '386f83da-a679-4ae3-8b2e-d0967a9524ad', 'name': '', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'network_id': 'e6853175-2230-40e6-b6c2-b3b48daf7ecb', 'ip_version': 4, 'cidr': '7.230.167.192/26', 'allocation_pools': [{'start': '7.230.167.194', 'end': '7.230.167.254'}], 'gateway_ip': '7.230.167.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '7.230.167.194', 'tags': [], 'project_id': '205884c5e3134121baa7a7cb62453f70'}} 2025-09-29 02:55:12,472 - INFO - Created VN ctest-trans_left_vn-91960265 2025-09-29 02:55:12,487 - DEBUG - VN ctest-trans_left_vn-91960265 UUID is e6853175-2230-40e6-b6c2-b3b48daf7ecb 2025-09-29 02:55:12,587 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:12,594 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:12,608 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:12,708 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e6853175-2230-40e6-b6c2-b3b48daf7ecb 2025-09-29 02:55:12,725 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e6853175-2230-40e6-b6c2-b3b48daf7ecb 2025-09-29 02:55:12,737 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/915af6b1-6ea3-4366-8327-6036fb5e9dbe 2025-09-29 02:55:12,748 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/915af6b1-6ea3-4366-8327-6036fb5e9dbe 2025-09-29 02:55:12,756 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/2299b537-2043-452a-a65f-dd00d293df9b 2025-09-29 02:55:12,765 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-29 02:55:12,765 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e6853175-2230-40e6-b6c2-b3b48daf7ecb 2025-09-29 02:55:12,774 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/915af6b1-6ea3-4366-8327-6036fb5e9dbe 2025-09-29 02:55:12,796 - INFO - Verified VN network id 18 for VN e6853175-2230-40e6-b6c2-b3b48daf7ecb 2025-09-29 02:55:12,796 - INFO - Verifications in API Server for VN ctest-trans_left_vn-91960265 passed 2025-09-29 02:55:12,796 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e6853175-2230-40e6-b6c2-b3b48daf7ecb 2025-09-29 02:55:12,816 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/915af6b1-6ea3-4366-8327-6036fb5e9dbe 2025-09-29 02:55:12,827 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/915af6b1-6ea3-4366-8327-6036fb5e9dbe 2025-09-29 02:55:12,836 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/2299b537-2043-452a-a65f-dd00d293df9b 2025-09-29 02:55:12,852 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16610737179780464870', 'uuid-lslong': '13169285848437325515'}, 'enable': 'true', 'created': '2025-09-29T02:55:12', 'last-modified': '2025-09-29T02:55:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.478010'} 2025-09-29 02:55:12,859 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-29 02:55:12,864 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16610737179780464870', 'uuid-lslong': '13169285848437325515'}, 'enable': 'true', 'created': '2025-09-29T02:55:12', 'last-modified': '2025-09-29T02:55:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.488970'} 2025-09-29 02:55:12,870 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-29 02:55:12,877 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16610737179780464870', 'uuid-lslong': '13169285848437325515'}, 'enable': 'true', 'created': '2025-09-29T02:55:12', 'last-modified': '2025-09-29T02:55:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.510090'} 2025-09-29 02:55:12,886 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-29 02:55:12,886 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-91960265 passed 2025-09-29 02:55:12,886 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-91960265 in API_Server ====== 2025-09-29 02:55:12,886 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:12,893 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:12,906 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:13,047 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e6853175-2230-40e6-b6c2-b3b48daf7ecb 2025-09-29 02:55:13,059 - DEBUG - =>VN ctest-trans_left_vn-91960265 has no policy to be verified 2025-09-29 02:55:13,059 - DEBUG - Verifying the vn in opserver 2025-09-29 02:55:13,059 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265 virtual network link through opserver 10.0.0.38 2025-09-29 02:55:13,059 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-29 02:55:13,074 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265?flat'} 2025-09-29 02:55:13,074 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265 virtual network link through opserver 10.0.0.33 2025-09-29 02:55:13,074 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-09-29 02:55:13,089 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265?flat'} 2025-09-29 02:55:13,090 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265 virtual network link through opserver 10.0.0.249 2025-09-29 02:55:13,090 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-29 02:55:13,108 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265?flat'} 2025-09-29 02:55:13,108 - INFO - Validated that VN default-domain:ctest-TestSvcHC-84201910:ctest-trans_left_vn-91960265 is found in opserver 2025-09-29 02:55:13,132 - DEBUG - Do not have enough data to verify VN in agent 2025-09-29 02:55:13,143 - DEBUG - VRF ids for VN ctest-trans_left_vn-91960265: {} 2025-09-29 02:55:13,553 - DEBUG - Response for create_network : {'network': {'id': 'd66f1394-5ba8-4a78-baba-67743fd1e4ea', 'name': 'ctest-trans_right_vn-89975738', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'project_id': '205884c5e3134121baa7a7cb62453f70', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-84201910', 'ctest-trans_right_vn-89975738'], 'port_security_enabled': True, 'description': ''}} 2025-09-29 02:55:13,828 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f269e807-4440-4064-8269-f9df128c72b7', 'name': '', 'tenant_id': '205884c5e3134121baa7a7cb62453f70', 'network_id': 'd66f1394-5ba8-4a78-baba-67743fd1e4ea', 'ip_version': 4, 'cidr': '80.82.51.192/26', 'allocation_pools': [{'start': '80.82.51.194', 'end': '80.82.51.254'}], 'gateway_ip': '80.82.51.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '80.82.51.194', 'tags': [], 'project_id': '205884c5e3134121baa7a7cb62453f70'}} 2025-09-29 02:55:13,848 - INFO - Created VN ctest-trans_right_vn-89975738 2025-09-29 02:55:13,864 - DEBUG - VN ctest-trans_right_vn-89975738 UUID is d66f1394-5ba8-4a78-baba-67743fd1e4ea 2025-09-29 02:55:13,936 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:13,942 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:13,954 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:14,065 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d66f1394-5ba8-4a78-baba-67743fd1e4ea 2025-09-29 02:55:14,079 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d66f1394-5ba8-4a78-baba-67743fd1e4ea 2025-09-29 02:55:14,089 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1695dd04-5638-43dc-96cf-cc3df72ff5bc 2025-09-29 02:55:14,097 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1695dd04-5638-43dc-96cf-cc3df72ff5bc 2025-09-29 02:55:14,105 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/8287956e-546b-433b-8f6c-376bc92f7268 2025-09-29 02:55:14,112 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-09-29 02:55:14,112 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d66f1394-5ba8-4a78-baba-67743fd1e4ea 2025-09-29 02:55:14,123 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1695dd04-5638-43dc-96cf-cc3df72ff5bc 2025-09-29 02:55:14,139 - INFO - Verified VN network id 19 for VN d66f1394-5ba8-4a78-baba-67743fd1e4ea 2025-09-29 02:55:14,139 - INFO - Verifications in API Server for VN ctest-trans_right_vn-89975738 passed 2025-09-29 02:55:14,139 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d66f1394-5ba8-4a78-baba-67743fd1e4ea 2025-09-29 02:55:14,150 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1695dd04-5638-43dc-96cf-cc3df72ff5bc 2025-09-29 02:55:14,157 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1695dd04-5638-43dc-96cf-cc3df72ff5bc 2025-09-29 02:55:14,164 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/8287956e-546b-433b-8f6c-376bc92f7268 2025-09-29 02:55:14,175 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15451590374445304440', 'uuid-lslong': '13455180585707365610'}, 'enable': 'true', 'created': '2025-09-29T02:55:13', 'last-modified': '2025-09-29T02:55:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399581'} 2025-09-29 02:55:14,182 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-09-29 02:55:14,187 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15451590374445304440', 'uuid-lslong': '13455180585707365610'}, 'enable': 'true', 'created': '2025-09-29T02:55:13', 'last-modified': '2025-09-29T02:55:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.418560'} 2025-09-29 02:55:14,195 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-09-29 02:55:14,202 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-84201910', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15451590374445304440', 'uuid-lslong': '13455180585707365610'}, 'enable': 'true', 'created': '2025-09-29T02:55:13', 'last-modified': '2025-09-29T02:55:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426643'} 2025-09-29 02:55:14,210 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-09-29 02:55:14,210 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-89975738 passed 2025-09-29 02:55:14,210 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-89975738 in API_Server ====== 2025-09-29 02:55:14,210 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:14,218 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:14,229 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:14,337 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d66f1394-5ba8-4a78-baba-67743fd1e4ea 2025-09-29 02:55:14,347 - DEBUG - =>VN ctest-trans_right_vn-89975738 has no policy to be verified 2025-09-29 02:55:14,347 - DEBUG - Verifying the vn in opserver 2025-09-29 02:55:14,347 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738 virtual network link through opserver 10.0.0.38 2025-09-29 02:55:14,347 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-29 02:55:14,363 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738?flat'} 2025-09-29 02:55:14,363 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738 virtual network link through opserver 10.0.0.33 2025-09-29 02:55:14,363 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-09-29 02:55:14,381 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738?flat'} 2025-09-29 02:55:14,381 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738 virtual network link through opserver 10.0.0.249 2025-09-29 02:55:14,381 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-29 02:55:14,393 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738?flat'} 2025-09-29 02:55:14,393 - INFO - Validated that VN default-domain:ctest-TestSvcHC-84201910:ctest-trans_right_vn-89975738 is found in opserver 2025-09-29 02:55:14,415 - DEBUG - Do not have enough data to verify VN in agent 2025-09-29 02:55:14,425 - DEBUG - VRF ids for VN ctest-trans_right_vn-89975738: {} 2025-09-29 02:55:15,482 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4203-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4203-1) 2025-09-29 02:55:16,838 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4203-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4203-2) 2025-09-29 02:55:16,838 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-64595938'] 2025-09-29 02:55:17,216 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-64595938'] created succesfully 2025-09-29 02:55:17,551 - DEBUG - Image by name tiny_trans_fw not found 2025-09-29 02:55:17,551 - DEBUG - Installing image tiny_trans_fw 2025-09-29 02:55:17,551 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-09-29 02:55:17,551 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-29 02:55:17,551 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-29 02:55:17,551 - DEBUG - Unzip image 2025-09-29 02:55:17,551 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-29 02:55:17,574 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-09-29 02:55:17,574 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-64595938'] 2025-09-29 02:55:17,675 - INFO - Service template: ['default-domain', 'ctest-service_template_1-64595938'] deleted successfully. 2025-09-29 02:55:17,675 - INFO - Skip interface_detach for VM ctest-right_vm-38713854 in state BUILD 2025-09-29 02:55:17,675 - INFO - Deleting VM ctest-right_vm-38713854 2025-09-29 02:55:17,675 - ERROR - VM ctest-right_vm-38713854 has failed to come up 2025-09-29 02:55:17,676 - ERROR - Nova failed to get host of the VM 2025-09-29 02:55:17,676 - ERROR - VM ctest-right_vm-38713854 has failed to come up 2025-09-29 02:55:17,676 - ERROR - Nova failed to get host of the VM 2025-09-29 02:55:17,798 - INFO - Skip interface_detach for VM ctest-left_vm-11141336 in state BUILD 2025-09-29 02:55:17,799 - INFO - Deleting VM ctest-left_vm-11141336 2025-09-29 02:55:17,799 - ERROR - VM ctest-left_vm-11141336 has failed to come up 2025-09-29 02:55:17,799 - ERROR - Nova failed to get host of the VM 2025-09-29 02:55:17,799 - ERROR - VM ctest-left_vm-11141336 has failed to come up 2025-09-29 02:55:17,799 - ERROR - Nova failed to get host of the VM 2025-09-29 02:55:17,873 - INFO - Deleting VN ctest-trans_right_vn-89975738 2025-09-29 02:55:18,050 - DEBUG - Response for deleting network () 2025-09-29 02:55:18,050 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/1695dd04-5638-43dc-96cf-cc3df72ff5bc 2025-09-29 02:55:18,056 - DEBUG - Response Code: 404 2025-09-29 02:55:18,061 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:18,072 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:18,089 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:18,189 - INFO - Validated that VN ctest-trans_right_vn-89975738 is not found in API Server 2025-09-29 02:55:18,200 - DEBUG - VN ctest-trans_right_vn-89975738 is not present in Agent 10.0.0.27 2025-09-29 02:55:18,213 - DEBUG - VN ctest-trans_right_vn-89975738 is not present in Agent 10.0.0.131 2025-09-29 02:55:18,213 - INFO - Validated that VN ctest-trans_right_vn-89975738 is not in any agent 2025-09-29 02:55:18,252 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-89975738 info 2025-09-29 02:55:18,252 - INFO - Deleting VN ctest-trans_left_vn-91960265 2025-09-29 02:55:18,410 - DEBUG - Response for deleting network () 2025-09-29 02:55:18,410 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/915af6b1-6ea3-4366-8327-6036fb5e9dbe 2025-09-29 02:55:18,416 - DEBUG - Response Code: 404 2025-09-29 02:55:18,416 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:18,425 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:18,449 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:18,557 - INFO - Validated that VN ctest-trans_left_vn-91960265 is not found in API Server 2025-09-29 02:55:18,570 - DEBUG - VN ctest-trans_left_vn-91960265 is not present in Agent 10.0.0.27 2025-09-29 02:55:18,588 - DEBUG - VN ctest-trans_left_vn-91960265 is not present in Agent 10.0.0.131 2025-09-29 02:55:18,588 - INFO - Validated that VN ctest-trans_left_vn-91960265 is not in any agent 2025-09-29 02:55:18,622 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-91960265 info 2025-09-29 02:55:18,622 - INFO - Deleting VN ctest-right_vn-27639614 2025-09-29 02:55:18,660 - DEBUG - VN def9311b-f8bb-47ce-a113-49542c2dcecd still in use: Unable to complete operation on network def9311b-f8bb-47ce-a113-49542c2dcecd. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f6f16263-b0af-4c4d-b4a7-f74b07e340f2'] 2025-09-29 02:55:18,660 - WARNING - Deleting VN ctest-right_vn-27639614 failed..Will retry 2025-09-29 02:55:20,851 - DEBUG - Response for deleting network () 2025-09-29 02:55:20,851 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/044baa7a-33fc-4981-8f92-b915351aa399 2025-09-29 02:55:20,861 - DEBUG - Response Code: 404 2025-09-29 02:55:20,861 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:20,867 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:20,924 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:21,033 - INFO - Validated that VN ctest-right_vn-27639614 is not found in API Server 2025-09-29 02:55:21,043 - DEBUG - VN ctest-right_vn-27639614 is not present in Agent 10.0.0.27 2025-09-29 02:55:21,053 - DEBUG - VN ctest-right_vn-27639614 is not present in Agent 10.0.0.131 2025-09-29 02:55:21,053 - INFO - Validated that VN ctest-right_vn-27639614 is not in any agent 2025-09-29 02:55:21,087 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-27639614 info 2025-09-29 02:55:21,087 - INFO - Deleting VN ctest-left_vn-52985187 2025-09-29 02:55:21,285 - DEBUG - Response for deleting network () 2025-09-29 02:55:21,286 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f2af0264-2fd7-49e9-b4a7-884f973012eb 2025-09-29 02:55:21,291 - DEBUG - Response Code: 404 2025-09-29 02:55:21,292 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:21,305 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:21,320 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:21,430 - INFO - Validated that VN ctest-left_vn-52985187 is not found in API Server 2025-09-29 02:55:21,441 - DEBUG - VN ctest-left_vn-52985187 is not present in Agent 10.0.0.27 2025-09-29 02:55:21,453 - DEBUG - VN ctest-left_vn-52985187 is not present in Agent 10.0.0.131 2025-09-29 02:55:21,453 - INFO - Validated that VN ctest-left_vn-52985187 is not in any agent 2025-09-29 02:55:21,490 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-52985187 info 2025-09-29 02:55:21,490 - INFO - Deleting VN ctest-mgmt_vn-08000462 2025-09-29 02:55:21,616 - DEBUG - Response for deleting network () 2025-09-29 02:55:21,616 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/50450082-d37b-4e47-bfa8-4e1e53d9e2ec 2025-09-29 02:55:21,627 - DEBUG - Response Code: 404 2025-09-29 02:55:21,627 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-09-29 02:55:21,641 - DEBUG - Requesting: http://10.0.0.38:8082/domain/026b1476-0afc-4093-a11e-3a5638365dda 2025-09-29 02:55:21,670 - DEBUG - Requesting: http://10.0.0.38:8082/project/205884c5-e313-4121-baa7-a7cb62453f70 2025-09-29 02:55:21,774 - INFO - Validated that VN ctest-mgmt_vn-08000462 is not found in API Server 2025-09-29 02:55:21,788 - DEBUG - VN ctest-mgmt_vn-08000462 is not present in Agent 10.0.0.27 2025-09-29 02:55:21,799 - DEBUG - VN ctest-mgmt_vn-08000462 is not present in Agent 10.0.0.131 2025-09-29 02:55:21,799 - INFO - Validated that VN ctest-mgmt_vn-08000462 is not in any agent 2025-09-29 02:55:21,836 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-08000462 info 2025-09-29 02:55:23,137 - DEBUG - No XMPP flaps were noticed during the test 2025-09-29 02:55:23,137 - INFO - 2025-09-29 02:55:23,137 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16] 2025-09-29 02:55:23,138 - INFO - -------------------------------------------------------------------------------- 2025-09-29 02:55:23,951 - INFO - Deleted project: ctest-TestSvcHC-84201910, ID : 205884c5-e313-4121-baa7-a7cb62453f70