2025-07-21 13:39:22,738 - INFO - Domain Default found not creating
2025-07-21 13:39:23,073 - INFO - Project ctest-TestSvcHC-09300673 not found, creating it
2025-07-21 13:39:23,845 - INFO - Created Project:ctest-TestSvcHC-09300673, ID : 0bd3da79-cc90-4714-892f-0e326a2da01f 
2025-07-21 13:39:26,233 - INFO - ================================================================================
2025-07-21 13:39:26,233 - INFO - STARTING TEST    : test_svc_hc_basic
2025-07-21 13:39:26,574 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with
2025-07-21 13:39:26,574 - INFO - Initial checks done. Running the testcase now
2025-07-21 13:39:26,575 - INFO - 
2025-07-21 13:39:27,392 - DEBUG - Response for create_network : {'network': {'id': '26404131-f529-45b9-a8de-63ed44e868cf', 'name': 'ctest-mgmt_vn-98250792', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'project_id': '0bd3da79cc904714892f0e326a2da01f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-09300673', 'ctest-mgmt_vn-98250792'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:39:27,603 - DEBUG - Response for create_subnet : {'subnet': {'id': 'facd860e-2572-483a-a918-d4c6ff22ce29', 'name': '', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'network_id': '26404131-f529-45b9-a8de-63ed44e868cf', 'ip_version': 4, 'cidr': '79.100.234.192/26', 'allocation_pools': [{'start': '79.100.234.194', 'end': '79.100.234.254'}], 'gateway_ip': '79.100.234.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '79.100.234.194', 'tags': [], 'project_id': '0bd3da79cc904714892f0e326a2da01f'}}
2025-07-21 13:39:27,630 - INFO - Created VN ctest-mgmt_vn-98250792
2025-07-21 13:39:27,689 - DEBUG - VN ctest-mgmt_vn-98250792 UUID is 26404131-f529-45b9-a8de-63ed44e868cf
2025-07-21 13:39:27,813 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:39:28,151 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:39:28,199 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:39:28,232 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:39:28,346 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/26404131-f529-45b9-a8de-63ed44e868cf
2025-07-21 13:39:28,371 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/26404131-f529-45b9-a8de-63ed44e868cf
2025-07-21 13:39:28,393 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ce8bc3b-78fc-4247-a849-99962ed8f1a9
2025-07-21 13:39:28,409 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ce8bc3b-78fc-4247-a849-99962ed8f1a9
2025-07-21 13:39:28,422 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/698c1df9-aef9-4445-8a3e-cf7cc5a0a3e3
2025-07-21 13:39:28,432 - DEBUG - Route Targets: ['target:64512:8000011']
2025-07-21 13:39:28,432 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/26404131-f529-45b9-a8de-63ed44e868cf
2025-07-21 13:39:28,450 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ce8bc3b-78fc-4247-a849-99962ed8f1a9
2025-07-21 13:39:28,481 - INFO - Verified VN network id 16 for VN 26404131-f529-45b9-a8de-63ed44e868cf
2025-07-21 13:39:28,481 - INFO - Verifications in API Server for VN ctest-mgmt_vn-98250792 passed
2025-07-21 13:39:28,482 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/26404131-f529-45b9-a8de-63ed44e868cf
2025-07-21 13:39:28,501 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ce8bc3b-78fc-4247-a849-99962ed8f1a9
2025-07-21 13:39:28,518 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ce8bc3b-78fc-4247-a849-99962ed8f1a9
2025-07-21 13:39:28,536 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/698c1df9-aef9-4445-8a3e-cf7cc5a0a3e3
2025-07-21 13:39:28,572 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-09300673:ctest-mgmt_vn-98250792', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-09300673', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2756274654773069241', 'uuid-lslong': '12168273113916139727'}, 'enable': 'true', 'created': '2025-07-21T13:39:27', 'last-modified': '2025-07-21T13:39:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.030165'}
2025-07-21 13:39:28,592 - DEBUG - Route Targets: ['target:64512:8000011']
2025-07-21 13:39:28,593 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-98250792 passed
2025-07-21 13:39:28,593 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-98250792 in API_Server ======
2025-07-21 13:39:28,593 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:39:28,604 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:39:28,634 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:39:28,748 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/26404131-f529-45b9-a8de-63ed44e868cf
2025-07-21 13:39:28,766 - DEBUG - =>VN ctest-mgmt_vn-98250792 has no policy to be verified
2025-07-21 13:39:28,766 - DEBUG - Verifying the vn in opserver
2025-07-21 13:39:28,766 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-09300673:ctest-mgmt_vn-98250792 virtual network link  through opserver 10.0.0.254
2025-07-21 13:39:28,766 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:39:29,102 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:39:29,177 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-09300673:ctest-mgmt_vn-98250792', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-09300673:ctest-mgmt_vn-98250792?flat'}
2025-07-21 13:39:29,177 - INFO - Validated that VN default-domain:ctest-TestSvcHC-09300673:ctest-mgmt_vn-98250792 is found in opserver
2025-07-21 13:39:29,200 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:39:29,211 - DEBUG - VRF ids for VN ctest-mgmt_vn-98250792: {}
2025-07-21 13:39:29,558 - DEBUG - Response for create_network : {'network': {'id': 'a0a27cf4-03be-4ece-a7e9-8a72cc7a694c', 'name': 'ctest-left_vn-98260975', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'project_id': '0bd3da79cc904714892f0e326a2da01f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-09300673', 'ctest-left_vn-98260975'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:39:29,772 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e18dfeb8-eae1-4d87-9234-24ca639a5511', 'name': '', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'network_id': 'a0a27cf4-03be-4ece-a7e9-8a72cc7a694c', 'ip_version': 4, 'cidr': '30.113.41.64/26', 'allocation_pools': [{'start': '30.113.41.66', 'end': '30.113.41.126'}], 'gateway_ip': '30.113.41.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.113.41.66', 'tags': [], 'project_id': '0bd3da79cc904714892f0e326a2da01f'}}
2025-07-21 13:39:29,803 - INFO - Created VN ctest-left_vn-98260975
2025-07-21 13:39:29,865 - DEBUG - VN ctest-left_vn-98260975 UUID is a0a27cf4-03be-4ece-a7e9-8a72cc7a694c
2025-07-21 13:39:30,070 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:39:30,086 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:39:30,123 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:39:30,248 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/a0a27cf4-03be-4ece-a7e9-8a72cc7a694c
2025-07-21 13:39:30,279 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/a0a27cf4-03be-4ece-a7e9-8a72cc7a694c
2025-07-21 13:39:30,294 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/847e55d9-71eb-4752-8686-217667b65546
2025-07-21 13:39:30,309 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/847e55d9-71eb-4752-8686-217667b65546
2025-07-21 13:39:30,329 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/a63345f9-4a59-4a41-91e5-8c06bf658804
2025-07-21 13:39:30,342 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:39:30,342 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/a0a27cf4-03be-4ece-a7e9-8a72cc7a694c
2025-07-21 13:39:30,356 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/847e55d9-71eb-4752-8686-217667b65546
2025-07-21 13:39:30,380 - INFO - Verified VN network id 17 for VN a0a27cf4-03be-4ece-a7e9-8a72cc7a694c
2025-07-21 13:39:30,380 - INFO - Verifications in API Server for VN ctest-left_vn-98260975 passed
2025-07-21 13:39:30,380 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/a0a27cf4-03be-4ece-a7e9-8a72cc7a694c
2025-07-21 13:39:30,395 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/847e55d9-71eb-4752-8686-217667b65546
2025-07-21 13:39:30,405 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/847e55d9-71eb-4752-8686-217667b65546
2025-07-21 13:39:30,419 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/a63345f9-4a59-4a41-91e5-8c06bf658804
2025-07-21 13:39:30,451 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-09300673:ctest-left_vn-98260975', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-09300673', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11574951379772264142', 'uuid-lslong': '12099354099569027404'}, 'enable': 'true', 'created': '2025-07-21T13:39:29', 'last-modified': '2025-07-21T13:39:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.720550'}
2025-07-21 13:39:30,468 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:39:30,468 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-98260975 passed
2025-07-21 13:39:30,468 - DEBUG - ====Verifying policy data for ctest-left_vn-98260975 in API_Server ======
2025-07-21 13:39:30,469 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:39:30,485 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:39:30,525 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:39:30,639 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/a0a27cf4-03be-4ece-a7e9-8a72cc7a694c
2025-07-21 13:39:30,666 - DEBUG - =>VN ctest-left_vn-98260975 has no policy to be verified
2025-07-21 13:39:30,667 - DEBUG - Verifying the vn in opserver
2025-07-21 13:39:30,667 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-09300673:ctest-left_vn-98260975 virtual network link  through opserver 10.0.0.254
2025-07-21 13:39:30,667 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:39:30,696 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-09300673:ctest-left_vn-98260975', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-09300673:ctest-left_vn-98260975?flat'}
2025-07-21 13:39:30,696 - INFO - Validated that VN default-domain:ctest-TestSvcHC-09300673:ctest-left_vn-98260975 is found in opserver
2025-07-21 13:39:30,728 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:39:30,749 - DEBUG - VRF ids for VN ctest-left_vn-98260975: {}
2025-07-21 13:39:31,068 - DEBUG - Response for create_network : {'network': {'id': 'ac7cb5f8-a72a-4fc8-9ef8-7f29e37db4cd', 'name': 'ctest-right_vn-78709096', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'project_id': '0bd3da79cc904714892f0e326a2da01f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-09300673', 'ctest-right_vn-78709096'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:39:31,293 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd2527304-7aca-41ec-a4a6-d4e3af34c47d', 'name': '', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'network_id': 'ac7cb5f8-a72a-4fc8-9ef8-7f29e37db4cd', 'ip_version': 4, 'cidr': '132.47.37.192/26', 'allocation_pools': [{'start': '132.47.37.194', 'end': '132.47.37.254'}], 'gateway_ip': '132.47.37.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '132.47.37.194', 'tags': [], 'project_id': '0bd3da79cc904714892f0e326a2da01f'}}
2025-07-21 13:39:31,322 - INFO - Created VN ctest-right_vn-78709096
2025-07-21 13:39:31,386 - DEBUG - VN ctest-right_vn-78709096 UUID is ac7cb5f8-a72a-4fc8-9ef8-7f29e37db4cd
2025-07-21 13:39:31,510 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:39:31,525 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:39:31,553 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:39:31,673 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ac7cb5f8-a72a-4fc8-9ef8-7f29e37db4cd
2025-07-21 13:39:31,704 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ac7cb5f8-a72a-4fc8-9ef8-7f29e37db4cd
2025-07-21 13:39:31,724 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6a454930-1be4-437f-8ed2-d5c09f233aeb
2025-07-21 13:39:31,746 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6a454930-1be4-437f-8ed2-d5c09f233aeb
2025-07-21 13:39:31,770 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/5a4b0d91-b579-44d5-bf84-c9ed19cec866
2025-07-21 13:39:31,790 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:39:31,790 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ac7cb5f8-a72a-4fc8-9ef8-7f29e37db4cd
2025-07-21 13:39:31,820 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6a454930-1be4-437f-8ed2-d5c09f233aeb
2025-07-21 13:39:31,866 - INFO - Verified VN network id 18 for VN ac7cb5f8-a72a-4fc8-9ef8-7f29e37db4cd
2025-07-21 13:39:31,866 - INFO - Verifications in API Server for VN ctest-right_vn-78709096 passed
2025-07-21 13:39:31,866 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ac7cb5f8-a72a-4fc8-9ef8-7f29e37db4cd
2025-07-21 13:39:31,883 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6a454930-1be4-437f-8ed2-d5c09f233aeb
2025-07-21 13:39:31,897 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6a454930-1be4-437f-8ed2-d5c09f233aeb
2025-07-21 13:39:31,910 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/5a4b0d91-b579-44d5-bf84-c9ed19cec866
2025-07-21 13:39:31,936 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-09300673:ctest-right_vn-78709096', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-09300673', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12429009151196811208', 'uuid-lslong': '11455045470103909581'}, 'enable': 'true', 'created': '2025-07-21T13:39:31', 'last-modified': '2025-07-21T13:39:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.700261'}
2025-07-21 13:39:31,948 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:39:31,948 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-78709096 passed
2025-07-21 13:39:31,948 - DEBUG - ====Verifying policy data for ctest-right_vn-78709096 in API_Server ======
2025-07-21 13:39:31,949 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:39:31,959 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:39:31,983 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:39:32,099 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ac7cb5f8-a72a-4fc8-9ef8-7f29e37db4cd
2025-07-21 13:39:32,124 - DEBUG - =>VN ctest-right_vn-78709096 has no policy to be verified
2025-07-21 13:39:32,125 - DEBUG - Verifying the vn in opserver
2025-07-21 13:39:32,125 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-09300673:ctest-right_vn-78709096 virtual network link  through opserver 10.0.0.254
2025-07-21 13:39:32,125 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:39:32,152 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-09300673:ctest-right_vn-78709096', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-09300673:ctest-right_vn-78709096?flat'}
2025-07-21 13:39:32,152 - INFO - Validated that VN default-domain:ctest-TestSvcHC-09300673:ctest-right_vn-78709096 is found in opserver
2025-07-21 13:39:32,186 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:39:32,196 - DEBUG - VRF ids for VN ctest-right_vn-78709096: {}
2025-07-21 13:39:32,292 - DEBUG - Services list from nova: [<Service: 1>, <Service: 1>, <Service: 2>]
2025-07-21 13:39:34,062 - INFO - VM ([<Server: ctest-left_vm-65366338>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:39:35,776 - INFO - VM ([<Server: ctest-right_vm-86794986>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:39:35,777 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-43403829']
2025-07-21 13:39:36,193 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-43403829'] created succesfully
2025-07-21 13:41:17,156 - DEBUG - Installing image tiny_nat_fw
2025-07-21 13:41:17,157 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmtx', 'vcname': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmdk', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-07-21 13:41:17,157 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:41:17,157 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:41:17,157 - DEBUG - Unzip image
2025-07-21 13:41:17,157 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-21 13:41:17,180 - DEBUG - Try to create image in user context
2025-07-21 13:41:17,319 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-43403829']
2025-07-21 13:41:17,429 - INFO - Service template: ['default-domain', 'ctest-service_template_1-43403829'] deleted successfully.
2025-07-21 13:41:17,429 - INFO - Skip interface_detach for VM ctest-right_vm-86794986 in state BUILD
2025-07-21 13:41:17,430 - INFO - Deleting VM ctest-right_vm-86794986
2025-07-21 13:41:17,467 - ERROR - VM ctest-right_vm-86794986 has failed to come up
2025-07-21 13:41:17,467 - ERROR - Nova failed to get host of the VM
2025-07-21 13:41:17,591 - INFO - Skip interface_detach for VM ctest-left_vm-65366338 in state BUILD
2025-07-21 13:41:17,591 - INFO - Deleting VM ctest-left_vm-65366338
2025-07-21 13:41:17,592 - ERROR - VM ctest-left_vm-65366338 has failed to come up
2025-07-21 13:41:17,592 - ERROR - Nova failed to get host of the VM
2025-07-21 13:41:17,711 - INFO - Deleting VN ctest-right_vn-78709096 
2025-07-21 13:41:17,804 - DEBUG - VN ac7cb5f8-a72a-4fc8-9ef8-7f29e37db4cd still in use: Unable to complete operation on network ac7cb5f8-a72a-4fc8-9ef8-7f29e37db4cd. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-02faa2ce-5269-466d-8419-3e347ac60bec']
2025-07-21 13:41:17,805 - WARNING - Deleting VN ctest-right_vn-78709096 failed..Will retry
2025-07-21 13:41:20,188 - DEBUG - Response for deleting network ()
2025-07-21 13:41:20,189 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6a454930-1be4-437f-8ed2-d5c09f233aeb
2025-07-21 13:41:20,200 - DEBUG - Response Code: 404
2025-07-21 13:41:20,200 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:20,213 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:20,247 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:20,390 - INFO - Validated that VN ctest-right_vn-78709096 is not found in API Server
2025-07-21 13:41:20,422 - DEBUG - VN ctest-right_vn-78709096 is not present in Agent 10.0.0.254 
2025-07-21 13:41:20,422 - INFO - Validated that VN ctest-right_vn-78709096 is not in any agent
2025-07-21 13:41:20,476 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-78709096 info
2025-07-21 13:41:20,478 - INFO - Deleting VN ctest-left_vn-98260975 
2025-07-21 13:41:20,746 - DEBUG - Response for deleting network ()
2025-07-21 13:41:20,746 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/847e55d9-71eb-4752-8686-217667b65546
2025-07-21 13:41:20,762 - DEBUG - Response Code: 404
2025-07-21 13:41:20,763 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:20,775 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:20,797 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:20,899 - INFO - Validated that VN ctest-left_vn-98260975 is not found in API Server
2025-07-21 13:41:20,915 - DEBUG - VN ctest-left_vn-98260975 is not present in Agent 10.0.0.254 
2025-07-21 13:41:20,915 - INFO - Validated that VN ctest-left_vn-98260975 is not in any agent
2025-07-21 13:41:20,942 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-98260975 info
2025-07-21 13:41:20,942 - INFO - Deleting VN ctest-mgmt_vn-98250792 
2025-07-21 13:41:21,100 - DEBUG - Response for deleting network ()
2025-07-21 13:41:21,100 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ce8bc3b-78fc-4247-a849-99962ed8f1a9
2025-07-21 13:41:21,114 - DEBUG - Response Code: 404
2025-07-21 13:41:21,114 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:21,122 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:21,181 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:21,285 - INFO - Validated that VN ctest-mgmt_vn-98250792 is not found in API Server
2025-07-21 13:41:21,304 - DEBUG - VN ctest-mgmt_vn-98250792 is not present in Agent 10.0.0.254 
2025-07-21 13:41:21,304 - INFO - Validated that VN ctest-mgmt_vn-98250792 is not in any agent
2025-07-21 13:41:21,348 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-98250792 info
2025-07-21 13:41:21,651 - ERROR - <pre>Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_health_check/test_svc_health_check.py", line 16, in test_svc_hc_basic
    create_svms=True, max_inst=1)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'
</pre>

2025-07-21 13:41:21,671 - DEBUG - No XMPP flaps were noticed during the test
2025-07-21 13:41:21,671 - INFO - 
2025-07-21 13:41:21,671 - INFO - END TEST : test_svc_hc_basic : FAILED[0:01:55]
2025-07-21 13:41:21,671 - INFO - --------------------------------------------------------------------------------
2025-07-21 13:41:21,682 - INFO - ================================================================================
2025-07-21 13:41:21,682 - INFO - STARTING TEST    : test_svc_trans_segment_right_hc_fail_svm
2025-07-21 13:41:22,016 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with
2025-07-21 13:41:22,016 - INFO - Initial checks done. Running the testcase now
2025-07-21 13:41:22,016 - INFO - 
2025-07-21 13:41:22,414 - DEBUG - Response for create_network : {'network': {'id': '9d2053d2-4d38-4016-b211-41b39f4f4efc', 'name': 'ctest-mgmt_vn-13317028', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'project_id': '0bd3da79cc904714892f0e326a2da01f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-09300673', 'ctest-mgmt_vn-13317028'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:41:22,619 - DEBUG - Response for create_subnet : {'subnet': {'id': '1d91e5c8-bff5-40e5-860d-964c9b96a51d', 'name': '', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'network_id': '9d2053d2-4d38-4016-b211-41b39f4f4efc', 'ip_version': 4, 'cidr': '156.67.181.0/26', 'allocation_pools': [{'start': '156.67.181.2', 'end': '156.67.181.62'}], 'gateway_ip': '156.67.181.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '156.67.181.2', 'tags': [], 'project_id': '0bd3da79cc904714892f0e326a2da01f'}}
2025-07-21 13:41:22,648 - INFO - Created VN ctest-mgmt_vn-13317028
2025-07-21 13:41:22,718 - DEBUG - VN ctest-mgmt_vn-13317028 UUID is 9d2053d2-4d38-4016-b211-41b39f4f4efc
2025-07-21 13:41:22,904 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:22,925 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:22,966 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:23,105 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9d2053d2-4d38-4016-b211-41b39f4f4efc
2025-07-21 13:41:23,133 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9d2053d2-4d38-4016-b211-41b39f4f4efc
2025-07-21 13:41:23,159 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b53b49c-7a20-4a88-bd4e-07121581972b
2025-07-21 13:41:23,180 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b53b49c-7a20-4a88-bd4e-07121581972b
2025-07-21 13:41:23,202 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/4c616cf1-b7c0-4f17-8a41-933772b31659
2025-07-21 13:41:23,219 - DEBUG - Route Targets: ['target:64512:8000011']
2025-07-21 13:41:23,219 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9d2053d2-4d38-4016-b211-41b39f4f4efc
2025-07-21 13:41:23,243 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b53b49c-7a20-4a88-bd4e-07121581972b
2025-07-21 13:41:23,280 - INFO - Verified VN network id 16 for VN 9d2053d2-4d38-4016-b211-41b39f4f4efc
2025-07-21 13:41:23,280 - INFO - Verifications in API Server for VN ctest-mgmt_vn-13317028 passed
2025-07-21 13:41:23,280 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9d2053d2-4d38-4016-b211-41b39f4f4efc
2025-07-21 13:41:23,306 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b53b49c-7a20-4a88-bd4e-07121581972b
2025-07-21 13:41:23,327 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b53b49c-7a20-4a88-bd4e-07121581972b
2025-07-21 13:41:23,349 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/4c616cf1-b7c0-4f17-8a41-933772b31659
2025-07-21 13:41:23,376 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-09300673:ctest-mgmt_vn-13317028', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-09300673', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11322141625913196566', 'uuid-lslong': '12831109053082980092'}, 'enable': 'true', 'created': '2025-07-21T13:41:22', 'last-modified': '2025-07-21T13:41:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.814408'}
2025-07-21 13:41:23,388 - DEBUG - Route Targets: ['target:64512:8000011']
2025-07-21 13:41:23,388 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-13317028 passed
2025-07-21 13:41:23,388 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-13317028 in API_Server ======
2025-07-21 13:41:23,389 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:23,401 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:23,427 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:23,535 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9d2053d2-4d38-4016-b211-41b39f4f4efc
2025-07-21 13:41:23,553 - DEBUG - =>VN ctest-mgmt_vn-13317028 has no policy to be verified
2025-07-21 13:41:23,553 - DEBUG - Verifying the vn in opserver
2025-07-21 13:41:23,553 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-09300673:ctest-mgmt_vn-13317028 virtual network link  through opserver 10.0.0.254
2025-07-21 13:41:23,553 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:41:23,578 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-09300673:ctest-mgmt_vn-13317028', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-09300673:ctest-mgmt_vn-13317028?flat'}
2025-07-21 13:41:23,578 - INFO - Validated that VN default-domain:ctest-TestSvcHC-09300673:ctest-mgmt_vn-13317028 is found in opserver
2025-07-21 13:41:23,605 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:41:23,619 - DEBUG - VRF ids for VN ctest-mgmt_vn-13317028: {}
2025-07-21 13:41:24,009 - DEBUG - Response for create_network : {'network': {'id': 'abf14fc2-dfec-43bd-a96d-4ad1af539bc1', 'name': 'ctest-left_vn-76007940', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'project_id': '0bd3da79cc904714892f0e326a2da01f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-09300673', 'ctest-left_vn-76007940'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:41:24,308 - DEBUG - Response for create_subnet : {'subnet': {'id': '4b83e43c-7d5f-4eb4-a9fc-4882214350f1', 'name': '', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'network_id': 'abf14fc2-dfec-43bd-a96d-4ad1af539bc1', 'ip_version': 4, 'cidr': '80.127.125.192/26', 'allocation_pools': [{'start': '80.127.125.194', 'end': '80.127.125.254'}], 'gateway_ip': '80.127.125.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '80.127.125.194', 'tags': [], 'project_id': '0bd3da79cc904714892f0e326a2da01f'}}
2025-07-21 13:41:24,341 - INFO - Created VN ctest-left_vn-76007940
2025-07-21 13:41:24,409 - DEBUG - VN ctest-left_vn-76007940 UUID is abf14fc2-dfec-43bd-a96d-4ad1af539bc1
2025-07-21 13:41:24,597 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:24,614 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:24,652 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:24,795 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/abf14fc2-dfec-43bd-a96d-4ad1af539bc1
2025-07-21 13:41:24,820 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/abf14fc2-dfec-43bd-a96d-4ad1af539bc1
2025-07-21 13:41:24,846 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/38a31b8b-36bd-4d1e-b14e-c63e5bd6dc2b
2025-07-21 13:41:24,870 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/38a31b8b-36bd-4d1e-b14e-c63e5bd6dc2b
2025-07-21 13:41:24,896 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/c69dd5fa-94a9-460a-8a0a-8e98c64ba2bd
2025-07-21 13:41:24,923 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:41:24,924 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/abf14fc2-dfec-43bd-a96d-4ad1af539bc1
2025-07-21 13:41:24,965 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/38a31b8b-36bd-4d1e-b14e-c63e5bd6dc2b
2025-07-21 13:41:25,006 - INFO - Verified VN network id 17 for VN abf14fc2-dfec-43bd-a96d-4ad1af539bc1
2025-07-21 13:41:25,007 - INFO - Verifications in API Server for VN ctest-left_vn-76007940 passed
2025-07-21 13:41:25,007 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/abf14fc2-dfec-43bd-a96d-4ad1af539bc1
2025-07-21 13:41:25,043 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/38a31b8b-36bd-4d1e-b14e-c63e5bd6dc2b
2025-07-21 13:41:25,061 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/38a31b8b-36bd-4d1e-b14e-c63e5bd6dc2b
2025-07-21 13:41:25,075 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/c69dd5fa-94a9-460a-8a0a-8e98c64ba2bd
2025-07-21 13:41:25,103 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-09300673:ctest-left_vn-76007940', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-09300673', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12389771748271997885', 'uuid-lslong': '12208496429321395137'}, 'enable': 'true', 'created': '2025-07-21T13:41:23', 'last-modified': '2025-07-21T13:41:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.848948'}
2025-07-21 13:41:25,116 - DEBUG - Route Targets: ['target:64512:8000012']
2025-07-21 13:41:25,116 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-76007940 passed
2025-07-21 13:41:25,117 - DEBUG - ====Verifying policy data for ctest-left_vn-76007940 in API_Server ======
2025-07-21 13:41:25,117 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:25,128 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:25,258 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:25,351 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/abf14fc2-dfec-43bd-a96d-4ad1af539bc1
2025-07-21 13:41:25,379 - DEBUG - =>VN ctest-left_vn-76007940 has no policy to be verified
2025-07-21 13:41:25,380 - DEBUG - Verifying the vn in opserver
2025-07-21 13:41:25,380 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-09300673:ctest-left_vn-76007940 virtual network link  through opserver 10.0.0.254
2025-07-21 13:41:25,380 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:41:25,411 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-09300673:ctest-left_vn-76007940', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-09300673:ctest-left_vn-76007940?flat'}
2025-07-21 13:41:25,411 - INFO - Validated that VN default-domain:ctest-TestSvcHC-09300673:ctest-left_vn-76007940 is found in opserver
2025-07-21 13:41:25,451 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:41:25,468 - DEBUG - VRF ids for VN ctest-left_vn-76007940: {}
2025-07-21 13:41:25,860 - DEBUG - Response for create_network : {'network': {'id': '8310c300-1890-4c95-b9b3-80327ae1249d', 'name': 'ctest-right_vn-56818374', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'project_id': '0bd3da79cc904714892f0e326a2da01f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-09300673', 'ctest-right_vn-56818374'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:41:26,120 - DEBUG - Response for create_subnet : {'subnet': {'id': '8931e1af-3fef-4d90-968c-8b345a032469', 'name': '', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'network_id': '8310c300-1890-4c95-b9b3-80327ae1249d', 'ip_version': 4, 'cidr': '140.35.147.64/26', 'allocation_pools': [{'start': '140.35.147.66', 'end': '140.35.147.126'}], 'gateway_ip': '140.35.147.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '140.35.147.66', 'tags': [], 'project_id': '0bd3da79cc904714892f0e326a2da01f'}}
2025-07-21 13:41:26,155 - INFO - Created VN ctest-right_vn-56818374
2025-07-21 13:41:26,217 - DEBUG - VN ctest-right_vn-56818374 UUID is 8310c300-1890-4c95-b9b3-80327ae1249d
2025-07-21 13:41:26,415 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:26,433 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:26,475 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:26,601 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/8310c300-1890-4c95-b9b3-80327ae1249d
2025-07-21 13:41:26,631 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/8310c300-1890-4c95-b9b3-80327ae1249d
2025-07-21 13:41:26,648 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf268e84-e3f8-4c23-8802-ba935e837ef8
2025-07-21 13:41:26,659 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf268e84-e3f8-4c23-8802-ba935e837ef8
2025-07-21 13:41:26,673 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/5360e3d4-ca4c-401a-8140-0c754ab84669
2025-07-21 13:41:26,687 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:41:26,688 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/8310c300-1890-4c95-b9b3-80327ae1249d
2025-07-21 13:41:26,708 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf268e84-e3f8-4c23-8802-ba935e837ef8
2025-07-21 13:41:26,744 - INFO - Verified VN network id 18 for VN 8310c300-1890-4c95-b9b3-80327ae1249d
2025-07-21 13:41:26,744 - INFO - Verifications in API Server for VN ctest-right_vn-56818374 passed
2025-07-21 13:41:26,744 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/8310c300-1890-4c95-b9b3-80327ae1249d
2025-07-21 13:41:26,767 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf268e84-e3f8-4c23-8802-ba935e837ef8
2025-07-21 13:41:26,786 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf268e84-e3f8-4c23-8802-ba935e837ef8
2025-07-21 13:41:26,805 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/5360e3d4-ca4c-401a-8140-0c754ab84669
2025-07-21 13:41:26,848 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-09300673:ctest-right_vn-56818374', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-09300673', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9444262823775456405', 'uuid-lslong': '13381179872146171037'}, 'enable': 'true', 'created': '2025-07-21T13:41:25', 'last-modified': '2025-07-21T13:41:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.792668'}
2025-07-21 13:41:26,870 - DEBUG - Route Targets: ['target:64512:8000013']
2025-07-21 13:41:26,870 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-56818374 passed
2025-07-21 13:41:26,871 - DEBUG - ====Verifying policy data for ctest-right_vn-56818374 in API_Server ======
2025-07-21 13:41:26,871 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:26,890 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:26,929 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:27,067 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/8310c300-1890-4c95-b9b3-80327ae1249d
2025-07-21 13:41:27,103 - DEBUG - =>VN ctest-right_vn-56818374 has no policy to be verified
2025-07-21 13:41:27,104 - DEBUG - Verifying the vn in opserver
2025-07-21 13:41:27,104 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-09300673:ctest-right_vn-56818374 virtual network link  through opserver 10.0.0.254
2025-07-21 13:41:27,104 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:41:27,141 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-09300673:ctest-right_vn-56818374', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-09300673:ctest-right_vn-56818374?flat'}
2025-07-21 13:41:27,142 - INFO - Validated that VN default-domain:ctest-TestSvcHC-09300673:ctest-right_vn-56818374 is found in opserver
2025-07-21 13:41:27,178 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:41:27,199 - DEBUG - VRF ids for VN ctest-right_vn-56818374: {}
2025-07-21 13:41:27,614 - DEBUG - Response for create_network : {'network': {'id': '69d00769-8830-448a-b947-1a436177c4dd', 'name': 'ctest-trans_left_vn-02060966', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'project_id': '0bd3da79cc904714892f0e326a2da01f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-09300673', 'ctest-trans_left_vn-02060966'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:41:27,859 - DEBUG - Response for create_subnet : {'subnet': {'id': '633158a3-5577-433c-be4d-eb8e952db5c4', 'name': '', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'network_id': '69d00769-8830-448a-b947-1a436177c4dd', 'ip_version': 4, 'cidr': '161.253.161.128/26', 'allocation_pools': [{'start': '161.253.161.130', 'end': '161.253.161.190'}], 'gateway_ip': '161.253.161.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '161.253.161.130', 'tags': [], 'project_id': '0bd3da79cc904714892f0e326a2da01f'}}
2025-07-21 13:41:27,889 - INFO - Created VN ctest-trans_left_vn-02060966
2025-07-21 13:41:27,945 - DEBUG - VN ctest-trans_left_vn-02060966 UUID is 69d00769-8830-448a-b947-1a436177c4dd
2025-07-21 13:41:28,063 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:28,072 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:28,089 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:28,193 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/69d00769-8830-448a-b947-1a436177c4dd
2025-07-21 13:41:28,215 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/69d00769-8830-448a-b947-1a436177c4dd
2025-07-21 13:41:28,234 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4a773f6-b83a-4230-b056-7a1b2df9434d
2025-07-21 13:41:28,253 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4a773f6-b83a-4230-b056-7a1b2df9434d
2025-07-21 13:41:28,269 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/1f00102a-fc92-44e4-8bbe-73f5060e6622
2025-07-21 13:41:28,282 - DEBUG - Route Targets: ['target:64512:8000014']
2025-07-21 13:41:28,282 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/69d00769-8830-448a-b947-1a436177c4dd
2025-07-21 13:41:28,303 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4a773f6-b83a-4230-b056-7a1b2df9434d
2025-07-21 13:41:28,339 - INFO - Verified VN network id 19 for VN 69d00769-8830-448a-b947-1a436177c4dd
2025-07-21 13:41:28,339 - INFO - Verifications in API Server for VN ctest-trans_left_vn-02060966 passed
2025-07-21 13:41:28,340 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/69d00769-8830-448a-b947-1a436177c4dd
2025-07-21 13:41:28,363 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4a773f6-b83a-4230-b056-7a1b2df9434d
2025-07-21 13:41:28,380 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4a773f6-b83a-4230-b056-7a1b2df9434d
2025-07-21 13:41:28,398 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/1f00102a-fc92-44e4-8bbe-73f5060e6622
2025-07-21 13:41:28,435 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-09300673:ctest-trans_left_vn-02060966', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-09300673', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7624602318976074890', 'uuid-lslong': '13350668497063494877'}, 'enable': 'true', 'created': '2025-07-21T13:41:27', 'last-modified': '2025-07-21T13:41:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.618834'}
2025-07-21 13:41:28,455 - DEBUG - Route Targets: ['target:64512:8000014']
2025-07-21 13:41:28,455 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-02060966 passed
2025-07-21 13:41:28,456 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-02060966 in API_Server ======
2025-07-21 13:41:28,456 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:28,472 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:28,503 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:28,621 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/69d00769-8830-448a-b947-1a436177c4dd
2025-07-21 13:41:28,647 - DEBUG - =>VN ctest-trans_left_vn-02060966 has no policy to be verified
2025-07-21 13:41:28,647 - DEBUG - Verifying the vn in opserver
2025-07-21 13:41:28,647 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-09300673:ctest-trans_left_vn-02060966 virtual network link  through opserver 10.0.0.254
2025-07-21 13:41:28,648 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:41:28,679 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-09300673:ctest-trans_left_vn-02060966', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-09300673:ctest-trans_left_vn-02060966?flat'}
2025-07-21 13:41:28,679 - INFO - Validated that VN default-domain:ctest-TestSvcHC-09300673:ctest-trans_left_vn-02060966 is found in opserver
2025-07-21 13:41:28,710 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:41:28,726 - DEBUG - VRF ids for VN ctest-trans_left_vn-02060966: {}
2025-07-21 13:41:29,105 - DEBUG - Response for create_network : {'network': {'id': '1ddbcc41-0fc2-49e0-a9f1-07657e299a8a', 'name': 'ctest-trans_right_vn-86989756', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'project_id': '0bd3da79cc904714892f0e326a2da01f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-09300673', 'ctest-trans_right_vn-86989756'], 'port_security_enabled': True, 'description': ''}}
2025-07-21 13:41:29,436 - DEBUG - Response for create_subnet : {'subnet': {'id': '8a545e50-d73d-4dec-9a0b-8e50c10b73f5', 'name': '', 'tenant_id': '0bd3da79cc904714892f0e326a2da01f', 'network_id': '1ddbcc41-0fc2-49e0-a9f1-07657e299a8a', 'ip_version': 4, 'cidr': '86.69.146.64/26', 'allocation_pools': [{'start': '86.69.146.66', 'end': '86.69.146.126'}], 'gateway_ip': '86.69.146.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '86.69.146.66', 'tags': [], 'project_id': '0bd3da79cc904714892f0e326a2da01f'}}
2025-07-21 13:41:29,483 - INFO - Created VN ctest-trans_right_vn-86989756
2025-07-21 13:41:29,557 - DEBUG - VN ctest-trans_right_vn-86989756 UUID is 1ddbcc41-0fc2-49e0-a9f1-07657e299a8a
2025-07-21 13:41:29,690 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:29,704 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:29,727 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:29,836 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1ddbcc41-0fc2-49e0-a9f1-07657e299a8a
2025-07-21 13:41:29,859 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1ddbcc41-0fc2-49e0-a9f1-07657e299a8a
2025-07-21 13:41:29,876 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f0e093e3-feb8-4929-9feb-8978f32449fe
2025-07-21 13:41:29,890 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f0e093e3-feb8-4929-9feb-8978f32449fe
2025-07-21 13:41:29,904 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/98e4b268-b0d7-4e1e-a217-887db29051dd
2025-07-21 13:41:29,918 - DEBUG - Route Targets: ['target:64512:8000015']
2025-07-21 13:41:29,918 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1ddbcc41-0fc2-49e0-a9f1-07657e299a8a
2025-07-21 13:41:29,937 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f0e093e3-feb8-4929-9feb-8978f32449fe
2025-07-21 13:41:29,967 - INFO - Verified VN network id 20 for VN 1ddbcc41-0fc2-49e0-a9f1-07657e299a8a
2025-07-21 13:41:29,967 - INFO - Verifications in API Server for VN ctest-trans_right_vn-86989756 passed
2025-07-21 13:41:29,968 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1ddbcc41-0fc2-49e0-a9f1-07657e299a8a
2025-07-21 13:41:30,000 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f0e093e3-feb8-4929-9feb-8978f32449fe
2025-07-21 13:41:30,020 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f0e093e3-feb8-4929-9feb-8978f32449fe
2025-07-21 13:41:30,037 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/98e4b268-b0d7-4e1e-a217-887db29051dd
2025-07-21 13:41:30,058 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-09300673:ctest-trans_right_vn-86989756', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-09300673', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2151537826808875488', 'uuid-lslong': '12245576994286836362'}, 'enable': 'true', 'created': '2025-07-21T13:41:29', 'last-modified': '2025-07-21T13:41:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.704622'}
2025-07-21 13:41:30,071 - DEBUG - Route Targets: ['target:64512:8000015']
2025-07-21 13:41:30,071 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-86989756 passed
2025-07-21 13:41:30,071 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-86989756 in API_Server ======
2025-07-21 13:41:30,071 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:41:30,083 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:41:30,114 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:41:30,237 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1ddbcc41-0fc2-49e0-a9f1-07657e299a8a
2025-07-21 13:41:30,261 - DEBUG - =>VN ctest-trans_right_vn-86989756 has no policy to be verified
2025-07-21 13:41:30,261 - DEBUG - Verifying the vn in opserver
2025-07-21 13:41:30,261 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-09300673:ctest-trans_right_vn-86989756 virtual network link  through opserver 10.0.0.254
2025-07-21 13:41:30,261 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-21 13:41:30,285 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-09300673:ctest-trans_right_vn-86989756', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-09300673:ctest-trans_right_vn-86989756?flat'}
2025-07-21 13:41:30,285 - INFO - Validated that VN default-domain:ctest-TestSvcHC-09300673:ctest-trans_right_vn-86989756 is found in opserver
2025-07-21 13:41:30,312 - DEBUG - Do not have enough data to verify VN in agent
2025-07-21 13:41:30,325 - DEBUG - VRF ids for VN ctest-trans_right_vn-86989756: {}
2025-07-21 13:41:32,232 - INFO - VM ([<Server: ctest-left_vm-48669160>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:41:33,956 - INFO - VM ([<Server: ctest-right_vm-99124410>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1)
2025-07-21 13:41:33,957 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-06796618']
2025-07-21 13:41:34,345 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-06796618'] created succesfully
2025-07-21 13:43:15,387 - DEBUG - Installing image tiny_trans_fw
2025-07-21 13:43:15,387 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-07-21 13:43:15,389 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-07-21 13:43:15,390 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-07-21 13:43:15,390 - DEBUG - Unzip image
2025-07-21 13:43:15,390 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-07-21 13:43:15,431 - DEBUG - Try to create image in user context
2025-07-21 13:43:15,592 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-06796618']
2025-07-21 13:43:15,728 - INFO - Service template: ['default-domain', 'ctest-service_template_1-06796618'] deleted successfully.
2025-07-21 13:43:15,729 - INFO - Skip interface_detach for VM ctest-right_vm-99124410 in state BUILD
2025-07-21 13:43:15,729 - INFO - Deleting VM ctest-right_vm-99124410
2025-07-21 13:43:15,729 - ERROR - VM ctest-right_vm-99124410 has failed to come up
2025-07-21 13:43:15,729 - ERROR - Nova failed to get host of the VM
2025-07-21 13:43:15,832 - INFO - Skip interface_detach for VM ctest-left_vm-48669160 in state BUILD
2025-07-21 13:43:15,832 - INFO - Deleting VM ctest-left_vm-48669160
2025-07-21 13:43:15,832 - ERROR - VM ctest-left_vm-48669160 has failed to come up
2025-07-21 13:43:15,832 - ERROR - Nova failed to get host of the VM
2025-07-21 13:43:15,928 - INFO - Deleting VN ctest-trans_right_vn-86989756 
2025-07-21 13:43:16,094 - DEBUG - Response for deleting network ()
2025-07-21 13:43:16,094 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f0e093e3-feb8-4929-9feb-8978f32449fe
2025-07-21 13:43:16,099 - DEBUG - Response Code: 404
2025-07-21 13:43:16,099 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:43:16,125 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:43:16,143 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:43:16,225 - INFO - Validated that VN ctest-trans_right_vn-86989756 is not found in API Server
2025-07-21 13:43:16,243 - DEBUG - VN ctest-trans_right_vn-86989756 is not present in Agent 10.0.0.254 
2025-07-21 13:43:16,243 - INFO - Validated that VN ctest-trans_right_vn-86989756 is not in any agent
2025-07-21 13:43:16,262 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-86989756 info
2025-07-21 13:43:16,262 - INFO - Deleting VN ctest-trans_left_vn-02060966 
2025-07-21 13:43:16,391 - DEBUG - Response for deleting network ()
2025-07-21 13:43:16,391 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b4a773f6-b83a-4230-b056-7a1b2df9434d
2025-07-21 13:43:16,403 - DEBUG - Response Code: 404
2025-07-21 13:43:16,403 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:43:16,410 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:43:16,469 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:43:16,551 - INFO - Validated that VN ctest-trans_left_vn-02060966 is not found in API Server
2025-07-21 13:43:16,567 - DEBUG - VN ctest-trans_left_vn-02060966 is not present in Agent 10.0.0.254 
2025-07-21 13:43:16,567 - INFO - Validated that VN ctest-trans_left_vn-02060966 is not in any agent
2025-07-21 13:43:16,595 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-02060966 info
2025-07-21 13:43:16,595 - INFO - Deleting VN ctest-right_vn-56818374 
2025-07-21 13:43:16,716 - DEBUG - Response for deleting network ()
2025-07-21 13:43:16,716 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf268e84-e3f8-4c23-8802-ba935e837ef8
2025-07-21 13:43:16,723 - DEBUG - Response Code: 404
2025-07-21 13:43:16,724 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:43:16,729 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:43:16,793 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:43:16,892 - INFO - Validated that VN ctest-right_vn-56818374 is not found in API Server
2025-07-21 13:43:16,912 - DEBUG - VN ctest-right_vn-56818374 is not present in Agent 10.0.0.254 
2025-07-21 13:43:16,912 - INFO - Validated that VN ctest-right_vn-56818374 is not in any agent
2025-07-21 13:43:16,943 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-56818374 info
2025-07-21 13:43:16,943 - INFO - Deleting VN ctest-left_vn-76007940 
2025-07-21 13:43:17,156 - DEBUG - Response for deleting network ()
2025-07-21 13:43:17,157 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/38a31b8b-36bd-4d1e-b14e-c63e5bd6dc2b
2025-07-21 13:43:17,166 - DEBUG - Response Code: 404
2025-07-21 13:43:17,166 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:43:17,178 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:43:17,241 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:43:17,353 - INFO - Validated that VN ctest-left_vn-76007940 is not found in API Server
2025-07-21 13:43:17,373 - DEBUG - VN ctest-left_vn-76007940 is not present in Agent 10.0.0.254 
2025-07-21 13:43:17,373 - INFO - Validated that VN ctest-left_vn-76007940 is not in any agent
2025-07-21 13:43:17,405 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-76007940 info
2025-07-21 13:43:17,405 - INFO - Deleting VN ctest-mgmt_vn-13317028 
2025-07-21 13:43:17,626 - DEBUG - Response for deleting network ()
2025-07-21 13:43:17,626 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b53b49c-7a20-4a88-bd4e-07121581972b
2025-07-21 13:43:17,640 - DEBUG - Response Code: 404
2025-07-21 13:43:17,640 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-21 13:43:17,651 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33
2025-07-21 13:43:17,670 - DEBUG - Requesting: http://10.0.0.254:8082/project/0bd3da79-cc90-4714-892f-0e326a2da01f
2025-07-21 13:43:17,767 - INFO - Validated that VN ctest-mgmt_vn-13317028 is not found in API Server
2025-07-21 13:43:17,789 - DEBUG - VN ctest-mgmt_vn-13317028 is not present in Agent 10.0.0.254 
2025-07-21 13:43:17,789 - INFO - Validated that VN ctest-mgmt_vn-13317028 is not in any agent
2025-07-21 13:43:17,828 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-13317028 info
2025-07-21 13:43:18,152 - ERROR - <pre>Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_health_check/test_svc_health_check.py", line 137, in test_svc_trans_segment_right_hc_fail_svm
    assert self.svc_hc_fail_svm_common()
  File "/contrail-test/scripts/svc_health_check/test_svc_health_check.py", line 180, in svc_hc_fail_svm_common
    create_svms=True, max_inst=1)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-net-transparent-fw.qcow2'
</pre>

2025-07-21 13:43:18,180 - DEBUG - No XMPP flaps were noticed during the test
2025-07-21 13:43:18,180 - INFO - 
2025-07-21 13:43:18,181 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : FAILED[0:01:57]
2025-07-21 13:43:18,181 - INFO - --------------------------------------------------------------------------------
2025-07-21 13:43:19,089 - INFO - Deleted project: ctest-TestSvcHC-09300673, ID : 0bd3da79-cc90-4714-892f-0e326a2da01f