2025-10-14 12:20:03,972 - INFO - Domain Default found not creating 2025-10-14 12:20:04,141 - INFO - Project ctest-TestSvcHC-24041364 not found, creating it 2025-10-14 12:20:04,729 - INFO - Created Project:ctest-TestSvcHC-24041364, ID : 1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:06,295 - INFO - ================================================================================ 2025-10-14 12:20:06,295 - INFO - STARTING TEST : test_svc_hc_basic 2025-10-14 12:20:07,572 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.17': '0', '10.20.0.210': '0'}, '10.0.0.22': {'10.20.0.210': '0', '10.20.0.14': '0'}} with 2025-10-14 12:20:07,572 - INFO - Initial checks done. Running the testcase now 2025-10-14 12:20:07,572 - INFO - 2025-10-14 12:20:08,297 - DEBUG - Response for create_network : {'network': {'id': 'c883b5fb-e249-4adb-af01-922eee5f4fae', 'name': 'ctest-mgmt_vn-26562832', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24041364', 'ctest-mgmt_vn-26562832'], 'port_security_enabled': True, 'description': ''}} 2025-10-14 12:20:08,602 - DEBUG - Response for create_subnet : {'subnet': {'id': '3a6bd910-995e-41c3-890c-8baf2c9c7ff6', 'name': '', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'network_id': 'c883b5fb-e249-4adb-af01-922eee5f4fae', 'ip_version': 4, 'cidr': '192.174.218.128/26', 'allocation_pools': [{'start': '192.174.218.130', 'end': '192.174.218.190'}], 'gateway_ip': '192.174.218.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '192.174.218.130', 'tags': [], 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118'}} 2025-10-14 12:20:08,633 - INFO - Created VN ctest-mgmt_vn-26562832 2025-10-14 12:20:08,647 - DEBUG - VN ctest-mgmt_vn-26562832 UUID is c883b5fb-e249-4adb-af01-922eee5f4fae 2025-10-14 12:20:08,729 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:09,023 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:09,056 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:09,075 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:09,171 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c883b5fb-e249-4adb-af01-922eee5f4fae 2025-10-14 12:20:09,186 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c883b5fb-e249-4adb-af01-922eee5f4fae 2025-10-14 12:20:09,195 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/53b8ec19-ac69-4ccf-b337-c45e0011ef6d 2025-10-14 12:20:09,206 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/53b8ec19-ac69-4ccf-b337-c45e0011ef6d 2025-10-14 12:20:09,214 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/d6f4f21a-b40b-4032-afcb-29531ed91285 2025-10-14 12:20:09,222 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:20:09,222 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c883b5fb-e249-4adb-af01-922eee5f4fae 2025-10-14 12:20:09,233 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/53b8ec19-ac69-4ccf-b337-c45e0011ef6d 2025-10-14 12:20:09,252 - INFO - Verified VN network id 14 for VN c883b5fb-e249-4adb-af01-922eee5f4fae 2025-10-14 12:20:09,252 - INFO - Verifications in API Server for VN ctest-mgmt_vn-26562832 passed 2025-10-14 12:20:09,252 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c883b5fb-e249-4adb-af01-922eee5f4fae 2025-10-14 12:20:09,263 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/53b8ec19-ac69-4ccf-b337-c45e0011ef6d 2025-10-14 12:20:09,271 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/53b8ec19-ac69-4ccf-b337-c45e0011ef6d 2025-10-14 12:20:09,278 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/d6f4f21a-b40b-4032-afcb-29531ed91285 2025-10-14 12:20:09,289 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14448592122972555995', 'uuid-lslong': '12610521161879474094'}, 'enable': 'true', 'created': '2025-10-14T12:20:08', 'last-modified': '2025-10-14T12:20:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.772080'} 2025-10-14 12:20:09,295 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:20:09,300 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14448592122972555995', 'uuid-lslong': '12610521161879474094'}, 'enable': 'true', 'created': '2025-10-14T12:20:08', 'last-modified': '2025-10-14T12:20:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.783383'} 2025-10-14 12:20:09,309 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:20:09,315 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14448592122972555995', 'uuid-lslong': '12610521161879474094'}, 'enable': 'true', 'created': '2025-10-14T12:20:08', 'last-modified': '2025-10-14T12:20:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.798588'} 2025-10-14 12:20:09,322 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:20:09,322 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-26562832 passed 2025-10-14 12:20:09,322 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-26562832 in API_Server ====== 2025-10-14 12:20:09,322 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:09,329 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:09,342 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:09,443 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c883b5fb-e249-4adb-af01-922eee5f4fae 2025-10-14 12:20:09,454 - DEBUG - =>VN ctest-mgmt_vn-26562832 has no policy to be verified 2025-10-14 12:20:09,454 - DEBUG - Verifying the vn in opserver 2025-10-14 12:20:09,454 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832 virtual network link through opserver 10.0.0.254 2025-10-14 12:20:09,454 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-14 12:20:09,757 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-14 12:20:09,821 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832?flat'} 2025-10-14 12:20:09,822 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832 virtual network link through opserver 10.0.0.50 2025-10-14 12:20:09,822 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-10-14 12:20:10,125 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-10-14 12:20:10,187 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832?flat'} 2025-10-14 12:20:10,187 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832 virtual network link through opserver 10.0.0.33 2025-10-14 12:20:10,187 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-14 12:20:10,488 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-14 12:20:10,550 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832?flat'} 2025-10-14 12:20:10,550 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-26562832 is found in opserver 2025-10-14 12:20:10,571 - DEBUG - Do not have enough data to verify VN in agent 2025-10-14 12:20:10,581 - DEBUG - VRF ids for VN ctest-mgmt_vn-26562832: {} 2025-10-14 12:20:10,987 - DEBUG - Response for create_network : {'network': {'id': 'f7524463-27fd-42a2-af66-7d8ae25eb375', 'name': 'ctest-left_vn-35981031', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24041364', 'ctest-left_vn-35981031'], 'port_security_enabled': True, 'description': ''}} 2025-10-14 12:20:11,271 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dc9cf477-a7dc-4780-afab-db24a22778f4', 'name': '', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'network_id': 'f7524463-27fd-42a2-af66-7d8ae25eb375', 'ip_version': 4, 'cidr': '45.34.149.128/26', 'allocation_pools': [{'start': '45.34.149.130', 'end': '45.34.149.190'}], 'gateway_ip': '45.34.149.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '45.34.149.130', 'tags': [], 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118'}} 2025-10-14 12:20:11,297 - INFO - Created VN ctest-left_vn-35981031 2025-10-14 12:20:11,316 - DEBUG - VN ctest-left_vn-35981031 UUID is f7524463-27fd-42a2-af66-7d8ae25eb375 2025-10-14 12:20:11,406 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:11,414 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:11,428 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:11,523 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f7524463-27fd-42a2-af66-7d8ae25eb375 2025-10-14 12:20:11,535 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f7524463-27fd-42a2-af66-7d8ae25eb375 2025-10-14 12:20:11,545 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/95044b23-9fbf-4416-ac67-f25bdbfdb2b2 2025-10-14 12:20:11,556 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/95044b23-9fbf-4416-ac67-f25bdbfdb2b2 2025-10-14 12:20:11,565 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/c030fd87-e9fc-4956-a17f-a3b804e87798 2025-10-14 12:20:11,572 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-14 12:20:11,572 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f7524463-27fd-42a2-af66-7d8ae25eb375 2025-10-14 12:20:11,581 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/95044b23-9fbf-4416-ac67-f25bdbfdb2b2 2025-10-14 12:20:11,598 - INFO - Verified VN network id 15 for VN f7524463-27fd-42a2-af66-7d8ae25eb375 2025-10-14 12:20:11,598 - INFO - Verifications in API Server for VN ctest-left_vn-35981031 passed 2025-10-14 12:20:11,598 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f7524463-27fd-42a2-af66-7d8ae25eb375 2025-10-14 12:20:11,608 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/95044b23-9fbf-4416-ac67-f25bdbfdb2b2 2025-10-14 12:20:11,616 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/95044b23-9fbf-4416-ac67-f25bdbfdb2b2 2025-10-14 12:20:11,624 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/c030fd87-e9fc-4956-a17f-a3b804e87798 2025-10-14 12:20:11,642 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17821381868121834146', 'uuid-lslong': '12638927439718691701'}, 'enable': 'true', 'created': '2025-10-14T12:20:10', 'last-modified': '2025-10-14T12:20:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444011'} 2025-10-14 12:20:11,648 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-14 12:20:11,655 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17821381868121834146', 'uuid-lslong': '12638927439718691701'}, 'enable': 'true', 'created': '2025-10-14T12:20:10', 'last-modified': '2025-10-14T12:20:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.462756'} 2025-10-14 12:20:11,664 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-14 12:20:11,673 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17821381868121834146', 'uuid-lslong': '12638927439718691701'}, 'enable': 'true', 'created': '2025-10-14T12:20:10', 'last-modified': '2025-10-14T12:20:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.478636'} 2025-10-14 12:20:11,692 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-14 12:20:11,692 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-35981031 passed 2025-10-14 12:20:11,692 - DEBUG - ====Verifying policy data for ctest-left_vn-35981031 in API_Server ====== 2025-10-14 12:20:11,692 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:11,699 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:11,710 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:11,807 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f7524463-27fd-42a2-af66-7d8ae25eb375 2025-10-14 12:20:11,820 - DEBUG - =>VN ctest-left_vn-35981031 has no policy to be verified 2025-10-14 12:20:11,820 - DEBUG - Verifying the vn in opserver 2025-10-14 12:20:11,820 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031 virtual network link through opserver 10.0.0.254 2025-10-14 12:20:11,820 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-14 12:20:11,877 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031?flat'} 2025-10-14 12:20:11,877 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031 virtual network link through opserver 10.0.0.50 2025-10-14 12:20:11,877 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-10-14 12:20:11,957 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031?flat'} 2025-10-14 12:20:11,957 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031 virtual network link through opserver 10.0.0.33 2025-10-14 12:20:11,957 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-14 12:20:12,036 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031?flat'} 2025-10-14 12:20:12,036 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-35981031 is found in opserver 2025-10-14 12:20:12,060 - DEBUG - Do not have enough data to verify VN in agent 2025-10-14 12:20:12,071 - DEBUG - VRF ids for VN ctest-left_vn-35981031: {} 2025-10-14 12:20:12,402 - DEBUG - Response for create_network : {'network': {'id': '0f2093ab-e925-4a02-ad82-fb0545106219', 'name': 'ctest-right_vn-06036255', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24041364', 'ctest-right_vn-06036255'], 'port_security_enabled': True, 'description': ''}} 2025-10-14 12:20:12,648 - DEBUG - Response for create_subnet : {'subnet': {'id': '5dddd892-e83a-4b6e-a94a-0a580157d94a', 'name': '', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'network_id': '0f2093ab-e925-4a02-ad82-fb0545106219', 'ip_version': 4, 'cidr': '143.21.71.64/26', 'allocation_pools': [{'start': '143.21.71.66', 'end': '143.21.71.126'}], 'gateway_ip': '143.21.71.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '143.21.71.66', 'tags': [], 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118'}} 2025-10-14 12:20:12,676 - INFO - Created VN ctest-right_vn-06036255 2025-10-14 12:20:12,694 - DEBUG - VN ctest-right_vn-06036255 UUID is 0f2093ab-e925-4a02-ad82-fb0545106219 2025-10-14 12:20:12,780 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:12,788 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:12,802 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:12,901 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0f2093ab-e925-4a02-ad82-fb0545106219 2025-10-14 12:20:12,917 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0f2093ab-e925-4a02-ad82-fb0545106219 2025-10-14 12:20:12,928 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/5619c070-92cb-4808-9fe0-c32920feb92f 2025-10-14 12:20:12,937 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/5619c070-92cb-4808-9fe0-c32920feb92f 2025-10-14 12:20:12,950 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/7b3cd72e-a190-4c64-89e5-dfd6d8aa25d7 2025-10-14 12:20:12,958 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-14 12:20:12,958 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0f2093ab-e925-4a02-ad82-fb0545106219 2025-10-14 12:20:12,968 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/5619c070-92cb-4808-9fe0-c32920feb92f 2025-10-14 12:20:12,989 - INFO - Verified VN network id 16 for VN 0f2093ab-e925-4a02-ad82-fb0545106219 2025-10-14 12:20:12,989 - INFO - Verifications in API Server for VN ctest-right_vn-06036255 passed 2025-10-14 12:20:12,989 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0f2093ab-e925-4a02-ad82-fb0545106219 2025-10-14 12:20:13,000 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/5619c070-92cb-4808-9fe0-c32920feb92f 2025-10-14 12:20:13,010 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/5619c070-92cb-4808-9fe0-c32920feb92f 2025-10-14 12:20:13,018 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/7b3cd72e-a190-4c64-89e5-dfd6d8aa25d7 2025-10-14 12:20:13,032 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1090033476383885826', 'uuid-lslong': '12502831515586028057'}, 'enable': 'true', 'created': '2025-10-14T12:20:12', 'last-modified': '2025-10-14T12:20:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.452704'} 2025-10-14 12:20:13,040 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-14 12:20:13,048 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1090033476383885826', 'uuid-lslong': '12502831515586028057'}, 'enable': 'true', 'created': '2025-10-14T12:20:12', 'last-modified': '2025-10-14T12:20:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.466852'} 2025-10-14 12:20:13,055 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-14 12:20:13,060 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1090033476383885826', 'uuid-lslong': '12502831515586028057'}, 'enable': 'true', 'created': '2025-10-14T12:20:12', 'last-modified': '2025-10-14T12:20:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.483983'} 2025-10-14 12:20:13,067 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-14 12:20:13,067 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-06036255 passed 2025-10-14 12:20:13,067 - DEBUG - ====Verifying policy data for ctest-right_vn-06036255 in API_Server ====== 2025-10-14 12:20:13,067 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:13,075 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:13,087 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:13,188 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0f2093ab-e925-4a02-ad82-fb0545106219 2025-10-14 12:20:13,202 - DEBUG - =>VN ctest-right_vn-06036255 has no policy to be verified 2025-10-14 12:20:13,202 - DEBUG - Verifying the vn in opserver 2025-10-14 12:20:13,202 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255 virtual network link through opserver 10.0.0.254 2025-10-14 12:20:13,202 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-14 12:20:13,260 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255?flat'} 2025-10-14 12:20:13,260 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255 virtual network link through opserver 10.0.0.50 2025-10-14 12:20:13,260 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-10-14 12:20:13,320 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255?flat'} 2025-10-14 12:20:13,320 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255 virtual network link through opserver 10.0.0.33 2025-10-14 12:20:13,320 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-14 12:20:13,381 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255?flat'} 2025-10-14 12:20:13,381 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-06036255 is found in opserver 2025-10-14 12:20:13,403 - DEBUG - Do not have enough data to verify VN in agent 2025-10-14 12:20:13,418 - DEBUG - VRF ids for VN ctest-right_vn-06036255: {} 2025-10-14 12:20:13,483 - DEBUG - Services list from nova: [, , , ] 2025-10-14 12:20:14,593 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-30), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-30) 2025-10-14 12:20:15,953 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-1) 2025-10-14 12:20:15,953 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-25264417'] 2025-10-14 12:20:16,310 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-25264417'] created succesfully 2025-10-14 12:20:16,694 - DEBUG - Image by name tiny_nat_fw not found 2025-10-14 12:20:16,694 - DEBUG - Installing image tiny_nat_fw 2025-10-14 12:20:16,694 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-10-14 12:20:16,694 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-14 12:20:16,694 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-14 12:20:16,695 - DEBUG - Unzip image 2025-10-14 12:20:16,695 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-14 12:20:16,714 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-10-14 12:20:16,715 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-25264417'] 2025-10-14 12:20:16,834 - INFO - Service template: ['default-domain', 'ctest-service_template_1-25264417'] deleted successfully. 2025-10-14 12:20:16,834 - INFO - Skip interface_detach for VM ctest-right_vm-38236874 in state BUILD 2025-10-14 12:20:16,834 - INFO - Deleting VM ctest-right_vm-38236874 2025-10-14 12:20:16,880 - ERROR - VM ctest-right_vm-38236874 has failed to come up 2025-10-14 12:20:16,880 - ERROR - Nova failed to get host of the VM 2025-10-14 12:20:16,880 - ERROR - VM ctest-right_vm-38236874 has failed to come up 2025-10-14 12:20:16,880 - ERROR - Nova failed to get host of the VM 2025-10-14 12:20:17,001 - INFO - Skip interface_detach for VM ctest-left_vm-07706324 in state BUILD 2025-10-14 12:20:17,001 - INFO - Deleting VM ctest-left_vm-07706324 2025-10-14 12:20:17,001 - ERROR - VM ctest-left_vm-07706324 has failed to come up 2025-10-14 12:20:17,001 - ERROR - Nova failed to get host of the VM 2025-10-14 12:20:17,001 - ERROR - VM ctest-left_vm-07706324 has failed to come up 2025-10-14 12:20:17,001 - ERROR - Nova failed to get host of the VM 2025-10-14 12:20:17,085 - INFO - Deleting VN ctest-right_vn-06036255 2025-10-14 12:20:17,143 - DEBUG - VN 0f2093ab-e925-4a02-ad82-fb0545106219 still in use: Unable to complete operation on network 0f2093ab-e925-4a02-ad82-fb0545106219. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6dd8af16-009e-478c-8b5d-e278bf285dbf'] 2025-10-14 12:20:17,143 - WARNING - Deleting VN ctest-right_vn-06036255 failed..Will retry 2025-10-14 12:20:19,353 - DEBUG - Response for deleting network () 2025-10-14 12:20:19,353 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/5619c070-92cb-4808-9fe0-c32920feb92f 2025-10-14 12:20:19,360 - DEBUG - Response Code: 404 2025-10-14 12:20:19,360 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:19,367 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:19,390 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:19,506 - INFO - Validated that VN ctest-right_vn-06036255 is not found in API Server 2025-10-14 12:20:19,520 - DEBUG - VN ctest-right_vn-06036255 is not present in Agent 10.0.0.65 2025-10-14 12:20:19,532 - DEBUG - VN ctest-right_vn-06036255 is not present in Agent 10.0.0.22 2025-10-14 12:20:19,532 - INFO - Validated that VN ctest-right_vn-06036255 is not in any agent 2025-10-14 12:20:19,578 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-06036255 info 2025-10-14 12:20:19,579 - INFO - Deleting VN ctest-left_vn-35981031 2025-10-14 12:20:19,840 - DEBUG - Response for deleting network () 2025-10-14 12:20:19,840 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/95044b23-9fbf-4416-ac67-f25bdbfdb2b2 2025-10-14 12:20:19,859 - DEBUG - Response Code: 404 2025-10-14 12:20:19,859 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:19,870 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:19,891 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:19,999 - INFO - Validated that VN ctest-left_vn-35981031 is not found in API Server 2025-10-14 12:20:20,014 - DEBUG - VN ctest-left_vn-35981031 is not present in Agent 10.0.0.65 2025-10-14 12:20:20,027 - DEBUG - VN ctest-left_vn-35981031 is not present in Agent 10.0.0.22 2025-10-14 12:20:20,027 - INFO - Validated that VN ctest-left_vn-35981031 is not in any agent 2025-10-14 12:20:20,075 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-35981031 info 2025-10-14 12:20:20,075 - INFO - Deleting VN ctest-mgmt_vn-26562832 2025-10-14 12:20:20,317 - DEBUG - Response for deleting network () 2025-10-14 12:20:20,317 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/53b8ec19-ac69-4ccf-b337-c45e0011ef6d 2025-10-14 12:20:20,326 - DEBUG - Response Code: 404 2025-10-14 12:20:20,326 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:20,348 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:20,360 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:20,469 - INFO - Validated that VN ctest-mgmt_vn-26562832 is not found in API Server 2025-10-14 12:20:20,482 - DEBUG - VN ctest-mgmt_vn-26562832 is not present in Agent 10.0.0.65 2025-10-14 12:20:20,492 - DEBUG - VN ctest-mgmt_vn-26562832 is not present in Agent 10.0.0.22 2025-10-14 12:20:20,492 - INFO - Validated that VN ctest-mgmt_vn-26562832 is not in any agent 2025-10-14 12:20:20,526 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-26562832 info 2025-10-14 12:20:21,818 - DEBUG - No XMPP flaps were noticed during the test 2025-10-14 12:20:21,818 - INFO -
2025-10-14 12:20:21,818 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15]
2025-10-14 12:20:21,818 - INFO - -------------------------------------------------------------------------------- 2025-10-14 12:20:21,822 - INFO - ================================================================================ 2025-10-14 12:20:21,822 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-10-14 12:20:23,092 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.17': '0', '10.20.0.210': '0'}, '10.0.0.22': {'10.20.0.210': '0', '10.20.0.14': '0'}} with 2025-10-14 12:20:23,092 - INFO - Initial checks done. Running the testcase now 2025-10-14 12:20:23,092 - INFO - 2025-10-14 12:20:23,369 - DEBUG - Response for create_network : {'network': {'id': 'a7143db5-8c66-45de-aac4-b6de74d23ace', 'name': 'ctest-mgmt_vn-31160301', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24041364', 'ctest-mgmt_vn-31160301'], 'port_security_enabled': True, 'description': ''}} 2025-10-14 12:20:23,665 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a991b4d6-57e1-41cf-88d2-a2b36d3cb89a', 'name': '', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'network_id': 'a7143db5-8c66-45de-aac4-b6de74d23ace', 'ip_version': 4, 'cidr': '23.29.250.192/26', 'allocation_pools': [{'start': '23.29.250.194', 'end': '23.29.250.254'}], 'gateway_ip': '23.29.250.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '23.29.250.194', 'tags': [], 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118'}} 2025-10-14 12:20:23,692 - INFO - Created VN ctest-mgmt_vn-31160301 2025-10-14 12:20:23,709 - DEBUG - VN ctest-mgmt_vn-31160301 UUID is a7143db5-8c66-45de-aac4-b6de74d23ace 2025-10-14 12:20:23,790 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:23,797 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:23,810 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:23,934 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/a7143db5-8c66-45de-aac4-b6de74d23ace 2025-10-14 12:20:23,947 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/a7143db5-8c66-45de-aac4-b6de74d23ace 2025-10-14 12:20:23,959 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9d3e4f17-5c31-4c89-8e7d-e884c9b509f2 2025-10-14 12:20:23,970 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9d3e4f17-5c31-4c89-8e7d-e884c9b509f2 2025-10-14 12:20:23,982 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/092ba9cb-c553-4a14-a563-b4a126d4f524 2025-10-14 12:20:23,991 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:20:23,991 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/a7143db5-8c66-45de-aac4-b6de74d23ace 2025-10-14 12:20:24,004 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9d3e4f17-5c31-4c89-8e7d-e884c9b509f2 2025-10-14 12:20:24,028 - INFO - Verified VN network id 14 for VN a7143db5-8c66-45de-aac4-b6de74d23ace 2025-10-14 12:20:24,028 - INFO - Verifications in API Server for VN ctest-mgmt_vn-31160301 passed 2025-10-14 12:20:24,028 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/a7143db5-8c66-45de-aac4-b6de74d23ace 2025-10-14 12:20:24,039 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9d3e4f17-5c31-4c89-8e7d-e884c9b509f2 2025-10-14 12:20:24,047 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9d3e4f17-5c31-4c89-8e7d-e884c9b509f2 2025-10-14 12:20:24,057 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/092ba9cb-c553-4a14-a563-b4a126d4f524 2025-10-14 12:20:24,070 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12039315553822066142', 'uuid-lslong': '12305161148441967310'}, 'enable': 'true', 'created': '2025-10-14T12:20:23', 'last-modified': '2025-10-14T12:20:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.487804'} 2025-10-14 12:20:24,076 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:20:24,084 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12039315553822066142', 'uuid-lslong': '12305161148441967310'}, 'enable': 'true', 'created': '2025-10-14T12:20:23', 'last-modified': '2025-10-14T12:20:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.499450'} 2025-10-14 12:20:24,090 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:20:24,097 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12039315553822066142', 'uuid-lslong': '12305161148441967310'}, 'enable': 'true', 'created': '2025-10-14T12:20:23', 'last-modified': '2025-10-14T12:20:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.518215'} 2025-10-14 12:20:24,105 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:20:24,105 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-31160301 passed 2025-10-14 12:20:24,105 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-31160301 in API_Server ====== 2025-10-14 12:20:24,105 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:24,112 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:24,123 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:24,228 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/a7143db5-8c66-45de-aac4-b6de74d23ace 2025-10-14 12:20:24,243 - DEBUG - =>VN ctest-mgmt_vn-31160301 has no policy to be verified 2025-10-14 12:20:24,243 - DEBUG - Verifying the vn in opserver 2025-10-14 12:20:24,243 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301 virtual network link through opserver 10.0.0.254 2025-10-14 12:20:24,244 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-14 12:20:24,259 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301?flat'} 2025-10-14 12:20:24,259 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301 virtual network link through opserver 10.0.0.50 2025-10-14 12:20:24,259 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-10-14 12:20:24,278 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301?flat'} 2025-10-14 12:20:24,278 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301 virtual network link through opserver 10.0.0.33 2025-10-14 12:20:24,278 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-14 12:20:24,293 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301?flat'} 2025-10-14 12:20:24,293 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24041364:ctest-mgmt_vn-31160301 is found in opserver 2025-10-14 12:20:24,321 - DEBUG - Do not have enough data to verify VN in agent 2025-10-14 12:20:24,332 - DEBUG - VRF ids for VN ctest-mgmt_vn-31160301: {} 2025-10-14 12:20:24,650 - DEBUG - Response for create_network : {'network': {'id': 'b17f51c8-dc3f-404b-80c7-fdf9cb85fa85', 'name': 'ctest-left_vn-44177549', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24041364', 'ctest-left_vn-44177549'], 'port_security_enabled': True, 'description': ''}} 2025-10-14 12:20:24,888 - DEBUG - Response for create_subnet : {'subnet': {'id': '61413c9a-aff8-4f6c-844d-d911c7b2a884', 'name': '', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'network_id': 'b17f51c8-dc3f-404b-80c7-fdf9cb85fa85', 'ip_version': 4, 'cidr': '136.233.150.0/26', 'allocation_pools': [{'start': '136.233.150.2', 'end': '136.233.150.62'}], 'gateway_ip': '136.233.150.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '136.233.150.2', 'tags': [], 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118'}} 2025-10-14 12:20:24,912 - INFO - Created VN ctest-left_vn-44177549 2025-10-14 12:20:24,923 - DEBUG - VN ctest-left_vn-44177549 UUID is b17f51c8-dc3f-404b-80c7-fdf9cb85fa85 2025-10-14 12:20:25,000 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:25,007 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:25,020 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:25,119 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b17f51c8-dc3f-404b-80c7-fdf9cb85fa85 2025-10-14 12:20:25,135 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b17f51c8-dc3f-404b-80c7-fdf9cb85fa85 2025-10-14 12:20:25,146 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ee4c598-7664-4d11-aa2c-8c25a023afb8 2025-10-14 12:20:25,161 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ee4c598-7664-4d11-aa2c-8c25a023afb8 2025-10-14 12:20:25,174 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/3f2867ad-b01b-496b-8cbb-ef7c9d77a4ff 2025-10-14 12:20:25,186 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-14 12:20:25,186 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b17f51c8-dc3f-404b-80c7-fdf9cb85fa85 2025-10-14 12:20:25,197 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ee4c598-7664-4d11-aa2c-8c25a023afb8 2025-10-14 12:20:25,215 - INFO - Verified VN network id 15 for VN b17f51c8-dc3f-404b-80c7-fdf9cb85fa85 2025-10-14 12:20:25,215 - INFO - Verifications in API Server for VN ctest-left_vn-44177549 passed 2025-10-14 12:20:25,216 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b17f51c8-dc3f-404b-80c7-fdf9cb85fa85 2025-10-14 12:20:25,226 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ee4c598-7664-4d11-aa2c-8c25a023afb8 2025-10-14 12:20:25,233 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ee4c598-7664-4d11-aa2c-8c25a023afb8 2025-10-14 12:20:25,241 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/3f2867ad-b01b-496b-8cbb-ef7c9d77a4ff 2025-10-14 12:20:25,254 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12790031389885939787', 'uuid-lslong': '9279664806523435653'}, 'enable': 'true', 'created': '2025-10-14T12:20:24', 'last-modified': '2025-10-14T12:20:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.441632'} 2025-10-14 12:20:25,261 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-14 12:20:25,267 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12790031389885939787', 'uuid-lslong': '9279664806523435653'}, 'enable': 'true', 'created': '2025-10-14T12:20:24', 'last-modified': '2025-10-14T12:20:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.455476'} 2025-10-14 12:20:25,273 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-14 12:20:25,282 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12790031389885939787', 'uuid-lslong': '9279664806523435653'}, 'enable': 'true', 'created': '2025-10-14T12:20:24', 'last-modified': '2025-10-14T12:20:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.469158'} 2025-10-14 12:20:25,288 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-14 12:20:25,289 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-44177549 passed 2025-10-14 12:20:25,289 - DEBUG - ====Verifying policy data for ctest-left_vn-44177549 in API_Server ====== 2025-10-14 12:20:25,289 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:25,295 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:25,307 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:25,404 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b17f51c8-dc3f-404b-80c7-fdf9cb85fa85 2025-10-14 12:20:25,420 - DEBUG - =>VN ctest-left_vn-44177549 has no policy to be verified 2025-10-14 12:20:25,420 - DEBUG - Verifying the vn in opserver 2025-10-14 12:20:25,420 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549 virtual network link through opserver 10.0.0.254 2025-10-14 12:20:25,420 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-14 12:20:25,432 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549?flat'} 2025-10-14 12:20:25,432 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549 virtual network link through opserver 10.0.0.50 2025-10-14 12:20:25,432 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-10-14 12:20:25,451 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549?flat'} 2025-10-14 12:20:25,451 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549 virtual network link through opserver 10.0.0.33 2025-10-14 12:20:25,451 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-14 12:20:25,467 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549?flat'} 2025-10-14 12:20:25,467 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24041364:ctest-left_vn-44177549 is found in opserver 2025-10-14 12:20:25,490 - DEBUG - Do not have enough data to verify VN in agent 2025-10-14 12:20:25,504 - DEBUG - VRF ids for VN ctest-left_vn-44177549: {} 2025-10-14 12:20:25,834 - DEBUG - Response for create_network : {'network': {'id': '1f8c8dc5-c3ea-4d03-9717-e8a1c77f79eb', 'name': 'ctest-right_vn-12745358', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24041364', 'ctest-right_vn-12745358'], 'port_security_enabled': True, 'description': ''}} 2025-10-14 12:20:26,083 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ab2b8943-3410-4837-94ad-c2dace8cddae', 'name': '', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'network_id': '1f8c8dc5-c3ea-4d03-9717-e8a1c77f79eb', 'ip_version': 4, 'cidr': '123.90.157.64/26', 'allocation_pools': [{'start': '123.90.157.66', 'end': '123.90.157.126'}], 'gateway_ip': '123.90.157.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '123.90.157.66', 'tags': [], 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118'}} 2025-10-14 12:20:26,107 - INFO - Created VN ctest-right_vn-12745358 2025-10-14 12:20:26,121 - DEBUG - VN ctest-right_vn-12745358 UUID is 1f8c8dc5-c3ea-4d03-9717-e8a1c77f79eb 2025-10-14 12:20:26,206 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:26,212 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:26,223 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:26,322 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1f8c8dc5-c3ea-4d03-9717-e8a1c77f79eb 2025-10-14 12:20:26,334 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1f8c8dc5-c3ea-4d03-9717-e8a1c77f79eb 2025-10-14 12:20:26,346 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cefcf937-afec-4cad-a3b9-6dd7049f66da 2025-10-14 12:20:26,353 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cefcf937-afec-4cad-a3b9-6dd7049f66da 2025-10-14 12:20:26,362 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/af57422c-b6ee-4c5e-add3-e63ac15491d5 2025-10-14 12:20:26,370 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-14 12:20:26,370 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1f8c8dc5-c3ea-4d03-9717-e8a1c77f79eb 2025-10-14 12:20:26,379 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cefcf937-afec-4cad-a3b9-6dd7049f66da 2025-10-14 12:20:26,398 - INFO - Verified VN network id 16 for VN 1f8c8dc5-c3ea-4d03-9717-e8a1c77f79eb 2025-10-14 12:20:26,398 - INFO - Verifications in API Server for VN ctest-right_vn-12745358 passed 2025-10-14 12:20:26,398 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1f8c8dc5-c3ea-4d03-9717-e8a1c77f79eb 2025-10-14 12:20:26,408 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cefcf937-afec-4cad-a3b9-6dd7049f66da 2025-10-14 12:20:26,417 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cefcf937-afec-4cad-a3b9-6dd7049f66da 2025-10-14 12:20:26,424 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/af57422c-b6ee-4c5e-add3-e63ac15491d5 2025-10-14 12:20:26,436 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2273347792450243843', 'uuid-lslong': '10887426405725862379'}, 'enable': 'true', 'created': '2025-10-14T12:20:25', 'last-modified': '2025-10-14T12:20:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.412732'} 2025-10-14 12:20:26,442 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-14 12:20:26,447 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2273347792450243843', 'uuid-lslong': '10887426405725862379'}, 'enable': 'true', 'created': '2025-10-14T12:20:25', 'last-modified': '2025-10-14T12:20:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424640'} 2025-10-14 12:20:26,454 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-14 12:20:26,459 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2273347792450243843', 'uuid-lslong': '10887426405725862379'}, 'enable': 'true', 'created': '2025-10-14T12:20:25', 'last-modified': '2025-10-14T12:20:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.437257'} 2025-10-14 12:20:26,466 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-14 12:20:26,466 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-12745358 passed 2025-10-14 12:20:26,466 - DEBUG - ====Verifying policy data for ctest-right_vn-12745358 in API_Server ====== 2025-10-14 12:20:26,466 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:26,472 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:26,485 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:26,579 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1f8c8dc5-c3ea-4d03-9717-e8a1c77f79eb 2025-10-14 12:20:26,590 - DEBUG - =>VN ctest-right_vn-12745358 has no policy to be verified 2025-10-14 12:20:26,590 - DEBUG - Verifying the vn in opserver 2025-10-14 12:20:26,590 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358 virtual network link through opserver 10.0.0.254 2025-10-14 12:20:26,590 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-14 12:20:26,605 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358?flat'} 2025-10-14 12:20:26,605 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358 virtual network link through opserver 10.0.0.50 2025-10-14 12:20:26,605 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-10-14 12:20:26,624 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358?flat'} 2025-10-14 12:20:26,624 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358 virtual network link through opserver 10.0.0.33 2025-10-14 12:20:26,625 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-14 12:20:26,639 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358?flat'} 2025-10-14 12:20:26,639 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24041364:ctest-right_vn-12745358 is found in opserver 2025-10-14 12:20:26,665 - DEBUG - Do not have enough data to verify VN in agent 2025-10-14 12:20:26,676 - DEBUG - VRF ids for VN ctest-right_vn-12745358: {} 2025-10-14 12:20:27,012 - DEBUG - Response for create_network : {'network': {'id': '5c50a279-734f-4ecc-83a5-b5b3c555700b', 'name': 'ctest-trans_left_vn-78485382', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24041364', 'ctest-trans_left_vn-78485382'], 'port_security_enabled': True, 'description': ''}} 2025-10-14 12:20:27,301 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e144f082-0395-4d92-ab93-f8d94759f3c8', 'name': '', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'network_id': '5c50a279-734f-4ecc-83a5-b5b3c555700b', 'ip_version': 4, 'cidr': '49.7.166.0/26', 'allocation_pools': [{'start': '49.7.166.2', 'end': '49.7.166.62'}], 'gateway_ip': '49.7.166.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '49.7.166.2', 'tags': [], 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118'}} 2025-10-14 12:20:27,334 - INFO - Created VN ctest-trans_left_vn-78485382 2025-10-14 12:20:27,350 - DEBUG - VN ctest-trans_left_vn-78485382 UUID is 5c50a279-734f-4ecc-83a5-b5b3c555700b 2025-10-14 12:20:27,441 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:27,449 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:27,462 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:27,570 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5c50a279-734f-4ecc-83a5-b5b3c555700b 2025-10-14 12:20:27,593 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5c50a279-734f-4ecc-83a5-b5b3c555700b 2025-10-14 12:20:27,607 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6d3b8f3-b784-4cf7-8c98-3bc7677e771a 2025-10-14 12:20:27,617 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6d3b8f3-b784-4cf7-8c98-3bc7677e771a 2025-10-14 12:20:27,631 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/2e7eeaf2-b936-4e34-9627-dcc072a08077 2025-10-14 12:20:27,644 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-14 12:20:27,644 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5c50a279-734f-4ecc-83a5-b5b3c555700b 2025-10-14 12:20:27,664 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6d3b8f3-b784-4cf7-8c98-3bc7677e771a 2025-10-14 12:20:27,686 - INFO - Verified VN network id 17 for VN 5c50a279-734f-4ecc-83a5-b5b3c555700b 2025-10-14 12:20:27,687 - INFO - Verifications in API Server for VN ctest-trans_left_vn-78485382 passed 2025-10-14 12:20:27,687 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5c50a279-734f-4ecc-83a5-b5b3c555700b 2025-10-14 12:20:27,698 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6d3b8f3-b784-4cf7-8c98-3bc7677e771a 2025-10-14 12:20:27,706 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6d3b8f3-b784-4cf7-8c98-3bc7677e771a 2025-10-14 12:20:27,715 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/2e7eeaf2-b936-4e34-9627-dcc072a08077 2025-10-14 12:20:27,731 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6651995292135542476', 'uuid-lslong': '9486187973840302091'}, 'enable': 'true', 'created': '2025-10-14T12:20:26', 'last-modified': '2025-10-14T12:20:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.518709'} 2025-10-14 12:20:27,739 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-14 12:20:27,748 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6651995292135542476', 'uuid-lslong': '9486187973840302091'}, 'enable': 'true', 'created': '2025-10-14T12:20:26', 'last-modified': '2025-10-14T12:20:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.542185'} 2025-10-14 12:20:27,760 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-14 12:20:27,768 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6651995292135542476', 'uuid-lslong': '9486187973840302091'}, 'enable': 'true', 'created': '2025-10-14T12:20:26', 'last-modified': '2025-10-14T12:20:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.547429'} 2025-10-14 12:20:27,774 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-14 12:20:27,774 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-78485382 passed 2025-10-14 12:20:27,774 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-78485382 in API_Server ====== 2025-10-14 12:20:27,774 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:27,780 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:27,792 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:27,892 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5c50a279-734f-4ecc-83a5-b5b3c555700b 2025-10-14 12:20:27,902 - DEBUG - =>VN ctest-trans_left_vn-78485382 has no policy to be verified 2025-10-14 12:20:27,902 - DEBUG - Verifying the vn in opserver 2025-10-14 12:20:27,902 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382 virtual network link through opserver 10.0.0.254 2025-10-14 12:20:27,902 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-14 12:20:27,916 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382?flat'} 2025-10-14 12:20:27,916 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382 virtual network link through opserver 10.0.0.50 2025-10-14 12:20:27,916 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-10-14 12:20:27,933 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382?flat'} 2025-10-14 12:20:27,933 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382 virtual network link through opserver 10.0.0.33 2025-10-14 12:20:27,933 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-14 12:20:27,947 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382?flat'} 2025-10-14 12:20:27,947 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24041364:ctest-trans_left_vn-78485382 is found in opserver 2025-10-14 12:20:27,968 - DEBUG - Do not have enough data to verify VN in agent 2025-10-14 12:20:27,979 - DEBUG - VRF ids for VN ctest-trans_left_vn-78485382: {} 2025-10-14 12:20:28,321 - DEBUG - Response for create_network : {'network': {'id': 'abd8531a-d857-47cb-9c5a-90bc0d07413e', 'name': 'ctest-trans_right_vn-58502949', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24041364', 'ctest-trans_right_vn-58502949'], 'port_security_enabled': True, 'description': ''}} 2025-10-14 12:20:28,599 - DEBUG - Response for create_subnet : {'subnet': {'id': '524961e6-2581-4a02-bc8f-4395de469ff5', 'name': '', 'tenant_id': '1643f1cab2ba43b4b80f98b1c5d10118', 'network_id': 'abd8531a-d857-47cb-9c5a-90bc0d07413e', 'ip_version': 4, 'cidr': '98.146.50.64/26', 'allocation_pools': [{'start': '98.146.50.66', 'end': '98.146.50.126'}], 'gateway_ip': '98.146.50.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '98.146.50.66', 'tags': [], 'project_id': '1643f1cab2ba43b4b80f98b1c5d10118'}} 2025-10-14 12:20:28,627 - INFO - Created VN ctest-trans_right_vn-58502949 2025-10-14 12:20:28,640 - DEBUG - VN ctest-trans_right_vn-58502949 UUID is abd8531a-d857-47cb-9c5a-90bc0d07413e 2025-10-14 12:20:28,729 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:28,736 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:28,748 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:28,855 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/abd8531a-d857-47cb-9c5a-90bc0d07413e 2025-10-14 12:20:28,872 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/abd8531a-d857-47cb-9c5a-90bc0d07413e 2025-10-14 12:20:28,884 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec081ad2-e76b-450a-a2b7-c07ece39ba75 2025-10-14 12:20:28,898 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec081ad2-e76b-450a-a2b7-c07ece39ba75 2025-10-14 12:20:28,909 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/af8edc5b-2e10-4391-8bdc-8f30281ee5af 2025-10-14 12:20:28,918 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-14 12:20:28,918 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/abd8531a-d857-47cb-9c5a-90bc0d07413e 2025-10-14 12:20:28,928 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec081ad2-e76b-450a-a2b7-c07ece39ba75 2025-10-14 12:20:28,946 - INFO - Verified VN network id 18 for VN abd8531a-d857-47cb-9c5a-90bc0d07413e 2025-10-14 12:20:28,947 - INFO - Verifications in API Server for VN ctest-trans_right_vn-58502949 passed 2025-10-14 12:20:28,947 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/abd8531a-d857-47cb-9c5a-90bc0d07413e 2025-10-14 12:20:28,958 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec081ad2-e76b-450a-a2b7-c07ece39ba75 2025-10-14 12:20:28,966 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec081ad2-e76b-450a-a2b7-c07ece39ba75 2025-10-14 12:20:28,974 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/af8edc5b-2e10-4391-8bdc-8f30281ee5af 2025-10-14 12:20:28,987 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12382738550219032523', 'uuid-lslong': '11266476555167547710'}, 'enable': 'true', 'created': '2025-10-14T12:20:28', 'last-modified': '2025-10-14T12:20:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.480762'} 2025-10-14 12:20:28,993 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-14 12:20:28,999 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12382738550219032523', 'uuid-lslong': '11266476555167547710'}, 'enable': 'true', 'created': '2025-10-14T12:20:28', 'last-modified': '2025-10-14T12:20:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.481417'} 2025-10-14 12:20:29,006 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-14 12:20:29,012 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24041364', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12382738550219032523', 'uuid-lslong': '11266476555167547710'}, 'enable': 'true', 'created': '2025-10-14T12:20:28', 'last-modified': '2025-10-14T12:20:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.505169'} 2025-10-14 12:20:29,020 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-14 12:20:29,020 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-58502949 passed 2025-10-14 12:20:29,020 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-58502949 in API_Server ====== 2025-10-14 12:20:29,020 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:29,028 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:29,041 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:29,145 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/abd8531a-d857-47cb-9c5a-90bc0d07413e 2025-10-14 12:20:29,156 - DEBUG - =>VN ctest-trans_right_vn-58502949 has no policy to be verified 2025-10-14 12:20:29,156 - DEBUG - Verifying the vn in opserver 2025-10-14 12:20:29,156 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949 virtual network link through opserver 10.0.0.254 2025-10-14 12:20:29,156 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-14 12:20:29,170 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949?flat'} 2025-10-14 12:20:29,170 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949 virtual network link through opserver 10.0.0.50 2025-10-14 12:20:29,170 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-10-14 12:20:29,186 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949?flat'} 2025-10-14 12:20:29,186 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949 virtual network link through opserver 10.0.0.33 2025-10-14 12:20:29,186 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-14 12:20:29,202 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949?flat'} 2025-10-14 12:20:29,202 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24041364:ctest-trans_right_vn-58502949 is found in opserver 2025-10-14 12:20:29,225 - DEBUG - Do not have enough data to verify VN in agent 2025-10-14 12:20:29,234 - DEBUG - VRF ids for VN ctest-trans_right_vn-58502949: {} 2025-10-14 12:20:30,379 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-1) 2025-10-14 12:20:31,801 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-30), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-30) 2025-10-14 12:20:31,802 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-13989801'] 2025-10-14 12:20:32,118 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-13989801'] created succesfully 2025-10-14 12:20:32,608 - DEBUG - Image by name tiny_trans_fw not found 2025-10-14 12:20:32,608 - DEBUG - Installing image tiny_trans_fw 2025-10-14 12:20:32,608 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-10-14 12:20:32,608 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-14 12:20:32,609 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-14 12:20:32,609 - DEBUG - Unzip image 2025-10-14 12:20:32,609 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-14 12:20:32,637 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-10-14 12:20:32,637 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-13989801'] 2025-10-14 12:20:32,746 - INFO - Service template: ['default-domain', 'ctest-service_template_1-13989801'] deleted successfully. 2025-10-14 12:20:32,746 - INFO - Skip interface_detach for VM ctest-right_vm-80919587 in state BUILD 2025-10-14 12:20:32,747 - INFO - Deleting VM ctest-right_vm-80919587 2025-10-14 12:20:32,747 - ERROR - VM ctest-right_vm-80919587 has failed to come up 2025-10-14 12:20:32,747 - ERROR - Nova failed to get host of the VM 2025-10-14 12:20:32,747 - ERROR - VM ctest-right_vm-80919587 has failed to come up 2025-10-14 12:20:32,748 - ERROR - Nova failed to get host of the VM 2025-10-14 12:20:32,850 - INFO - Skip interface_detach for VM ctest-left_vm-84037998 in state BUILD 2025-10-14 12:20:32,850 - INFO - Deleting VM ctest-left_vm-84037998 2025-10-14 12:20:32,851 - ERROR - VM ctest-left_vm-84037998 has failed to come up 2025-10-14 12:20:32,851 - ERROR - Nova failed to get host of the VM 2025-10-14 12:20:32,851 - ERROR - VM ctest-left_vm-84037998 has failed to come up 2025-10-14 12:20:32,851 - ERROR - Nova failed to get host of the VM 2025-10-14 12:20:32,945 - INFO - Deleting VN ctest-trans_right_vn-58502949 2025-10-14 12:20:33,238 - DEBUG - Response for deleting network () 2025-10-14 12:20:33,238 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ec081ad2-e76b-450a-a2b7-c07ece39ba75 2025-10-14 12:20:33,249 - DEBUG - Response Code: 404 2025-10-14 12:20:33,249 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:33,265 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:33,291 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:33,437 - INFO - Validated that VN ctest-trans_right_vn-58502949 is not found in API Server 2025-10-14 12:20:33,456 - DEBUG - VN ctest-trans_right_vn-58502949 is not present in Agent 10.0.0.65 2025-10-14 12:20:33,472 - DEBUG - VN ctest-trans_right_vn-58502949 is not present in Agent 10.0.0.22 2025-10-14 12:20:33,472 - INFO - Validated that VN ctest-trans_right_vn-58502949 is not in any agent 2025-10-14 12:20:33,517 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-58502949 info 2025-10-14 12:20:33,517 - INFO - Deleting VN ctest-trans_left_vn-78485382 2025-10-14 12:20:33,743 - DEBUG - Response for deleting network () 2025-10-14 12:20:33,743 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6d3b8f3-b784-4cf7-8c98-3bc7677e771a 2025-10-14 12:20:33,750 - DEBUG - Response Code: 404 2025-10-14 12:20:33,750 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:33,757 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:33,824 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:33,946 - INFO - Validated that VN ctest-trans_left_vn-78485382 is not found in API Server 2025-10-14 12:20:33,959 - DEBUG - VN ctest-trans_left_vn-78485382 is not present in Agent 10.0.0.65 2025-10-14 12:20:33,968 - DEBUG - VN ctest-trans_left_vn-78485382 is not present in Agent 10.0.0.22 2025-10-14 12:20:33,968 - INFO - Validated that VN ctest-trans_left_vn-78485382 is not in any agent 2025-10-14 12:20:34,007 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-78485382 info 2025-10-14 12:20:34,007 - INFO - Deleting VN ctest-right_vn-12745358 2025-10-14 12:20:34,053 - DEBUG - VN 1f8c8dc5-c3ea-4d03-9717-e8a1c77f79eb still in use: Unable to complete operation on network 1f8c8dc5-c3ea-4d03-9717-e8a1c77f79eb. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-64ec3948-c67e-49f7-963e-c0ac2423ab83'] 2025-10-14 12:20:34,053 - WARNING - Deleting VN ctest-right_vn-12745358 failed..Will retry 2025-10-14 12:20:36,260 - DEBUG - Response for deleting network () 2025-10-14 12:20:36,260 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cefcf937-afec-4cad-a3b9-6dd7049f66da 2025-10-14 12:20:36,273 - DEBUG - Response Code: 404 2025-10-14 12:20:36,273 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:36,283 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:36,298 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:36,399 - INFO - Validated that VN ctest-right_vn-12745358 is not found in API Server 2025-10-14 12:20:36,415 - DEBUG - VN ctest-right_vn-12745358 is not present in Agent 10.0.0.65 2025-10-14 12:20:36,430 - DEBUG - VN ctest-right_vn-12745358 is not present in Agent 10.0.0.22 2025-10-14 12:20:36,430 - INFO - Validated that VN ctest-right_vn-12745358 is not in any agent 2025-10-14 12:20:36,466 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-12745358 info 2025-10-14 12:20:36,466 - INFO - Deleting VN ctest-left_vn-44177549 2025-10-14 12:20:36,647 - DEBUG - Response for deleting network () 2025-10-14 12:20:36,647 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2ee4c598-7664-4d11-aa2c-8c25a023afb8 2025-10-14 12:20:36,655 - DEBUG - Response Code: 404 2025-10-14 12:20:36,655 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:36,667 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:36,724 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:36,829 - INFO - Validated that VN ctest-left_vn-44177549 is not found in API Server 2025-10-14 12:20:36,842 - DEBUG - VN ctest-left_vn-44177549 is not present in Agent 10.0.0.65 2025-10-14 12:20:36,853 - DEBUG - VN ctest-left_vn-44177549 is not present in Agent 10.0.0.22 2025-10-14 12:20:36,853 - INFO - Validated that VN ctest-left_vn-44177549 is not in any agent 2025-10-14 12:20:36,890 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-44177549 info 2025-10-14 12:20:36,890 - INFO - Deleting VN ctest-mgmt_vn-31160301 2025-10-14 12:20:37,067 - DEBUG - Response for deleting network () 2025-10-14 12:20:37,067 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9d3e4f17-5c31-4c89-8e7d-e884c9b509f2 2025-10-14 12:20:37,073 - DEBUG - Response Code: 404 2025-10-14 12:20:37,074 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:20:37,081 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:20:37,100 - DEBUG - Requesting: http://10.0.0.254:8082/project/1643f1ca-b2ba-43b4-b80f-98b1c5d10118 2025-10-14 12:20:37,204 - INFO - Validated that VN ctest-mgmt_vn-31160301 is not found in API Server 2025-10-14 12:20:37,217 - DEBUG - VN ctest-mgmt_vn-31160301 is not present in Agent 10.0.0.65 2025-10-14 12:20:37,227 - DEBUG - VN ctest-mgmt_vn-31160301 is not present in Agent 10.0.0.22 2025-10-14 12:20:37,227 - INFO - Validated that VN ctest-mgmt_vn-31160301 is not in any agent 2025-10-14 12:20:37,261 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-31160301 info 2025-10-14 12:20:38,558 - DEBUG - No XMPP flaps were noticed during the test 2025-10-14 12:20:38,558 - INFO -
2025-10-14 12:20:38,558 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:17]
2025-10-14 12:20:38,558 - INFO - -------------------------------------------------------------------------------- 2025-10-14 12:20:39,391 - INFO - Deleted project: ctest-TestSvcHC-24041364, ID : 1643f1ca-b2ba-43b4-b80f-98b1c5d10118