2025-11-06 03:12:19,802 - INFO - Domain Default found not creating 2025-11-06 03:12:19,996 - INFO - Project ctest-TestSvcRegr-33331716 not found, creating it 2025-11-06 03:12:20,589 - INFO - Created Project:ctest-TestSvcRegr-33331716, ID : 0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:22,089 - INFO - ================================================================================ 2025-11-06 03:12:22,089 - INFO - STARTING TEST : test_svc_in_net_nat_with_static_routes 2025-11-06 03:12:23,366 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.20.0.252': '0', '10.20.0.249': '0'}, '10.0.0.133': {'10.20.0.252': '0', '10.20.0.249': '0'}} with 2025-11-06 03:12:23,366 - INFO - Initial checks done. Running the testcase now 2025-11-06 03:12:23,366 - INFO - 2025-11-06 03:12:24,088 - DEBUG - Response for create_network : {'network': {'id': '766dbf92-453b-4105-a3bc-fa5668df5c3f', 'name': 'ctest-third-vn-49433653', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'project_id': '0f02614d9d2549c1bfed043ce8680f50', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33331716', 'ctest-third-vn-49433653'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:12:24,435 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e7d3c91e-20a5-4439-9e16-9f47217b85df', 'name': '', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'network_id': '766dbf92-453b-4105-a3bc-fa5668df5c3f', 'ip_version': 4, 'cidr': '177.189.4.64/26', 'allocation_pools': [{'start': '177.189.4.66', 'end': '177.189.4.126'}], 'gateway_ip': '177.189.4.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '177.189.4.66', 'tags': [], 'project_id': '0f02614d9d2549c1bfed043ce8680f50'}} 2025-11-06 03:12:24,464 - INFO - Created VN ctest-third-vn-49433653 2025-11-06 03:12:24,495 - DEBUG - VN ctest-third-vn-49433653 UUID is 766dbf92-453b-4105-a3bc-fa5668df5c3f 2025-11-06 03:12:24,679 - DEBUG - Services list from nova: [, , , ] 2025-11-06 03:12:25,854 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4662-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4662-2) 2025-11-06 03:12:25,898 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-06 03:12:30,991 - DEBUG - VM is in ACTIVE state now 2025-11-06 03:12:31,411 - DEBUG - Response for create_network : {'network': {'id': '2e769dde-32ba-4146-a97a-3f54813a7d72', 'name': 'ctest-mgmt_vn-60859915', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'project_id': '0f02614d9d2549c1bfed043ce8680f50', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33331716', 'ctest-mgmt_vn-60859915'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:12:31,716 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a8842d1a-93cb-4e92-96ad-30e1e5f97970', 'name': '', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'network_id': '2e769dde-32ba-4146-a97a-3f54813a7d72', 'ip_version': 4, 'cidr': '113.89.3.128/26', 'allocation_pools': [{'start': '113.89.3.130', 'end': '113.89.3.190'}], 'gateway_ip': '113.89.3.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '113.89.3.130', 'tags': [], 'project_id': '0f02614d9d2549c1bfed043ce8680f50'}} 2025-11-06 03:12:31,748 - INFO - Created VN ctest-mgmt_vn-60859915 2025-11-06 03:12:31,763 - DEBUG - VN ctest-mgmt_vn-60859915 UUID is 2e769dde-32ba-4146-a97a-3f54813a7d72 2025-11-06 03:12:31,842 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:32,173 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:32,201 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:32,216 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:32,325 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2e769dde-32ba-4146-a97a-3f54813a7d72 2025-11-06 03:12:32,338 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2e769dde-32ba-4146-a97a-3f54813a7d72 2025-11-06 03:12:32,348 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/93020db4-34a1-4b27-8be0-aacd457a4e40 2025-11-06 03:12:32,358 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/93020db4-34a1-4b27-8be0-aacd457a4e40 2025-11-06 03:12:32,366 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d1713660-3222-443d-98b9-2e583df1f15e 2025-11-06 03:12:32,373 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:12:32,373 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2e769dde-32ba-4146-a97a-3f54813a7d72 2025-11-06 03:12:32,383 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/93020db4-34a1-4b27-8be0-aacd457a4e40 2025-11-06 03:12:32,400 - INFO - Verified VN network id 15 for VN 2e769dde-32ba-4146-a97a-3f54813a7d72 2025-11-06 03:12:32,400 - INFO - Verifications in API Server for VN ctest-mgmt_vn-60859915 passed 2025-11-06 03:12:32,400 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2e769dde-32ba-4146-a97a-3f54813a7d72 2025-11-06 03:12:32,409 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/93020db4-34a1-4b27-8be0-aacd457a4e40 2025-11-06 03:12:32,417 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/93020db4-34a1-4b27-8be0-aacd457a4e40 2025-11-06 03:12:32,423 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d1713660-3222-443d-98b9-2e583df1f15e 2025-11-06 03:12:32,436 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3348036950655910214', 'uuid-lslong': '12212142971746418034'}, 'enable': 'true', 'created': '2025-11-06T03:12:31', 'last-modified': '2025-11-06T03:12:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.771853'} 2025-11-06 03:12:32,442 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:12:32,447 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3348036950655910214', 'uuid-lslong': '12212142971746418034'}, 'enable': 'true', 'created': '2025-11-06T03:12:31', 'last-modified': '2025-11-06T03:12:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.790871'} 2025-11-06 03:12:32,453 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:12:32,459 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3348036950655910214', 'uuid-lslong': '12212142971746418034'}, 'enable': 'true', 'created': '2025-11-06T03:12:31', 'last-modified': '2025-11-06T03:12:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.804437'} 2025-11-06 03:12:32,465 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:12:32,465 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-60859915 passed 2025-11-06 03:12:32,465 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-60859915 in API_Server ====== 2025-11-06 03:12:32,465 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:32,472 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:32,482 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:32,575 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2e769dde-32ba-4146-a97a-3f54813a7d72 2025-11-06 03:12:32,589 - DEBUG - =>VN ctest-mgmt_vn-60859915 has no policy to be verified 2025-11-06 03:12:32,589 - DEBUG - Verifying the vn in opserver 2025-11-06 03:12:32,589 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915 virtual network link through opserver 10.0.0.41 2025-11-06 03:12:32,589 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:12:32,880 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:12:32,941 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915?flat'} 2025-11-06 03:12:32,941 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915 virtual network link through opserver 10.0.0.38 2025-11-06 03:12:32,941 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:12:33,237 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:12:33,302 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915?flat'} 2025-11-06 03:12:33,302 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915 virtual network link through opserver 10.0.0.131 2025-11-06 03:12:33,302 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:12:33,612 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:12:33,695 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915?flat'} 2025-11-06 03:12:33,695 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-60859915 is found in opserver 2025-11-06 03:12:33,722 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:12:33,733 - DEBUG - VRF ids for VN ctest-mgmt_vn-60859915: {} 2025-11-06 03:12:34,031 - DEBUG - Response for create_network : {'network': {'id': 'ed245465-2e5f-4e90-ad3e-bcb844382d4d', 'name': 'ctest-left_vn-36144606', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'project_id': '0f02614d9d2549c1bfed043ce8680f50', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33331716', 'ctest-left_vn-36144606'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:12:34,275 - DEBUG - Response for create_subnet : {'subnet': {'id': '5e0b4b8a-0d69-48d2-b902-eae3901e55fd', 'name': '', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'network_id': 'ed245465-2e5f-4e90-ad3e-bcb844382d4d', 'ip_version': 4, 'cidr': '147.91.170.64/26', 'allocation_pools': [{'start': '147.91.170.66', 'end': '147.91.170.126'}], 'gateway_ip': '147.91.170.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '147.91.170.66', 'tags': [], 'project_id': '0f02614d9d2549c1bfed043ce8680f50'}} 2025-11-06 03:12:34,301 - INFO - Created VN ctest-left_vn-36144606 2025-11-06 03:12:34,317 - DEBUG - VN ctest-left_vn-36144606 UUID is ed245465-2e5f-4e90-ad3e-bcb844382d4d 2025-11-06 03:12:34,395 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:34,403 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:34,415 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:34,515 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ed245465-2e5f-4e90-ad3e-bcb844382d4d 2025-11-06 03:12:34,531 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ed245465-2e5f-4e90-ad3e-bcb844382d4d 2025-11-06 03:12:34,543 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/040a21f0-213c-4c6a-b297-acc9a60f84cc 2025-11-06 03:12:34,554 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/040a21f0-213c-4c6a-b297-acc9a60f84cc 2025-11-06 03:12:34,563 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/c152c3d8-85d7-4e50-9c76-bae5d0a03a8a 2025-11-06 03:12:34,571 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:12:34,572 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ed245465-2e5f-4e90-ad3e-bcb844382d4d 2025-11-06 03:12:34,582 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/040a21f0-213c-4c6a-b297-acc9a60f84cc 2025-11-06 03:12:34,600 - INFO - Verified VN network id 16 for VN ed245465-2e5f-4e90-ad3e-bcb844382d4d 2025-11-06 03:12:34,601 - INFO - Verifications in API Server for VN ctest-left_vn-36144606 passed 2025-11-06 03:12:34,601 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ed245465-2e5f-4e90-ad3e-bcb844382d4d 2025-11-06 03:12:34,613 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/040a21f0-213c-4c6a-b297-acc9a60f84cc 2025-11-06 03:12:34,623 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/040a21f0-213c-4c6a-b297-acc9a60f84cc 2025-11-06 03:12:34,631 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/c152c3d8-85d7-4e50-9c76-bae5d0a03a8a 2025-11-06 03:12:34,644 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17087875679696932496', 'uuid-lslong': '12483622716722130253'}, 'enable': 'true', 'created': '2025-11-06T03:12:33', 'last-modified': '2025-11-06T03:12:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.440036'} 2025-11-06 03:12:34,651 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:12:34,657 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17087875679696932496', 'uuid-lslong': '12483622716722130253'}, 'enable': 'true', 'created': '2025-11-06T03:12:33', 'last-modified': '2025-11-06T03:12:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.453199'} 2025-11-06 03:12:34,665 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:12:34,671 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17087875679696932496', 'uuid-lslong': '12483622716722130253'}, 'enable': 'true', 'created': '2025-11-06T03:12:33', 'last-modified': '2025-11-06T03:12:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459449'} 2025-11-06 03:12:34,677 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:12:34,677 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-36144606 passed 2025-11-06 03:12:34,677 - DEBUG - ====Verifying policy data for ctest-left_vn-36144606 in API_Server ====== 2025-11-06 03:12:34,677 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:34,685 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:34,697 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:34,796 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ed245465-2e5f-4e90-ad3e-bcb844382d4d 2025-11-06 03:12:34,810 - DEBUG - =>VN ctest-left_vn-36144606 has no policy to be verified 2025-11-06 03:12:34,810 - DEBUG - Verifying the vn in opserver 2025-11-06 03:12:34,810 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606 virtual network link through opserver 10.0.0.41 2025-11-06 03:12:34,810 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:12:34,872 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606?flat'} 2025-11-06 03:12:34,872 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606 virtual network link through opserver 10.0.0.38 2025-11-06 03:12:34,872 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:12:34,929 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606?flat'} 2025-11-06 03:12:34,929 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606 virtual network link through opserver 10.0.0.131 2025-11-06 03:12:34,929 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:12:34,987 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606?flat'} 2025-11-06 03:12:34,987 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-36144606 is found in opserver 2025-11-06 03:12:35,011 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:12:35,023 - DEBUG - VRF ids for VN ctest-left_vn-36144606: {} 2025-11-06 03:12:35,337 - DEBUG - Response for create_network : {'network': {'id': '0e62d8ed-7aea-4b95-87c8-1d44070ac4c4', 'name': 'ctest-right_vn-31663093', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'project_id': '0f02614d9d2549c1bfed043ce8680f50', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33331716', 'ctest-right_vn-31663093'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:12:35,610 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ba527001-fa47-4fbe-b9da-ba74de74d040', 'name': '', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'network_id': '0e62d8ed-7aea-4b95-87c8-1d44070ac4c4', 'ip_version': 4, 'cidr': '210.14.248.128/26', 'allocation_pools': [{'start': '210.14.248.130', 'end': '210.14.248.190'}], 'gateway_ip': '210.14.248.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '210.14.248.130', 'tags': [], 'project_id': '0f02614d9d2549c1bfed043ce8680f50'}} 2025-11-06 03:12:35,636 - INFO - Created VN ctest-right_vn-31663093 2025-11-06 03:12:35,651 - DEBUG - VN ctest-right_vn-31663093 UUID is 0e62d8ed-7aea-4b95-87c8-1d44070ac4c4 2025-11-06 03:12:35,730 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:35,737 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:35,749 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:35,840 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0e62d8ed-7aea-4b95-87c8-1d44070ac4c4 2025-11-06 03:12:35,858 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0e62d8ed-7aea-4b95-87c8-1d44070ac4c4 2025-11-06 03:12:35,871 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/71e7b9ca-1a37-48a3-83c2-e7b9af532392 2025-11-06 03:12:35,881 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/71e7b9ca-1a37-48a3-83c2-e7b9af532392 2025-11-06 03:12:35,888 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ac1a5218-2b9b-4c5b-a158-b8ea7d2e3a89 2025-11-06 03:12:35,895 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-06 03:12:35,895 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0e62d8ed-7aea-4b95-87c8-1d44070ac4c4 2025-11-06 03:12:35,904 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/71e7b9ca-1a37-48a3-83c2-e7b9af532392 2025-11-06 03:12:35,920 - INFO - Verified VN network id 17 for VN 0e62d8ed-7aea-4b95-87c8-1d44070ac4c4 2025-11-06 03:12:35,920 - INFO - Verifications in API Server for VN ctest-right_vn-31663093 passed 2025-11-06 03:12:35,920 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0e62d8ed-7aea-4b95-87c8-1d44070ac4c4 2025-11-06 03:12:35,930 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/71e7b9ca-1a37-48a3-83c2-e7b9af532392 2025-11-06 03:12:35,939 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/71e7b9ca-1a37-48a3-83c2-e7b9af532392 2025-11-06 03:12:35,948 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ac1a5218-2b9b-4c5b-a158-b8ea7d2e3a89 2025-11-06 03:12:35,963 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1036629378729659285', 'uuid-lslong': '9784102368475530436'}, 'enable': 'true', 'created': '2025-11-06T03:12:35', 'last-modified': '2025-11-06T03:12:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.413945'} 2025-11-06 03:12:35,968 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-06 03:12:35,974 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1036629378729659285', 'uuid-lslong': '9784102368475530436'}, 'enable': 'true', 'created': '2025-11-06T03:12:35', 'last-modified': '2025-11-06T03:12:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.429110'} 2025-11-06 03:12:35,982 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-06 03:12:35,989 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1036629378729659285', 'uuid-lslong': '9784102368475530436'}, 'enable': 'true', 'created': '2025-11-06T03:12:35', 'last-modified': '2025-11-06T03:12:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.440856'} 2025-11-06 03:12:35,996 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-06 03:12:35,996 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-31663093 passed 2025-11-06 03:12:35,996 - DEBUG - ====Verifying policy data for ctest-right_vn-31663093 in API_Server ====== 2025-11-06 03:12:35,996 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:36,008 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:36,023 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:36,122 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/0e62d8ed-7aea-4b95-87c8-1d44070ac4c4 2025-11-06 03:12:36,133 - DEBUG - =>VN ctest-right_vn-31663093 has no policy to be verified 2025-11-06 03:12:36,133 - DEBUG - Verifying the vn in opserver 2025-11-06 03:12:36,133 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093 virtual network link through opserver 10.0.0.41 2025-11-06 03:12:36,133 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:12:36,197 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093?flat'} 2025-11-06 03:12:36,197 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093 virtual network link through opserver 10.0.0.38 2025-11-06 03:12:36,197 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:12:36,262 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093?flat'} 2025-11-06 03:12:36,262 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093 virtual network link through opserver 10.0.0.131 2025-11-06 03:12:36,262 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:12:36,323 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093?flat'} 2025-11-06 03:12:36,323 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31663093 is found in opserver 2025-11-06 03:12:36,349 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:12:36,362 - DEBUG - VRF ids for VN ctest-right_vn-31663093: {} 2025-11-06 03:12:37,604 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4662-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4662-1) 2025-11-06 03:12:39,029 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4662-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4662-2) 2025-11-06 03:12:39,029 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-50022665'] 2025-11-06 03:12:39,346 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-50022665'] created succesfully 2025-11-06 03:12:39,731 - DEBUG - Image by name tiny_nat_fw not found 2025-11-06 03:12:39,731 - DEBUG - Installing image tiny_nat_fw 2025-11-06 03:12:39,732 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-11-06 03:12:39,732 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz 2025-11-06 03:12:39,732 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz 2025-11-06 03:12:39,750 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz -O /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-06 03:12:39,878 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-06 03:12:39,878 - DEBUG - Unzip image 2025-11-06 03:12:39,878 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-06 03:12:39,915 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-11-06 03:12:39,916 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-50022665'] 2025-11-06 03:12:40,018 - INFO - Service template: ['default-domain', 'ctest-service_template_1-50022665'] deleted successfully. 2025-11-06 03:12:40,019 - INFO - Skip interface_detach for VM ctest-right_vm-58703246 in state BUILD 2025-11-06 03:12:40,019 - INFO - Deleting VM ctest-right_vm-58703246 2025-11-06 03:12:40,060 - ERROR - VM ctest-right_vm-58703246 has failed to come up 2025-11-06 03:12:40,060 - ERROR - Nova failed to get host of the VM 2025-11-06 03:12:40,060 - ERROR - VM ctest-right_vm-58703246 has failed to come up 2025-11-06 03:12:40,060 - ERROR - Nova failed to get host of the VM 2025-11-06 03:12:40,144 - INFO - Skip interface_detach for VM ctest-left_vm-50564511 in state BUILD 2025-11-06 03:12:40,148 - INFO - Deleting VM ctest-left_vm-50564511 2025-11-06 03:12:40,148 - ERROR - VM ctest-left_vm-50564511 has failed to come up 2025-11-06 03:12:40,149 - ERROR - Nova failed to get host of the VM 2025-11-06 03:12:40,149 - ERROR - VM ctest-left_vm-50564511 has failed to come up 2025-11-06 03:12:40,149 - ERROR - Nova failed to get host of the VM 2025-11-06 03:12:40,233 - INFO - Deleting VN ctest-right_vn-31663093 2025-11-06 03:12:40,287 - DEBUG - VN 0e62d8ed-7aea-4b95-87c8-1d44070ac4c4 still in use: Unable to complete operation on network 0e62d8ed-7aea-4b95-87c8-1d44070ac4c4. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-8952b004-7379-42db-a11a-59a77e16f6e1'] 2025-11-06 03:12:40,288 - WARNING - Deleting VN ctest-right_vn-31663093 failed..Will retry 2025-11-06 03:12:42,476 - DEBUG - Response for deleting network () 2025-11-06 03:12:42,477 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/71e7b9ca-1a37-48a3-83c2-e7b9af532392 2025-11-06 03:12:42,493 - DEBUG - Response Code: 404 2025-11-06 03:12:42,494 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:42,510 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:42,527 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:42,644 - INFO - Validated that VN ctest-right_vn-31663093 is not found in API Server 2025-11-06 03:12:42,655 - DEBUG - VN ctest-right_vn-31663093 is not present in Agent 10.0.0.240 2025-11-06 03:12:42,669 - DEBUG - VN ctest-right_vn-31663093 is not present in Agent 10.0.0.133 2025-11-06 03:12:42,669 - INFO - Validated that VN ctest-right_vn-31663093 is not in any agent 2025-11-06 03:12:42,701 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-31663093 info 2025-11-06 03:12:42,702 - INFO - Deleting VN ctest-left_vn-36144606 2025-11-06 03:12:42,892 - DEBUG - Response for deleting network () 2025-11-06 03:12:42,892 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/040a21f0-213c-4c6a-b297-acc9a60f84cc 2025-11-06 03:12:42,921 - DEBUG - Response Code: 404 2025-11-06 03:12:42,922 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:42,934 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:42,949 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:43,051 - INFO - Validated that VN ctest-left_vn-36144606 is not found in API Server 2025-11-06 03:12:43,064 - DEBUG - VN ctest-left_vn-36144606 is not present in Agent 10.0.0.240 2025-11-06 03:12:43,077 - DEBUG - VN ctest-left_vn-36144606 is not present in Agent 10.0.0.133 2025-11-06 03:12:43,077 - INFO - Validated that VN ctest-left_vn-36144606 is not in any agent 2025-11-06 03:12:43,118 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-36144606 info 2025-11-06 03:12:43,118 - INFO - Deleting VN ctest-mgmt_vn-60859915 2025-11-06 03:12:43,271 - DEBUG - Response for deleting network () 2025-11-06 03:12:43,272 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/93020db4-34a1-4b27-8be0-aacd457a4e40 2025-11-06 03:12:43,277 - DEBUG - Response Code: 404 2025-11-06 03:12:43,277 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:43,283 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:43,300 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:43,418 - INFO - Validated that VN ctest-mgmt_vn-60859915 is not found in API Server 2025-11-06 03:12:43,431 - DEBUG - VN ctest-mgmt_vn-60859915 is not present in Agent 10.0.0.240 2025-11-06 03:12:43,447 - DEBUG - VN ctest-mgmt_vn-60859915 is not present in Agent 10.0.0.133 2025-11-06 03:12:43,448 - INFO - Validated that VN ctest-mgmt_vn-60859915 is not in any agent 2025-11-06 03:12:43,483 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-60859915 info 2025-11-06 03:12:43,483 - INFO - Deleting VM ctest-vm-in-third-vn-63819077 2025-11-06 03:12:43,559 - INFO - Deleting VN ctest-third-vn-49433653 2025-11-06 03:12:43,600 - DEBUG - VN 766dbf92-453b-4105-a3bc-fa5668df5c3f still in use: Unable to complete operation on network 766dbf92-453b-4105-a3bc-fa5668df5c3f. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-0b0b27e8-3459-4f2e-a417-a6ba90d6bfca'] 2025-11-06 03:12:43,600 - WARNING - Deleting VN ctest-third-vn-49433653 failed..Will retry 2025-11-06 03:12:45,827 - DEBUG - Response for deleting network () 2025-11-06 03:12:47,132 - DEBUG - No XMPP flaps were noticed during the test 2025-11-06 03:12:47,132 - INFO - 2025-11-06 03:12:47,132 - INFO - END TEST : test_svc_in_net_nat_with_static_routes : SKIPPED[0:00:25] 2025-11-06 03:12:47,132 - INFO - -------------------------------------------------------------------------------- 2025-11-06 03:12:47,135 - INFO - ================================================================================ 2025-11-06 03:12:47,135 - INFO - STARTING TEST : test_svc_v2_transparent_datapath 2025-11-06 03:12:48,417 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.20.0.252': '0', '10.20.0.249': '0'}, '10.0.0.133': {'10.20.0.252': '0', '10.20.0.249': '0'}} with 2025-11-06 03:12:48,417 - INFO - Initial checks done. Running the testcase now 2025-11-06 03:12:48,417 - INFO - 2025-11-06 03:12:48,699 - DEBUG - Response for create_network : {'network': {'id': '615813e7-874e-4743-9bed-ff11d327c431', 'name': 'ctest-mgmt_vn-66493374', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'project_id': '0f02614d9d2549c1bfed043ce8680f50', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33331716', 'ctest-mgmt_vn-66493374'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:12:48,938 - DEBUG - Response for create_subnet : {'subnet': {'id': '9a838836-ed16-40dc-8a36-562b42648b12', 'name': '', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'network_id': '615813e7-874e-4743-9bed-ff11d327c431', 'ip_version': 4, 'cidr': '162.29.173.192/26', 'allocation_pools': [{'start': '162.29.173.194', 'end': '162.29.173.254'}], 'gateway_ip': '162.29.173.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '162.29.173.194', 'tags': [], 'project_id': '0f02614d9d2549c1bfed043ce8680f50'}} 2025-11-06 03:12:48,968 - INFO - Created VN ctest-mgmt_vn-66493374 2025-11-06 03:12:48,984 - DEBUG - VN ctest-mgmt_vn-66493374 UUID is 615813e7-874e-4743-9bed-ff11d327c431 2025-11-06 03:12:49,065 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:49,073 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:49,087 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:49,183 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/615813e7-874e-4743-9bed-ff11d327c431 2025-11-06 03:12:49,195 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/615813e7-874e-4743-9bed-ff11d327c431 2025-11-06 03:12:49,205 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0b393db9-9fb1-4e93-9e8e-9fccbcfeaf5d 2025-11-06 03:12:49,213 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0b393db9-9fb1-4e93-9e8e-9fccbcfeaf5d 2025-11-06 03:12:49,222 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/586812a0-bc6e-4a86-9c70-1efb6a24c948 2025-11-06 03:12:49,232 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:12:49,232 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/615813e7-874e-4743-9bed-ff11d327c431 2025-11-06 03:12:49,242 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0b393db9-9fb1-4e93-9e8e-9fccbcfeaf5d 2025-11-06 03:12:49,259 - INFO - Verified VN network id 14 for VN 615813e7-874e-4743-9bed-ff11d327c431 2025-11-06 03:12:49,259 - INFO - Verifications in API Server for VN ctest-mgmt_vn-66493374 passed 2025-11-06 03:12:49,260 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/615813e7-874e-4743-9bed-ff11d327c431 2025-11-06 03:12:49,270 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0b393db9-9fb1-4e93-9e8e-9fccbcfeaf5d 2025-11-06 03:12:49,277 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0b393db9-9fb1-4e93-9e8e-9fccbcfeaf5d 2025-11-06 03:12:49,284 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/586812a0-bc6e-4a86-9c70-1efb6a24c948 2025-11-06 03:12:49,301 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7014378304757974851', 'uuid-lslong': '11235917097381381169'}, 'enable': 'true', 'created': '2025-11-06T03:12:48', 'last-modified': '2025-11-06T03:12:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.438584'} 2025-11-06 03:12:49,307 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:12:49,313 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7014378304757974851', 'uuid-lslong': '11235917097381381169'}, 'enable': 'true', 'created': '2025-11-06T03:12:48', 'last-modified': '2025-11-06T03:12:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.454155'} 2025-11-06 03:12:49,320 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:12:49,326 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7014378304757974851', 'uuid-lslong': '11235917097381381169'}, 'enable': 'true', 'created': '2025-11-06T03:12:48', 'last-modified': '2025-11-06T03:12:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.465365'} 2025-11-06 03:12:49,332 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:12:49,333 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-66493374 passed 2025-11-06 03:12:49,333 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-66493374 in API_Server ====== 2025-11-06 03:12:49,333 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:49,339 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:49,349 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:49,451 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/615813e7-874e-4743-9bed-ff11d327c431 2025-11-06 03:12:49,461 - DEBUG - =>VN ctest-mgmt_vn-66493374 has no policy to be verified 2025-11-06 03:12:49,461 - DEBUG - Verifying the vn in opserver 2025-11-06 03:12:49,461 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374 virtual network link through opserver 10.0.0.41 2025-11-06 03:12:49,461 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:12:49,477 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374?flat'} 2025-11-06 03:12:49,477 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374 virtual network link through opserver 10.0.0.38 2025-11-06 03:12:49,477 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:12:49,491 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374?flat'} 2025-11-06 03:12:49,492 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374 virtual network link through opserver 10.0.0.131 2025-11-06 03:12:49,492 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:12:49,508 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374?flat'} 2025-11-06 03:12:49,508 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-33331716:ctest-mgmt_vn-66493374 is found in opserver 2025-11-06 03:12:49,535 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:12:49,545 - DEBUG - VRF ids for VN ctest-mgmt_vn-66493374: {} 2025-11-06 03:12:49,867 - DEBUG - Response for create_network : {'network': {'id': '66fe73dc-9af5-4013-a8b2-d59257021da9', 'name': 'ctest-left_vn-37944583', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'project_id': '0f02614d9d2549c1bfed043ce8680f50', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33331716', 'ctest-left_vn-37944583'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:12:50,086 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ab23c69a-87ab-4dd7-b1a5-a684e25d30fb', 'name': '', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'network_id': '66fe73dc-9af5-4013-a8b2-d59257021da9', 'ip_version': 4, 'cidr': '26.104.224.192/26', 'allocation_pools': [{'start': '26.104.224.194', 'end': '26.104.224.254'}], 'gateway_ip': '26.104.224.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '26.104.224.194', 'tags': [], 'project_id': '0f02614d9d2549c1bfed043ce8680f50'}} 2025-11-06 03:12:50,108 - INFO - Created VN ctest-left_vn-37944583 2025-11-06 03:12:50,120 - DEBUG - VN ctest-left_vn-37944583 UUID is 66fe73dc-9af5-4013-a8b2-d59257021da9 2025-11-06 03:12:50,197 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:50,211 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:50,228 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:50,319 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/66fe73dc-9af5-4013-a8b2-d59257021da9 2025-11-06 03:12:50,334 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/66fe73dc-9af5-4013-a8b2-d59257021da9 2025-11-06 03:12:50,345 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d3280463-094d-41cc-a534-dac4df85b7bb 2025-11-06 03:12:50,356 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d3280463-094d-41cc-a534-dac4df85b7bb 2025-11-06 03:12:50,364 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/e0cb7572-29c0-4ae2-ba7d-ed97afe13278 2025-11-06 03:12:50,373 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:12:50,373 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/66fe73dc-9af5-4013-a8b2-d59257021da9 2025-11-06 03:12:50,382 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d3280463-094d-41cc-a534-dac4df85b7bb 2025-11-06 03:12:50,400 - INFO - Verified VN network id 15 for VN 66fe73dc-9af5-4013-a8b2-d59257021da9 2025-11-06 03:12:50,401 - INFO - Verifications in API Server for VN ctest-left_vn-37944583 passed 2025-11-06 03:12:50,401 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/66fe73dc-9af5-4013-a8b2-d59257021da9 2025-11-06 03:12:50,412 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d3280463-094d-41cc-a534-dac4df85b7bb 2025-11-06 03:12:50,420 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d3280463-094d-41cc-a534-dac4df85b7bb 2025-11-06 03:12:50,426 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/e0cb7572-29c0-4ae2-ba7d-ed97afe13278 2025-11-06 03:12:50,440 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7421496627282919443', 'uuid-lslong': '12156013168728087977'}, 'enable': 'true', 'created': '2025-11-06T03:12:49', 'last-modified': '2025-11-06T03:12:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410915'} 2025-11-06 03:12:50,446 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:12:50,451 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7421496627282919443', 'uuid-lslong': '12156013168728087977'}, 'enable': 'true', 'created': '2025-11-06T03:12:49', 'last-modified': '2025-11-06T03:12:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.421650'} 2025-11-06 03:12:50,457 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:12:50,463 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7421496627282919443', 'uuid-lslong': '12156013168728087977'}, 'enable': 'true', 'created': '2025-11-06T03:12:49', 'last-modified': '2025-11-06T03:12:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433694'} 2025-11-06 03:12:50,470 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:12:50,470 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-37944583 passed 2025-11-06 03:12:50,470 - DEBUG - ====Verifying policy data for ctest-left_vn-37944583 in API_Server ====== 2025-11-06 03:12:50,470 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:50,477 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:50,489 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:50,590 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/66fe73dc-9af5-4013-a8b2-d59257021da9 2025-11-06 03:12:50,603 - DEBUG - =>VN ctest-left_vn-37944583 has no policy to be verified 2025-11-06 03:12:50,603 - DEBUG - Verifying the vn in opserver 2025-11-06 03:12:50,603 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583 virtual network link through opserver 10.0.0.41 2025-11-06 03:12:50,603 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:12:50,624 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583?flat'} 2025-11-06 03:12:50,624 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583 virtual network link through opserver 10.0.0.38 2025-11-06 03:12:50,624 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:12:50,637 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583?flat'} 2025-11-06 03:12:50,637 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583 virtual network link through opserver 10.0.0.131 2025-11-06 03:12:50,637 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:12:50,654 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583?flat'} 2025-11-06 03:12:50,654 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-33331716:ctest-left_vn-37944583 is found in opserver 2025-11-06 03:12:50,675 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:12:50,688 - DEBUG - VRF ids for VN ctest-left_vn-37944583: {} 2025-11-06 03:12:51,009 - DEBUG - Response for create_network : {'network': {'id': '177b1651-e567-4c97-972b-6371c26a1e3f', 'name': 'ctest-right_vn-31216321', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'project_id': '0f02614d9d2549c1bfed043ce8680f50', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33331716', 'ctest-right_vn-31216321'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:12:51,248 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c85a1428-1470-4cae-bb29-7572ef03011b', 'name': '', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'network_id': '177b1651-e567-4c97-972b-6371c26a1e3f', 'ip_version': 4, 'cidr': '109.75.73.64/26', 'allocation_pools': [{'start': '109.75.73.66', 'end': '109.75.73.126'}], 'gateway_ip': '109.75.73.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '109.75.73.66', 'tags': [], 'project_id': '0f02614d9d2549c1bfed043ce8680f50'}} 2025-11-06 03:12:51,272 - INFO - Created VN ctest-right_vn-31216321 2025-11-06 03:12:51,285 - DEBUG - VN ctest-right_vn-31216321 UUID is 177b1651-e567-4c97-972b-6371c26a1e3f 2025-11-06 03:12:51,366 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:51,371 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:51,383 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:51,492 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/177b1651-e567-4c97-972b-6371c26a1e3f 2025-11-06 03:12:51,504 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/177b1651-e567-4c97-972b-6371c26a1e3f 2025-11-06 03:12:51,514 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a396b567-4509-4fec-8b3c-ff5c2cef9299 2025-11-06 03:12:51,524 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a396b567-4509-4fec-8b3c-ff5c2cef9299 2025-11-06 03:12:51,532 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/1852f8da-c036-4a1c-a7cd-cbdfadc95fe3 2025-11-06 03:12:51,540 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:12:51,541 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/177b1651-e567-4c97-972b-6371c26a1e3f 2025-11-06 03:12:51,551 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a396b567-4509-4fec-8b3c-ff5c2cef9299 2025-11-06 03:12:51,571 - INFO - Verified VN network id 16 for VN 177b1651-e567-4c97-972b-6371c26a1e3f 2025-11-06 03:12:51,571 - INFO - Verifications in API Server for VN ctest-right_vn-31216321 passed 2025-11-06 03:12:51,572 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/177b1651-e567-4c97-972b-6371c26a1e3f 2025-11-06 03:12:51,585 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a396b567-4509-4fec-8b3c-ff5c2cef9299 2025-11-06 03:12:51,593 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a396b567-4509-4fec-8b3c-ff5c2cef9299 2025-11-06 03:12:51,602 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/1852f8da-c036-4a1c-a7cd-cbdfadc95fe3 2025-11-06 03:12:51,616 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1691970626004667543', 'uuid-lslong': '10892909463969865279'}, 'enable': 'true', 'created': '2025-11-06T03:12:50', 'last-modified': '2025-11-06T03:12:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.429340'} 2025-11-06 03:12:51,623 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:12:51,629 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1691970626004667543', 'uuid-lslong': '10892909463969865279'}, 'enable': 'true', 'created': '2025-11-06T03:12:50', 'last-modified': '2025-11-06T03:12:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444829'} 2025-11-06 03:12:51,636 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:12:51,643 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1691970626004667543', 'uuid-lslong': '10892909463969865279'}, 'enable': 'true', 'created': '2025-11-06T03:12:50', 'last-modified': '2025-11-06T03:12:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.457346'} 2025-11-06 03:12:51,650 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:12:51,650 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-31216321 passed 2025-11-06 03:12:51,650 - DEBUG - ====Verifying policy data for ctest-right_vn-31216321 in API_Server ====== 2025-11-06 03:12:51,651 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:51,658 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:51,670 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:51,762 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/177b1651-e567-4c97-972b-6371c26a1e3f 2025-11-06 03:12:51,779 - DEBUG - =>VN ctest-right_vn-31216321 has no policy to be verified 2025-11-06 03:12:51,779 - DEBUG - Verifying the vn in opserver 2025-11-06 03:12:51,779 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321 virtual network link through opserver 10.0.0.41 2025-11-06 03:12:51,779 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:12:51,795 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321?flat'} 2025-11-06 03:12:51,795 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321 virtual network link through opserver 10.0.0.38 2025-11-06 03:12:51,795 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:12:51,809 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321?flat'} 2025-11-06 03:12:51,809 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321 virtual network link through opserver 10.0.0.131 2025-11-06 03:12:51,809 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:12:51,825 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321?flat'} 2025-11-06 03:12:51,825 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-33331716:ctest-right_vn-31216321 is found in opserver 2025-11-06 03:12:51,848 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:12:51,858 - DEBUG - VRF ids for VN ctest-right_vn-31216321: {} 2025-11-06 03:12:52,240 - DEBUG - Response for create_network : {'network': {'id': 'a0a45ffe-2cdc-4154-9a07-8e8c2d2352f0', 'name': 'ctest-trans_left_vn-01360978', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'project_id': '0f02614d9d2549c1bfed043ce8680f50', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33331716', 'ctest-trans_left_vn-01360978'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:12:52,491 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ad84bc0b-9245-43fa-9102-3db594b71cc4', 'name': '', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'network_id': 'a0a45ffe-2cdc-4154-9a07-8e8c2d2352f0', 'ip_version': 4, 'cidr': '206.117.16.64/26', 'allocation_pools': [{'start': '206.117.16.66', 'end': '206.117.16.126'}], 'gateway_ip': '206.117.16.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '206.117.16.66', 'tags': [], 'project_id': '0f02614d9d2549c1bfed043ce8680f50'}} 2025-11-06 03:12:52,521 - INFO - Created VN ctest-trans_left_vn-01360978 2025-11-06 03:12:52,541 - DEBUG - VN ctest-trans_left_vn-01360978 UUID is a0a45ffe-2cdc-4154-9a07-8e8c2d2352f0 2025-11-06 03:12:52,635 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:52,642 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:52,658 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:52,753 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/a0a45ffe-2cdc-4154-9a07-8e8c2d2352f0 2025-11-06 03:12:52,778 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/a0a45ffe-2cdc-4154-9a07-8e8c2d2352f0 2025-11-06 03:12:52,789 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/485832de-d0fb-4f06-8c93-33764c177099 2025-11-06 03:12:52,798 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/485832de-d0fb-4f06-8c93-33764c177099 2025-11-06 03:12:52,805 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/b01932b6-fb73-48a6-917d-d1c9c13fe1a0 2025-11-06 03:12:52,812 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-06 03:12:52,813 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/a0a45ffe-2cdc-4154-9a07-8e8c2d2352f0 2025-11-06 03:12:52,824 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/485832de-d0fb-4f06-8c93-33764c177099 2025-11-06 03:12:52,842 - INFO - Verified VN network id 17 for VN a0a45ffe-2cdc-4154-9a07-8e8c2d2352f0 2025-11-06 03:12:52,842 - INFO - Verifications in API Server for VN ctest-trans_left_vn-01360978 passed 2025-11-06 03:12:52,843 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/a0a45ffe-2cdc-4154-9a07-8e8c2d2352f0 2025-11-06 03:12:52,855 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/485832de-d0fb-4f06-8c93-33764c177099 2025-11-06 03:12:52,864 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/485832de-d0fb-4f06-8c93-33764c177099 2025-11-06 03:12:52,879 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/b01932b6-fb73-48a6-917d-d1c9c13fe1a0 2025-11-06 03:12:52,896 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11575482487527981396', 'uuid-lslong': '11098996539381732080'}, 'enable': 'true', 'created': '2025-11-06T03:12:52', 'last-modified': '2025-11-06T03:12:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.464381'} 2025-11-06 03:12:52,907 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-06 03:12:52,914 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11575482487527981396', 'uuid-lslong': '11098996539381732080'}, 'enable': 'true', 'created': '2025-11-06T03:12:52', 'last-modified': '2025-11-06T03:12:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.489223'} 2025-11-06 03:12:52,922 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-06 03:12:52,928 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11575482487527981396', 'uuid-lslong': '11098996539381732080'}, 'enable': 'true', 'created': '2025-11-06T03:12:52', 'last-modified': '2025-11-06T03:12:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.502188'} 2025-11-06 03:12:52,937 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-06 03:12:52,937 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-01360978 passed 2025-11-06 03:12:52,937 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-01360978 in API_Server ====== 2025-11-06 03:12:52,937 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:52,945 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:52,958 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:53,062 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/a0a45ffe-2cdc-4154-9a07-8e8c2d2352f0 2025-11-06 03:12:53,072 - DEBUG - =>VN ctest-trans_left_vn-01360978 has no policy to be verified 2025-11-06 03:12:53,072 - DEBUG - Verifying the vn in opserver 2025-11-06 03:12:53,072 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978 virtual network link through opserver 10.0.0.41 2025-11-06 03:12:53,072 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:12:53,085 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978?flat'} 2025-11-06 03:12:53,085 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978 virtual network link through opserver 10.0.0.38 2025-11-06 03:12:53,085 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:12:53,099 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978?flat'} 2025-11-06 03:12:53,099 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978 virtual network link through opserver 10.0.0.131 2025-11-06 03:12:53,099 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:12:53,114 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978?flat'} 2025-11-06 03:12:53,114 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-33331716:ctest-trans_left_vn-01360978 is found in opserver 2025-11-06 03:12:53,135 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:12:53,145 - DEBUG - VRF ids for VN ctest-trans_left_vn-01360978: {} 2025-11-06 03:12:53,470 - DEBUG - Response for create_network : {'network': {'id': '746cd567-c94d-4e45-91d9-8c54ee049138', 'name': 'ctest-trans_right_vn-22771766', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'project_id': '0f02614d9d2549c1bfed043ce8680f50', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33331716', 'ctest-trans_right_vn-22771766'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:12:53,774 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a6c14201-7ab4-487b-a8c2-8501799c9f15', 'name': '', 'tenant_id': '0f02614d9d2549c1bfed043ce8680f50', 'network_id': '746cd567-c94d-4e45-91d9-8c54ee049138', 'ip_version': 4, 'cidr': '32.183.251.0/26', 'allocation_pools': [{'start': '32.183.251.2', 'end': '32.183.251.62'}], 'gateway_ip': '32.183.251.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '32.183.251.2', 'tags': [], 'project_id': '0f02614d9d2549c1bfed043ce8680f50'}} 2025-11-06 03:12:53,796 - INFO - Created VN ctest-trans_right_vn-22771766 2025-11-06 03:12:53,807 - DEBUG - VN ctest-trans_right_vn-22771766 UUID is 746cd567-c94d-4e45-91d9-8c54ee049138 2025-11-06 03:12:53,883 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:53,891 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:53,903 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:53,999 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/746cd567-c94d-4e45-91d9-8c54ee049138 2025-11-06 03:12:54,014 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/746cd567-c94d-4e45-91d9-8c54ee049138 2025-11-06 03:12:54,028 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1f3474ad-049f-4661-8b9a-2ad124a902ef 2025-11-06 03:12:54,042 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1f3474ad-049f-4661-8b9a-2ad124a902ef 2025-11-06 03:12:54,049 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/44b35386-d875-4fff-9a60-ef2087bce94f 2025-11-06 03:12:54,057 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-06 03:12:54,057 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/746cd567-c94d-4e45-91d9-8c54ee049138 2025-11-06 03:12:54,070 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1f3474ad-049f-4661-8b9a-2ad124a902ef 2025-11-06 03:12:54,088 - INFO - Verified VN network id 18 for VN 746cd567-c94d-4e45-91d9-8c54ee049138 2025-11-06 03:12:54,088 - INFO - Verifications in API Server for VN ctest-trans_right_vn-22771766 passed 2025-11-06 03:12:54,088 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/746cd567-c94d-4e45-91d9-8c54ee049138 2025-11-06 03:12:54,098 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1f3474ad-049f-4661-8b9a-2ad124a902ef 2025-11-06 03:12:54,105 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1f3474ad-049f-4661-8b9a-2ad124a902ef 2025-11-06 03:12:54,112 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/44b35386-d875-4fff-9a60-ef2087bce94f 2025-11-06 03:12:54,124 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8389314847620025925', 'uuid-lslong': '10509585501844181304'}, 'enable': 'true', 'created': '2025-11-06T03:12:53', 'last-modified': '2025-11-06T03:12:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419819'} 2025-11-06 03:12:54,129 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-06 03:12:54,134 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8389314847620025925', 'uuid-lslong': '10509585501844181304'}, 'enable': 'true', 'created': '2025-11-06T03:12:53', 'last-modified': '2025-11-06T03:12:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.418528'} 2025-11-06 03:12:54,139 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-06 03:12:54,145 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33331716', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8389314847620025925', 'uuid-lslong': '10509585501844181304'}, 'enable': 'true', 'created': '2025-11-06T03:12:53', 'last-modified': '2025-11-06T03:12:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432919'} 2025-11-06 03:12:54,150 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-06 03:12:54,150 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-22771766 passed 2025-11-06 03:12:54,151 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-22771766 in API_Server ====== 2025-11-06 03:12:54,151 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:54,157 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:54,167 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:54,269 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/746cd567-c94d-4e45-91d9-8c54ee049138 2025-11-06 03:12:54,279 - DEBUG - =>VN ctest-trans_right_vn-22771766 has no policy to be verified 2025-11-06 03:12:54,279 - DEBUG - Verifying the vn in opserver 2025-11-06 03:12:54,279 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766 virtual network link through opserver 10.0.0.41 2025-11-06 03:12:54,279 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:12:54,294 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766?flat'} 2025-11-06 03:12:54,294 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766 virtual network link through opserver 10.0.0.38 2025-11-06 03:12:54,294 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:12:54,308 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766?flat'} 2025-11-06 03:12:54,308 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766 virtual network link through opserver 10.0.0.131 2025-11-06 03:12:54,308 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:12:54,323 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766?flat'} 2025-11-06 03:12:54,323 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-33331716:ctest-trans_right_vn-22771766 is found in opserver 2025-11-06 03:12:54,349 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:12:54,363 - DEBUG - VRF ids for VN ctest-trans_right_vn-22771766: {} 2025-11-06 03:12:55,406 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4662-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4662-2) 2025-11-06 03:12:56,751 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4662-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4662-1) 2025-11-06 03:12:56,751 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-79731354'] 2025-11-06 03:12:57,088 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-79731354'] created succesfully 2025-11-06 03:12:57,448 - DEBUG - Image by name tiny_trans_fw not found 2025-11-06 03:12:57,448 - DEBUG - Installing image tiny_trans_fw 2025-11-06 03:12:57,448 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-11-06 03:12:57,449 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz 2025-11-06 03:12:57,449 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz 2025-11-06 03:12:57,469 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz -O /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-06 03:12:57,508 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-06 03:12:57,509 - DEBUG - Unzip image 2025-11-06 03:12:57,509 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-06 03:12:57,530 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-11-06 03:12:57,530 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-79731354'] 2025-11-06 03:12:57,686 - INFO - Service template: ['default-domain', 'ctest-service_template_1-79731354'] deleted successfully. 2025-11-06 03:12:57,686 - INFO - Skip interface_detach for VM ctest-right_vm-32151299 in state BUILD 2025-11-06 03:12:57,686 - INFO - Deleting VM ctest-right_vm-32151299 2025-11-06 03:12:57,686 - ERROR - VM ctest-right_vm-32151299 has failed to come up 2025-11-06 03:12:57,686 - ERROR - Nova failed to get host of the VM 2025-11-06 03:12:57,687 - ERROR - VM ctest-right_vm-32151299 has failed to come up 2025-11-06 03:12:57,687 - ERROR - Nova failed to get host of the VM 2025-11-06 03:12:57,773 - INFO - Skip interface_detach for VM ctest-left_vm-85167524 in state BUILD 2025-11-06 03:12:57,773 - INFO - Deleting VM ctest-left_vm-85167524 2025-11-06 03:12:57,773 - ERROR - VM ctest-left_vm-85167524 has failed to come up 2025-11-06 03:12:57,773 - ERROR - Nova failed to get host of the VM 2025-11-06 03:12:57,773 - ERROR - VM ctest-left_vm-85167524 has failed to come up 2025-11-06 03:12:57,773 - ERROR - Nova failed to get host of the VM 2025-11-06 03:12:57,858 - INFO - Deleting VN ctest-trans_right_vn-22771766 2025-11-06 03:12:58,030 - DEBUG - Response for deleting network () 2025-11-06 03:12:58,031 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1f3474ad-049f-4661-8b9a-2ad124a902ef 2025-11-06 03:12:58,038 - DEBUG - Response Code: 404 2025-11-06 03:12:58,038 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:58,054 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:58,115 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:58,215 - INFO - Validated that VN ctest-trans_right_vn-22771766 is not found in API Server 2025-11-06 03:12:58,231 - DEBUG - VN ctest-trans_right_vn-22771766 is not present in Agent 10.0.0.240 2025-11-06 03:12:58,242 - DEBUG - VN ctest-trans_right_vn-22771766 is not present in Agent 10.0.0.133 2025-11-06 03:12:58,242 - INFO - Validated that VN ctest-trans_right_vn-22771766 is not in any agent 2025-11-06 03:12:58,287 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-22771766 info 2025-11-06 03:12:58,287 - INFO - Deleting VN ctest-trans_left_vn-01360978 2025-11-06 03:12:58,618 - DEBUG - Response for deleting network () 2025-11-06 03:12:58,618 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/485832de-d0fb-4f06-8c93-33764c177099 2025-11-06 03:12:58,632 - DEBUG - Response Code: 404 2025-11-06 03:12:58,632 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:12:58,644 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:12:58,660 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:12:58,756 - INFO - Validated that VN ctest-trans_left_vn-01360978 is not found in API Server 2025-11-06 03:12:58,771 - DEBUG - VN ctest-trans_left_vn-01360978 is not present in Agent 10.0.0.240 2025-11-06 03:12:58,782 - DEBUG - VN ctest-trans_left_vn-01360978 is not present in Agent 10.0.0.133 2025-11-06 03:12:58,783 - INFO - Validated that VN ctest-trans_left_vn-01360978 is not in any agent 2025-11-06 03:12:58,819 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-01360978 info 2025-11-06 03:12:58,819 - INFO - Deleting VN ctest-right_vn-31216321 2025-11-06 03:12:58,878 - DEBUG - VN 177b1651-e567-4c97-972b-6371c26a1e3f still in use: Unable to complete operation on network 177b1651-e567-4c97-972b-6371c26a1e3f. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-539881e0-7ae8-4b77-b6bf-ced9c716b12b'] 2025-11-06 03:12:58,878 - WARNING - Deleting VN ctest-right_vn-31216321 failed..Will retry 2025-11-06 03:13:01,113 - DEBUG - Response for deleting network () 2025-11-06 03:13:01,114 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a396b567-4509-4fec-8b3c-ff5c2cef9299 2025-11-06 03:13:01,120 - DEBUG - Response Code: 404 2025-11-06 03:13:01,121 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:01,132 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:01,147 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:13:01,240 - INFO - Validated that VN ctest-right_vn-31216321 is not found in API Server 2025-11-06 03:13:01,255 - DEBUG - VN ctest-right_vn-31216321 is not present in Agent 10.0.0.240 2025-11-06 03:13:01,269 - DEBUG - VN ctest-right_vn-31216321 is not present in Agent 10.0.0.133 2025-11-06 03:13:01,270 - INFO - Validated that VN ctest-right_vn-31216321 is not in any agent 2025-11-06 03:13:01,309 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-31216321 info 2025-11-06 03:13:01,309 - INFO - Deleting VN ctest-left_vn-37944583 2025-11-06 03:13:01,490 - DEBUG - Response for deleting network () 2025-11-06 03:13:01,490 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d3280463-094d-41cc-a534-dac4df85b7bb 2025-11-06 03:13:01,497 - DEBUG - Response Code: 404 2025-11-06 03:13:01,497 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:01,507 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:01,566 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:13:01,673 - INFO - Validated that VN ctest-left_vn-37944583 is not found in API Server 2025-11-06 03:13:01,685 - DEBUG - VN ctest-left_vn-37944583 is not present in Agent 10.0.0.240 2025-11-06 03:13:01,697 - DEBUG - VN ctest-left_vn-37944583 is not present in Agent 10.0.0.133 2025-11-06 03:13:01,697 - INFO - Validated that VN ctest-left_vn-37944583 is not in any agent 2025-11-06 03:13:01,731 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-37944583 info 2025-11-06 03:13:01,731 - INFO - Deleting VN ctest-mgmt_vn-66493374 2025-11-06 03:13:01,911 - DEBUG - Response for deleting network () 2025-11-06 03:13:01,911 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0b393db9-9fb1-4e93-9e8e-9fccbcfeaf5d 2025-11-06 03:13:01,917 - DEBUG - Response Code: 404 2025-11-06 03:13:01,917 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:01,932 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:01,949 - DEBUG - Requesting: http://10.0.0.41:8082/project/0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:13:02,050 - INFO - Validated that VN ctest-mgmt_vn-66493374 is not found in API Server 2025-11-06 03:13:02,062 - DEBUG - VN ctest-mgmt_vn-66493374 is not present in Agent 10.0.0.240 2025-11-06 03:13:02,076 - DEBUG - VN ctest-mgmt_vn-66493374 is not present in Agent 10.0.0.133 2025-11-06 03:13:02,076 - INFO - Validated that VN ctest-mgmt_vn-66493374 is not in any agent 2025-11-06 03:13:02,108 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-66493374 info 2025-11-06 03:13:03,413 - DEBUG - No XMPP flaps were noticed during the test 2025-11-06 03:13:03,413 - INFO - 2025-11-06 03:13:03,413 - INFO - END TEST : test_svc_v2_transparent_datapath : SKIPPED[0:00:16] 2025-11-06 03:13:03,413 - INFO - -------------------------------------------------------------------------------- 2025-11-06 03:13:04,180 - INFO - Deleted project: ctest-TestSvcRegr-33331716, ID : 0f02614d-9d25-49c1-bfed-043ce8680f50 2025-11-06 03:13:04,351 - INFO - Domain Default found not creating 2025-11-06 03:13:04,507 - INFO - Project ctest-TestSvcRegr-86163929 not found, creating it 2025-11-06 03:13:05,134 - INFO - Created Project:ctest-TestSvcRegr-86163929, ID : 52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:06,551 - INFO - ================================================================================ 2025-11-06 03:13:06,551 - INFO - STARTING TEST : test_svc_CEM_22032 2025-11-06 03:13:07,834 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.20.0.252': '0', '10.20.0.249': '0'}, '10.0.0.133': {'10.20.0.252': '0', '10.20.0.249': '0'}} with 2025-11-06 03:13:07,834 - INFO - Initial checks done. Running the testcase now 2025-11-06 03:13:07,834 - INFO - 2025-11-06 03:13:08,512 - DEBUG - Response for create_network : {'network': {'id': '1a7cacc5-7899-4515-804d-81111538ff90', 'name': 'ctest-mgmt_vn-31420470', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-86163929', 'ctest-mgmt_vn-31420470'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:13:08,784 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd2ccdb22-740c-41be-b3f9-8bede656d347', 'name': '', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'network_id': '1a7cacc5-7899-4515-804d-81111538ff90', 'ip_version': 4, 'cidr': '87.167.100.192/26', 'allocation_pools': [{'start': '87.167.100.194', 'end': '87.167.100.254'}], 'gateway_ip': '87.167.100.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '87.167.100.194', 'tags': [], 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a'}} 2025-11-06 03:13:08,808 - INFO - Created VN ctest-mgmt_vn-31420470 2025-11-06 03:13:08,820 - DEBUG - VN ctest-mgmt_vn-31420470 UUID is 1a7cacc5-7899-4515-804d-81111538ff90 2025-11-06 03:13:08,907 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:09,206 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:09,234 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:09,250 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:09,350 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1a7cacc5-7899-4515-804d-81111538ff90 2025-11-06 03:13:09,365 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1a7cacc5-7899-4515-804d-81111538ff90 2025-11-06 03:13:09,374 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1fe9fcf6-88ff-4c0d-a43b-3facc868ec41 2025-11-06 03:13:09,383 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1fe9fcf6-88ff-4c0d-a43b-3facc868ec41 2025-11-06 03:13:09,391 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/317ed2d6-4a35-4a03-b7df-2ffae5dfc4dd 2025-11-06 03:13:09,401 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:13:09,401 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1a7cacc5-7899-4515-804d-81111538ff90 2025-11-06 03:13:09,428 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1fe9fcf6-88ff-4c0d-a43b-3facc868ec41 2025-11-06 03:13:09,475 - INFO - Verified VN network id 14 for VN 1a7cacc5-7899-4515-804d-81111538ff90 2025-11-06 03:13:09,475 - INFO - Verifications in API Server for VN ctest-mgmt_vn-31420470 passed 2025-11-06 03:13:09,475 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1a7cacc5-7899-4515-804d-81111538ff90 2025-11-06 03:13:09,485 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1fe9fcf6-88ff-4c0d-a43b-3facc868ec41 2025-11-06 03:13:09,492 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1fe9fcf6-88ff-4c0d-a43b-3facc868ec41 2025-11-06 03:13:09,499 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/317ed2d6-4a35-4a03-b7df-2ffae5dfc4dd 2025-11-06 03:13:09,510 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1908590306230093077', 'uuid-lslong': '9245187520431980432'}, 'enable': 'true', 'created': '2025-11-06T03:13:08', 'last-modified': '2025-11-06T03:13:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.793820'} 2025-11-06 03:13:09,515 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:13:09,521 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1908590306230093077', 'uuid-lslong': '9245187520431980432'}, 'enable': 'true', 'created': '2025-11-06T03:13:08', 'last-modified': '2025-11-06T03:13:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.802203'} 2025-11-06 03:13:09,530 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:13:09,536 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1908590306230093077', 'uuid-lslong': '9245187520431980432'}, 'enable': 'true', 'created': '2025-11-06T03:13:08', 'last-modified': '2025-11-06T03:13:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.816659'} 2025-11-06 03:13:09,543 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:13:09,543 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-31420470 passed 2025-11-06 03:13:09,543 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-31420470 in API_Server ====== 2025-11-06 03:13:09,543 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:09,550 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:09,563 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:09,660 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1a7cacc5-7899-4515-804d-81111538ff90 2025-11-06 03:13:09,672 - DEBUG - =>VN ctest-mgmt_vn-31420470 has no policy to be verified 2025-11-06 03:13:09,672 - DEBUG - Verifying the vn in opserver 2025-11-06 03:13:09,672 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470 virtual network link through opserver 10.0.0.41 2025-11-06 03:13:09,672 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:13:09,967 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:13:10,042 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470?flat'} 2025-11-06 03:13:10,042 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470 virtual network link through opserver 10.0.0.38 2025-11-06 03:13:10,042 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:13:10,345 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:13:10,401 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470?flat'} 2025-11-06 03:13:10,401 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470 virtual network link through opserver 10.0.0.131 2025-11-06 03:13:10,401 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:13:10,704 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:13:10,782 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470?flat'} 2025-11-06 03:13:10,782 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-31420470 is found in opserver 2025-11-06 03:13:10,810 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:13:10,822 - DEBUG - VRF ids for VN ctest-mgmt_vn-31420470: {} 2025-11-06 03:13:11,100 - DEBUG - Response for create_network : {'network': {'id': '9c20441e-bffd-435a-b318-23062489f1da', 'name': 'service-left-vn-72404496', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-86163929', 'service-left-vn-72404496'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:13:11,373 - DEBUG - Response for create_subnet : {'subnet': {'id': '157dee73-37d5-4e91-a1e9-e59bae584597', 'name': '', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'network_id': '9c20441e-bffd-435a-b318-23062489f1da', 'ip_version': 4, 'cidr': '139.240.232.128/26', 'allocation_pools': [{'start': '139.240.232.130', 'end': '139.240.232.190'}], 'gateway_ip': '139.240.232.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '139.240.232.130', 'tags': [], 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a'}} 2025-11-06 03:13:11,397 - INFO - Created VN service-left-vn-72404496 2025-11-06 03:13:11,411 - DEBUG - VN service-left-vn-72404496 UUID is 9c20441e-bffd-435a-b318-23062489f1da 2025-11-06 03:13:11,484 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:11,490 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:11,503 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:11,614 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9c20441e-bffd-435a-b318-23062489f1da 2025-11-06 03:13:11,627 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9c20441e-bffd-435a-b318-23062489f1da 2025-11-06 03:13:11,641 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/24c653c5-78e9-482e-87a0-0475ef67660d 2025-11-06 03:13:11,654 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/24c653c5-78e9-482e-87a0-0475ef67660d 2025-11-06 03:13:11,663 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/9b64b7f7-8904-489c-8d38-6c7e4bd24662 2025-11-06 03:13:11,672 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:13:11,672 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9c20441e-bffd-435a-b318-23062489f1da 2025-11-06 03:13:11,688 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/24c653c5-78e9-482e-87a0-0475ef67660d 2025-11-06 03:13:11,707 - INFO - Verified VN network id 15 for VN 9c20441e-bffd-435a-b318-23062489f1da 2025-11-06 03:13:11,707 - INFO - Verifications in API Server for VN service-left-vn-72404496 passed 2025-11-06 03:13:11,708 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9c20441e-bffd-435a-b318-23062489f1da 2025-11-06 03:13:11,721 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/24c653c5-78e9-482e-87a0-0475ef67660d 2025-11-06 03:13:11,730 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/24c653c5-78e9-482e-87a0-0475ef67660d 2025-11-06 03:13:11,738 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/9b64b7f7-8904-489c-8d38-6c7e4bd24662 2025-11-06 03:13:11,750 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11250066768032252762', 'uuid-lslong': '12905103241519952346'}, 'enable': 'true', 'created': '2025-11-06T03:13:11', 'last-modified': '2025-11-06T03:13:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.430249'} 2025-11-06 03:13:11,763 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:13:11,770 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11250066768032252762', 'uuid-lslong': '12905103241519952346'}, 'enable': 'true', 'created': '2025-11-06T03:13:11', 'last-modified': '2025-11-06T03:13:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.452148'} 2025-11-06 03:13:11,777 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:13:11,783 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11250066768032252762', 'uuid-lslong': '12905103241519952346'}, 'enable': 'true', 'created': '2025-11-06T03:13:11', 'last-modified': '2025-11-06T03:13:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.463890'} 2025-11-06 03:13:11,790 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:13:11,790 - INFO - On all control nodes, Config, RI and RT verification for VN service-left-vn-72404496 passed 2025-11-06 03:13:11,790 - DEBUG - ====Verifying policy data for service-left-vn-72404496 in API_Server ====== 2025-11-06 03:13:11,790 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:11,799 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:11,816 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:11,922 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9c20441e-bffd-435a-b318-23062489f1da 2025-11-06 03:13:11,934 - DEBUG - =>VN service-left-vn-72404496 has no policy to be verified 2025-11-06 03:13:11,934 - DEBUG - Verifying the vn in opserver 2025-11-06 03:13:11,934 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496 virtual network link through opserver 10.0.0.41 2025-11-06 03:13:11,934 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:13:11,996 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496?flat'} 2025-11-06 03:13:11,996 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496 virtual network link through opserver 10.0.0.38 2025-11-06 03:13:11,996 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:13:12,051 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496?flat'} 2025-11-06 03:13:12,052 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496 virtual network link through opserver 10.0.0.131 2025-11-06 03:13:12,052 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:13:12,107 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496?flat'} 2025-11-06 03:13:12,107 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-86163929:service-left-vn-72404496 is found in opserver 2025-11-06 03:13:12,129 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:13:12,140 - DEBUG - VRF ids for VN service-left-vn-72404496: {} 2025-11-06 03:13:12,433 - DEBUG - Response for create_network : {'network': {'id': '7566aabd-7e8b-4b22-8cb3-1047f70a2c16', 'name': 'service-right-vn-92718033', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-86163929', 'service-right-vn-92718033'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:13:12,657 - DEBUG - Response for create_subnet : {'subnet': {'id': '35d936a1-de91-4097-b1f2-cde3891b4c80', 'name': '', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'network_id': '7566aabd-7e8b-4b22-8cb3-1047f70a2c16', 'ip_version': 4, 'cidr': '33.90.122.64/26', 'allocation_pools': [{'start': '33.90.122.66', 'end': '33.90.122.126'}], 'gateway_ip': '33.90.122.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '33.90.122.66', 'tags': [], 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a'}} 2025-11-06 03:13:12,684 - INFO - Created VN service-right-vn-92718033 2025-11-06 03:13:12,698 - DEBUG - VN service-right-vn-92718033 UUID is 7566aabd-7e8b-4b22-8cb3-1047f70a2c16 2025-11-06 03:13:12,778 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:12,784 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:12,797 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:12,915 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/7566aabd-7e8b-4b22-8cb3-1047f70a2c16 2025-11-06 03:13:12,935 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/7566aabd-7e8b-4b22-8cb3-1047f70a2c16 2025-11-06 03:13:12,945 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/002d6706-5684-4dcf-8e6b-e0c43be1b476 2025-11-06 03:13:12,954 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/002d6706-5684-4dcf-8e6b-e0c43be1b476 2025-11-06 03:13:12,966 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/9961ec78-0816-443a-9e9c-f36fa27e7c08 2025-11-06 03:13:12,976 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:13:12,976 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/7566aabd-7e8b-4b22-8cb3-1047f70a2c16 2025-11-06 03:13:12,999 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/002d6706-5684-4dcf-8e6b-e0c43be1b476 2025-11-06 03:13:13,023 - INFO - Verified VN network id 16 for VN 7566aabd-7e8b-4b22-8cb3-1047f70a2c16 2025-11-06 03:13:13,023 - INFO - Verifications in API Server for VN service-right-vn-92718033 passed 2025-11-06 03:13:13,023 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/7566aabd-7e8b-4b22-8cb3-1047f70a2c16 2025-11-06 03:13:13,034 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/002d6706-5684-4dcf-8e6b-e0c43be1b476 2025-11-06 03:13:13,042 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/002d6706-5684-4dcf-8e6b-e0c43be1b476 2025-11-06 03:13:13,050 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/9961ec78-0816-443a-9e9c-f36fa27e7c08 2025-11-06 03:13:13,064 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8459636680910654242', 'uuid-lslong': '10138465087414479894'}, 'enable': 'true', 'created': '2025-11-06T03:13:12', 'last-modified': '2025-11-06T03:13:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.461287'} 2025-11-06 03:13:13,072 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:13:13,078 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8459636680910654242', 'uuid-lslong': '10138465087414479894'}, 'enable': 'true', 'created': '2025-11-06T03:13:12', 'last-modified': '2025-11-06T03:13:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.481996'} 2025-11-06 03:13:13,085 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:13:13,091 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8459636680910654242', 'uuid-lslong': '10138465087414479894'}, 'enable': 'true', 'created': '2025-11-06T03:13:12', 'last-modified': '2025-11-06T03:13:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.490994'} 2025-11-06 03:13:13,098 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:13:13,098 - INFO - On all control nodes, Config, RI and RT verification for VN service-right-vn-92718033 passed 2025-11-06 03:13:13,098 - DEBUG - ====Verifying policy data for service-right-vn-92718033 in API_Server ====== 2025-11-06 03:13:13,098 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:13,104 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:13,117 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:13,215 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/7566aabd-7e8b-4b22-8cb3-1047f70a2c16 2025-11-06 03:13:13,227 - DEBUG - =>VN service-right-vn-92718033 has no policy to be verified 2025-11-06 03:13:13,228 - DEBUG - Verifying the vn in opserver 2025-11-06 03:13:13,228 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033 virtual network link through opserver 10.0.0.41 2025-11-06 03:13:13,228 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:13:13,285 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033?flat'} 2025-11-06 03:13:13,285 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033 virtual network link through opserver 10.0.0.38 2025-11-06 03:13:13,285 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:13:13,340 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033?flat'} 2025-11-06 03:13:13,340 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033 virtual network link through opserver 10.0.0.131 2025-11-06 03:13:13,340 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:13:13,409 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033?flat'} 2025-11-06 03:13:13,409 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-86163929:service-right-vn-92718033 is found in opserver 2025-11-06 03:13:13,431 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:13:13,440 - DEBUG - VRF ids for VN service-right-vn-92718033: {} 2025-11-06 03:13:13,502 - DEBUG - Services list from nova: [, , , ] 2025-11-06 03:13:14,552 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4662-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4662-2) 2025-11-06 03:13:16,142 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4662-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4662-1) 2025-11-06 03:13:16,143 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-57929019'] 2025-11-06 03:13:16,456 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-57929019'] created succesfully 2025-11-06 03:13:16,844 - DEBUG - Image by name tiny_nat_fw not found 2025-11-06 03:13:16,844 - DEBUG - Installing image tiny_nat_fw 2025-11-06 03:13:16,844 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-11-06 03:13:16,844 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-06 03:13:16,844 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-06 03:13:16,844 - DEBUG - Unzip image 2025-11-06 03:13:16,844 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-06 03:13:16,867 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-11-06 03:13:16,867 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-57929019'] 2025-11-06 03:13:17,010 - INFO - Service template: ['default-domain', 'ctest-service_template_1-57929019'] deleted successfully. 2025-11-06 03:13:17,010 - INFO - Skip interface_detach for VM ctest-right_vm-30971443 in state BUILD 2025-11-06 03:13:17,010 - INFO - Deleting VM ctest-right_vm-30971443 2025-11-06 03:13:17,057 - ERROR - VM ctest-right_vm-30971443 has failed to come up 2025-11-06 03:13:17,057 - ERROR - Nova failed to get host of the VM 2025-11-06 03:13:17,057 - ERROR - VM ctest-right_vm-30971443 has failed to come up 2025-11-06 03:13:17,057 - ERROR - Nova failed to get host of the VM 2025-11-06 03:13:17,194 - INFO - Skip interface_detach for VM ctest-left_vm-95272967 in state BUILD 2025-11-06 03:13:17,194 - INFO - Deleting VM ctest-left_vm-95272967 2025-11-06 03:13:17,194 - ERROR - VM ctest-left_vm-95272967 has failed to come up 2025-11-06 03:13:17,194 - ERROR - Nova failed to get host of the VM 2025-11-06 03:13:17,194 - ERROR - VM ctest-left_vm-95272967 has failed to come up 2025-11-06 03:13:17,194 - ERROR - Nova failed to get host of the VM 2025-11-06 03:13:17,274 - INFO - Deleting VN service-right-vn-92718033 2025-11-06 03:13:17,326 - DEBUG - VN 7566aabd-7e8b-4b22-8cb3-1047f70a2c16 still in use: Unable to complete operation on network 7566aabd-7e8b-4b22-8cb3-1047f70a2c16. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-43a4273d-24cf-4296-b0f7-80ddfd27ef7a'] 2025-11-06 03:13:17,326 - WARNING - Deleting VN service-right-vn-92718033 failed..Will retry 2025-11-06 03:13:19,572 - DEBUG - Response for deleting network () 2025-11-06 03:13:19,572 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/002d6706-5684-4dcf-8e6b-e0c43be1b476 2025-11-06 03:13:19,579 - DEBUG - Response Code: 404 2025-11-06 03:13:19,579 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:19,586 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:19,608 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:19,710 - INFO - Validated that VN service-right-vn-92718033 is not found in API Server 2025-11-06 03:13:19,724 - DEBUG - VN service-right-vn-92718033 is not present in Agent 10.0.0.240 2025-11-06 03:13:19,734 - DEBUG - VN service-right-vn-92718033 is not present in Agent 10.0.0.133 2025-11-06 03:13:19,734 - INFO - Validated that VN service-right-vn-92718033 is not in any agent 2025-11-06 03:13:19,770 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-right-vn-92718033 info 2025-11-06 03:13:19,771 - INFO - Deleting VN service-left-vn-72404496 2025-11-06 03:13:19,968 - DEBUG - Response for deleting network () 2025-11-06 03:13:19,968 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/24c653c5-78e9-482e-87a0-0475ef67660d 2025-11-06 03:13:19,977 - DEBUG - Response Code: 404 2025-11-06 03:13:19,977 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:19,983 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:20,004 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:20,092 - INFO - Validated that VN service-left-vn-72404496 is not found in API Server 2025-11-06 03:13:20,105 - DEBUG - VN service-left-vn-72404496 is not present in Agent 10.0.0.240 2025-11-06 03:13:20,117 - DEBUG - VN service-left-vn-72404496 is not present in Agent 10.0.0.133 2025-11-06 03:13:20,117 - INFO - Validated that VN service-left-vn-72404496 is not in any agent 2025-11-06 03:13:20,153 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-left-vn-72404496 info 2025-11-06 03:13:20,153 - INFO - Deleting VN ctest-mgmt_vn-31420470 2025-11-06 03:13:20,323 - DEBUG - Response for deleting network () 2025-11-06 03:13:20,323 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1fe9fcf6-88ff-4c0d-a43b-3facc868ec41 2025-11-06 03:13:20,329 - DEBUG - Response Code: 404 2025-11-06 03:13:20,330 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:20,340 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:20,353 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:20,451 - INFO - Validated that VN ctest-mgmt_vn-31420470 is not found in API Server 2025-11-06 03:13:20,466 - DEBUG - VN ctest-mgmt_vn-31420470 is not present in Agent 10.0.0.240 2025-11-06 03:13:20,479 - DEBUG - VN ctest-mgmt_vn-31420470 is not present in Agent 10.0.0.133 2025-11-06 03:13:20,479 - INFO - Validated that VN ctest-mgmt_vn-31420470 is not in any agent 2025-11-06 03:13:20,517 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-31420470 info 2025-11-06 03:13:21,788 - DEBUG - No XMPP flaps were noticed during the test 2025-11-06 03:13:21,788 - INFO - 2025-11-06 03:13:21,788 - INFO - END TEST : test_svc_CEM_22032 : SKIPPED[0:00:15] 2025-11-06 03:13:21,788 - INFO - -------------------------------------------------------------------------------- 2025-11-06 03:13:21,791 - INFO - ================================================================================ 2025-11-06 03:13:21,791 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-11-06 03:13:23,113 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.20.0.252': '0', '10.20.0.249': '0'}, '10.0.0.133': {'10.20.0.252': '0', '10.20.0.249': '0'}} with 2025-11-06 03:13:23,113 - INFO - Initial checks done. Running the testcase now 2025-11-06 03:13:23,113 - INFO - 2025-11-06 03:13:23,424 - DEBUG - Response for create_network : {'network': {'id': '83b7c206-edbc-4e68-8a7b-ed5b81730947', 'name': 'ctest-mgmt_vn-58388788', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-86163929', 'ctest-mgmt_vn-58388788'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:13:23,719 - DEBUG - Response for create_subnet : {'subnet': {'id': '0ccb8c37-1d50-4264-80bf-76f56a933a69', 'name': '', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'network_id': '83b7c206-edbc-4e68-8a7b-ed5b81730947', 'ip_version': 4, 'cidr': '94.113.87.192/26', 'allocation_pools': [{'start': '94.113.87.194', 'end': '94.113.87.254'}], 'gateway_ip': '94.113.87.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '94.113.87.194', 'tags': [], 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a'}} 2025-11-06 03:13:23,744 - INFO - Created VN ctest-mgmt_vn-58388788 2025-11-06 03:13:23,761 - DEBUG - VN ctest-mgmt_vn-58388788 UUID is 83b7c206-edbc-4e68-8a7b-ed5b81730947 2025-11-06 03:13:23,861 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:23,872 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:23,889 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:24,004 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83b7c206-edbc-4e68-8a7b-ed5b81730947 2025-11-06 03:13:24,025 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83b7c206-edbc-4e68-8a7b-ed5b81730947 2025-11-06 03:13:24,036 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ffd186d3-17a6-4fc0-a8ff-95421de3ec76 2025-11-06 03:13:24,048 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ffd186d3-17a6-4fc0-a8ff-95421de3ec76 2025-11-06 03:13:24,057 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d0965171-638e-4918-9344-45a9c7603b76 2025-11-06 03:13:24,065 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:13:24,065 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83b7c206-edbc-4e68-8a7b-ed5b81730947 2025-11-06 03:13:24,075 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ffd186d3-17a6-4fc0-a8ff-95421de3ec76 2025-11-06 03:13:24,093 - INFO - Verified VN network id 14 for VN 83b7c206-edbc-4e68-8a7b-ed5b81730947 2025-11-06 03:13:24,093 - INFO - Verifications in API Server for VN ctest-mgmt_vn-58388788 passed 2025-11-06 03:13:24,093 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83b7c206-edbc-4e68-8a7b-ed5b81730947 2025-11-06 03:13:24,108 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ffd186d3-17a6-4fc0-a8ff-95421de3ec76 2025-11-06 03:13:24,119 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ffd186d3-17a6-4fc0-a8ff-95421de3ec76 2025-11-06 03:13:24,130 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d0965171-638e-4918-9344-45a9c7603b76 2025-11-06 03:13:24,145 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9491268074720743016', 'uuid-lslong': '9978830376639072583'}, 'enable': 'true', 'created': '2025-11-06T03:13:23', 'last-modified': '2025-11-06T03:13:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.514694'} 2025-11-06 03:13:24,153 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:13:24,160 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9491268074720743016', 'uuid-lslong': '9978830376639072583'}, 'enable': 'true', 'created': '2025-11-06T03:13:23', 'last-modified': '2025-11-06T03:13:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.523004'} 2025-11-06 03:13:24,167 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:13:24,173 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9491268074720743016', 'uuid-lslong': '9978830376639072583'}, 'enable': 'true', 'created': '2025-11-06T03:13:23', 'last-modified': '2025-11-06T03:13:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.525343'} 2025-11-06 03:13:24,181 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-06 03:13:24,181 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-58388788 passed 2025-11-06 03:13:24,181 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-58388788 in API_Server ====== 2025-11-06 03:13:24,181 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:24,190 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:24,204 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:24,334 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/83b7c206-edbc-4e68-8a7b-ed5b81730947 2025-11-06 03:13:24,371 - DEBUG - =>VN ctest-mgmt_vn-58388788 has no policy to be verified 2025-11-06 03:13:24,371 - DEBUG - Verifying the vn in opserver 2025-11-06 03:13:24,371 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788 virtual network link through opserver 10.0.0.41 2025-11-06 03:13:24,371 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:13:24,389 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788?flat'} 2025-11-06 03:13:24,389 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788 virtual network link through opserver 10.0.0.38 2025-11-06 03:13:24,389 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:13:24,405 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788?flat'} 2025-11-06 03:13:24,405 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788 virtual network link through opserver 10.0.0.131 2025-11-06 03:13:24,405 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:13:24,419 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788?flat'} 2025-11-06 03:13:24,419 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-86163929:ctest-mgmt_vn-58388788 is found in opserver 2025-11-06 03:13:24,444 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:13:24,456 - DEBUG - VRF ids for VN ctest-mgmt_vn-58388788: {} 2025-11-06 03:13:24,848 - DEBUG - Response for create_network : {'network': {'id': '43bc0ac0-290a-4197-ab4a-5022fc1d6176', 'name': 'ctest-left_vn-48831964', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-86163929', 'ctest-left_vn-48831964'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:13:25,164 - DEBUG - Response for create_subnet : {'subnet': {'id': '3e271068-3207-402b-8589-58a98c33d34d', 'name': '', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'network_id': '43bc0ac0-290a-4197-ab4a-5022fc1d6176', 'ip_version': 4, 'cidr': '184.189.89.192/26', 'allocation_pools': [{'start': '184.189.89.194', 'end': '184.189.89.254'}], 'gateway_ip': '184.189.89.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '184.189.89.194', 'tags': [], 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a'}} 2025-11-06 03:13:25,188 - INFO - Created VN ctest-left_vn-48831964 2025-11-06 03:13:25,205 - DEBUG - VN ctest-left_vn-48831964 UUID is 43bc0ac0-290a-4197-ab4a-5022fc1d6176 2025-11-06 03:13:25,296 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:25,304 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:25,320 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:25,411 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/43bc0ac0-290a-4197-ab4a-5022fc1d6176 2025-11-06 03:13:25,425 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/43bc0ac0-290a-4197-ab4a-5022fc1d6176 2025-11-06 03:13:25,434 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a5d62596-7bfb-401f-bbfc-8a0943206217 2025-11-06 03:13:25,442 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a5d62596-7bfb-401f-bbfc-8a0943206217 2025-11-06 03:13:25,448 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/17ce7a05-db04-47e4-b2b3-023db865eacb 2025-11-06 03:13:25,453 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:13:25,453 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/43bc0ac0-290a-4197-ab4a-5022fc1d6176 2025-11-06 03:13:25,462 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a5d62596-7bfb-401f-bbfc-8a0943206217 2025-11-06 03:13:25,482 - INFO - Verified VN network id 15 for VN 43bc0ac0-290a-4197-ab4a-5022fc1d6176 2025-11-06 03:13:25,482 - INFO - Verifications in API Server for VN ctest-left_vn-48831964 passed 2025-11-06 03:13:25,482 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/43bc0ac0-290a-4197-ab4a-5022fc1d6176 2025-11-06 03:13:25,492 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a5d62596-7bfb-401f-bbfc-8a0943206217 2025-11-06 03:13:25,500 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a5d62596-7bfb-401f-bbfc-8a0943206217 2025-11-06 03:13:25,508 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/17ce7a05-db04-47e4-b2b3-023db865eacb 2025-11-06 03:13:25,524 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4880787916601311639', 'uuid-lslong': '12342765839951159670'}, 'enable': 'true', 'created': '2025-11-06T03:13:24', 'last-modified': '2025-11-06T03:13:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.447133'} 2025-11-06 03:13:25,533 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:13:25,539 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4880787916601311639', 'uuid-lslong': '12342765839951159670'}, 'enable': 'true', 'created': '2025-11-06T03:13:24', 'last-modified': '2025-11-06T03:13:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.467982'} 2025-11-06 03:13:25,547 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:13:25,553 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4880787916601311639', 'uuid-lslong': '12342765839951159670'}, 'enable': 'true', 'created': '2025-11-06T03:13:24', 'last-modified': '2025-11-06T03:13:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.482140'} 2025-11-06 03:13:25,560 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-06 03:13:25,560 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-48831964 passed 2025-11-06 03:13:25,560 - DEBUG - ====Verifying policy data for ctest-left_vn-48831964 in API_Server ====== 2025-11-06 03:13:25,560 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:25,567 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:25,581 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:25,677 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/43bc0ac0-290a-4197-ab4a-5022fc1d6176 2025-11-06 03:13:25,690 - DEBUG - =>VN ctest-left_vn-48831964 has no policy to be verified 2025-11-06 03:13:25,690 - DEBUG - Verifying the vn in opserver 2025-11-06 03:13:25,690 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964 virtual network link through opserver 10.0.0.41 2025-11-06 03:13:25,691 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:13:25,704 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964?flat'} 2025-11-06 03:13:25,704 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964 virtual network link through opserver 10.0.0.38 2025-11-06 03:13:25,704 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:13:25,717 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964?flat'} 2025-11-06 03:13:25,717 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964 virtual network link through opserver 10.0.0.131 2025-11-06 03:13:25,717 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:13:25,735 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964?flat'} 2025-11-06 03:13:25,735 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-86163929:ctest-left_vn-48831964 is found in opserver 2025-11-06 03:13:25,756 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:13:25,767 - DEBUG - VRF ids for VN ctest-left_vn-48831964: {} 2025-11-06 03:13:26,064 - DEBUG - Response for create_network : {'network': {'id': '1d88efcf-9820-4f4d-b227-336da9b88cbf', 'name': 'ctest-right_vn-83565185', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-86163929', 'ctest-right_vn-83565185'], 'port_security_enabled': True, 'description': ''}} 2025-11-06 03:13:26,314 - DEBUG - Response for create_subnet : {'subnet': {'id': '642eda9d-9095-4583-abd6-d2d1340f95e9', 'name': '', 'tenant_id': '52ec6d5a5f7849b2b01028d5585d8a8a', 'network_id': '1d88efcf-9820-4f4d-b227-336da9b88cbf', 'ip_version': 4, 'cidr': '26.7.151.192/26', 'allocation_pools': [{'start': '26.7.151.194', 'end': '26.7.151.254'}], 'gateway_ip': '26.7.151.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '26.7.151.194', 'tags': [], 'project_id': '52ec6d5a5f7849b2b01028d5585d8a8a'}} 2025-11-06 03:13:26,337 - INFO - Created VN ctest-right_vn-83565185 2025-11-06 03:13:26,354 - DEBUG - VN ctest-right_vn-83565185 UUID is 1d88efcf-9820-4f4d-b227-336da9b88cbf 2025-11-06 03:13:26,441 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:26,448 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:26,458 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:26,566 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1d88efcf-9820-4f4d-b227-336da9b88cbf 2025-11-06 03:13:26,588 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1d88efcf-9820-4f4d-b227-336da9b88cbf 2025-11-06 03:13:26,601 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/bece5dc2-960e-459a-9d7f-d45c805ed8ce 2025-11-06 03:13:26,614 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/bece5dc2-960e-459a-9d7f-d45c805ed8ce 2025-11-06 03:13:26,622 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/a8fd4089-f3c8-4e6c-bee5-c33d262e86f3 2025-11-06 03:13:26,632 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:13:26,632 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1d88efcf-9820-4f4d-b227-336da9b88cbf 2025-11-06 03:13:26,641 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/bece5dc2-960e-459a-9d7f-d45c805ed8ce 2025-11-06 03:13:26,657 - INFO - Verified VN network id 16 for VN 1d88efcf-9820-4f4d-b227-336da9b88cbf 2025-11-06 03:13:26,657 - INFO - Verifications in API Server for VN ctest-right_vn-83565185 passed 2025-11-06 03:13:26,657 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1d88efcf-9820-4f4d-b227-336da9b88cbf 2025-11-06 03:13:26,667 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/bece5dc2-960e-459a-9d7f-d45c805ed8ce 2025-11-06 03:13:26,674 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/bece5dc2-960e-459a-9d7f-d45c805ed8ce 2025-11-06 03:13:26,683 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/a8fd4089-f3c8-4e6c-bee5-c33d262e86f3 2025-11-06 03:13:26,696 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2128214498822082381', 'uuid-lslong': '12837285808934784191'}, 'enable': 'true', 'created': '2025-11-06T03:13:26', 'last-modified': '2025-11-06T03:13:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.454368'} 2025-11-06 03:13:26,708 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:13:26,714 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2128214498822082381', 'uuid-lslong': '12837285808934784191'}, 'enable': 'true', 'created': '2025-11-06T03:13:26', 'last-modified': '2025-11-06T03:13:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.473168'} 2025-11-06 03:13:26,722 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:13:26,731 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-86163929', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2128214498822082381', 'uuid-lslong': '12837285808934784191'}, 'enable': 'true', 'created': '2025-11-06T03:13:26', 'last-modified': '2025-11-06T03:13:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.484497'} 2025-11-06 03:13:26,737 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-06 03:13:26,737 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-83565185 passed 2025-11-06 03:13:26,737 - DEBUG - ====Verifying policy data for ctest-right_vn-83565185 in API_Server ====== 2025-11-06 03:13:26,737 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:26,743 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:26,753 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:26,846 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1d88efcf-9820-4f4d-b227-336da9b88cbf 2025-11-06 03:13:26,862 - DEBUG - =>VN ctest-right_vn-83565185 has no policy to be verified 2025-11-06 03:13:26,862 - DEBUG - Verifying the vn in opserver 2025-11-06 03:13:26,862 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185 virtual network link through opserver 10.0.0.41 2025-11-06 03:13:26,862 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-11-06 03:13:26,877 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185?flat'} 2025-11-06 03:13:26,877 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185 virtual network link through opserver 10.0.0.38 2025-11-06 03:13:26,877 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-06 03:13:26,892 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185?flat'} 2025-11-06 03:13:26,892 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185 virtual network link through opserver 10.0.0.131 2025-11-06 03:13:26,892 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-11-06 03:13:26,907 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185?flat'} 2025-11-06 03:13:26,907 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-86163929:ctest-right_vn-83565185 is found in opserver 2025-11-06 03:13:26,930 - DEBUG - Do not have enough data to verify VN in agent 2025-11-06 03:13:26,940 - DEBUG - VRF ids for VN ctest-right_vn-83565185: {} 2025-11-06 03:13:28,054 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4662-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4662-1) 2025-11-06 03:13:29,421 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4662-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4662-2) 2025-11-06 03:13:29,421 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-07686602'] 2025-11-06 03:13:29,718 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-07686602'] created succesfully 2025-11-06 03:13:30,072 - DEBUG - Image by name tiny_nat_fw not found 2025-11-06 03:13:30,072 - DEBUG - Installing image tiny_nat_fw 2025-11-06 03:13:30,072 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-11-06 03:13:30,072 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-06 03:13:30,073 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-06 03:13:30,073 - DEBUG - Unzip image 2025-11-06 03:13:30,073 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-06 03:13:30,104 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-11-06 03:13:30,105 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-07686602'] 2025-11-06 03:13:30,222 - INFO - Service template: ['default-domain', 'ctest-service_template_1-07686602'] deleted successfully. 2025-11-06 03:13:30,223 - INFO - Skip interface_detach for VM ctest-right_vm-71437092 in state BUILD 2025-11-06 03:13:30,223 - INFO - Deleting VM ctest-right_vm-71437092 2025-11-06 03:13:30,223 - ERROR - VM ctest-right_vm-71437092 has failed to come up 2025-11-06 03:13:30,223 - ERROR - Nova failed to get host of the VM 2025-11-06 03:13:30,223 - ERROR - VM ctest-right_vm-71437092 has failed to come up 2025-11-06 03:13:30,223 - ERROR - Nova failed to get host of the VM 2025-11-06 03:13:30,333 - INFO - Skip interface_detach for VM ctest-left_vm-89357523 in state BUILD 2025-11-06 03:13:30,334 - INFO - Deleting VM ctest-left_vm-89357523 2025-11-06 03:13:30,334 - ERROR - VM ctest-left_vm-89357523 has failed to come up 2025-11-06 03:13:30,334 - ERROR - Nova failed to get host of the VM 2025-11-06 03:13:30,334 - ERROR - VM ctest-left_vm-89357523 has failed to come up 2025-11-06 03:13:30,334 - ERROR - Nova failed to get host of the VM 2025-11-06 03:13:30,465 - INFO - Deleting VN ctest-right_vn-83565185 2025-11-06 03:13:30,557 - DEBUG - VN 1d88efcf-9820-4f4d-b227-336da9b88cbf still in use: Unable to complete operation on network 1d88efcf-9820-4f4d-b227-336da9b88cbf. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-11a29159-6048-421c-94a0-8edf7581c8dc'] 2025-11-06 03:13:30,557 - WARNING - Deleting VN ctest-right_vn-83565185 failed..Will retry 2025-11-06 03:13:32,749 - DEBUG - Response for deleting network () 2025-11-06 03:13:32,749 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/bece5dc2-960e-459a-9d7f-d45c805ed8ce 2025-11-06 03:13:32,758 - DEBUG - Response Code: 404 2025-11-06 03:13:32,758 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:32,766 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:32,817 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:32,876 - INFO - Validated that VN ctest-right_vn-83565185 is not found in API Server 2025-11-06 03:13:32,891 - DEBUG - VN ctest-right_vn-83565185 is not present in Agent 10.0.0.240 2025-11-06 03:13:32,914 - DEBUG - VN ctest-right_vn-83565185 is not present in Agent 10.0.0.133 2025-11-06 03:13:32,914 - INFO - Validated that VN ctest-right_vn-83565185 is not in any agent 2025-11-06 03:13:32,955 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-83565185 info 2025-11-06 03:13:32,956 - INFO - Deleting VN ctest-left_vn-48831964 2025-11-06 03:13:33,148 - DEBUG - Response for deleting network () 2025-11-06 03:13:33,149 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/a5d62596-7bfb-401f-bbfc-8a0943206217 2025-11-06 03:13:33,156 - DEBUG - Response Code: 404 2025-11-06 03:13:33,156 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:33,163 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:33,177 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:33,277 - INFO - Validated that VN ctest-left_vn-48831964 is not found in API Server 2025-11-06 03:13:33,290 - DEBUG - VN ctest-left_vn-48831964 is not present in Agent 10.0.0.240 2025-11-06 03:13:33,301 - DEBUG - VN ctest-left_vn-48831964 is not present in Agent 10.0.0.133 2025-11-06 03:13:33,301 - INFO - Validated that VN ctest-left_vn-48831964 is not in any agent 2025-11-06 03:13:33,332 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-48831964 info 2025-11-06 03:13:33,332 - INFO - Deleting VN ctest-mgmt_vn-58388788 2025-11-06 03:13:33,522 - DEBUG - Response for deleting network () 2025-11-06 03:13:33,522 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ffd186d3-17a6-4fc0-a8ff-95421de3ec76 2025-11-06 03:13:33,528 - DEBUG - Response Code: 404 2025-11-06 03:13:33,529 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-11-06 03:13:33,534 - DEBUG - Requesting: http://10.0.0.41:8082/domain/dd557474-6eee-442f-acdf-559f4d754f9d 2025-11-06 03:13:33,600 - DEBUG - Requesting: http://10.0.0.41:8082/project/52ec6d5a-5f78-49b2-b010-28d5585d8a8a 2025-11-06 03:13:33,710 - INFO - Validated that VN ctest-mgmt_vn-58388788 is not found in API Server 2025-11-06 03:13:33,723 - DEBUG - VN ctest-mgmt_vn-58388788 is not present in Agent 10.0.0.240 2025-11-06 03:13:33,734 - DEBUG - VN ctest-mgmt_vn-58388788 is not present in Agent 10.0.0.133 2025-11-06 03:13:33,734 - INFO - Validated that VN ctest-mgmt_vn-58388788 is not in any agent 2025-11-06 03:13:33,767 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-58388788 info 2025-11-06 03:13:35,057 - DEBUG - No XMPP flaps were noticed during the test 2025-11-06 03:13:35,057 - INFO - 2025-11-06 03:13:35,057 - INFO - END TEST : test_svc_in_network_datapath : SKIPPED[0:00:14] 2025-11-06 03:13:35,057 - INFO - -------------------------------------------------------------------------------- 2025-11-06 03:13:35,801 - INFO - Deleted project: ctest-TestSvcRegr-86163929, ID : 52ec6d5a-5f78-49b2-b010-28d5585d8a8a