2025-10-29 20:35:13,213 - INFO - Domain Default found not creating 2025-10-29 20:35:13,371 - INFO - Project ctest-TestSvcHC-50129806 not found, creating it 2025-10-29 20:35:13,892 - INFO - Created Project:ctest-TestSvcHC-50129806, ID : 9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:15,494 - INFO - ================================================================================ 2025-10-29 20:35:15,494 - INFO - STARTING TEST : test_svc_hc_basic 2025-10-29 20:35:16,850 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.20.0.254': '0', '10.20.0.18': '0'}, '10.0.0.242': {'10.20.0.18': '0', '10.20.0.14': '0'}} with 2025-10-29 20:35:16,850 - INFO - Initial checks done. Running the testcase now 2025-10-29 20:35:16,850 - INFO - 2025-10-29 20:35:17,472 - DEBUG - Response for create_network : {'network': {'id': '4deda0b6-f39e-4894-8867-efe0ea5281bb', 'name': 'ctest-mgmt_vn-18681254', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'project_id': '9752b0c17c9b48a1b2cacf703c226410', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-50129806', 'ctest-mgmt_vn-18681254'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 20:35:17,676 - DEBUG - Response for create_subnet : {'subnet': {'id': '074b6be2-0992-4830-813b-7350ee397496', 'name': '', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'network_id': '4deda0b6-f39e-4894-8867-efe0ea5281bb', 'ip_version': 4, 'cidr': '197.195.13.64/26', 'allocation_pools': [{'start': '197.195.13.66', 'end': '197.195.13.126'}], 'gateway_ip': '197.195.13.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '197.195.13.66', 'tags': [], 'project_id': '9752b0c17c9b48a1b2cacf703c226410'}} 2025-10-29 20:35:17,702 - INFO - Created VN ctest-mgmt_vn-18681254 2025-10-29 20:35:17,713 - DEBUG - VN ctest-mgmt_vn-18681254 UUID is 4deda0b6-f39e-4894-8867-efe0ea5281bb 2025-10-29 20:35:17,780 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:18,109 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:18,141 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:18,156 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:18,269 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4deda0b6-f39e-4894-8867-efe0ea5281bb 2025-10-29 20:35:18,281 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4deda0b6-f39e-4894-8867-efe0ea5281bb 2025-10-29 20:35:18,293 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/80b19f0b-98b4-4fa9-8fc1-a8cca8df92af 2025-10-29 20:35:18,304 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/80b19f0b-98b4-4fa9-8fc1-a8cca8df92af 2025-10-29 20:35:18,315 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/0a94bf7d-df8e-488c-ab0d-e0f8ae386c66 2025-10-29 20:35:18,327 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 20:35:18,327 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4deda0b6-f39e-4894-8867-efe0ea5281bb 2025-10-29 20:35:18,341 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/80b19f0b-98b4-4fa9-8fc1-a8cca8df92af 2025-10-29 20:35:18,359 - INFO - Verified VN network id 15 for VN 4deda0b6-f39e-4894-8867-efe0ea5281bb 2025-10-29 20:35:18,360 - INFO - Verifications in API Server for VN ctest-mgmt_vn-18681254 passed 2025-10-29 20:35:18,360 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4deda0b6-f39e-4894-8867-efe0ea5281bb 2025-10-29 20:35:18,373 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/80b19f0b-98b4-4fa9-8fc1-a8cca8df92af 2025-10-29 20:35:18,382 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/80b19f0b-98b4-4fa9-8fc1-a8cca8df92af 2025-10-29 20:35:18,391 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/0a94bf7d-df8e-488c-ab0d-e0f8ae386c66 2025-10-29 20:35:18,407 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5615321018032605332', 'uuid-lslong': '9829088461042385339'}, 'enable': 'true', 'created': '2025-10-29T20:35:17', 'last-modified': '2025-10-29T20:35:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.763176'} 2025-10-29 20:35:18,416 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 20:35:18,422 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5615321018032605332', 'uuid-lslong': '9829088461042385339'}, 'enable': 'true', 'created': '2025-10-29T20:35:17', 'last-modified': '2025-10-29T20:35:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.780589'} 2025-10-29 20:35:18,429 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 20:35:18,434 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5615321018032605332', 'uuid-lslong': '9829088461042385339'}, 'enable': 'true', 'created': '2025-10-29T20:35:17', 'last-modified': '2025-10-29T20:35:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.791761'} 2025-10-29 20:35:18,440 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 20:35:18,440 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-18681254 passed 2025-10-29 20:35:18,440 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-18681254 in API_Server ====== 2025-10-29 20:35:18,440 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:18,446 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:18,457 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:18,549 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4deda0b6-f39e-4894-8867-efe0ea5281bb 2025-10-29 20:35:18,559 - DEBUG - =>VN ctest-mgmt_vn-18681254 has no policy to be verified 2025-10-29 20:35:18,559 - DEBUG - Verifying the vn in opserver 2025-10-29 20:35:18,559 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254 virtual network link through opserver 10.0.0.254 2025-10-29 20:35:18,559 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-29 20:35:18,855 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-29 20:35:18,910 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254?flat'} 2025-10-29 20:35:18,911 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254 virtual network link through opserver 10.0.0.38 2025-10-29 20:35:18,911 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-29 20:35:19,204 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-29 20:35:19,262 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254?flat'} 2025-10-29 20:35:19,262 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254 virtual network link through opserver 10.0.0.33 2025-10-29 20:35:19,263 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-29 20:35:19,561 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-29 20:35:19,623 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254?flat'} 2025-10-29 20:35:19,623 - INFO - Validated that VN default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-18681254 is found in opserver 2025-10-29 20:35:19,654 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 20:35:19,668 - DEBUG - VRF ids for VN ctest-mgmt_vn-18681254: {} 2025-10-29 20:35:19,921 - DEBUG - Response for create_network : {'network': {'id': 'f93f61f5-4f09-44f6-a45f-d53652a26b62', 'name': 'ctest-left_vn-50276569', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'project_id': '9752b0c17c9b48a1b2cacf703c226410', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-50129806', 'ctest-left_vn-50276569'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 20:35:20,187 - DEBUG - Response for create_subnet : {'subnet': {'id': '37e5fbba-dec7-4a48-99af-28ea922e9f1f', 'name': '', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'network_id': 'f93f61f5-4f09-44f6-a45f-d53652a26b62', 'ip_version': 4, 'cidr': '109.225.129.64/26', 'allocation_pools': [{'start': '109.225.129.66', 'end': '109.225.129.126'}], 'gateway_ip': '109.225.129.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '109.225.129.66', 'tags': [], 'project_id': '9752b0c17c9b48a1b2cacf703c226410'}} 2025-10-29 20:35:20,211 - INFO - Created VN ctest-left_vn-50276569 2025-10-29 20:35:20,224 - DEBUG - VN ctest-left_vn-50276569 UUID is f93f61f5-4f09-44f6-a45f-d53652a26b62 2025-10-29 20:35:20,308 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:20,316 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:20,328 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:20,422 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f93f61f5-4f09-44f6-a45f-d53652a26b62 2025-10-29 20:35:20,434 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f93f61f5-4f09-44f6-a45f-d53652a26b62 2025-10-29 20:35:20,444 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e69fc496-c3e1-45e3-a27a-1e0bd46e90e5 2025-10-29 20:35:20,452 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e69fc496-c3e1-45e3-a27a-1e0bd46e90e5 2025-10-29 20:35:20,458 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/dfe5ea97-ebde-44d2-b8da-2a9a8bb18d2d 2025-10-29 20:35:20,466 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 20:35:20,466 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f93f61f5-4f09-44f6-a45f-d53652a26b62 2025-10-29 20:35:20,476 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e69fc496-c3e1-45e3-a27a-1e0bd46e90e5 2025-10-29 20:35:20,493 - INFO - Verified VN network id 16 for VN f93f61f5-4f09-44f6-a45f-d53652a26b62 2025-10-29 20:35:20,493 - INFO - Verifications in API Server for VN ctest-left_vn-50276569 passed 2025-10-29 20:35:20,493 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f93f61f5-4f09-44f6-a45f-d53652a26b62 2025-10-29 20:35:20,503 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e69fc496-c3e1-45e3-a27a-1e0bd46e90e5 2025-10-29 20:35:20,511 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e69fc496-c3e1-45e3-a27a-1e0bd46e90e5 2025-10-29 20:35:20,520 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/dfe5ea97-ebde-44d2-b8da-2a9a8bb18d2d 2025-10-29 20:35:20,533 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17960181545197716726', 'uuid-lslong': '11844419974299020130'}, 'enable': 'true', 'created': '2025-10-29T20:35:19', 'last-modified': '2025-10-29T20:35:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415186'} 2025-10-29 20:35:20,540 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 20:35:20,546 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17960181545197716726', 'uuid-lslong': '11844419974299020130'}, 'enable': 'true', 'created': '2025-10-29T20:35:19', 'last-modified': '2025-10-29T20:35:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.417052'} 2025-10-29 20:35:20,553 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 20:35:20,558 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17960181545197716726', 'uuid-lslong': '11844419974299020130'}, 'enable': 'true', 'created': '2025-10-29T20:35:19', 'last-modified': '2025-10-29T20:35:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423969'} 2025-10-29 20:35:20,565 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 20:35:20,565 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-50276569 passed 2025-10-29 20:35:20,565 - DEBUG - ====Verifying policy data for ctest-left_vn-50276569 in API_Server ====== 2025-10-29 20:35:20,565 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:20,571 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:20,583 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:20,671 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/f93f61f5-4f09-44f6-a45f-d53652a26b62 2025-10-29 20:35:20,687 - DEBUG - =>VN ctest-left_vn-50276569 has no policy to be verified 2025-10-29 20:35:20,687 - DEBUG - Verifying the vn in opserver 2025-10-29 20:35:20,688 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569 virtual network link through opserver 10.0.0.254 2025-10-29 20:35:20,688 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-29 20:35:20,752 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569?flat'} 2025-10-29 20:35:20,752 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569 virtual network link through opserver 10.0.0.38 2025-10-29 20:35:20,752 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-29 20:35:20,808 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569?flat'} 2025-10-29 20:35:20,808 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569 virtual network link through opserver 10.0.0.33 2025-10-29 20:35:20,808 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-29 20:35:20,868 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569?flat'} 2025-10-29 20:35:20,868 - INFO - Validated that VN default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-50276569 is found in opserver 2025-10-29 20:35:20,901 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 20:35:20,918 - DEBUG - VRF ids for VN ctest-left_vn-50276569: {} 2025-10-29 20:35:21,226 - DEBUG - Response for create_network : {'network': {'id': '849cecd8-2c6b-4a28-970f-854fdcf9d805', 'name': 'ctest-right_vn-39886198', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'project_id': '9752b0c17c9b48a1b2cacf703c226410', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-50129806', 'ctest-right_vn-39886198'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 20:35:21,508 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a6516ead-178d-4c2a-983a-807e0bae7e9b', 'name': '', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'network_id': '849cecd8-2c6b-4a28-970f-854fdcf9d805', 'ip_version': 4, 'cidr': '121.193.86.0/26', 'allocation_pools': [{'start': '121.193.86.2', 'end': '121.193.86.62'}], 'gateway_ip': '121.193.86.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '121.193.86.2', 'tags': [], 'project_id': '9752b0c17c9b48a1b2cacf703c226410'}} 2025-10-29 20:35:21,533 - INFO - Created VN ctest-right_vn-39886198 2025-10-29 20:35:21,543 - DEBUG - VN ctest-right_vn-39886198 UUID is 849cecd8-2c6b-4a28-970f-854fdcf9d805 2025-10-29 20:35:21,625 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:21,631 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:21,643 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:21,755 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/849cecd8-2c6b-4a28-970f-854fdcf9d805 2025-10-29 20:35:21,774 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/849cecd8-2c6b-4a28-970f-854fdcf9d805 2025-10-29 20:35:21,788 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e516d910-f4df-480c-a9a1-b97dfbe5ed24 2025-10-29 20:35:21,799 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e516d910-f4df-480c-a9a1-b97dfbe5ed24 2025-10-29 20:35:21,809 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/413a6df8-8b19-4159-b62c-3cdcdd0f761c 2025-10-29 20:35:21,818 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 20:35:21,818 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/849cecd8-2c6b-4a28-970f-854fdcf9d805 2025-10-29 20:35:21,831 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e516d910-f4df-480c-a9a1-b97dfbe5ed24 2025-10-29 20:35:21,852 - INFO - Verified VN network id 17 for VN 849cecd8-2c6b-4a28-970f-854fdcf9d805 2025-10-29 20:35:21,853 - INFO - Verifications in API Server for VN ctest-right_vn-39886198 passed 2025-10-29 20:35:21,853 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/849cecd8-2c6b-4a28-970f-854fdcf9d805 2025-10-29 20:35:21,871 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e516d910-f4df-480c-a9a1-b97dfbe5ed24 2025-10-29 20:35:21,880 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e516d910-f4df-480c-a9a1-b97dfbe5ed24 2025-10-29 20:35:21,888 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/413a6df8-8b19-4159-b62c-3cdcdd0f761c 2025-10-29 20:35:21,901 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9555772922575669800', 'uuid-lslong': '10885065402434050053'}, 'enable': 'true', 'created': '2025-10-29T20:35:21', 'last-modified': '2025-10-29T20:35:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.451015'} 2025-10-29 20:35:21,909 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 20:35:21,916 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9555772922575669800', 'uuid-lslong': '10885065402434050053'}, 'enable': 'true', 'created': '2025-10-29T20:35:21', 'last-modified': '2025-10-29T20:35:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.467738'} 2025-10-29 20:35:21,923 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 20:35:21,930 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9555772922575669800', 'uuid-lslong': '10885065402434050053'}, 'enable': 'true', 'created': '2025-10-29T20:35:21', 'last-modified': '2025-10-29T20:35:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.479584'} 2025-10-29 20:35:21,938 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 20:35:21,938 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-39886198 passed 2025-10-29 20:35:21,938 - DEBUG - ====Verifying policy data for ctest-right_vn-39886198 in API_Server ====== 2025-10-29 20:35:21,938 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:21,945 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:21,960 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:22,056 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/849cecd8-2c6b-4a28-970f-854fdcf9d805 2025-10-29 20:35:22,071 - DEBUG - =>VN ctest-right_vn-39886198 has no policy to be verified 2025-10-29 20:35:22,071 - DEBUG - Verifying the vn in opserver 2025-10-29 20:35:22,071 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198 virtual network link through opserver 10.0.0.254 2025-10-29 20:35:22,071 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-29 20:35:22,154 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198?flat'} 2025-10-29 20:35:22,154 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198 virtual network link through opserver 10.0.0.38 2025-10-29 20:35:22,154 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-29 20:35:22,227 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198?flat'} 2025-10-29 20:35:22,227 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198 virtual network link through opserver 10.0.0.33 2025-10-29 20:35:22,227 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-29 20:35:22,297 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198?flat'} 2025-10-29 20:35:22,297 - INFO - Validated that VN default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-39886198 is found in opserver 2025-10-29 20:35:22,327 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 20:35:22,342 - DEBUG - VRF ids for VN ctest-right_vn-39886198: {} 2025-10-29 20:35:22,419 - DEBUG - Services list from nova: [, , , ] 2025-10-29 20:35:23,490 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4527-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4527-2) 2025-10-29 20:35:24,934 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4527-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4527-1) 2025-10-29 20:35:24,935 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-23035557'] 2025-10-29 20:35:25,220 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-23035557'] created succesfully 2025-10-29 20:35:25,657 - DEBUG - Image by name tiny_nat_fw not found 2025-10-29 20:35:25,657 - DEBUG - Installing image tiny_nat_fw 2025-10-29 20:35:25,657 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-10-29 20:35:25,657 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-29 20:35:25,657 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-29 20:35:25,657 - DEBUG - Unzip image 2025-10-29 20:35:25,657 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-29 20:35:25,688 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-10-29 20:35:25,688 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-23035557'] 2025-10-29 20:35:25,782 - INFO - Service template: ['default-domain', 'ctest-service_template_1-23035557'] deleted successfully. 2025-10-29 20:35:25,782 - INFO - Skip interface_detach for VM ctest-right_vm-74774147 in state BUILD 2025-10-29 20:35:25,782 - INFO - Deleting VM ctest-right_vm-74774147 2025-10-29 20:35:25,824 - ERROR - VM ctest-right_vm-74774147 has failed to come up 2025-10-29 20:35:25,824 - ERROR - Nova failed to get host of the VM 2025-10-29 20:35:25,824 - ERROR - VM ctest-right_vm-74774147 has failed to come up 2025-10-29 20:35:25,824 - ERROR - Nova failed to get host of the VM 2025-10-29 20:35:25,954 - INFO - Skip interface_detach for VM ctest-left_vm-95695867 in state BUILD 2025-10-29 20:35:25,954 - INFO - Deleting VM ctest-left_vm-95695867 2025-10-29 20:35:25,954 - ERROR - VM ctest-left_vm-95695867 has failed to come up 2025-10-29 20:35:25,954 - ERROR - Nova failed to get host of the VM 2025-10-29 20:35:25,955 - ERROR - VM ctest-left_vm-95695867 has failed to come up 2025-10-29 20:35:25,955 - ERROR - Nova failed to get host of the VM 2025-10-29 20:35:26,070 - INFO - Deleting VN ctest-right_vn-39886198 2025-10-29 20:35:26,130 - DEBUG - VN 849cecd8-2c6b-4a28-970f-854fdcf9d805 still in use: Unable to complete operation on network 849cecd8-2c6b-4a28-970f-854fdcf9d805. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-25a1f155-2b94-49e5-a457-41dda8ad70cd'] 2025-10-29 20:35:26,131 - WARNING - Deleting VN ctest-right_vn-39886198 failed..Will retry 2025-10-29 20:35:28,281 - DEBUG - Response for deleting network () 2025-10-29 20:35:28,281 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e516d910-f4df-480c-a9a1-b97dfbe5ed24 2025-10-29 20:35:28,288 - DEBUG - Response Code: 404 2025-10-29 20:35:28,288 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:28,297 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:28,324 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:28,421 - INFO - Validated that VN ctest-right_vn-39886198 is not found in API Server 2025-10-29 20:35:28,454 - DEBUG - VN ctest-right_vn-39886198 is not present in Agent 10.0.0.241 2025-10-29 20:35:28,467 - DEBUG - VN ctest-right_vn-39886198 is not present in Agent 10.0.0.242 2025-10-29 20:35:28,467 - INFO - Validated that VN ctest-right_vn-39886198 is not in any agent 2025-10-29 20:35:28,509 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-39886198 info 2025-10-29 20:35:28,509 - INFO - Deleting VN ctest-left_vn-50276569 2025-10-29 20:35:28,689 - DEBUG - Response for deleting network () 2025-10-29 20:35:28,689 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e69fc496-c3e1-45e3-a27a-1e0bd46e90e5 2025-10-29 20:35:28,694 - DEBUG - Response Code: 404 2025-10-29 20:35:28,694 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:28,700 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:28,724 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:28,817 - INFO - Validated that VN ctest-left_vn-50276569 is not found in API Server 2025-10-29 20:35:28,836 - DEBUG - VN ctest-left_vn-50276569 is not present in Agent 10.0.0.241 2025-10-29 20:35:28,847 - DEBUG - VN ctest-left_vn-50276569 is not present in Agent 10.0.0.242 2025-10-29 20:35:28,847 - INFO - Validated that VN ctest-left_vn-50276569 is not in any agent 2025-10-29 20:35:28,886 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-50276569 info 2025-10-29 20:35:28,887 - INFO - Deleting VN ctest-mgmt_vn-18681254 2025-10-29 20:35:29,043 - DEBUG - Response for deleting network () 2025-10-29 20:35:29,044 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/80b19f0b-98b4-4fa9-8fc1-a8cca8df92af 2025-10-29 20:35:29,050 - DEBUG - Response Code: 404 2025-10-29 20:35:29,050 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:29,057 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:29,082 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:29,184 - INFO - Validated that VN ctest-mgmt_vn-18681254 is not found in API Server 2025-10-29 20:35:29,206 - DEBUG - VN ctest-mgmt_vn-18681254 is not present in Agent 10.0.0.241 2025-10-29 20:35:29,217 - DEBUG - VN ctest-mgmt_vn-18681254 is not present in Agent 10.0.0.242 2025-10-29 20:35:29,217 - INFO - Validated that VN ctest-mgmt_vn-18681254 is not in any agent 2025-10-29 20:35:29,258 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-18681254 info 2025-10-29 20:35:30,595 - DEBUG - No XMPP flaps were noticed during the test 2025-10-29 20:35:30,595 - INFO -
2025-10-29 20:35:30,595 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15]
2025-10-29 20:35:30,595 - INFO - -------------------------------------------------------------------------------- 2025-10-29 20:35:30,598 - INFO - ================================================================================ 2025-10-29 20:35:30,598 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-10-29 20:35:31,921 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.20.0.254': '0', '10.20.0.18': '0'}, '10.0.0.242': {'10.20.0.18': '0', '10.20.0.14': '0'}} with 2025-10-29 20:35:31,921 - INFO - Initial checks done. Running the testcase now 2025-10-29 20:35:31,921 - INFO - 2025-10-29 20:35:32,170 - DEBUG - Response for create_network : {'network': {'id': '5025108c-0d19-4fc9-8937-276a10982ca6', 'name': 'ctest-mgmt_vn-59010824', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'project_id': '9752b0c17c9b48a1b2cacf703c226410', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-50129806', 'ctest-mgmt_vn-59010824'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 20:35:32,425 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bd939799-d4f9-4c2d-90dd-f87cc5ec0fe5', 'name': '', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'network_id': '5025108c-0d19-4fc9-8937-276a10982ca6', 'ip_version': 4, 'cidr': '14.34.178.0/26', 'allocation_pools': [{'start': '14.34.178.2', 'end': '14.34.178.62'}], 'gateway_ip': '14.34.178.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '14.34.178.2', 'tags': [], 'project_id': '9752b0c17c9b48a1b2cacf703c226410'}} 2025-10-29 20:35:32,450 - INFO - Created VN ctest-mgmt_vn-59010824 2025-10-29 20:35:32,463 - DEBUG - VN ctest-mgmt_vn-59010824 UUID is 5025108c-0d19-4fc9-8937-276a10982ca6 2025-10-29 20:35:32,552 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:32,558 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:32,572 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:32,665 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5025108c-0d19-4fc9-8937-276a10982ca6 2025-10-29 20:35:32,679 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5025108c-0d19-4fc9-8937-276a10982ca6 2025-10-29 20:35:32,688 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/909030ce-7096-4e2b-a6b2-98aa13ccf06f 2025-10-29 20:35:32,699 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/909030ce-7096-4e2b-a6b2-98aa13ccf06f 2025-10-29 20:35:32,707 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/aec5a2ea-8392-49a3-9f6f-608b93bdd077 2025-10-29 20:35:32,716 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 20:35:32,716 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5025108c-0d19-4fc9-8937-276a10982ca6 2025-10-29 20:35:32,728 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/909030ce-7096-4e2b-a6b2-98aa13ccf06f 2025-10-29 20:35:32,743 - INFO - Verified VN network id 15 for VN 5025108c-0d19-4fc9-8937-276a10982ca6 2025-10-29 20:35:32,743 - INFO - Verifications in API Server for VN ctest-mgmt_vn-59010824 passed 2025-10-29 20:35:32,743 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5025108c-0d19-4fc9-8937-276a10982ca6 2025-10-29 20:35:32,755 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/909030ce-7096-4e2b-a6b2-98aa13ccf06f 2025-10-29 20:35:32,768 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/909030ce-7096-4e2b-a6b2-98aa13ccf06f 2025-10-29 20:35:32,777 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/aec5a2ea-8392-49a3-9f6f-608b93bdd077 2025-10-29 20:35:32,794 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5775040290873757641', 'uuid-lslong': '9887414843413638310'}, 'enable': 'true', 'created': '2025-10-29T20:35:32', 'last-modified': '2025-10-29T20:35:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428617'} 2025-10-29 20:35:32,802 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 20:35:32,809 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5775040290873757641', 'uuid-lslong': '9887414843413638310'}, 'enable': 'true', 'created': '2025-10-29T20:35:32', 'last-modified': '2025-10-29T20:35:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.437533'} 2025-10-29 20:35:32,816 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 20:35:32,824 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5775040290873757641', 'uuid-lslong': '9887414843413638310'}, 'enable': 'true', 'created': '2025-10-29T20:35:32', 'last-modified': '2025-10-29T20:35:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459859'} 2025-10-29 20:35:32,831 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 20:35:32,831 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-59010824 passed 2025-10-29 20:35:32,832 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-59010824 in API_Server ====== 2025-10-29 20:35:32,832 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:32,838 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:32,853 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:32,962 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5025108c-0d19-4fc9-8937-276a10982ca6 2025-10-29 20:35:32,981 - DEBUG - =>VN ctest-mgmt_vn-59010824 has no policy to be verified 2025-10-29 20:35:32,981 - DEBUG - Verifying the vn in opserver 2025-10-29 20:35:32,981 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824 virtual network link through opserver 10.0.0.254 2025-10-29 20:35:32,981 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-29 20:35:32,997 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824?flat'} 2025-10-29 20:35:32,997 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824 virtual network link through opserver 10.0.0.38 2025-10-29 20:35:32,997 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-29 20:35:33,011 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824?flat'} 2025-10-29 20:35:33,011 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824 virtual network link through opserver 10.0.0.33 2025-10-29 20:35:33,011 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-29 20:35:33,029 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824?flat'} 2025-10-29 20:35:33,030 - INFO - Validated that VN default-domain:ctest-TestSvcHC-50129806:ctest-mgmt_vn-59010824 is found in opserver 2025-10-29 20:35:33,060 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 20:35:33,076 - DEBUG - VRF ids for VN ctest-mgmt_vn-59010824: {} 2025-10-29 20:35:33,395 - DEBUG - Response for create_network : {'network': {'id': '872c99ff-8b0f-4d7e-8332-fb11349d3af8', 'name': 'ctest-left_vn-30942160', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'project_id': '9752b0c17c9b48a1b2cacf703c226410', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-50129806', 'ctest-left_vn-30942160'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 20:35:33,640 - DEBUG - Response for create_subnet : {'subnet': {'id': '2a009373-f2f6-4c7c-944a-d60c03fd117e', 'name': '', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'network_id': '872c99ff-8b0f-4d7e-8332-fb11349d3af8', 'ip_version': 4, 'cidr': '5.2.181.128/26', 'allocation_pools': [{'start': '5.2.181.130', 'end': '5.2.181.190'}], 'gateway_ip': '5.2.181.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '5.2.181.130', 'tags': [], 'project_id': '9752b0c17c9b48a1b2cacf703c226410'}} 2025-10-29 20:35:33,666 - INFO - Created VN ctest-left_vn-30942160 2025-10-29 20:35:33,679 - DEBUG - VN ctest-left_vn-30942160 UUID is 872c99ff-8b0f-4d7e-8332-fb11349d3af8 2025-10-29 20:35:33,759 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:33,767 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:33,782 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:33,888 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/872c99ff-8b0f-4d7e-8332-fb11349d3af8 2025-10-29 20:35:33,904 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/872c99ff-8b0f-4d7e-8332-fb11349d3af8 2025-10-29 20:35:33,916 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3088c892-e5af-4077-b473-700a5b0560ee 2025-10-29 20:35:33,926 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3088c892-e5af-4077-b473-700a5b0560ee 2025-10-29 20:35:33,936 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/78802bda-e57c-47bb-bca9-e382d2c911a1 2025-10-29 20:35:33,943 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 20:35:33,943 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/872c99ff-8b0f-4d7e-8332-fb11349d3af8 2025-10-29 20:35:33,953 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3088c892-e5af-4077-b473-700a5b0560ee 2025-10-29 20:35:33,973 - INFO - Verified VN network id 16 for VN 872c99ff-8b0f-4d7e-8332-fb11349d3af8 2025-10-29 20:35:33,974 - INFO - Verifications in API Server for VN ctest-left_vn-30942160 passed 2025-10-29 20:35:33,974 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/872c99ff-8b0f-4d7e-8332-fb11349d3af8 2025-10-29 20:35:33,985 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3088c892-e5af-4077-b473-700a5b0560ee 2025-10-29 20:35:33,993 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3088c892-e5af-4077-b473-700a5b0560ee 2025-10-29 20:35:34,001 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/78802bda-e57c-47bb-bca9-e382d2c911a1 2025-10-29 20:35:34,019 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9740329416924286334', 'uuid-lslong': '9453894619119827704'}, 'enable': 'true', 'created': '2025-10-29T20:35:33', 'last-modified': '2025-10-29T20:35:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.437666'} 2025-10-29 20:35:34,027 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 20:35:34,033 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9740329416924286334', 'uuid-lslong': '9453894619119827704'}, 'enable': 'true', 'created': '2025-10-29T20:35:33', 'last-modified': '2025-10-29T20:35:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.457227'} 2025-10-29 20:35:34,041 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 20:35:34,047 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9740329416924286334', 'uuid-lslong': '9453894619119827704'}, 'enable': 'true', 'created': '2025-10-29T20:35:33', 'last-modified': '2025-10-29T20:35:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.472060'} 2025-10-29 20:35:34,053 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 20:35:34,053 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-30942160 passed 2025-10-29 20:35:34,053 - DEBUG - ====Verifying policy data for ctest-left_vn-30942160 in API_Server ====== 2025-10-29 20:35:34,053 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:34,060 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:34,071 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:34,168 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/872c99ff-8b0f-4d7e-8332-fb11349d3af8 2025-10-29 20:35:34,182 - DEBUG - =>VN ctest-left_vn-30942160 has no policy to be verified 2025-10-29 20:35:34,182 - DEBUG - Verifying the vn in opserver 2025-10-29 20:35:34,182 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160 virtual network link through opserver 10.0.0.254 2025-10-29 20:35:34,182 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-29 20:35:34,197 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160?flat'} 2025-10-29 20:35:34,197 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160 virtual network link through opserver 10.0.0.38 2025-10-29 20:35:34,197 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-29 20:35:34,212 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160?flat'} 2025-10-29 20:35:34,212 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160 virtual network link through opserver 10.0.0.33 2025-10-29 20:35:34,212 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-29 20:35:34,224 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160?flat'} 2025-10-29 20:35:34,224 - INFO - Validated that VN default-domain:ctest-TestSvcHC-50129806:ctest-left_vn-30942160 is found in opserver 2025-10-29 20:35:34,258 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 20:35:34,278 - DEBUG - VRF ids for VN ctest-left_vn-30942160: {} 2025-10-29 20:35:34,594 - DEBUG - Response for create_network : {'network': {'id': '8b75f530-8a95-4f09-a7a0-59d688058275', 'name': 'ctest-right_vn-72486572', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'project_id': '9752b0c17c9b48a1b2cacf703c226410', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-50129806', 'ctest-right_vn-72486572'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 20:35:34,848 - DEBUG - Response for create_subnet : {'subnet': {'id': '4aaefb56-ad6e-4b9d-be79-69eeb96371ae', 'name': '', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'network_id': '8b75f530-8a95-4f09-a7a0-59d688058275', 'ip_version': 4, 'cidr': '123.212.236.64/26', 'allocation_pools': [{'start': '123.212.236.66', 'end': '123.212.236.126'}], 'gateway_ip': '123.212.236.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '123.212.236.66', 'tags': [], 'project_id': '9752b0c17c9b48a1b2cacf703c226410'}} 2025-10-29 20:35:34,872 - INFO - Created VN ctest-right_vn-72486572 2025-10-29 20:35:34,886 - DEBUG - VN ctest-right_vn-72486572 UUID is 8b75f530-8a95-4f09-a7a0-59d688058275 2025-10-29 20:35:34,958 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:34,967 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:34,983 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:35,085 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/8b75f530-8a95-4f09-a7a0-59d688058275 2025-10-29 20:35:35,097 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/8b75f530-8a95-4f09-a7a0-59d688058275 2025-10-29 20:35:35,107 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/60b004c6-af7f-48c5-a6a0-c85bd4c6f117 2025-10-29 20:35:35,114 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/60b004c6-af7f-48c5-a6a0-c85bd4c6f117 2025-10-29 20:35:35,121 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/a17d6a71-09de-48ea-bec2-e4a7235098f1 2025-10-29 20:35:35,127 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 20:35:35,128 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/8b75f530-8a95-4f09-a7a0-59d688058275 2025-10-29 20:35:35,136 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/60b004c6-af7f-48c5-a6a0-c85bd4c6f117 2025-10-29 20:35:35,152 - INFO - Verified VN network id 17 for VN 8b75f530-8a95-4f09-a7a0-59d688058275 2025-10-29 20:35:35,152 - INFO - Verifications in API Server for VN ctest-right_vn-72486572 passed 2025-10-29 20:35:35,152 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/8b75f530-8a95-4f09-a7a0-59d688058275 2025-10-29 20:35:35,162 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/60b004c6-af7f-48c5-a6a0-c85bd4c6f117 2025-10-29 20:35:35,169 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/60b004c6-af7f-48c5-a6a0-c85bd4c6f117 2025-10-29 20:35:35,178 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/a17d6a71-09de-48ea-bec2-e4a7235098f1 2025-10-29 20:35:35,191 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10049207732379406089', 'uuid-lslong': '12078752978547606133'}, 'enable': 'true', 'created': '2025-10-29T20:35:34', 'last-modified': '2025-10-29T20:35:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416970'} 2025-10-29 20:35:35,199 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 20:35:35,205 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10049207732379406089', 'uuid-lslong': '12078752978547606133'}, 'enable': 'true', 'created': '2025-10-29T20:35:34', 'last-modified': '2025-10-29T20:35:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.431901'} 2025-10-29 20:35:35,211 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 20:35:35,217 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10049207732379406089', 'uuid-lslong': '12078752978547606133'}, 'enable': 'true', 'created': '2025-10-29T20:35:34', 'last-modified': '2025-10-29T20:35:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443893'} 2025-10-29 20:35:35,223 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 20:35:35,223 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-72486572 passed 2025-10-29 20:35:35,223 - DEBUG - ====Verifying policy data for ctest-right_vn-72486572 in API_Server ====== 2025-10-29 20:35:35,223 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:35,229 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:35,241 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:35,330 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/8b75f530-8a95-4f09-a7a0-59d688058275 2025-10-29 20:35:35,339 - DEBUG - =>VN ctest-right_vn-72486572 has no policy to be verified 2025-10-29 20:35:35,339 - DEBUG - Verifying the vn in opserver 2025-10-29 20:35:35,339 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572 virtual network link through opserver 10.0.0.254 2025-10-29 20:35:35,339 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-29 20:35:35,352 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572?flat'} 2025-10-29 20:35:35,352 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572 virtual network link through opserver 10.0.0.38 2025-10-29 20:35:35,353 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-29 20:35:35,364 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572?flat'} 2025-10-29 20:35:35,364 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572 virtual network link through opserver 10.0.0.33 2025-10-29 20:35:35,364 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-29 20:35:35,375 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572?flat'} 2025-10-29 20:35:35,375 - INFO - Validated that VN default-domain:ctest-TestSvcHC-50129806:ctest-right_vn-72486572 is found in opserver 2025-10-29 20:35:35,406 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 20:35:35,426 - DEBUG - VRF ids for VN ctest-right_vn-72486572: {} 2025-10-29 20:35:35,692 - DEBUG - Response for create_network : {'network': {'id': '099a8ce5-571b-428e-9e64-d06bbf7bf1b6', 'name': 'ctest-trans_left_vn-02181288', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'project_id': '9752b0c17c9b48a1b2cacf703c226410', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-50129806', 'ctest-trans_left_vn-02181288'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 20:35:35,955 - DEBUG - Response for create_subnet : {'subnet': {'id': '3617fcde-d573-4137-95c8-49589a1797a9', 'name': '', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'network_id': '099a8ce5-571b-428e-9e64-d06bbf7bf1b6', 'ip_version': 4, 'cidr': '214.46.3.192/26', 'allocation_pools': [{'start': '214.46.3.194', 'end': '214.46.3.254'}], 'gateway_ip': '214.46.3.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '214.46.3.194', 'tags': [], 'project_id': '9752b0c17c9b48a1b2cacf703c226410'}} 2025-10-29 20:35:35,980 - INFO - Created VN ctest-trans_left_vn-02181288 2025-10-29 20:35:35,991 - DEBUG - VN ctest-trans_left_vn-02181288 UUID is 099a8ce5-571b-428e-9e64-d06bbf7bf1b6 2025-10-29 20:35:36,066 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:36,077 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:36,090 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:36,188 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/099a8ce5-571b-428e-9e64-d06bbf7bf1b6 2025-10-29 20:35:36,202 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/099a8ce5-571b-428e-9e64-d06bbf7bf1b6 2025-10-29 20:35:36,211 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f34c9828-3dc0-43cb-b7f9-4d6a449eb18f 2025-10-29 20:35:36,233 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f34c9828-3dc0-43cb-b7f9-4d6a449eb18f 2025-10-29 20:35:36,268 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/89039f78-f221-4145-a00d-d442463dd8bc 2025-10-29 20:35:36,276 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 20:35:36,276 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/099a8ce5-571b-428e-9e64-d06bbf7bf1b6 2025-10-29 20:35:36,286 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f34c9828-3dc0-43cb-b7f9-4d6a449eb18f 2025-10-29 20:35:36,301 - INFO - Verified VN network id 18 for VN 099a8ce5-571b-428e-9e64-d06bbf7bf1b6 2025-10-29 20:35:36,301 - INFO - Verifications in API Server for VN ctest-trans_left_vn-02181288 passed 2025-10-29 20:35:36,301 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/099a8ce5-571b-428e-9e64-d06bbf7bf1b6 2025-10-29 20:35:36,311 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f34c9828-3dc0-43cb-b7f9-4d6a449eb18f 2025-10-29 20:35:36,317 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f34c9828-3dc0-43cb-b7f9-4d6a449eb18f 2025-10-29 20:35:36,324 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/89039f78-f221-4145-a00d-d442463dd8bc 2025-10-29 20:35:36,335 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '692020409391596174', 'uuid-lslong': '11413476516856328630'}, 'enable': 'true', 'created': '2025-10-29T20:35:35', 'last-modified': '2025-10-29T20:35:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423376'} 2025-10-29 20:35:36,340 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 20:35:36,345 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '692020409391596174', 'uuid-lslong': '11413476516856328630'}, 'enable': 'true', 'created': '2025-10-29T20:35:35', 'last-modified': '2025-10-29T20:35:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.436207'} 2025-10-29 20:35:36,351 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 20:35:36,356 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '692020409391596174', 'uuid-lslong': '11413476516856328630'}, 'enable': 'true', 'created': '2025-10-29T20:35:35', 'last-modified': '2025-10-29T20:35:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.450074'} 2025-10-29 20:35:36,362 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 20:35:36,362 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-02181288 passed 2025-10-29 20:35:36,362 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-02181288 in API_Server ====== 2025-10-29 20:35:36,362 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:36,367 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:36,378 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:36,469 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/099a8ce5-571b-428e-9e64-d06bbf7bf1b6 2025-10-29 20:35:36,478 - DEBUG - =>VN ctest-trans_left_vn-02181288 has no policy to be verified 2025-10-29 20:35:36,478 - DEBUG - Verifying the vn in opserver 2025-10-29 20:35:36,478 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288 virtual network link through opserver 10.0.0.254 2025-10-29 20:35:36,478 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-29 20:35:36,489 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288?flat'} 2025-10-29 20:35:36,489 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288 virtual network link through opserver 10.0.0.38 2025-10-29 20:35:36,489 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-29 20:35:36,501 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288?flat'} 2025-10-29 20:35:36,501 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288 virtual network link through opserver 10.0.0.33 2025-10-29 20:35:36,501 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-29 20:35:36,514 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288?flat'} 2025-10-29 20:35:36,514 - INFO - Validated that VN default-domain:ctest-TestSvcHC-50129806:ctest-trans_left_vn-02181288 is found in opserver 2025-10-29 20:35:36,539 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 20:35:36,557 - DEBUG - VRF ids for VN ctest-trans_left_vn-02181288: {} 2025-10-29 20:35:36,806 - DEBUG - Response for create_network : {'network': {'id': 'afd43359-6b5a-499f-af03-69174bf7471b', 'name': 'ctest-trans_right_vn-41423146', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'project_id': '9752b0c17c9b48a1b2cacf703c226410', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-50129806', 'ctest-trans_right_vn-41423146'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 20:35:37,048 - DEBUG - Response for create_subnet : {'subnet': {'id': '7b79c992-ff40-4cad-ae50-f183439e554b', 'name': '', 'tenant_id': '9752b0c17c9b48a1b2cacf703c226410', 'network_id': 'afd43359-6b5a-499f-af03-69174bf7471b', 'ip_version': 4, 'cidr': '104.65.120.0/26', 'allocation_pools': [{'start': '104.65.120.2', 'end': '104.65.120.62'}], 'gateway_ip': '104.65.120.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '104.65.120.2', 'tags': [], 'project_id': '9752b0c17c9b48a1b2cacf703c226410'}} 2025-10-29 20:35:37,082 - INFO - Created VN ctest-trans_right_vn-41423146 2025-10-29 20:35:37,093 - DEBUG - VN ctest-trans_right_vn-41423146 UUID is afd43359-6b5a-499f-af03-69174bf7471b 2025-10-29 20:35:37,167 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:37,172 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:37,183 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:37,273 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/afd43359-6b5a-499f-af03-69174bf7471b 2025-10-29 20:35:37,285 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/afd43359-6b5a-499f-af03-69174bf7471b 2025-10-29 20:35:37,295 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a908471b-135d-4d2b-a349-cff68a7568a9 2025-10-29 20:35:37,303 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a908471b-135d-4d2b-a349-cff68a7568a9 2025-10-29 20:35:37,310 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/45dabc23-8728-4149-85a8-1046f3fcaca4 2025-10-29 20:35:37,320 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 20:35:37,320 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/afd43359-6b5a-499f-af03-69174bf7471b 2025-10-29 20:35:37,333 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a908471b-135d-4d2b-a349-cff68a7568a9 2025-10-29 20:35:37,352 - INFO - Verified VN network id 19 for VN afd43359-6b5a-499f-af03-69174bf7471b 2025-10-29 20:35:37,353 - INFO - Verifications in API Server for VN ctest-trans_right_vn-41423146 passed 2025-10-29 20:35:37,353 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/afd43359-6b5a-499f-af03-69174bf7471b 2025-10-29 20:35:37,362 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a908471b-135d-4d2b-a349-cff68a7568a9 2025-10-29 20:35:37,369 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a908471b-135d-4d2b-a349-cff68a7568a9 2025-10-29 20:35:37,375 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/45dabc23-8728-4149-85a8-1046f3fcaca4 2025-10-29 20:35:37,386 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12669808110846232991', 'uuid-lslong': '12611038930347181851'}, 'enable': 'true', 'created': '2025-10-29T20:35:36', 'last-modified': '2025-10-29T20:35:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.383496'} 2025-10-29 20:35:37,392 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 20:35:37,397 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12669808110846232991', 'uuid-lslong': '12611038930347181851'}, 'enable': 'true', 'created': '2025-10-29T20:35:36', 'last-modified': '2025-10-29T20:35:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402986'} 2025-10-29 20:35:37,403 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 20:35:37,408 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-50129806', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12669808110846232991', 'uuid-lslong': '12611038930347181851'}, 'enable': 'true', 'created': '2025-10-29T20:35:36', 'last-modified': '2025-10-29T20:35:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.427085'} 2025-10-29 20:35:37,414 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 20:35:37,414 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-41423146 passed 2025-10-29 20:35:37,414 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-41423146 in API_Server ====== 2025-10-29 20:35:37,414 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:37,420 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:37,433 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:37,541 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/afd43359-6b5a-499f-af03-69174bf7471b 2025-10-29 20:35:37,549 - DEBUG - =>VN ctest-trans_right_vn-41423146 has no policy to be verified 2025-10-29 20:35:37,549 - DEBUG - Verifying the vn in opserver 2025-10-29 20:35:37,549 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146 virtual network link through opserver 10.0.0.254 2025-10-29 20:35:37,549 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-29 20:35:37,562 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146?flat'} 2025-10-29 20:35:37,562 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146 virtual network link through opserver 10.0.0.38 2025-10-29 20:35:37,562 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-29 20:35:37,574 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146?flat'} 2025-10-29 20:35:37,574 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146 virtual network link through opserver 10.0.0.33 2025-10-29 20:35:37,574 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-29 20:35:37,586 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146?flat'} 2025-10-29 20:35:37,586 - INFO - Validated that VN default-domain:ctest-TestSvcHC-50129806:ctest-trans_right_vn-41423146 is found in opserver 2025-10-29 20:35:37,620 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 20:35:37,638 - DEBUG - VRF ids for VN ctest-trans_right_vn-41423146: {} 2025-10-29 20:35:38,707 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4527-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4527-1) 2025-10-29 20:35:40,099 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4527-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4527-2) 2025-10-29 20:35:40,099 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-40535198'] 2025-10-29 20:35:40,389 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-40535198'] created succesfully 2025-10-29 20:35:40,716 - DEBUG - Image by name tiny_trans_fw not found 2025-10-29 20:35:40,716 - DEBUG - Installing image tiny_trans_fw 2025-10-29 20:35:40,716 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-10-29 20:35:40,716 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-29 20:35:40,716 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-29 20:35:40,716 - DEBUG - Unzip image 2025-10-29 20:35:40,716 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-29 20:35:40,741 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-10-29 20:35:40,742 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-40535198'] 2025-10-29 20:35:40,830 - INFO - Service template: ['default-domain', 'ctest-service_template_1-40535198'] deleted successfully. 2025-10-29 20:35:40,830 - INFO - Skip interface_detach for VM ctest-right_vm-27813656 in state BUILD 2025-10-29 20:35:40,831 - INFO - Deleting VM ctest-right_vm-27813656 2025-10-29 20:35:40,831 - ERROR - VM ctest-right_vm-27813656 has failed to come up 2025-10-29 20:35:40,831 - ERROR - Nova failed to get host of the VM 2025-10-29 20:35:40,831 - ERROR - VM ctest-right_vm-27813656 has failed to come up 2025-10-29 20:35:40,831 - ERROR - Nova failed to get host of the VM 2025-10-29 20:35:40,940 - INFO - Skip interface_detach for VM ctest-left_vm-91577059 in state BUILD 2025-10-29 20:35:40,940 - INFO - Deleting VM ctest-left_vm-91577059 2025-10-29 20:35:40,940 - ERROR - VM ctest-left_vm-91577059 has failed to come up 2025-10-29 20:35:40,940 - ERROR - Nova failed to get host of the VM 2025-10-29 20:35:40,941 - ERROR - VM ctest-left_vm-91577059 has failed to come up 2025-10-29 20:35:40,941 - ERROR - Nova failed to get host of the VM 2025-10-29 20:35:41,061 - INFO - Deleting VN ctest-trans_right_vn-41423146 2025-10-29 20:35:41,230 - DEBUG - Response for deleting network () 2025-10-29 20:35:41,230 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a908471b-135d-4d2b-a349-cff68a7568a9 2025-10-29 20:35:41,247 - DEBUG - Response Code: 404 2025-10-29 20:35:41,247 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:41,257 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:41,273 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:41,370 - INFO - Validated that VN ctest-trans_right_vn-41423146 is not found in API Server 2025-10-29 20:35:41,389 - DEBUG - VN ctest-trans_right_vn-41423146 is not present in Agent 10.0.0.241 2025-10-29 20:35:41,401 - DEBUG - VN ctest-trans_right_vn-41423146 is not present in Agent 10.0.0.242 2025-10-29 20:35:41,402 - INFO - Validated that VN ctest-trans_right_vn-41423146 is not in any agent 2025-10-29 20:35:41,441 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-41423146 info 2025-10-29 20:35:41,442 - INFO - Deleting VN ctest-trans_left_vn-02181288 2025-10-29 20:35:41,645 - DEBUG - Response for deleting network () 2025-10-29 20:35:41,645 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f34c9828-3dc0-43cb-b7f9-4d6a449eb18f 2025-10-29 20:35:41,654 - DEBUG - Response Code: 404 2025-10-29 20:35:41,655 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:41,664 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:41,733 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:41,864 - INFO - Validated that VN ctest-trans_left_vn-02181288 is not found in API Server 2025-10-29 20:35:41,885 - DEBUG - VN ctest-trans_left_vn-02181288 is not present in Agent 10.0.0.241 2025-10-29 20:35:41,896 - DEBUG - VN ctest-trans_left_vn-02181288 is not present in Agent 10.0.0.242 2025-10-29 20:35:41,896 - INFO - Validated that VN ctest-trans_left_vn-02181288 is not in any agent 2025-10-29 20:35:41,936 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-02181288 info 2025-10-29 20:35:41,936 - INFO - Deleting VN ctest-right_vn-72486572 2025-10-29 20:35:41,980 - DEBUG - VN 8b75f530-8a95-4f09-a7a0-59d688058275 still in use: Unable to complete operation on network 8b75f530-8a95-4f09-a7a0-59d688058275. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a8d03324-e2a6-4d4d-95f2-d2807d6a6ff4'] 2025-10-29 20:35:41,980 - WARNING - Deleting VN ctest-right_vn-72486572 failed..Will retry 2025-10-29 20:35:44,133 - DEBUG - Response for deleting network () 2025-10-29 20:35:44,133 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/60b004c6-af7f-48c5-a6a0-c85bd4c6f117 2025-10-29 20:35:44,140 - DEBUG - Response Code: 404 2025-10-29 20:35:44,140 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:44,149 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:44,213 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:44,311 - INFO - Validated that VN ctest-right_vn-72486572 is not found in API Server 2025-10-29 20:35:44,327 - DEBUG - VN ctest-right_vn-72486572 is not present in Agent 10.0.0.241 2025-10-29 20:35:44,337 - DEBUG - VN ctest-right_vn-72486572 is not present in Agent 10.0.0.242 2025-10-29 20:35:44,337 - INFO - Validated that VN ctest-right_vn-72486572 is not in any agent 2025-10-29 20:35:44,368 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-72486572 info 2025-10-29 20:35:44,368 - INFO - Deleting VN ctest-left_vn-30942160 2025-10-29 20:35:44,495 - DEBUG - Response for deleting network () 2025-10-29 20:35:44,495 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3088c892-e5af-4077-b473-700a5b0560ee 2025-10-29 20:35:44,502 - DEBUG - Response Code: 404 2025-10-29 20:35:44,502 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:44,514 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:44,525 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:44,608 - INFO - Validated that VN ctest-left_vn-30942160 is not found in API Server 2025-10-29 20:35:44,631 - DEBUG - VN ctest-left_vn-30942160 is not present in Agent 10.0.0.241 2025-10-29 20:35:44,640 - DEBUG - VN ctest-left_vn-30942160 is not present in Agent 10.0.0.242 2025-10-29 20:35:44,640 - INFO - Validated that VN ctest-left_vn-30942160 is not in any agent 2025-10-29 20:35:44,676 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-30942160 info 2025-10-29 20:35:44,676 - INFO - Deleting VN ctest-mgmt_vn-59010824 2025-10-29 20:35:44,856 - DEBUG - Response for deleting network () 2025-10-29 20:35:44,856 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/909030ce-7096-4e2b-a6b2-98aa13ccf06f 2025-10-29 20:35:44,862 - DEBUG - Response Code: 404 2025-10-29 20:35:44,862 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-29 20:35:44,869 - DEBUG - Requesting: http://10.0.0.254:8082/domain/a090225f-9b9e-4366-926c-6397a8c195bb 2025-10-29 20:35:44,883 - DEBUG - Requesting: http://10.0.0.254:8082/project/9752b0c1-7c9b-48a1-b2ca-cf703c226410 2025-10-29 20:35:44,972 - INFO - Validated that VN ctest-mgmt_vn-59010824 is not found in API Server 2025-10-29 20:35:44,990 - DEBUG - VN ctest-mgmt_vn-59010824 is not present in Agent 10.0.0.241 2025-10-29 20:35:45,002 - DEBUG - VN ctest-mgmt_vn-59010824 is not present in Agent 10.0.0.242 2025-10-29 20:35:45,002 - INFO - Validated that VN ctest-mgmt_vn-59010824 is not in any agent 2025-10-29 20:35:45,043 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-59010824 info 2025-10-29 20:35:46,398 - DEBUG - No XMPP flaps were noticed during the test 2025-10-29 20:35:46,398 - INFO -
2025-10-29 20:35:46,398 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16]
2025-10-29 20:35:46,398 - INFO - -------------------------------------------------------------------------------- 2025-10-29 20:35:47,113 - INFO - Deleted project: ctest-TestSvcHC-50129806, ID : 9752b0c1-7c9b-48a1-b2ca-cf703c226410