2025-08-04 03:23:04,809 - INFO - Domain Default found not creating
2025-08-04 03:23:04,995 - INFO - Project ctest-TestSvcHC-34830667 not found, creating it
2025-08-04 03:23:05,539 - INFO - Created Project:ctest-TestSvcHC-34830667, ID : 8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:07,104 - INFO - ================================================================================
2025-08-04 03:23:07,104 - INFO - STARTING TEST : test_svc_hc_basic
2025-08-04 03:23:08,388 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.57': {'10.20.0.193': '0', '10.20.0.18': '0'}} with
2025-08-04 03:23:08,388 - INFO - Initial checks done. Running the testcase now
2025-08-04 03:23:08,388 - INFO -
2025-08-04 03:23:09,120 - DEBUG - Response for create_network : {'network': {'id': '9203940e-ef14-4ad6-8ed6-66c98aec7345', 'name': 'ctest-mgmt_vn-81013763', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'project_id': '8bbabb2310594c4094f72e6eae01cb6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34830667', 'ctest-mgmt_vn-81013763'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:23:09,433 - DEBUG - Response for create_subnet : {'subnet': {'id': '450316a6-b926-4df9-a43b-6c86ab141cca', 'name': '', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'network_id': '9203940e-ef14-4ad6-8ed6-66c98aec7345', 'ip_version': 4, 'cidr': '11.162.231.0/26', 'allocation_pools': [{'start': '11.162.231.2', 'end': '11.162.231.62'}], 'gateway_ip': '11.162.231.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.162.231.2', 'tags': [], 'project_id': '8bbabb2310594c4094f72e6eae01cb6f'}}
2025-08-04 03:23:09,463 - INFO - Created VN ctest-mgmt_vn-81013763
2025-08-04 03:23:09,482 - DEBUG - VN ctest-mgmt_vn-81013763 UUID is 9203940e-ef14-4ad6-8ed6-66c98aec7345
2025-08-04 03:23:09,564 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:09,864 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:09,899 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:09,919 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:10,026 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9203940e-ef14-4ad6-8ed6-66c98aec7345
2025-08-04 03:23:10,040 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9203940e-ef14-4ad6-8ed6-66c98aec7345
2025-08-04 03:23:10,054 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/22ca24f2-723c-493a-a8c3-890630d2d0c1
2025-08-04 03:23:10,064 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/22ca24f2-723c-493a-a8c3-890630d2d0c1
2025-08-04 03:23:10,074 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/2edeb6e9-b1c3-4df6-9396-c9e50cc0f481
2025-08-04 03:23:10,082 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:23:10,082 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9203940e-ef14-4ad6-8ed6-66c98aec7345
2025-08-04 03:23:10,092 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/22ca24f2-723c-493a-a8c3-890630d2d0c1
2025-08-04 03:23:10,112 - INFO - Verified VN network id 13 for VN 9203940e-ef14-4ad6-8ed6-66c98aec7345
2025-08-04 03:23:10,112 - INFO - Verifications in API Server for VN ctest-mgmt_vn-81013763 passed
2025-08-04 03:23:10,113 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9203940e-ef14-4ad6-8ed6-66c98aec7345
2025-08-04 03:23:10,127 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/22ca24f2-723c-493a-a8c3-890630d2d0c1
2025-08-04 03:23:10,135 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/22ca24f2-723c-493a-a8c3-890630d2d0c1
2025-08-04 03:23:10,144 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/2edeb6e9-b1c3-4df6-9396-c9e50cc0f481
2025-08-04 03:23:10,161 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10521415946329148118', 'uuid-lslong': '10292527014207058757'}, 'enable': 'true', 'created': '2025-08-04T03:23:09', 'last-modified': '2025-08-04T03:23:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.792878'}
2025-08-04 03:23:10,168 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:23:10,174 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10521415946329148118', 'uuid-lslong': '10292527014207058757'}, 'enable': 'true', 'created': '2025-08-04T03:23:09', 'last-modified': '2025-08-04T03:23:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.799797'}
2025-08-04 03:23:10,181 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:23:10,188 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10521415946329148118', 'uuid-lslong': '10292527014207058757'}, 'enable': 'true', 'created': '2025-08-04T03:23:09', 'last-modified': '2025-08-04T03:23:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.805973'}
2025-08-04 03:23:10,196 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:23:10,196 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-81013763 passed
2025-08-04 03:23:10,196 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-81013763 in API_Server ======
2025-08-04 03:23:10,197 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:10,203 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:10,218 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:10,319 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9203940e-ef14-4ad6-8ed6-66c98aec7345
2025-08-04 03:23:10,333 - DEBUG - =>VN ctest-mgmt_vn-81013763 has no policy to be verified
2025-08-04 03:23:10,333 - DEBUG - Verifying the vn in opserver
2025-08-04 03:23:10,333 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763 virtual network link through opserver 10.0.0.27
2025-08-04 03:23:10,333 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:23:10,644 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:23:10,706 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763?flat'}
2025-08-04 03:23:10,707 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763 virtual network link through opserver 10.0.0.38
2025-08-04 03:23:10,707 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:23:11,010 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:23:11,082 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763?flat'}
2025-08-04 03:23:11,082 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763 virtual network link through opserver 10.0.0.61
2025-08-04 03:23:11,083 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:23:11,397 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:23:11,470 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763?flat'}
2025-08-04 03:23:11,470 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-81013763 is found in opserver
2025-08-04 03:23:11,508 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:23:11,520 - DEBUG - VRF ids for VN ctest-mgmt_vn-81013763: {}
2025-08-04 03:23:11,830 - DEBUG - Response for create_network : {'network': {'id': '37f32285-0685-4d33-95a1-edcb576bdb06', 'name': 'ctest-left_vn-34904713', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'project_id': '8bbabb2310594c4094f72e6eae01cb6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34830667', 'ctest-left_vn-34904713'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:23:12,129 - DEBUG - Response for create_subnet : {'subnet': {'id': '61af193f-1c1f-4672-b09a-fd91ee92efda', 'name': '', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'network_id': '37f32285-0685-4d33-95a1-edcb576bdb06', 'ip_version': 4, 'cidr': '130.232.145.192/26', 'allocation_pools': [{'start': '130.232.145.194', 'end': '130.232.145.254'}], 'gateway_ip': '130.232.145.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '130.232.145.194', 'tags': [], 'project_id': '8bbabb2310594c4094f72e6eae01cb6f'}}
2025-08-04 03:23:12,160 - INFO - Created VN ctest-left_vn-34904713
2025-08-04 03:23:12,175 - DEBUG - VN ctest-left_vn-34904713 UUID is 37f32285-0685-4d33-95a1-edcb576bdb06
2025-08-04 03:23:12,259 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:12,268 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:12,283 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:12,395 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/37f32285-0685-4d33-95a1-edcb576bdb06
2025-08-04 03:23:12,414 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/37f32285-0685-4d33-95a1-edcb576bdb06
2025-08-04 03:23:12,429 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/1e7117b9-40b4-4478-9b4c-fc3e1a937039
2025-08-04 03:23:12,442 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/1e7117b9-40b4-4478-9b4c-fc3e1a937039
2025-08-04 03:23:12,451 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/07146f97-d092-421a-9322-9f0f65e3b900
2025-08-04 03:23:12,459 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:23:12,459 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/37f32285-0685-4d33-95a1-edcb576bdb06
2025-08-04 03:23:12,471 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/1e7117b9-40b4-4478-9b4c-fc3e1a937039
2025-08-04 03:23:12,492 - INFO - Verified VN network id 14 for VN 37f32285-0685-4d33-95a1-edcb576bdb06
2025-08-04 03:23:12,492 - INFO - Verifications in API Server for VN ctest-left_vn-34904713 passed
2025-08-04 03:23:12,492 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/37f32285-0685-4d33-95a1-edcb576bdb06
2025-08-04 03:23:12,505 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/1e7117b9-40b4-4478-9b4c-fc3e1a937039
2025-08-04 03:23:12,514 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/1e7117b9-40b4-4478-9b4c-fc3e1a937039
2025-08-04 03:23:12,523 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/07146f97-d092-421a-9322-9f0f65e3b900
2025-08-04 03:23:12,540 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4031604046162119987', 'uuid-lslong': '10782160440502508294'}, 'enable': 'true', 'created': '2025-08-04T03:23:11', 'last-modified': '2025-08-04T03:23:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.457839'}
2025-08-04 03:23:12,548 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:23:12,555 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4031604046162119987', 'uuid-lslong': '10782160440502508294'}, 'enable': 'true', 'created': '2025-08-04T03:23:11', 'last-modified': '2025-08-04T03:23:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.477202'}
2025-08-04 03:23:12,562 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:23:12,570 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4031604046162119987', 'uuid-lslong': '10782160440502508294'}, 'enable': 'true', 'created': '2025-08-04T03:23:11', 'last-modified': '2025-08-04T03:23:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.495015'}
2025-08-04 03:23:12,582 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:23:12,582 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-34904713 passed
2025-08-04 03:23:12,583 - DEBUG - ====Verifying policy data for ctest-left_vn-34904713 in API_Server ======
2025-08-04 03:23:12,583 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:12,590 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:12,604 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:12,698 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/37f32285-0685-4d33-95a1-edcb576bdb06
2025-08-04 03:23:12,713 - DEBUG - =>VN ctest-left_vn-34904713 has no policy to be verified
2025-08-04 03:23:12,713 - DEBUG - Verifying the vn in opserver
2025-08-04 03:23:12,713 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713 virtual network link through opserver 10.0.0.27
2025-08-04 03:23:12,713 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:23:12,776 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713?flat'}
2025-08-04 03:23:12,776 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713 virtual network link through opserver 10.0.0.38
2025-08-04 03:23:12,776 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:23:12,845 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713?flat'}
2025-08-04 03:23:12,845 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713 virtual network link through opserver 10.0.0.61
2025-08-04 03:23:12,845 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:23:12,916 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713?flat'}
2025-08-04 03:23:12,916 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-34904713 is found in opserver
2025-08-04 03:23:12,944 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:23:12,958 - DEBUG - VRF ids for VN ctest-left_vn-34904713: {}
2025-08-04 03:23:13,263 - DEBUG - Response for create_network : {'network': {'id': 'acb5ba0f-46dc-4a3f-b8c1-7ba36856bce0', 'name': 'ctest-right_vn-65553255', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'project_id': '8bbabb2310594c4094f72e6eae01cb6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34830667', 'ctest-right_vn-65553255'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:23:13,578 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b0cea3f4-3af2-410e-a200-59e1ed3f64bf', 'name': '', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'network_id': 'acb5ba0f-46dc-4a3f-b8c1-7ba36856bce0', 'ip_version': 4, 'cidr': '84.209.229.0/26', 'allocation_pools': [{'start': '84.209.229.2', 'end': '84.209.229.62'}], 'gateway_ip': '84.209.229.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '84.209.229.2', 'tags': [], 'project_id': '8bbabb2310594c4094f72e6eae01cb6f'}}
2025-08-04 03:23:13,603 - INFO - Created VN ctest-right_vn-65553255
2025-08-04 03:23:13,618 - DEBUG - VN ctest-right_vn-65553255 UUID is acb5ba0f-46dc-4a3f-b8c1-7ba36856bce0
2025-08-04 03:23:13,708 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:13,718 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:13,734 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:13,828 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/acb5ba0f-46dc-4a3f-b8c1-7ba36856bce0
2025-08-04 03:23:13,842 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/acb5ba0f-46dc-4a3f-b8c1-7ba36856bce0
2025-08-04 03:23:13,852 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4a62621a-82fe-4167-83e0-66dea963ee77
2025-08-04 03:23:13,862 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4a62621a-82fe-4167-83e0-66dea963ee77
2025-08-04 03:23:13,872 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/267e8efd-c02e-495c-868e-1b6be1872403
2025-08-04 03:23:13,881 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:23:13,881 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/acb5ba0f-46dc-4a3f-b8c1-7ba36856bce0
2025-08-04 03:23:13,894 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4a62621a-82fe-4167-83e0-66dea963ee77
2025-08-04 03:23:13,914 - INFO - Verified VN network id 15 for VN acb5ba0f-46dc-4a3f-b8c1-7ba36856bce0
2025-08-04 03:23:13,914 - INFO - Verifications in API Server for VN ctest-right_vn-65553255 passed
2025-08-04 03:23:13,914 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/acb5ba0f-46dc-4a3f-b8c1-7ba36856bce0
2025-08-04 03:23:13,926 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4a62621a-82fe-4167-83e0-66dea963ee77
2025-08-04 03:23:13,937 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4a62621a-82fe-4167-83e0-66dea963ee77
2025-08-04 03:23:13,946 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/267e8efd-c02e-495c-868e-1b6be1872403
2025-08-04 03:23:13,962 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12445057720084351551', 'uuid-lslong': '13313057915244297440'}, 'enable': 'true', 'created': '2025-08-04T03:23:13', 'last-modified': '2025-08-04T03:23:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.462449'}
2025-08-04 03:23:13,970 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:23:13,976 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12445057720084351551', 'uuid-lslong': '13313057915244297440'}, 'enable': 'true', 'created': '2025-08-04T03:23:13', 'last-modified': '2025-08-04T03:23:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.473351'}
2025-08-04 03:23:13,983 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:23:13,990 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12445057720084351551', 'uuid-lslong': '13313057915244297440'}, 'enable': 'true', 'created': '2025-08-04T03:23:13', 'last-modified': '2025-08-04T03:23:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493604'}
2025-08-04 03:23:14,000 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:23:14,000 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-65553255 passed
2025-08-04 03:23:14,000 - DEBUG - ====Verifying policy data for ctest-right_vn-65553255 in API_Server ======
2025-08-04 03:23:14,000 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:14,009 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:14,026 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:14,126 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/acb5ba0f-46dc-4a3f-b8c1-7ba36856bce0
2025-08-04 03:23:14,138 - DEBUG - =>VN ctest-right_vn-65553255 has no policy to be verified
2025-08-04 03:23:14,138 - DEBUG - Verifying the vn in opserver
2025-08-04 03:23:14,138 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255 virtual network link through opserver 10.0.0.27
2025-08-04 03:23:14,138 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:23:14,216 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255?flat'}
2025-08-04 03:23:14,216 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255 virtual network link through opserver 10.0.0.38
2025-08-04 03:23:14,216 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:23:14,293 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255?flat'}
2025-08-04 03:23:14,293 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255 virtual network link through opserver 10.0.0.61
2025-08-04 03:23:14,293 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:23:14,380 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255?flat'}
2025-08-04 03:23:14,380 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-65553255 is found in opserver
2025-08-04 03:23:14,424 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:23:14,444 - DEBUG - VRF ids for VN ctest-right_vn-65553255: {}
2025-08-04 03:23:14,553 - DEBUG - Services list from nova: [, , , ]
2025-08-04 03:23:15,777 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2)
2025-08-04 03:23:17,220 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-1)
2025-08-04 03:23:17,221 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-76734605']
2025-08-04 03:23:17,536 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-76734605'] created succesfully
2025-08-04 03:23:17,901 - DEBUG - Image by name tiny_nat_fw not found
2025-08-04 03:23:17,901 - DEBUG - Installing image tiny_nat_fw
2025-08-04 03:23:17,901 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-08-04 03:23:17,901 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:23:17,902 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:23:17,902 - DEBUG - Unzip image
2025-08-04 03:23:17,902 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-08-04 03:23:17,922 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found
2025-08-04 03:23:17,922 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-76734605']
2025-08-04 03:23:18,027 - INFO - Service template: ['default-domain', 'ctest-service_template_1-76734605'] deleted successfully.
2025-08-04 03:23:18,028 - INFO - Skip interface_detach for VM ctest-right_vm-26688531 in state BUILD
2025-08-04 03:23:18,028 - INFO - Deleting VM ctest-right_vm-26688531
2025-08-04 03:23:18,087 - ERROR - VM ctest-right_vm-26688531 has failed to come up
2025-08-04 03:23:18,087 - ERROR - Nova failed to get host of the VM
2025-08-04 03:23:18,087 - ERROR - VM ctest-right_vm-26688531 has failed to come up
2025-08-04 03:23:18,088 - ERROR - Nova failed to get host of the VM
2025-08-04 03:23:18,179 - INFO - Skip interface_detach for VM ctest-left_vm-64633449 in state BUILD
2025-08-04 03:23:18,180 - INFO - Deleting VM ctest-left_vm-64633449
2025-08-04 03:23:18,180 - ERROR - VM ctest-left_vm-64633449 has failed to come up
2025-08-04 03:23:18,181 - ERROR - Nova failed to get host of the VM
2025-08-04 03:23:18,181 - ERROR - VM ctest-left_vm-64633449 has failed to come up
2025-08-04 03:23:18,182 - ERROR - Nova failed to get host of the VM
2025-08-04 03:23:18,262 - INFO - Deleting VN ctest-right_vn-65553255
2025-08-04 03:23:18,313 - DEBUG - VN acb5ba0f-46dc-4a3f-b8c1-7ba36856bce0 still in use: Unable to complete operation on network acb5ba0f-46dc-4a3f-b8c1-7ba36856bce0. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-860b8259-4699-421e-8c80-1127057034d8']
2025-08-04 03:23:18,313 - WARNING - Deleting VN ctest-right_vn-65553255 failed..Will retry
2025-08-04 03:23:20,539 - DEBUG - Response for deleting network ()
2025-08-04 03:23:20,539 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4a62621a-82fe-4167-83e0-66dea963ee77
2025-08-04 03:23:20,547 - DEBUG - Response Code: 404
2025-08-04 03:23:20,547 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:20,557 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:20,580 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:20,700 - INFO - Validated that VN ctest-right_vn-65553255 is not found in API Server
2025-08-04 03:23:20,715 - DEBUG - VN ctest-right_vn-65553255 is not present in Agent 10.0.0.41
2025-08-04 03:23:20,730 - DEBUG - VN ctest-right_vn-65553255 is not present in Agent 10.0.0.57
2025-08-04 03:23:20,731 - INFO - Validated that VN ctest-right_vn-65553255 is not in any agent
2025-08-04 03:23:20,772 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-65553255 info
2025-08-04 03:23:20,772 - INFO - Deleting VN ctest-left_vn-34904713
2025-08-04 03:23:20,948 - DEBUG - Response for deleting network ()
2025-08-04 03:23:20,948 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/1e7117b9-40b4-4478-9b4c-fc3e1a937039
2025-08-04 03:23:20,955 - DEBUG - Response Code: 404
2025-08-04 03:23:20,955 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:20,967 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:21,027 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:21,130 - INFO - Validated that VN ctest-left_vn-34904713 is not found in API Server
2025-08-04 03:23:21,149 - DEBUG - VN ctest-left_vn-34904713 is not present in Agent 10.0.0.41
2025-08-04 03:23:21,162 - DEBUG - VN ctest-left_vn-34904713 is not present in Agent 10.0.0.57
2025-08-04 03:23:21,163 - INFO - Validated that VN ctest-left_vn-34904713 is not in any agent
2025-08-04 03:23:21,205 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-34904713 info
2025-08-04 03:23:21,205 - INFO - Deleting VN ctest-mgmt_vn-81013763
2025-08-04 03:23:21,387 - DEBUG - Response for deleting network ()
2025-08-04 03:23:21,387 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/22ca24f2-723c-493a-a8c3-890630d2d0c1
2025-08-04 03:23:21,398 - DEBUG - Response Code: 404
2025-08-04 03:23:21,399 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:21,406 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:21,426 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:21,526 - INFO - Validated that VN ctest-mgmt_vn-81013763 is not found in API Server
2025-08-04 03:23:21,541 - DEBUG - VN ctest-mgmt_vn-81013763 is not present in Agent 10.0.0.41
2025-08-04 03:23:21,556 - DEBUG - VN ctest-mgmt_vn-81013763 is not present in Agent 10.0.0.57
2025-08-04 03:23:21,557 - INFO - Validated that VN ctest-mgmt_vn-81013763 is not in any agent
2025-08-04 03:23:21,606 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-81013763 info
2025-08-04 03:23:22,899 - DEBUG - No XMPP flaps were noticed during the test
2025-08-04 03:23:22,899 - INFO -
2025-08-04 03:23:22,899 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15]
2025-08-04 03:23:22,899 - INFO - --------------------------------------------------------------------------------
2025-08-04 03:23:22,903 - INFO - ================================================================================
2025-08-04 03:23:22,903 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm
2025-08-04 03:23:24,176 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.57': {'10.20.0.193': '0', '10.20.0.18': '0'}} with
2025-08-04 03:23:24,176 - INFO - Initial checks done. Running the testcase now
2025-08-04 03:23:24,176 - INFO -
2025-08-04 03:23:24,478 - DEBUG - Response for create_network : {'network': {'id': '007a185e-df96-4f22-a81a-69e1154c9a49', 'name': 'ctest-mgmt_vn-29505045', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'project_id': '8bbabb2310594c4094f72e6eae01cb6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34830667', 'ctest-mgmt_vn-29505045'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:23:24,746 - DEBUG - Response for create_subnet : {'subnet': {'id': '78c1ac71-6f4f-4596-80b2-c1d7aad1fff3', 'name': '', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'network_id': '007a185e-df96-4f22-a81a-69e1154c9a49', 'ip_version': 4, 'cidr': '20.180.168.128/26', 'allocation_pools': [{'start': '20.180.168.130', 'end': '20.180.168.190'}], 'gateway_ip': '20.180.168.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '20.180.168.130', 'tags': [], 'project_id': '8bbabb2310594c4094f72e6eae01cb6f'}}
2025-08-04 03:23:24,769 - INFO - Created VN ctest-mgmt_vn-29505045
2025-08-04 03:23:24,783 - DEBUG - VN ctest-mgmt_vn-29505045 UUID is 007a185e-df96-4f22-a81a-69e1154c9a49
2025-08-04 03:23:24,868 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:24,876 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:24,889 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:24,985 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/007a185e-df96-4f22-a81a-69e1154c9a49
2025-08-04 03:23:24,998 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/007a185e-df96-4f22-a81a-69e1154c9a49
2025-08-04 03:23:25,010 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/012f0c80-fe05-43b6-9592-02523073afa0
2025-08-04 03:23:25,022 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/012f0c80-fe05-43b6-9592-02523073afa0
2025-08-04 03:23:25,031 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/54589ee8-0d54-4155-b473-1dd800b8fbb1
2025-08-04 03:23:25,040 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:23:25,040 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/007a185e-df96-4f22-a81a-69e1154c9a49
2025-08-04 03:23:25,051 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/012f0c80-fe05-43b6-9592-02523073afa0
2025-08-04 03:23:25,070 - INFO - Verified VN network id 13 for VN 007a185e-df96-4f22-a81a-69e1154c9a49
2025-08-04 03:23:25,071 - INFO - Verifications in API Server for VN ctest-mgmt_vn-29505045 passed
2025-08-04 03:23:25,071 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/007a185e-df96-4f22-a81a-69e1154c9a49
2025-08-04 03:23:25,087 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/012f0c80-fe05-43b6-9592-02523073afa0
2025-08-04 03:23:25,096 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/012f0c80-fe05-43b6-9592-02523073afa0
2025-08-04 03:23:25,107 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/54589ee8-0d54-4155-b473-1dd800b8fbb1
2025-08-04 03:23:25,124 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '34366742915862306', 'uuid-lslong': '12113110563212270153'}, 'enable': 'true', 'created': '2025-08-04T03:23:24', 'last-modified': '2025-08-04T03:23:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.436411'}
2025-08-04 03:23:25,132 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:23:25,139 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '34366742915862306', 'uuid-lslong': '12113110563212270153'}, 'enable': 'true', 'created': '2025-08-04T03:23:24', 'last-modified': '2025-08-04T03:23:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.454271'}
2025-08-04 03:23:25,147 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:23:25,156 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '34366742915862306', 'uuid-lslong': '12113110563212270153'}, 'enable': 'true', 'created': '2025-08-04T03:23:24', 'last-modified': '2025-08-04T03:23:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.466011'}
2025-08-04 03:23:25,168 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:23:25,168 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-29505045 passed
2025-08-04 03:23:25,168 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-29505045 in API_Server ======
2025-08-04 03:23:25,168 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:25,176 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:25,192 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:25,282 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/007a185e-df96-4f22-a81a-69e1154c9a49
2025-08-04 03:23:25,298 - DEBUG - =>VN ctest-mgmt_vn-29505045 has no policy to be verified
2025-08-04 03:23:25,298 - DEBUG - Verifying the vn in opserver
2025-08-04 03:23:25,298 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045 virtual network link through opserver 10.0.0.27
2025-08-04 03:23:25,298 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:23:25,314 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045?flat'}
2025-08-04 03:23:25,314 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045 virtual network link through opserver 10.0.0.38
2025-08-04 03:23:25,314 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:23:25,328 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045?flat'}
2025-08-04 03:23:25,328 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045 virtual network link through opserver 10.0.0.61
2025-08-04 03:23:25,328 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:23:25,348 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045?flat'}
2025-08-04 03:23:25,348 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34830667:ctest-mgmt_vn-29505045 is found in opserver
2025-08-04 03:23:25,379 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:23:25,392 - DEBUG - VRF ids for VN ctest-mgmt_vn-29505045: {}
2025-08-04 03:23:25,694 - DEBUG - Response for create_network : {'network': {'id': '7bd549e0-b57d-41e2-a8ff-c9d0415aa211', 'name': 'ctest-left_vn-05506082', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'project_id': '8bbabb2310594c4094f72e6eae01cb6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34830667', 'ctest-left_vn-05506082'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:23:26,022 - DEBUG - Response for create_subnet : {'subnet': {'id': 'db8426f3-38a2-4c3d-b2be-22408eb8650b', 'name': '', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'network_id': '7bd549e0-b57d-41e2-a8ff-c9d0415aa211', 'ip_version': 4, 'cidr': '126.243.101.0/26', 'allocation_pools': [{'start': '126.243.101.2', 'end': '126.243.101.62'}], 'gateway_ip': '126.243.101.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '126.243.101.2', 'tags': [], 'project_id': '8bbabb2310594c4094f72e6eae01cb6f'}}
2025-08-04 03:23:26,045 - INFO - Created VN ctest-left_vn-05506082
2025-08-04 03:23:26,063 - DEBUG - VN ctest-left_vn-05506082 UUID is 7bd549e0-b57d-41e2-a8ff-c9d0415aa211
2025-08-04 03:23:26,157 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:26,166 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:26,190 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:26,294 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7bd549e0-b57d-41e2-a8ff-c9d0415aa211
2025-08-04 03:23:26,307 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7bd549e0-b57d-41e2-a8ff-c9d0415aa211
2025-08-04 03:23:26,318 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94c6c55e-82a4-4296-b472-267e880edb60
2025-08-04 03:23:26,326 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94c6c55e-82a4-4296-b472-267e880edb60
2025-08-04 03:23:26,334 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/d13f6902-7096-45ff-a3ea-0c645150d79b
2025-08-04 03:23:26,342 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:23:26,342 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7bd549e0-b57d-41e2-a8ff-c9d0415aa211
2025-08-04 03:23:26,354 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94c6c55e-82a4-4296-b472-267e880edb60
2025-08-04 03:23:26,374 - INFO - Verified VN network id 14 for VN 7bd549e0-b57d-41e2-a8ff-c9d0415aa211
2025-08-04 03:23:26,375 - INFO - Verifications in API Server for VN ctest-left_vn-05506082 passed
2025-08-04 03:23:26,375 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7bd549e0-b57d-41e2-a8ff-c9d0415aa211
2025-08-04 03:23:26,387 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94c6c55e-82a4-4296-b472-267e880edb60
2025-08-04 03:23:26,396 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94c6c55e-82a4-4296-b472-267e880edb60
2025-08-04 03:23:26,405 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/d13f6902-7096-45ff-a3ea-0c645150d79b
2025-08-04 03:23:26,418 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8923119466170892770', 'uuid-lslong': '12177673813719949841'}, 'enable': 'true', 'created': '2025-08-04T03:23:25', 'last-modified': '2025-08-04T03:23:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.453146'}
2025-08-04 03:23:26,426 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:23:26,433 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8923119466170892770', 'uuid-lslong': '12177673813719949841'}, 'enable': 'true', 'created': '2025-08-04T03:23:25', 'last-modified': '2025-08-04T03:23:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.464206'}
2025-08-04 03:23:26,441 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:23:26,451 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8923119466170892770', 'uuid-lslong': '12177673813719949841'}, 'enable': 'true', 'created': '2025-08-04T03:23:25', 'last-modified': '2025-08-04T03:23:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.490973'}
2025-08-04 03:23:26,462 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-04 03:23:26,462 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-05506082 passed
2025-08-04 03:23:26,463 - DEBUG - ====Verifying policy data for ctest-left_vn-05506082 in API_Server ======
2025-08-04 03:23:26,463 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:26,473 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:26,493 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:26,641 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7bd549e0-b57d-41e2-a8ff-c9d0415aa211
2025-08-04 03:23:26,655 - DEBUG - =>VN ctest-left_vn-05506082 has no policy to be verified
2025-08-04 03:23:26,655 - DEBUG - Verifying the vn in opserver
2025-08-04 03:23:26,655 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082 virtual network link through opserver 10.0.0.27
2025-08-04 03:23:26,655 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:23:26,675 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082?flat'}
2025-08-04 03:23:26,675 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082 virtual network link through opserver 10.0.0.38
2025-08-04 03:23:26,675 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:23:26,690 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082?flat'}
2025-08-04 03:23:26,690 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082 virtual network link through opserver 10.0.0.61
2025-08-04 03:23:26,690 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:23:26,708 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082?flat'}
2025-08-04 03:23:26,708 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34830667:ctest-left_vn-05506082 is found in opserver
2025-08-04 03:23:26,737 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:23:26,750 - DEBUG - VRF ids for VN ctest-left_vn-05506082: {}
2025-08-04 03:23:27,039 - DEBUG - Response for create_network : {'network': {'id': 'bccc1b12-3988-4817-a036-03d57ee50f91', 'name': 'ctest-right_vn-73766050', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'project_id': '8bbabb2310594c4094f72e6eae01cb6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34830667', 'ctest-right_vn-73766050'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:23:27,261 - DEBUG - Response for create_subnet : {'subnet': {'id': '1787acf2-b5da-4818-8b51-39db198633a3', 'name': '', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'network_id': 'bccc1b12-3988-4817-a036-03d57ee50f91', 'ip_version': 4, 'cidr': '92.35.50.0/26', 'allocation_pools': [{'start': '92.35.50.2', 'end': '92.35.50.62'}], 'gateway_ip': '92.35.50.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '92.35.50.2', 'tags': [], 'project_id': '8bbabb2310594c4094f72e6eae01cb6f'}}
2025-08-04 03:23:27,287 - INFO - Created VN ctest-right_vn-73766050
2025-08-04 03:23:27,307 - DEBUG - VN ctest-right_vn-73766050 UUID is bccc1b12-3988-4817-a036-03d57ee50f91
2025-08-04 03:23:27,416 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:27,423 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:27,437 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:27,539 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/bccc1b12-3988-4817-a036-03d57ee50f91
2025-08-04 03:23:27,556 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/bccc1b12-3988-4817-a036-03d57ee50f91
2025-08-04 03:23:27,567 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/ace22918-8182-4e09-ba55-476cd70a0aaf
2025-08-04 03:23:27,576 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/ace22918-8182-4e09-ba55-476cd70a0aaf
2025-08-04 03:23:27,586 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/23b7793d-57f1-4aa2-8339-8b60c9d53b82
2025-08-04 03:23:27,600 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:23:27,600 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/bccc1b12-3988-4817-a036-03d57ee50f91
2025-08-04 03:23:27,621 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/ace22918-8182-4e09-ba55-476cd70a0aaf
2025-08-04 03:23:27,647 - INFO - Verified VN network id 15 for VN bccc1b12-3988-4817-a036-03d57ee50f91
2025-08-04 03:23:27,647 - INFO - Verifications in API Server for VN ctest-right_vn-73766050 passed
2025-08-04 03:23:27,647 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/bccc1b12-3988-4817-a036-03d57ee50f91
2025-08-04 03:23:27,663 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/ace22918-8182-4e09-ba55-476cd70a0aaf
2025-08-04 03:23:27,674 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/ace22918-8182-4e09-ba55-476cd70a0aaf
2025-08-04 03:23:27,684 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/23b7793d-57f1-4aa2-8339-8b60c9d53b82
2025-08-04 03:23:27,698 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13604278339468019735', 'uuid-lslong': '11544418910302703505'}, 'enable': 'true', 'created': '2025-08-04T03:23:26', 'last-modified': '2025-08-04T03:23:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.481009'}
2025-08-04 03:23:27,708 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:23:27,715 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13604278339468019735', 'uuid-lslong': '11544418910302703505'}, 'enable': 'true', 'created': '2025-08-04T03:23:26', 'last-modified': '2025-08-04T03:23:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.497737'}
2025-08-04 03:23:27,722 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:23:27,730 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13604278339468019735', 'uuid-lslong': '11544418910302703505'}, 'enable': 'true', 'created': '2025-08-04T03:23:26', 'last-modified': '2025-08-04T03:23:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.511500'}
2025-08-04 03:23:27,737 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-04 03:23:27,737 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-73766050 passed
2025-08-04 03:23:27,738 - DEBUG - ====Verifying policy data for ctest-right_vn-73766050 in API_Server ======
2025-08-04 03:23:27,738 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:27,746 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:27,764 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:27,872 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/bccc1b12-3988-4817-a036-03d57ee50f91
2025-08-04 03:23:27,886 - DEBUG - =>VN ctest-right_vn-73766050 has no policy to be verified
2025-08-04 03:23:27,886 - DEBUG - Verifying the vn in opserver
2025-08-04 03:23:27,886 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050 virtual network link through opserver 10.0.0.27
2025-08-04 03:23:27,886 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:23:27,907 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050?flat'}
2025-08-04 03:23:27,907 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050 virtual network link through opserver 10.0.0.38
2025-08-04 03:23:27,907 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:23:27,932 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050?flat'}
2025-08-04 03:23:27,932 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050 virtual network link through opserver 10.0.0.61
2025-08-04 03:23:27,932 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:23:27,949 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050?flat'}
2025-08-04 03:23:27,949 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34830667:ctest-right_vn-73766050 is found in opserver
2025-08-04 03:23:27,981 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:23:27,997 - DEBUG - VRF ids for VN ctest-right_vn-73766050: {}
2025-08-04 03:23:28,318 - DEBUG - Response for create_network : {'network': {'id': '23938309-22d6-498a-b230-4c6ccf7e334d', 'name': 'ctest-trans_left_vn-83639413', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'project_id': '8bbabb2310594c4094f72e6eae01cb6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34830667', 'ctest-trans_left_vn-83639413'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:23:28,590 - DEBUG - Response for create_subnet : {'subnet': {'id': '29b0f4a5-618c-4ee9-bd71-e7551c65594b', 'name': '', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'network_id': '23938309-22d6-498a-b230-4c6ccf7e334d', 'ip_version': 4, 'cidr': '20.125.110.64/26', 'allocation_pools': [{'start': '20.125.110.66', 'end': '20.125.110.126'}], 'gateway_ip': '20.125.110.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '20.125.110.66', 'tags': [], 'project_id': '8bbabb2310594c4094f72e6eae01cb6f'}}
2025-08-04 03:23:28,615 - INFO - Created VN ctest-trans_left_vn-83639413
2025-08-04 03:23:28,631 - DEBUG - VN ctest-trans_left_vn-83639413 UUID is 23938309-22d6-498a-b230-4c6ccf7e334d
2025-08-04 03:23:28,716 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:28,724 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:28,738 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:28,880 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/23938309-22d6-498a-b230-4c6ccf7e334d
2025-08-04 03:23:28,895 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/23938309-22d6-498a-b230-4c6ccf7e334d
2025-08-04 03:23:28,912 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/112b7fac-1d20-4300-a758-cd65f746711c
2025-08-04 03:23:28,927 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/112b7fac-1d20-4300-a758-cd65f746711c
2025-08-04 03:23:28,940 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/6aef3ead-aedc-40ec-9022-d115d8cd37f5
2025-08-04 03:23:28,953 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-04 03:23:28,953 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/23938309-22d6-498a-b230-4c6ccf7e334d
2025-08-04 03:23:28,970 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/112b7fac-1d20-4300-a758-cd65f746711c
2025-08-04 03:23:28,989 - INFO - Verified VN network id 16 for VN 23938309-22d6-498a-b230-4c6ccf7e334d
2025-08-04 03:23:28,989 - INFO - Verifications in API Server for VN ctest-trans_left_vn-83639413 passed
2025-08-04 03:23:28,989 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/23938309-22d6-498a-b230-4c6ccf7e334d
2025-08-04 03:23:29,001 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/112b7fac-1d20-4300-a758-cd65f746711c
2025-08-04 03:23:29,011 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/112b7fac-1d20-4300-a758-cd65f746711c
2025-08-04 03:23:29,021 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/6aef3ead-aedc-40ec-9022-d115d8cd37f5
2025-08-04 03:23:29,042 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2563536688166357386', 'uuid-lslong': '12839846567854617421'}, 'enable': 'true', 'created': '2025-08-04T03:23:28', 'last-modified': '2025-08-04T03:23:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.526436'}
2025-08-04 03:23:29,056 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-04 03:23:29,067 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2563536688166357386', 'uuid-lslong': '12839846567854617421'}, 'enable': 'true', 'created': '2025-08-04T03:23:28', 'last-modified': '2025-08-04T03:23:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.549505'}
2025-08-04 03:23:29,077 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-04 03:23:29,085 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2563536688166357386', 'uuid-lslong': '12839846567854617421'}, 'enable': 'true', 'created': '2025-08-04T03:23:28', 'last-modified': '2025-08-04T03:23:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.554990'}
2025-08-04 03:23:29,093 - DEBUG - Route Targets: ['target:64512:8000008']
2025-08-04 03:23:29,093 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-83639413 passed
2025-08-04 03:23:29,093 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-83639413 in API_Server ======
2025-08-04 03:23:29,094 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:29,106 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:29,120 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:29,248 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/23938309-22d6-498a-b230-4c6ccf7e334d
2025-08-04 03:23:29,263 - DEBUG - =>VN ctest-trans_left_vn-83639413 has no policy to be verified
2025-08-04 03:23:29,263 - DEBUG - Verifying the vn in opserver
2025-08-04 03:23:29,263 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413 virtual network link through opserver 10.0.0.27
2025-08-04 03:23:29,263 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:23:29,281 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413?flat'}
2025-08-04 03:23:29,281 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413 virtual network link through opserver 10.0.0.38
2025-08-04 03:23:29,281 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:23:29,297 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413?flat'}
2025-08-04 03:23:29,298 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413 virtual network link through opserver 10.0.0.61
2025-08-04 03:23:29,298 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:23:29,314 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413?flat'}
2025-08-04 03:23:29,314 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34830667:ctest-trans_left_vn-83639413 is found in opserver
2025-08-04 03:23:29,350 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:23:29,372 - DEBUG - VRF ids for VN ctest-trans_left_vn-83639413: {}
2025-08-04 03:23:29,788 - DEBUG - Response for create_network : {'network': {'id': '6a3c7ea2-14fb-4cbb-bf15-7ed63c2588ec', 'name': 'ctest-trans_right_vn-58415186', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'project_id': '8bbabb2310594c4094f72e6eae01cb6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34830667', 'ctest-trans_right_vn-58415186'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:23:30,097 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e5465578-8bd8-48cf-a913-8f88f25231eb', 'name': '', 'tenant_id': '8bbabb2310594c4094f72e6eae01cb6f', 'network_id': '6a3c7ea2-14fb-4cbb-bf15-7ed63c2588ec', 'ip_version': 4, 'cidr': '96.85.215.192/26', 'allocation_pools': [{'start': '96.85.215.194', 'end': '96.85.215.254'}], 'gateway_ip': '96.85.215.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '96.85.215.194', 'tags': [], 'project_id': '8bbabb2310594c4094f72e6eae01cb6f'}}
2025-08-04 03:23:30,139 - INFO - Created VN ctest-trans_right_vn-58415186
2025-08-04 03:23:30,165 - DEBUG - VN ctest-trans_right_vn-58415186 UUID is 6a3c7ea2-14fb-4cbb-bf15-7ed63c2588ec
2025-08-04 03:23:30,256 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:30,264 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:30,292 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:30,397 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6a3c7ea2-14fb-4cbb-bf15-7ed63c2588ec
2025-08-04 03:23:30,419 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6a3c7ea2-14fb-4cbb-bf15-7ed63c2588ec
2025-08-04 03:23:30,434 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/09041849-b64d-4e8e-9584-0caa16d6db96
2025-08-04 03:23:30,445 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/09041849-b64d-4e8e-9584-0caa16d6db96
2025-08-04 03:23:30,455 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/c2831869-be4d-48a8-af7c-14557173aac7
2025-08-04 03:23:30,467 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-04 03:23:30,467 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6a3c7ea2-14fb-4cbb-bf15-7ed63c2588ec
2025-08-04 03:23:30,485 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/09041849-b64d-4e8e-9584-0caa16d6db96
2025-08-04 03:23:30,505 - INFO - Verified VN network id 17 for VN 6a3c7ea2-14fb-4cbb-bf15-7ed63c2588ec
2025-08-04 03:23:30,505 - INFO - Verifications in API Server for VN ctest-trans_right_vn-58415186 passed
2025-08-04 03:23:30,505 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6a3c7ea2-14fb-4cbb-bf15-7ed63c2588ec
2025-08-04 03:23:30,528 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/09041849-b64d-4e8e-9584-0caa16d6db96
2025-08-04 03:23:30,548 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/09041849-b64d-4e8e-9584-0caa16d6db96
2025-08-04 03:23:30,567 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/c2831869-be4d-48a8-af7c-14557173aac7
2025-08-04 03:23:30,603 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7655132701224815803', 'uuid-lslong': '13769050894352353516'}, 'enable': 'true', 'created': '2025-08-04T03:23:29', 'last-modified': '2025-08-04T03:23:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.579742'}
2025-08-04 03:23:30,616 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-04 03:23:30,624 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7655132701224815803', 'uuid-lslong': '13769050894352353516'}, 'enable': 'true', 'created': '2025-08-04T03:23:29', 'last-modified': '2025-08-04T03:23:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.602571'}
2025-08-04 03:23:30,634 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-04 03:23:30,641 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34830667', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7655132701224815803', 'uuid-lslong': '13769050894352353516'}, 'enable': 'true', 'created': '2025-08-04T03:23:29', 'last-modified': '2025-08-04T03:23:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.615368'}
2025-08-04 03:23:30,648 - DEBUG - Route Targets: ['target:64512:8000009']
2025-08-04 03:23:30,649 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-58415186 passed
2025-08-04 03:23:30,649 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-58415186 in API_Server ======
2025-08-04 03:23:30,649 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:30,656 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:30,672 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:30,777 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6a3c7ea2-14fb-4cbb-bf15-7ed63c2588ec
2025-08-04 03:23:30,791 - DEBUG - =>VN ctest-trans_right_vn-58415186 has no policy to be verified
2025-08-04 03:23:30,791 - DEBUG - Verifying the vn in opserver
2025-08-04 03:23:30,791 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186 virtual network link through opserver 10.0.0.27
2025-08-04 03:23:30,791 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:23:30,807 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186?flat'}
2025-08-04 03:23:30,807 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186 virtual network link through opserver 10.0.0.38
2025-08-04 03:23:30,807 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:23:30,828 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186?flat'}
2025-08-04 03:23:30,828 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186 virtual network link through opserver 10.0.0.61
2025-08-04 03:23:30,828 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:23:30,857 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186?flat'}
2025-08-04 03:23:30,857 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34830667:ctest-trans_right_vn-58415186 is found in opserver
2025-08-04 03:23:30,883 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:23:30,895 - DEBUG - VRF ids for VN ctest-trans_right_vn-58415186: {}
2025-08-04 03:23:32,023 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-1)
2025-08-04 03:23:33,498 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2)
2025-08-04 03:23:33,498 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-77304606']
2025-08-04 03:23:33,823 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-77304606'] created succesfully
2025-08-04 03:23:34,167 - DEBUG - Image by name tiny_trans_fw not found
2025-08-04 03:23:34,168 - DEBUG - Installing image tiny_trans_fw
2025-08-04 03:23:34,168 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-08-04 03:23:34,168 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-08-04 03:23:34,168 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-08-04 03:23:34,168 - DEBUG - Unzip image
2025-08-04 03:23:34,168 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-08-04 03:23:34,202 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found
2025-08-04 03:23:34,209 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-77304606']
2025-08-04 03:23:34,360 - INFO - Service template: ['default-domain', 'ctest-service_template_1-77304606'] deleted successfully.
2025-08-04 03:23:34,361 - INFO - Skip interface_detach for VM ctest-right_vm-18156696 in state BUILD
2025-08-04 03:23:34,361 - INFO - Deleting VM ctest-right_vm-18156696
2025-08-04 03:23:34,361 - ERROR - VM ctest-right_vm-18156696 has failed to come up
2025-08-04 03:23:34,361 - ERROR - Nova failed to get host of the VM
2025-08-04 03:23:34,361 - ERROR - VM ctest-right_vm-18156696 has failed to come up
2025-08-04 03:23:34,361 - ERROR - Nova failed to get host of the VM
2025-08-04 03:23:34,594 - INFO - Skip interface_detach for VM ctest-left_vm-96780247 in state BUILD
2025-08-04 03:23:34,594 - INFO - Deleting VM ctest-left_vm-96780247
2025-08-04 03:23:34,595 - ERROR - VM ctest-left_vm-96780247 has failed to come up
2025-08-04 03:23:34,595 - ERROR - Nova failed to get host of the VM
2025-08-04 03:23:34,595 - ERROR - VM ctest-left_vm-96780247 has failed to come up
2025-08-04 03:23:34,595 - ERROR - Nova failed to get host of the VM
2025-08-04 03:23:34,745 - INFO - Deleting VN ctest-trans_right_vn-58415186
2025-08-04 03:23:34,975 - DEBUG - Response for deleting network ()
2025-08-04 03:23:34,975 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/09041849-b64d-4e8e-9584-0caa16d6db96
2025-08-04 03:23:34,986 - DEBUG - Response Code: 404
2025-08-04 03:23:34,986 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:35,002 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:35,055 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:35,179 - INFO - Validated that VN ctest-trans_right_vn-58415186 is not found in API Server
2025-08-04 03:23:35,210 - DEBUG - VN ctest-trans_right_vn-58415186 is not present in Agent 10.0.0.41
2025-08-04 03:23:35,233 - DEBUG - VN ctest-trans_right_vn-58415186 is not present in Agent 10.0.0.57
2025-08-04 03:23:35,233 - INFO - Validated that VN ctest-trans_right_vn-58415186 is not in any agent
2025-08-04 03:23:35,294 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-58415186 info
2025-08-04 03:23:35,294 - INFO - Deleting VN ctest-trans_left_vn-83639413
2025-08-04 03:23:35,506 - DEBUG - Response for deleting network ()
2025-08-04 03:23:35,506 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/112b7fac-1d20-4300-a758-cd65f746711c
2025-08-04 03:23:35,528 - DEBUG - Response Code: 404
2025-08-04 03:23:35,529 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:35,546 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:35,582 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:35,786 - INFO - Validated that VN ctest-trans_left_vn-83639413 is not found in API Server
2025-08-04 03:23:35,822 - DEBUG - VN ctest-trans_left_vn-83639413 is not present in Agent 10.0.0.41
2025-08-04 03:23:35,874 - DEBUG - VN ctest-trans_left_vn-83639413 is not present in Agent 10.0.0.57
2025-08-04 03:23:35,874 - INFO - Validated that VN ctest-trans_left_vn-83639413 is not in any agent
2025-08-04 03:23:35,963 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-83639413 info
2025-08-04 03:23:35,963 - INFO - Deleting VN ctest-right_vn-73766050
2025-08-04 03:23:36,030 - DEBUG - VN bccc1b12-3988-4817-a036-03d57ee50f91 still in use: Unable to complete operation on network bccc1b12-3988-4817-a036-03d57ee50f91. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-dd4a632e-e4e2-4289-b24e-89497f74d9e9']
2025-08-04 03:23:36,031 - WARNING - Deleting VN ctest-right_vn-73766050 failed..Will retry
2025-08-04 03:23:38,247 - DEBUG - Response for deleting network ()
2025-08-04 03:23:38,247 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/ace22918-8182-4e09-ba55-476cd70a0aaf
2025-08-04 03:23:38,262 - DEBUG - Response Code: 404
2025-08-04 03:23:38,262 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:38,275 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:38,292 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:38,407 - INFO - Validated that VN ctest-right_vn-73766050 is not found in API Server
2025-08-04 03:23:38,427 - DEBUG - VN ctest-right_vn-73766050 is not present in Agent 10.0.0.41
2025-08-04 03:23:38,440 - DEBUG - VN ctest-right_vn-73766050 is not present in Agent 10.0.0.57
2025-08-04 03:23:38,440 - INFO - Validated that VN ctest-right_vn-73766050 is not in any agent
2025-08-04 03:23:38,490 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-73766050 info
2025-08-04 03:23:38,490 - INFO - Deleting VN ctest-left_vn-05506082
2025-08-04 03:23:38,678 - DEBUG - Response for deleting network ()
2025-08-04 03:23:38,679 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94c6c55e-82a4-4296-b472-267e880edb60
2025-08-04 03:23:38,688 - DEBUG - Response Code: 404
2025-08-04 03:23:38,689 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:38,707 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:38,737 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:38,838 - INFO - Validated that VN ctest-left_vn-05506082 is not found in API Server
2025-08-04 03:23:38,856 - DEBUG - VN ctest-left_vn-05506082 is not present in Agent 10.0.0.41
2025-08-04 03:23:38,867 - DEBUG - VN ctest-left_vn-05506082 is not present in Agent 10.0.0.57
2025-08-04 03:23:38,867 - INFO - Validated that VN ctest-left_vn-05506082 is not in any agent
2025-08-04 03:23:38,914 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-05506082 info
2025-08-04 03:23:38,914 - INFO - Deleting VN ctest-mgmt_vn-29505045
2025-08-04 03:23:39,079 - DEBUG - Response for deleting network ()
2025-08-04 03:23:39,080 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/012f0c80-fe05-43b6-9592-02523073afa0
2025-08-04 03:23:39,087 - DEBUG - Response Code: 404
2025-08-04 03:23:39,087 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:23:39,093 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:23:39,118 - DEBUG - Requesting: http://10.0.0.27:8082/project/8bbabb23-1059-4c40-94f7-2e6eae01cb6f
2025-08-04 03:23:39,220 - INFO - Validated that VN ctest-mgmt_vn-29505045 is not found in API Server
2025-08-04 03:23:39,233 - DEBUG - VN ctest-mgmt_vn-29505045 is not present in Agent 10.0.0.41
2025-08-04 03:23:39,246 - DEBUG - VN ctest-mgmt_vn-29505045 is not present in Agent 10.0.0.57
2025-08-04 03:23:39,246 - INFO - Validated that VN ctest-mgmt_vn-29505045 is not in any agent
2025-08-04 03:23:39,295 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-29505045 info
2025-08-04 03:23:40,569 - DEBUG - No XMPP flaps were noticed during the test
2025-08-04 03:23:40,569 - INFO -
2025-08-04 03:23:40,569 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:18]
2025-08-04 03:23:40,570 - INFO - --------------------------------------------------------------------------------
2025-08-04 03:23:41,324 - INFO - Deleted project: ctest-TestSvcHC-34830667, ID : 8bbabb23-1059-4c40-94f7-2e6eae01cb6f