2026-03-05 03:04:47,002 - INFO - Domain Default found not creating 2026-03-05 03:04:47,191 - INFO - Project ctest-TestSvcHC-24580491 not found, creating it 2026-03-05 03:04:47,740 - INFO - Created Project:ctest-TestSvcHC-24580491, ID : ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:04:49,247 - INFO - ================================================================================ 2026-03-05 03:04:49,248 - INFO - STARTING TEST : test_svc_hc_basic 2026-03-05 03:04:50,515 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.254': '0', '10.20.0.14': '0'}, '10.0.0.73': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2026-03-05 03:04:50,515 - INFO - Initial checks done. Running the testcase now 2026-03-05 03:04:50,515 - INFO - 2026-03-05 03:04:51,198 - DEBUG - Response for create_network : {'network': {'id': '195552aa-d434-4418-8c14-147b1e83a7e6', 'name': 'ctest-mgmt_vn-39867769', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24580491', 'ctest-mgmt_vn-39867769'], 'port_security_enabled': True, 'description': ''}} 2026-03-05 03:04:51,522 - DEBUG - Response for create_subnet : {'subnet': {'id': '6951a042-dc2d-4541-9569-1c537680e282', 'name': '', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'network_id': '195552aa-d434-4418-8c14-147b1e83a7e6', 'ip_version': 4, 'cidr': '14.251.25.192/26', 'allocation_pools': [{'start': '14.251.25.194', 'end': '14.251.25.254'}], 'gateway_ip': '14.251.25.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '14.251.25.194', 'tags': [], 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616'}} 2026-03-05 03:04:51,542 - INFO - Created VN ctest-mgmt_vn-39867769 2026-03-05 03:04:51,553 - DEBUG - VN ctest-mgmt_vn-39867769 UUID is 195552aa-d434-4418-8c14-147b1e83a7e6 2026-03-05 03:04:51,631 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:04:51,930 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:04:51,961 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:04:51,976 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:04:52,068 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/195552aa-d434-4418-8c14-147b1e83a7e6 2026-03-05 03:04:52,081 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/195552aa-d434-4418-8c14-147b1e83a7e6 2026-03-05 03:04:52,093 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/f72cd07c-7921-4cdd-b116-6ee2bcb6f025 2026-03-05 03:04:52,101 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/f72cd07c-7921-4cdd-b116-6ee2bcb6f025 2026-03-05 03:04:52,108 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/45fad6db-282b-4853-a20c-984b085e08eb 2026-03-05 03:04:52,116 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-05 03:04:52,116 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/195552aa-d434-4418-8c14-147b1e83a7e6 2026-03-05 03:04:52,126 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/f72cd07c-7921-4cdd-b116-6ee2bcb6f025 2026-03-05 03:04:52,141 - INFO - Verified VN network id 16 for VN 195552aa-d434-4418-8c14-147b1e83a7e6 2026-03-05 03:04:52,142 - INFO - Verifications in API Server for VN ctest-mgmt_vn-39867769 passed 2026-03-05 03:04:52,142 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/195552aa-d434-4418-8c14-147b1e83a7e6 2026-03-05 03:04:52,152 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/f72cd07c-7921-4cdd-b116-6ee2bcb6f025 2026-03-05 03:04:52,160 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/f72cd07c-7921-4cdd-b116-6ee2bcb6f025 2026-03-05 03:04:52,170 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/45fad6db-282b-4853-a20c-984b085e08eb 2026-03-05 03:04:52,184 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1825456117626717208', 'uuid-lslong': '10093715183869601766'}, 'enable': 'true', 'created': '2026-03-05T03:04:51', 'last-modified': '2026-03-05T03:04:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.725350'} 2026-03-05 03:04:52,190 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-05 03:04:52,196 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1825456117626717208', 'uuid-lslong': '10093715183869601766'}, 'enable': 'true', 'created': '2026-03-05T03:04:51', 'last-modified': '2026-03-05T03:04:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.737722'} 2026-03-05 03:04:52,203 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-05 03:04:52,213 - DEBUG - Control-node 10.0.0.133 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1825456117626717208', 'uuid-lslong': '10093715183869601766'}, 'enable': 'true', 'created': '2026-03-05T03:04:51', 'last-modified': '2026-03-05T03:04:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.745760'} 2026-03-05 03:04:52,222 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-05 03:04:52,222 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-39867769 passed 2026-03-05 03:04:52,223 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-39867769 in API_Server ====== 2026-03-05 03:04:52,223 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:04:52,229 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:04:52,243 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:04:52,335 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/195552aa-d434-4418-8c14-147b1e83a7e6 2026-03-05 03:04:52,345 - DEBUG - =>VN ctest-mgmt_vn-39867769 has no policy to be verified 2026-03-05 03:04:52,345 - DEBUG - Verifying the vn in opserver 2026-03-05 03:04:52,345 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769 virtual network link through opserver 10.0.0.65 2026-03-05 03:04:52,346 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-05 03:04:52,642 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-05 03:04:52,710 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769?flat'} 2026-03-05 03:04:52,710 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769 virtual network link through opserver 10.0.0.33 2026-03-05 03:04:52,710 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-05 03:04:53,007 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-05 03:04:53,082 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769?flat'} 2026-03-05 03:04:53,082 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769 virtual network link through opserver 10.0.0.133 2026-03-05 03:04:53,082 - DEBUG - Requesting: http://10.0.0.133:8081/analytics/uves/virtual-networks 2026-03-05 03:04:53,377 - DEBUG - Requesting: http://10.0.0.133:8081/analytics/uves/virtual-networks 2026-03-05 03:04:53,439 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769', 'href': 'http://10.0.0.133:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769?flat'} 2026-03-05 03:04:53,439 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-39867769 is found in opserver 2026-03-05 03:04:53,465 - DEBUG - Do not have enough data to verify VN in agent 2026-03-05 03:04:53,475 - DEBUG - VRF ids for VN ctest-mgmt_vn-39867769: {} 2026-03-05 03:04:53,709 - DEBUG - Response for create_network : {'network': {'id': '6937a13c-83c1-470c-a3f5-2a78b5098104', 'name': 'ctest-left_vn-02869603', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24580491', 'ctest-left_vn-02869603'], 'port_security_enabled': True, 'description': ''}} 2026-03-05 03:04:53,938 - DEBUG - Response for create_subnet : {'subnet': {'id': '9d94149e-f64f-437a-a85e-18ef307de440', 'name': '', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'network_id': '6937a13c-83c1-470c-a3f5-2a78b5098104', 'ip_version': 4, 'cidr': '6.138.89.64/26', 'allocation_pools': [{'start': '6.138.89.66', 'end': '6.138.89.126'}], 'gateway_ip': '6.138.89.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '6.138.89.66', 'tags': [], 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616'}} 2026-03-05 03:04:53,961 - INFO - Created VN ctest-left_vn-02869603 2026-03-05 03:04:53,975 - DEBUG - VN ctest-left_vn-02869603 UUID is 6937a13c-83c1-470c-a3f5-2a78b5098104 2026-03-05 03:04:54,038 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:04:54,044 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:04:54,055 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:04:54,142 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6937a13c-83c1-470c-a3f5-2a78b5098104 2026-03-05 03:04:54,154 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6937a13c-83c1-470c-a3f5-2a78b5098104 2026-03-05 03:04:54,163 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/713a821d-b02f-4797-aea0-a9755b2b9db3 2026-03-05 03:04:54,171 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/713a821d-b02f-4797-aea0-a9755b2b9db3 2026-03-05 03:04:54,177 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/26984298-acf4-44b0-9ce0-bf4573fee4cb 2026-03-05 03:04:54,184 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-05 03:04:54,184 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6937a13c-83c1-470c-a3f5-2a78b5098104 2026-03-05 03:04:54,195 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/713a821d-b02f-4797-aea0-a9755b2b9db3 2026-03-05 03:04:54,212 - INFO - Verified VN network id 17 for VN 6937a13c-83c1-470c-a3f5-2a78b5098104 2026-03-05 03:04:54,212 - INFO - Verifications in API Server for VN ctest-left_vn-02869603 passed 2026-03-05 03:04:54,212 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6937a13c-83c1-470c-a3f5-2a78b5098104 2026-03-05 03:04:54,222 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/713a821d-b02f-4797-aea0-a9755b2b9db3 2026-03-05 03:04:54,229 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/713a821d-b02f-4797-aea0-a9755b2b9db3 2026-03-05 03:04:54,247 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/26984298-acf4-44b0-9ce0-bf4573fee4cb 2026-03-05 03:04:54,261 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7581705778982110988', 'uuid-lslong': '11814395895398105348'}, 'enable': 'true', 'created': '2026-03-05T03:04:53', 'last-modified': '2026-03-05T03:04:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.372760'} 2026-03-05 03:04:54,267 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-05 03:04:54,272 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7581705778982110988', 'uuid-lslong': '11814395895398105348'}, 'enable': 'true', 'created': '2026-03-05T03:04:53', 'last-modified': '2026-03-05T03:04:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.378970'} 2026-03-05 03:04:54,278 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-05 03:04:54,285 - DEBUG - Control-node 10.0.0.133 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7581705778982110988', 'uuid-lslong': '11814395895398105348'}, 'enable': 'true', 'created': '2026-03-05T03:04:53', 'last-modified': '2026-03-05T03:04:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.397367'} 2026-03-05 03:04:54,299 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-05 03:04:54,300 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-02869603 passed 2026-03-05 03:04:54,300 - DEBUG - ====Verifying policy data for ctest-left_vn-02869603 in API_Server ====== 2026-03-05 03:04:54,300 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:04:54,310 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:04:54,322 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:04:54,415 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6937a13c-83c1-470c-a3f5-2a78b5098104 2026-03-05 03:04:54,426 - DEBUG - =>VN ctest-left_vn-02869603 has no policy to be verified 2026-03-05 03:04:54,426 - DEBUG - Verifying the vn in opserver 2026-03-05 03:04:54,426 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603 virtual network link through opserver 10.0.0.65 2026-03-05 03:04:54,426 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-05 03:04:54,506 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603?flat'} 2026-03-05 03:04:54,506 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603 virtual network link through opserver 10.0.0.33 2026-03-05 03:04:54,506 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-05 03:04:54,585 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603?flat'} 2026-03-05 03:04:54,585 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603 virtual network link through opserver 10.0.0.133 2026-03-05 03:04:54,585 - DEBUG - Requesting: http://10.0.0.133:8081/analytics/uves/virtual-networks 2026-03-05 03:04:54,642 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603', 'href': 'http://10.0.0.133:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603?flat'} 2026-03-05 03:04:54,642 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-02869603 is found in opserver 2026-03-05 03:04:54,663 - DEBUG - Do not have enough data to verify VN in agent 2026-03-05 03:04:54,673 - DEBUG - VRF ids for VN ctest-left_vn-02869603: {} 2026-03-05 03:04:54,921 - DEBUG - Response for create_network : {'network': {'id': 'ca87be7d-f2da-4a49-8246-4b673a71a418', 'name': 'ctest-right_vn-87002047', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24580491', 'ctest-right_vn-87002047'], 'port_security_enabled': True, 'description': ''}} 2026-03-05 03:04:55,145 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd3325807-0de6-4f37-ab19-1116ed547db0', 'name': '', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'network_id': 'ca87be7d-f2da-4a49-8246-4b673a71a418', 'ip_version': 4, 'cidr': '185.143.49.0/26', 'allocation_pools': [{'start': '185.143.49.2', 'end': '185.143.49.62'}], 'gateway_ip': '185.143.49.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '185.143.49.2', 'tags': [], 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616'}} 2026-03-05 03:04:55,164 - INFO - Created VN ctest-right_vn-87002047 2026-03-05 03:04:55,173 - DEBUG - VN ctest-right_vn-87002047 UUID is ca87be7d-f2da-4a49-8246-4b673a71a418 2026-03-05 03:04:55,242 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:04:55,249 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:04:55,287 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:04:55,371 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/ca87be7d-f2da-4a49-8246-4b673a71a418 2026-03-05 03:04:55,383 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/ca87be7d-f2da-4a49-8246-4b673a71a418 2026-03-05 03:04:55,392 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/793f67d5-cd40-407a-905e-9cdd4ad163f6 2026-03-05 03:04:55,402 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/793f67d5-cd40-407a-905e-9cdd4ad163f6 2026-03-05 03:04:55,413 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/9691375f-d31a-4e90-9c1e-4bec206cb07c 2026-03-05 03:04:55,423 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-05 03:04:55,423 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/ca87be7d-f2da-4a49-8246-4b673a71a418 2026-03-05 03:04:55,437 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/793f67d5-cd40-407a-905e-9cdd4ad163f6 2026-03-05 03:04:55,455 - INFO - Verified VN network id 18 for VN ca87be7d-f2da-4a49-8246-4b673a71a418 2026-03-05 03:04:55,456 - INFO - Verifications in API Server for VN ctest-right_vn-87002047 passed 2026-03-05 03:04:55,456 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/ca87be7d-f2da-4a49-8246-4b673a71a418 2026-03-05 03:04:55,466 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/793f67d5-cd40-407a-905e-9cdd4ad163f6 2026-03-05 03:04:55,475 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/793f67d5-cd40-407a-905e-9cdd4ad163f6 2026-03-05 03:04:55,482 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/9691375f-d31a-4e90-9c1e-4bec206cb07c 2026-03-05 03:04:55,493 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14593842565671963209', 'uuid-lslong': '9387273380034618392'}, 'enable': 'true', 'created': '2026-03-05T03:04:54', 'last-modified': '2026-03-05T03:04:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.393175'} 2026-03-05 03:04:55,500 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-05 03:04:55,506 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14593842565671963209', 'uuid-lslong': '9387273380034618392'}, 'enable': 'true', 'created': '2026-03-05T03:04:54', 'last-modified': '2026-03-05T03:04:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404444'} 2026-03-05 03:04:55,512 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-05 03:04:55,518 - DEBUG - Control-node 10.0.0.133 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14593842565671963209', 'uuid-lslong': '9387273380034618392'}, 'enable': 'true', 'created': '2026-03-05T03:04:54', 'last-modified': '2026-03-05T03:04:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414549'} 2026-03-05 03:04:55,524 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-05 03:04:55,524 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-87002047 passed 2026-03-05 03:04:55,524 - DEBUG - ====Verifying policy data for ctest-right_vn-87002047 in API_Server ====== 2026-03-05 03:04:55,524 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:04:55,531 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:04:55,542 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:04:55,648 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/ca87be7d-f2da-4a49-8246-4b673a71a418 2026-03-05 03:04:55,664 - DEBUG - =>VN ctest-right_vn-87002047 has no policy to be verified 2026-03-05 03:04:55,664 - DEBUG - Verifying the vn in opserver 2026-03-05 03:04:55,664 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047 virtual network link through opserver 10.0.0.65 2026-03-05 03:04:55,664 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-05 03:04:55,739 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047?flat'} 2026-03-05 03:04:55,739 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047 virtual network link through opserver 10.0.0.33 2026-03-05 03:04:55,739 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-05 03:04:55,800 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047?flat'} 2026-03-05 03:04:55,800 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047 virtual network link through opserver 10.0.0.133 2026-03-05 03:04:55,800 - DEBUG - Requesting: http://10.0.0.133:8081/analytics/uves/virtual-networks 2026-03-05 03:04:55,861 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047', 'href': 'http://10.0.0.133:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047?flat'} 2026-03-05 03:04:55,861 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-87002047 is found in opserver 2026-03-05 03:04:55,883 - DEBUG - Do not have enough data to verify VN in agent 2026-03-05 03:04:55,893 - DEBUG - VRF ids for VN ctest-right_vn-87002047: {} 2026-03-05 03:04:55,951 - DEBUG - Services list from nova: [, , , ] 2026-03-05 03:04:57,020 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5433-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5433-2) 2026-03-05 03:04:58,376 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5433-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5433-1) 2026-03-05 03:04:58,377 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-47335578'] 2026-03-05 03:04:58,660 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-47335578'] created succesfully 2026-03-05 03:04:59,051 - DEBUG - Image by name tiny_nat_fw not found 2026-03-05 03:04:59,051 - DEBUG - Installing image tiny_nat_fw 2026-03-05 03:04:59,051 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-03-05 03:04:59,052 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-05 03:04:59,052 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-05 03:04:59,052 - DEBUG - Unzip image 2026-03-05 03:04:59,052 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-05 03:04:59,073 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2026-03-05 03:04:59,074 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-47335578'] 2026-03-05 03:04:59,173 - INFO - Service template: ['default-domain', 'ctest-service_template_1-47335578'] deleted successfully. 2026-03-05 03:04:59,174 - INFO - Skip interface_detach for VM ctest-right_vm-17502817 in state BUILD 2026-03-05 03:04:59,174 - INFO - Deleting VM ctest-right_vm-17502817 2026-03-05 03:04:59,283 - ERROR - VM ctest-right_vm-17502817 has failed to come up 2026-03-05 03:04:59,288 - ERROR - Nova failed to get host of the VM 2026-03-05 03:04:59,289 - ERROR - VM ctest-right_vm-17502817 has failed to come up 2026-03-05 03:04:59,289 - ERROR - Nova failed to get host of the VM 2026-03-05 03:04:59,396 - INFO - Skip interface_detach for VM ctest-left_vm-68978413 in state BUILD 2026-03-05 03:04:59,396 - INFO - Deleting VM ctest-left_vm-68978413 2026-03-05 03:04:59,396 - ERROR - VM ctest-left_vm-68978413 has failed to come up 2026-03-05 03:04:59,396 - ERROR - Nova failed to get host of the VM 2026-03-05 03:04:59,396 - ERROR - VM ctest-left_vm-68978413 has failed to come up 2026-03-05 03:04:59,396 - ERROR - Nova failed to get host of the VM 2026-03-05 03:04:59,530 - INFO - Deleting VN ctest-right_vn-87002047 2026-03-05 03:04:59,583 - DEBUG - VN ca87be7d-f2da-4a49-8246-4b673a71a418 still in use: Unable to complete operation on network ca87be7d-f2da-4a49-8246-4b673a71a418. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-e49be2b1-9ae3-4481-b142-475195ea5f6f'] 2026-03-05 03:04:59,583 - WARNING - Deleting VN ctest-right_vn-87002047 failed..Will retry 2026-03-05 03:05:01,715 - DEBUG - Response for deleting network () 2026-03-05 03:05:01,715 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/793f67d5-cd40-407a-905e-9cdd4ad163f6 2026-03-05 03:05:01,721 - DEBUG - Response Code: 404 2026-03-05 03:05:01,721 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:01,728 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:01,750 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:01,860 - INFO - Validated that VN ctest-right_vn-87002047 is not found in API Server 2026-03-05 03:05:01,870 - DEBUG - VN ctest-right_vn-87002047 is not present in Agent 10.0.0.141 2026-03-05 03:05:01,880 - DEBUG - VN ctest-right_vn-87002047 is not present in Agent 10.0.0.73 2026-03-05 03:05:01,881 - INFO - Validated that VN ctest-right_vn-87002047 is not in any agent 2026-03-05 03:05:01,919 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-87002047 info 2026-03-05 03:05:01,919 - INFO - Deleting VN ctest-left_vn-02869603 2026-03-05 03:05:02,051 - DEBUG - Response for deleting network () 2026-03-05 03:05:02,051 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/713a821d-b02f-4797-aea0-a9755b2b9db3 2026-03-05 03:05:02,057 - DEBUG - Response Code: 404 2026-03-05 03:05:02,058 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:02,064 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:02,082 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:02,187 - INFO - Validated that VN ctest-left_vn-02869603 is not found in API Server 2026-03-05 03:05:02,199 - DEBUG - VN ctest-left_vn-02869603 is not present in Agent 10.0.0.141 2026-03-05 03:05:02,218 - DEBUG - VN ctest-left_vn-02869603 is not present in Agent 10.0.0.73 2026-03-05 03:05:02,218 - INFO - Validated that VN ctest-left_vn-02869603 is not in any agent 2026-03-05 03:05:02,252 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-02869603 info 2026-03-05 03:05:02,252 - INFO - Deleting VN ctest-mgmt_vn-39867769 2026-03-05 03:05:02,543 - DEBUG - Response for deleting network () 2026-03-05 03:05:02,543 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/f72cd07c-7921-4cdd-b116-6ee2bcb6f025 2026-03-05 03:05:02,550 - DEBUG - Response Code: 404 2026-03-05 03:05:02,551 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:02,566 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:02,604 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:02,783 - INFO - Validated that VN ctest-mgmt_vn-39867769 is not found in API Server 2026-03-05 03:05:02,794 - DEBUG - VN ctest-mgmt_vn-39867769 is not present in Agent 10.0.0.141 2026-03-05 03:05:02,804 - DEBUG - VN ctest-mgmt_vn-39867769 is not present in Agent 10.0.0.73 2026-03-05 03:05:02,804 - INFO - Validated that VN ctest-mgmt_vn-39867769 is not in any agent 2026-03-05 03:05:02,848 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-39867769 info 2026-03-05 03:05:04,162 - DEBUG - No XMPP flaps were noticed during the test 2026-03-05 03:05:04,162 - INFO - 2026-03-05 03:05:04,162 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15] 2026-03-05 03:05:04,162 - INFO - -------------------------------------------------------------------------------- 2026-03-05 03:05:04,166 - INFO - ================================================================================ 2026-03-05 03:05:04,166 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2026-03-05 03:05:05,440 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.254': '0', '10.20.0.14': '0'}, '10.0.0.73': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2026-03-05 03:05:05,440 - INFO - Initial checks done. Running the testcase now 2026-03-05 03:05:05,440 - INFO - 2026-03-05 03:05:05,703 - DEBUG - Response for create_network : {'network': {'id': 'a093fc21-092f-4cd7-b7e5-c1e25ab3bba3', 'name': 'ctest-mgmt_vn-00837634', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24580491', 'ctest-mgmt_vn-00837634'], 'port_security_enabled': True, 'description': ''}} 2026-03-05 03:05:05,930 - DEBUG - Response for create_subnet : {'subnet': {'id': '89ade559-38f4-433d-aaba-f3db236cbd17', 'name': '', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'network_id': 'a093fc21-092f-4cd7-b7e5-c1e25ab3bba3', 'ip_version': 4, 'cidr': '193.133.45.64/26', 'allocation_pools': [{'start': '193.133.45.66', 'end': '193.133.45.126'}], 'gateway_ip': '193.133.45.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '193.133.45.66', 'tags': [], 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616'}} 2026-03-05 03:05:05,953 - INFO - Created VN ctest-mgmt_vn-00837634 2026-03-05 03:05:05,965 - DEBUG - VN ctest-mgmt_vn-00837634 UUID is a093fc21-092f-4cd7-b7e5-c1e25ab3bba3 2026-03-05 03:05:06,039 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:06,045 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:06,062 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:06,158 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/a093fc21-092f-4cd7-b7e5-c1e25ab3bba3 2026-03-05 03:05:06,171 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/a093fc21-092f-4cd7-b7e5-c1e25ab3bba3 2026-03-05 03:05:06,182 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8c8261a4-7b3f-4806-82cf-9465334950a1 2026-03-05 03:05:06,191 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8c8261a4-7b3f-4806-82cf-9465334950a1 2026-03-05 03:05:06,199 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/a3cef898-9803-4218-b0d5-e8ef64cce439 2026-03-05 03:05:06,205 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-05 03:05:06,205 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/a093fc21-092f-4cd7-b7e5-c1e25ab3bba3 2026-03-05 03:05:06,214 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8c8261a4-7b3f-4806-82cf-9465334950a1 2026-03-05 03:05:06,231 - INFO - Verified VN network id 16 for VN a093fc21-092f-4cd7-b7e5-c1e25ab3bba3 2026-03-05 03:05:06,231 - INFO - Verifications in API Server for VN ctest-mgmt_vn-00837634 passed 2026-03-05 03:05:06,231 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/a093fc21-092f-4cd7-b7e5-c1e25ab3bba3 2026-03-05 03:05:06,244 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8c8261a4-7b3f-4806-82cf-9465334950a1 2026-03-05 03:05:06,253 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8c8261a4-7b3f-4806-82cf-9465334950a1 2026-03-05 03:05:06,260 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/a3cef898-9803-4218-b0d5-e8ef64cce439 2026-03-05 03:05:06,273 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11570869086463151319', 'uuid-lslong': '13251210656536050595'}, 'enable': 'true', 'created': '2026-03-05T03:05:05', 'last-modified': '2026-03-05T03:05:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.396351'} 2026-03-05 03:05:06,279 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-05 03:05:06,284 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11570869086463151319', 'uuid-lslong': '13251210656536050595'}, 'enable': 'true', 'created': '2026-03-05T03:05:05', 'last-modified': '2026-03-05T03:05:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.408256'} 2026-03-05 03:05:06,290 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-05 03:05:06,295 - DEBUG - Control-node 10.0.0.133 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11570869086463151319', 'uuid-lslong': '13251210656536050595'}, 'enable': 'true', 'created': '2026-03-05T03:05:05', 'last-modified': '2026-03-05T03:05:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416824'} 2026-03-05 03:05:06,301 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-05 03:05:06,301 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-00837634 passed 2026-03-05 03:05:06,301 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-00837634 in API_Server ====== 2026-03-05 03:05:06,301 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:06,307 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:06,319 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:06,407 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/a093fc21-092f-4cd7-b7e5-c1e25ab3bba3 2026-03-05 03:05:06,419 - DEBUG - =>VN ctest-mgmt_vn-00837634 has no policy to be verified 2026-03-05 03:05:06,419 - DEBUG - Verifying the vn in opserver 2026-03-05 03:05:06,419 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634 virtual network link through opserver 10.0.0.65 2026-03-05 03:05:06,419 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-05 03:05:06,432 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634?flat'} 2026-03-05 03:05:06,432 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634 virtual network link through opserver 10.0.0.33 2026-03-05 03:05:06,432 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-05 03:05:06,445 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634?flat'} 2026-03-05 03:05:06,445 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634 virtual network link through opserver 10.0.0.133 2026-03-05 03:05:06,445 - DEBUG - Requesting: http://10.0.0.133:8081/analytics/uves/virtual-networks 2026-03-05 03:05:06,457 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634', 'href': 'http://10.0.0.133:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634?flat'} 2026-03-05 03:05:06,457 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24580491:ctest-mgmt_vn-00837634 is found in opserver 2026-03-05 03:05:06,482 - DEBUG - Do not have enough data to verify VN in agent 2026-03-05 03:05:06,497 - DEBUG - VRF ids for VN ctest-mgmt_vn-00837634: {} 2026-03-05 03:05:06,768 - DEBUG - Response for create_network : {'network': {'id': '7dcf84b3-ef81-45c7-8a30-a2316ce1aad1', 'name': 'ctest-left_vn-85178786', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24580491', 'ctest-left_vn-85178786'], 'port_security_enabled': True, 'description': ''}} 2026-03-05 03:05:06,990 - DEBUG - Response for create_subnet : {'subnet': {'id': '1daae347-218d-468f-a128-f471bb1d3274', 'name': '', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'network_id': '7dcf84b3-ef81-45c7-8a30-a2316ce1aad1', 'ip_version': 4, 'cidr': '220.0.194.192/26', 'allocation_pools': [{'start': '220.0.194.194', 'end': '220.0.194.254'}], 'gateway_ip': '220.0.194.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '220.0.194.194', 'tags': [], 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616'}} 2026-03-05 03:05:07,009 - INFO - Created VN ctest-left_vn-85178786 2026-03-05 03:05:07,019 - DEBUG - VN ctest-left_vn-85178786 UUID is 7dcf84b3-ef81-45c7-8a30-a2316ce1aad1 2026-03-05 03:05:07,097 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:07,103 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:07,114 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:07,202 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/7dcf84b3-ef81-45c7-8a30-a2316ce1aad1 2026-03-05 03:05:07,213 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/7dcf84b3-ef81-45c7-8a30-a2316ce1aad1 2026-03-05 03:05:07,221 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/96a1b99a-cca9-4654-930a-2075b02fa331 2026-03-05 03:05:07,228 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/96a1b99a-cca9-4654-930a-2075b02fa331 2026-03-05 03:05:07,235 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/dfc47929-f8e8-471f-88cf-48aedfa413e3 2026-03-05 03:05:07,241 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-05 03:05:07,241 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/7dcf84b3-ef81-45c7-8a30-a2316ce1aad1 2026-03-05 03:05:07,250 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/96a1b99a-cca9-4654-930a-2075b02fa331 2026-03-05 03:05:07,270 - INFO - Verified VN network id 17 for VN 7dcf84b3-ef81-45c7-8a30-a2316ce1aad1 2026-03-05 03:05:07,271 - INFO - Verifications in API Server for VN ctest-left_vn-85178786 passed 2026-03-05 03:05:07,271 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/7dcf84b3-ef81-45c7-8a30-a2316ce1aad1 2026-03-05 03:05:07,280 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/96a1b99a-cca9-4654-930a-2075b02fa331 2026-03-05 03:05:07,287 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/96a1b99a-cca9-4654-930a-2075b02fa331 2026-03-05 03:05:07,295 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/dfc47929-f8e8-471f-88cf-48aedfa413e3 2026-03-05 03:05:07,308 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9065610483272336839', 'uuid-lslong': '9957637109279992529'}, 'enable': 'true', 'created': '2026-03-05T03:05:06', 'last-modified': '2026-03-05T03:05:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.375093'} 2026-03-05 03:05:07,315 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-05 03:05:07,321 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9065610483272336839', 'uuid-lslong': '9957637109279992529'}, 'enable': 'true', 'created': '2026-03-05T03:05:06', 'last-modified': '2026-03-05T03:05:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.391188'} 2026-03-05 03:05:07,326 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-05 03:05:07,333 - DEBUG - Control-node 10.0.0.133 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9065610483272336839', 'uuid-lslong': '9957637109279992529'}, 'enable': 'true', 'created': '2026-03-05T03:05:06', 'last-modified': '2026-03-05T03:05:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405044'} 2026-03-05 03:05:07,339 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-05 03:05:07,339 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-85178786 passed 2026-03-05 03:05:07,340 - DEBUG - ====Verifying policy data for ctest-left_vn-85178786 in API_Server ====== 2026-03-05 03:05:07,340 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:07,346 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:07,357 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:07,460 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/7dcf84b3-ef81-45c7-8a30-a2316ce1aad1 2026-03-05 03:05:07,470 - DEBUG - =>VN ctest-left_vn-85178786 has no policy to be verified 2026-03-05 03:05:07,470 - DEBUG - Verifying the vn in opserver 2026-03-05 03:05:07,470 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786 virtual network link through opserver 10.0.0.65 2026-03-05 03:05:07,470 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-05 03:05:07,482 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786?flat'} 2026-03-05 03:05:07,482 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786 virtual network link through opserver 10.0.0.33 2026-03-05 03:05:07,482 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-05 03:05:07,494 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786?flat'} 2026-03-05 03:05:07,494 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786 virtual network link through opserver 10.0.0.133 2026-03-05 03:05:07,494 - DEBUG - Requesting: http://10.0.0.133:8081/analytics/uves/virtual-networks 2026-03-05 03:05:07,506 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786', 'href': 'http://10.0.0.133:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786?flat'} 2026-03-05 03:05:07,506 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24580491:ctest-left_vn-85178786 is found in opserver 2026-03-05 03:05:07,527 - DEBUG - Do not have enough data to verify VN in agent 2026-03-05 03:05:07,538 - DEBUG - VRF ids for VN ctest-left_vn-85178786: {} 2026-03-05 03:05:07,803 - DEBUG - Response for create_network : {'network': {'id': '89b9a5d8-1a7b-444c-be1f-c4a7bedfbfcc', 'name': 'ctest-right_vn-14619302', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24580491', 'ctest-right_vn-14619302'], 'port_security_enabled': True, 'description': ''}} 2026-03-05 03:05:08,051 - DEBUG - Response for create_subnet : {'subnet': {'id': '61fd0d39-00d6-47ec-b60b-a04c247a0ec0', 'name': '', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'network_id': '89b9a5d8-1a7b-444c-be1f-c4a7bedfbfcc', 'ip_version': 4, 'cidr': '169.36.130.64/26', 'allocation_pools': [{'start': '169.36.130.66', 'end': '169.36.130.126'}], 'gateway_ip': '169.36.130.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '169.36.130.66', 'tags': [], 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616'}} 2026-03-05 03:05:08,071 - INFO - Created VN ctest-right_vn-14619302 2026-03-05 03:05:08,086 - DEBUG - VN ctest-right_vn-14619302 UUID is 89b9a5d8-1a7b-444c-be1f-c4a7bedfbfcc 2026-03-05 03:05:08,154 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:08,160 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:08,171 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:08,259 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/89b9a5d8-1a7b-444c-be1f-c4a7bedfbfcc 2026-03-05 03:05:08,272 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/89b9a5d8-1a7b-444c-be1f-c4a7bedfbfcc 2026-03-05 03:05:08,281 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/154a1548-da18-4565-98f2-48cd9bafb75f 2026-03-05 03:05:08,288 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/154a1548-da18-4565-98f2-48cd9bafb75f 2026-03-05 03:05:08,295 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/dc09b9d3-f92d-47c7-a2db-d5d976ff71ff 2026-03-05 03:05:08,302 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-05 03:05:08,302 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/89b9a5d8-1a7b-444c-be1f-c4a7bedfbfcc 2026-03-05 03:05:08,313 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/154a1548-da18-4565-98f2-48cd9bafb75f 2026-03-05 03:05:08,329 - INFO - Verified VN network id 18 for VN 89b9a5d8-1a7b-444c-be1f-c4a7bedfbfcc 2026-03-05 03:05:08,329 - INFO - Verifications in API Server for VN ctest-right_vn-14619302 passed 2026-03-05 03:05:08,329 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/89b9a5d8-1a7b-444c-be1f-c4a7bedfbfcc 2026-03-05 03:05:08,338 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/154a1548-da18-4565-98f2-48cd9bafb75f 2026-03-05 03:05:08,345 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/154a1548-da18-4565-98f2-48cd9bafb75f 2026-03-05 03:05:08,352 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/dc09b9d3-f92d-47c7-a2db-d5d976ff71ff 2026-03-05 03:05:08,364 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9924145601463403596', 'uuid-lslong': '13699884816225255372'}, 'enable': 'true', 'created': '2026-03-05T03:05:07', 'last-modified': '2026-03-05T03:05:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.367280'} 2026-03-05 03:05:08,369 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-05 03:05:08,375 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9924145601463403596', 'uuid-lslong': '13699884816225255372'}, 'enable': 'true', 'created': '2026-03-05T03:05:07', 'last-modified': '2026-03-05T03:05:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.375559'} 2026-03-05 03:05:08,381 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-05 03:05:08,386 - DEBUG - Control-node 10.0.0.133 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9924145601463403596', 'uuid-lslong': '13699884816225255372'}, 'enable': 'true', 'created': '2026-03-05T03:05:07', 'last-modified': '2026-03-05T03:05:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.383378'} 2026-03-05 03:05:08,392 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-05 03:05:08,392 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-14619302 passed 2026-03-05 03:05:08,392 - DEBUG - ====Verifying policy data for ctest-right_vn-14619302 in API_Server ====== 2026-03-05 03:05:08,392 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:08,399 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:08,410 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:08,507 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/89b9a5d8-1a7b-444c-be1f-c4a7bedfbfcc 2026-03-05 03:05:08,518 - DEBUG - =>VN ctest-right_vn-14619302 has no policy to be verified 2026-03-05 03:05:08,518 - DEBUG - Verifying the vn in opserver 2026-03-05 03:05:08,518 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302 virtual network link through opserver 10.0.0.65 2026-03-05 03:05:08,518 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-05 03:05:08,529 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302?flat'} 2026-03-05 03:05:08,530 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302 virtual network link through opserver 10.0.0.33 2026-03-05 03:05:08,530 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-05 03:05:08,547 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302?flat'} 2026-03-05 03:05:08,547 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302 virtual network link through opserver 10.0.0.133 2026-03-05 03:05:08,547 - DEBUG - Requesting: http://10.0.0.133:8081/analytics/uves/virtual-networks 2026-03-05 03:05:08,563 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302', 'href': 'http://10.0.0.133:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302?flat'} 2026-03-05 03:05:08,563 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24580491:ctest-right_vn-14619302 is found in opserver 2026-03-05 03:05:08,588 - DEBUG - Do not have enough data to verify VN in agent 2026-03-05 03:05:08,600 - DEBUG - VRF ids for VN ctest-right_vn-14619302: {} 2026-03-05 03:05:08,872 - DEBUG - Response for create_network : {'network': {'id': 'b5b94ff8-c342-4779-b5c0-7b6a04a9c2fa', 'name': 'ctest-trans_left_vn-01786246', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24580491', 'ctest-trans_left_vn-01786246'], 'port_security_enabled': True, 'description': ''}} 2026-03-05 03:05:09,096 - DEBUG - Response for create_subnet : {'subnet': {'id': '38e2d11a-e7b2-43a4-bef1-43d0c663e88b', 'name': '', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'network_id': 'b5b94ff8-c342-4779-b5c0-7b6a04a9c2fa', 'ip_version': 4, 'cidr': '141.117.35.0/26', 'allocation_pools': [{'start': '141.117.35.2', 'end': '141.117.35.62'}], 'gateway_ip': '141.117.35.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '141.117.35.2', 'tags': [], 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616'}} 2026-03-05 03:05:09,124 - INFO - Created VN ctest-trans_left_vn-01786246 2026-03-05 03:05:09,136 - DEBUG - VN ctest-trans_left_vn-01786246 UUID is b5b94ff8-c342-4779-b5c0-7b6a04a9c2fa 2026-03-05 03:05:09,207 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:09,214 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:09,226 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:09,319 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/b5b94ff8-c342-4779-b5c0-7b6a04a9c2fa 2026-03-05 03:05:09,332 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/b5b94ff8-c342-4779-b5c0-7b6a04a9c2fa 2026-03-05 03:05:09,341 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/2b9115d2-0baa-4444-afc1-3dfc392738a4 2026-03-05 03:05:09,350 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/2b9115d2-0baa-4444-afc1-3dfc392738a4 2026-03-05 03:05:09,356 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/ecb1f92b-5f00-4a58-b31c-a818c7d16241 2026-03-05 03:05:09,363 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-05 03:05:09,363 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/b5b94ff8-c342-4779-b5c0-7b6a04a9c2fa 2026-03-05 03:05:09,371 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/2b9115d2-0baa-4444-afc1-3dfc392738a4 2026-03-05 03:05:09,387 - INFO - Verified VN network id 19 for VN b5b94ff8-c342-4779-b5c0-7b6a04a9c2fa 2026-03-05 03:05:09,387 - INFO - Verifications in API Server for VN ctest-trans_left_vn-01786246 passed 2026-03-05 03:05:09,389 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/b5b94ff8-c342-4779-b5c0-7b6a04a9c2fa 2026-03-05 03:05:09,399 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/2b9115d2-0baa-4444-afc1-3dfc392738a4 2026-03-05 03:05:09,406 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/2b9115d2-0baa-4444-afc1-3dfc392738a4 2026-03-05 03:05:09,413 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/ecb1f92b-5f00-4a58-b31c-a818c7d16241 2026-03-05 03:05:09,425 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13094585321402812281', 'uuid-lslong': '13096603411668386554'}, 'enable': 'true', 'created': '2026-03-05T03:05:08', 'last-modified': '2026-03-05T03:05:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.364823'} 2026-03-05 03:05:09,431 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-05 03:05:09,437 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13094585321402812281', 'uuid-lslong': '13096603411668386554'}, 'enable': 'true', 'created': '2026-03-05T03:05:08', 'last-modified': '2026-03-05T03:05:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.374495'} 2026-03-05 03:05:09,442 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-05 03:05:09,448 - DEBUG - Control-node 10.0.0.133 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13094585321402812281', 'uuid-lslong': '13096603411668386554'}, 'enable': 'true', 'created': '2026-03-05T03:05:08', 'last-modified': '2026-03-05T03:05:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.388807'} 2026-03-05 03:05:09,454 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-05 03:05:09,454 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-01786246 passed 2026-03-05 03:05:09,454 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-01786246 in API_Server ====== 2026-03-05 03:05:09,454 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:09,460 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:09,471 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:09,575 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/b5b94ff8-c342-4779-b5c0-7b6a04a9c2fa 2026-03-05 03:05:09,587 - DEBUG - =>VN ctest-trans_left_vn-01786246 has no policy to be verified 2026-03-05 03:05:09,587 - DEBUG - Verifying the vn in opserver 2026-03-05 03:05:09,587 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246 virtual network link through opserver 10.0.0.65 2026-03-05 03:05:09,587 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-05 03:05:09,607 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246?flat'} 2026-03-05 03:05:09,607 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246 virtual network link through opserver 10.0.0.33 2026-03-05 03:05:09,607 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-05 03:05:09,620 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246?flat'} 2026-03-05 03:05:09,620 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246 virtual network link through opserver 10.0.0.133 2026-03-05 03:05:09,620 - DEBUG - Requesting: http://10.0.0.133:8081/analytics/uves/virtual-networks 2026-03-05 03:05:09,632 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246', 'href': 'http://10.0.0.133:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246?flat'} 2026-03-05 03:05:09,632 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24580491:ctest-trans_left_vn-01786246 is found in opserver 2026-03-05 03:05:09,656 - DEBUG - Do not have enough data to verify VN in agent 2026-03-05 03:05:09,673 - DEBUG - VRF ids for VN ctest-trans_left_vn-01786246: {} 2026-03-05 03:05:09,949 - DEBUG - Response for create_network : {'network': {'id': '8fd52f67-6d1e-494c-b803-5a0125334be3', 'name': 'ctest-trans_right_vn-03480481', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-24580491', 'ctest-trans_right_vn-03480481'], 'port_security_enabled': True, 'description': ''}} 2026-03-05 03:05:10,137 - DEBUG - Response for create_subnet : {'subnet': {'id': '3df4c887-6336-4634-8ca6-4f901f9e93bb', 'name': '', 'tenant_id': 'ed6bcf7120124251b00e3fb4ebc2e616', 'network_id': '8fd52f67-6d1e-494c-b803-5a0125334be3', 'ip_version': 4, 'cidr': '143.32.199.0/26', 'allocation_pools': [{'start': '143.32.199.2', 'end': '143.32.199.62'}], 'gateway_ip': '143.32.199.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '143.32.199.2', 'tags': [], 'project_id': 'ed6bcf7120124251b00e3fb4ebc2e616'}} 2026-03-05 03:05:10,158 - INFO - Created VN ctest-trans_right_vn-03480481 2026-03-05 03:05:10,170 - DEBUG - VN ctest-trans_right_vn-03480481 UUID is 8fd52f67-6d1e-494c-b803-5a0125334be3 2026-03-05 03:05:10,243 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:10,249 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:10,259 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:10,349 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/8fd52f67-6d1e-494c-b803-5a0125334be3 2026-03-05 03:05:10,361 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/8fd52f67-6d1e-494c-b803-5a0125334be3 2026-03-05 03:05:10,371 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/088bd33e-b0ca-491d-a4a5-8c62c66409bc 2026-03-05 03:05:10,379 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/088bd33e-b0ca-491d-a4a5-8c62c66409bc 2026-03-05 03:05:10,385 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/46b7a027-c390-49b3-baf3-1da23774749a 2026-03-05 03:05:10,392 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-05 03:05:10,392 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/8fd52f67-6d1e-494c-b803-5a0125334be3 2026-03-05 03:05:10,400 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/088bd33e-b0ca-491d-a4a5-8c62c66409bc 2026-03-05 03:05:10,414 - INFO - Verified VN network id 20 for VN 8fd52f67-6d1e-494c-b803-5a0125334be3 2026-03-05 03:05:10,415 - INFO - Verifications in API Server for VN ctest-trans_right_vn-03480481 passed 2026-03-05 03:05:10,415 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/8fd52f67-6d1e-494c-b803-5a0125334be3 2026-03-05 03:05:10,425 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/088bd33e-b0ca-491d-a4a5-8c62c66409bc 2026-03-05 03:05:10,433 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/088bd33e-b0ca-491d-a4a5-8c62c66409bc 2026-03-05 03:05:10,442 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/46b7a027-c390-49b3-baf3-1da23774749a 2026-03-05 03:05:10,455 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10364242238721902924', 'uuid-lslong': '13259540688874458083'}, 'enable': 'true', 'created': '2026-03-05T03:05:09', 'last-modified': '2026-03-05T03:05:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.362291'} 2026-03-05 03:05:10,461 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-05 03:05:10,466 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10364242238721902924', 'uuid-lslong': '13259540688874458083'}, 'enable': 'true', 'created': '2026-03-05T03:05:09', 'last-modified': '2026-03-05T03:05:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.376011'} 2026-03-05 03:05:10,473 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-05 03:05:10,480 - DEBUG - Control-node 10.0.0.133 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-24580491', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10364242238721902924', 'uuid-lslong': '13259540688874458083'}, 'enable': 'true', 'created': '2026-03-05T03:05:09', 'last-modified': '2026-03-05T03:05:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.388318'} 2026-03-05 03:05:10,485 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-05 03:05:10,486 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-03480481 passed 2026-03-05 03:05:10,486 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-03480481 in API_Server ====== 2026-03-05 03:05:10,486 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:10,492 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:10,505 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:10,599 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/8fd52f67-6d1e-494c-b803-5a0125334be3 2026-03-05 03:05:10,611 - DEBUG - =>VN ctest-trans_right_vn-03480481 has no policy to be verified 2026-03-05 03:05:10,611 - DEBUG - Verifying the vn in opserver 2026-03-05 03:05:10,611 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481 virtual network link through opserver 10.0.0.65 2026-03-05 03:05:10,611 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-05 03:05:10,624 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481?flat'} 2026-03-05 03:05:10,624 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481 virtual network link through opserver 10.0.0.33 2026-03-05 03:05:10,624 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-05 03:05:10,638 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481?flat'} 2026-03-05 03:05:10,638 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481 virtual network link through opserver 10.0.0.133 2026-03-05 03:05:10,638 - DEBUG - Requesting: http://10.0.0.133:8081/analytics/uves/virtual-networks 2026-03-05 03:05:10,654 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481', 'href': 'http://10.0.0.133:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481?flat'} 2026-03-05 03:05:10,654 - INFO - Validated that VN default-domain:ctest-TestSvcHC-24580491:ctest-trans_right_vn-03480481 is found in opserver 2026-03-05 03:05:10,677 - DEBUG - Do not have enough data to verify VN in agent 2026-03-05 03:05:10,689 - DEBUG - VRF ids for VN ctest-trans_right_vn-03480481: {} 2026-03-05 03:05:11,785 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5433-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5433-1) 2026-03-05 03:05:13,112 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5433-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5433-2) 2026-03-05 03:05:13,113 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-12665792'] 2026-03-05 03:05:13,391 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-12665792'] created succesfully 2026-03-05 03:05:13,718 - DEBUG - Image by name tiny_trans_fw not found 2026-03-05 03:05:13,718 - DEBUG - Installing image tiny_trans_fw 2026-03-05 03:05:13,718 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-03-05 03:05:13,718 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-05 03:05:13,718 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-05 03:05:13,718 - DEBUG - Unzip image 2026-03-05 03:05:13,718 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-05 03:05:13,741 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2026-03-05 03:05:13,741 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-12665792'] 2026-03-05 03:05:13,837 - INFO - Service template: ['default-domain', 'ctest-service_template_1-12665792'] deleted successfully. 2026-03-05 03:05:13,837 - INFO - Skip interface_detach for VM ctest-right_vm-86389556 in state BUILD 2026-03-05 03:05:13,837 - INFO - Deleting VM ctest-right_vm-86389556 2026-03-05 03:05:13,837 - ERROR - VM ctest-right_vm-86389556 has failed to come up 2026-03-05 03:05:13,838 - ERROR - Nova failed to get host of the VM 2026-03-05 03:05:13,838 - ERROR - VM ctest-right_vm-86389556 has failed to come up 2026-03-05 03:05:13,838 - ERROR - Nova failed to get host of the VM 2026-03-05 03:05:13,926 - INFO - Skip interface_detach for VM ctest-left_vm-06170370 in state BUILD 2026-03-05 03:05:13,926 - INFO - Deleting VM ctest-left_vm-06170370 2026-03-05 03:05:13,926 - ERROR - VM ctest-left_vm-06170370 has failed to come up 2026-03-05 03:05:13,926 - ERROR - Nova failed to get host of the VM 2026-03-05 03:05:13,926 - ERROR - VM ctest-left_vm-06170370 has failed to come up 2026-03-05 03:05:13,926 - ERROR - Nova failed to get host of the VM 2026-03-05 03:05:14,011 - INFO - Deleting VN ctest-trans_right_vn-03480481 2026-03-05 03:05:14,159 - DEBUG - Response for deleting network () 2026-03-05 03:05:14,159 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/088bd33e-b0ca-491d-a4a5-8c62c66409bc 2026-03-05 03:05:14,170 - DEBUG - Response Code: 404 2026-03-05 03:05:14,171 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:14,184 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:14,200 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:14,289 - INFO - Validated that VN ctest-trans_right_vn-03480481 is not found in API Server 2026-03-05 03:05:14,307 - DEBUG - VN ctest-trans_right_vn-03480481 is not present in Agent 10.0.0.141 2026-03-05 03:05:14,344 - DEBUG - VN ctest-trans_right_vn-03480481 is not present in Agent 10.0.0.73 2026-03-05 03:05:14,344 - INFO - Validated that VN ctest-trans_right_vn-03480481 is not in any agent 2026-03-05 03:05:14,392 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-03480481 info 2026-03-05 03:05:14,392 - INFO - Deleting VN ctest-trans_left_vn-01786246 2026-03-05 03:05:14,530 - DEBUG - Response for deleting network () 2026-03-05 03:05:14,530 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/2b9115d2-0baa-4444-afc1-3dfc392738a4 2026-03-05 03:05:14,537 - DEBUG - Response Code: 404 2026-03-05 03:05:14,537 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:14,543 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:14,612 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:14,712 - INFO - Validated that VN ctest-trans_left_vn-01786246 is not found in API Server 2026-03-05 03:05:14,727 - DEBUG - VN ctest-trans_left_vn-01786246 is not present in Agent 10.0.0.141 2026-03-05 03:05:14,745 - DEBUG - VN ctest-trans_left_vn-01786246 is not present in Agent 10.0.0.73 2026-03-05 03:05:14,745 - INFO - Validated that VN ctest-trans_left_vn-01786246 is not in any agent 2026-03-05 03:05:14,802 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-01786246 info 2026-03-05 03:05:14,802 - INFO - Deleting VN ctest-right_vn-14619302 2026-03-05 03:05:14,855 - DEBUG - VN 89b9a5d8-1a7b-444c-be1f-c4a7bedfbfcc still in use: Unable to complete operation on network 89b9a5d8-1a7b-444c-be1f-c4a7bedfbfcc. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-2102fdff-c233-49c1-9fea-69acfb5861eb'] 2026-03-05 03:05:14,855 - WARNING - Deleting VN ctest-right_vn-14619302 failed..Will retry 2026-03-05 03:05:17,021 - DEBUG - Response for deleting network () 2026-03-05 03:05:17,021 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/154a1548-da18-4565-98f2-48cd9bafb75f 2026-03-05 03:05:17,037 - DEBUG - Response Code: 404 2026-03-05 03:05:17,037 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:17,048 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:17,098 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:17,188 - INFO - Validated that VN ctest-right_vn-14619302 is not found in API Server 2026-03-05 03:05:17,199 - DEBUG - VN ctest-right_vn-14619302 is not present in Agent 10.0.0.141 2026-03-05 03:05:17,210 - DEBUG - VN ctest-right_vn-14619302 is not present in Agent 10.0.0.73 2026-03-05 03:05:17,210 - INFO - Validated that VN ctest-right_vn-14619302 is not in any agent 2026-03-05 03:05:17,241 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-14619302 info 2026-03-05 03:05:17,241 - INFO - Deleting VN ctest-left_vn-85178786 2026-03-05 03:05:17,380 - DEBUG - Response for deleting network () 2026-03-05 03:05:17,380 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/96a1b99a-cca9-4654-930a-2075b02fa331 2026-03-05 03:05:17,387 - DEBUG - Response Code: 404 2026-03-05 03:05:17,387 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:17,393 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:17,411 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:17,500 - INFO - Validated that VN ctest-left_vn-85178786 is not found in API Server 2026-03-05 03:05:17,510 - DEBUG - VN ctest-left_vn-85178786 is not present in Agent 10.0.0.141 2026-03-05 03:05:17,521 - DEBUG - VN ctest-left_vn-85178786 is not present in Agent 10.0.0.73 2026-03-05 03:05:17,521 - INFO - Validated that VN ctest-left_vn-85178786 is not in any agent 2026-03-05 03:05:17,552 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-85178786 info 2026-03-05 03:05:17,554 - INFO - Deleting VN ctest-mgmt_vn-00837634 2026-03-05 03:05:17,675 - DEBUG - Response for deleting network () 2026-03-05 03:05:17,675 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8c8261a4-7b3f-4806-82cf-9465334950a1 2026-03-05 03:05:17,680 - DEBUG - Response Code: 404 2026-03-05 03:05:17,680 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2026-03-05 03:05:17,690 - DEBUG - Requesting: http://10.0.0.65:8082/domain/8ec23053-61d3-4e86-b71e-e24c9bc5c983 2026-03-05 03:05:17,701 - DEBUG - Requesting: http://10.0.0.65:8082/project/ed6bcf71-2012-4251-b00e-3fb4ebc2e616 2026-03-05 03:05:17,802 - INFO - Validated that VN ctest-mgmt_vn-00837634 is not found in API Server 2026-03-05 03:05:17,814 - DEBUG - VN ctest-mgmt_vn-00837634 is not present in Agent 10.0.0.141 2026-03-05 03:05:17,826 - DEBUG - VN ctest-mgmt_vn-00837634 is not present in Agent 10.0.0.73 2026-03-05 03:05:17,826 - INFO - Validated that VN ctest-mgmt_vn-00837634 is not in any agent 2026-03-05 03:05:17,857 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-00837634 info 2026-03-05 03:05:19,127 - DEBUG - No XMPP flaps were noticed during the test 2026-03-05 03:05:19,127 - INFO - 2026-03-05 03:05:19,127 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15] 2026-03-05 03:05:19,127 - INFO - -------------------------------------------------------------------------------- 2026-03-05 03:05:19,849 - INFO - Deleted project: ctest-TestSvcHC-24580491, ID : ed6bcf71-2012-4251-b00e-3fb4ebc2e616