2025-09-11 02:51:24,614 - INFO - Domain Default found not creating 2025-09-11 02:51:24,771 - INFO - Project ctest-TestSvcRegr-11850212 not found, creating it 2025-09-11 02:51:25,351 - INFO - Created Project:ctest-TestSvcRegr-11850212, ID : 77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:26,794 - INFO - ================================================================================ 2025-09-11 02:51:26,794 - INFO - STARTING TEST : test_svc_in_net_nat_with_static_routes 2025-09-11 02:51:28,067 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.19': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-09-11 02:51:28,067 - INFO - Initial checks done. Running the testcase now 2025-09-11 02:51:28,067 - INFO - 2025-09-11 02:51:28,708 - DEBUG - Response for create_network : {'network': {'id': '79aa5a85-b7c5-4e55-9b6e-3956052e076c', 'name': 'ctest-third-vn-39974078', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-11850212', 'ctest-third-vn-39974078'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:51:28,958 - DEBUG - Response for create_subnet : {'subnet': {'id': '031881a8-524f-421e-b20c-c68e93578d80', 'name': '', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'network_id': '79aa5a85-b7c5-4e55-9b6e-3956052e076c', 'ip_version': 4, 'cidr': '156.127.75.64/26', 'allocation_pools': [{'start': '156.127.75.66', 'end': '156.127.75.126'}], 'gateway_ip': '156.127.75.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '156.127.75.66', 'tags': [], 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9'}} 2025-09-11 02:51:28,977 - INFO - Created VN ctest-third-vn-39974078 2025-09-11 02:51:28,988 - DEBUG - VN ctest-third-vn-39974078 UUID is 79aa5a85-b7c5-4e55-9b6e-3956052e076c 2025-09-11 02:51:29,184 - DEBUG - Services list from nova: [, , , ] 2025-09-11 02:51:30,251 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-1) 2025-09-11 02:51:30,294 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-11 02:51:35,382 - DEBUG - VM is in ACTIVE state now 2025-09-11 02:51:35,718 - DEBUG - Response for create_network : {'network': {'id': '4b2022eb-66fa-4fca-a1fe-a253dbe58de9', 'name': 'ctest-mgmt_vn-18940281', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-11850212', 'ctest-mgmt_vn-18940281'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:51:35,956 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ac1af7bb-518e-4748-8c6d-c9e4ee14527f', 'name': '', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'network_id': '4b2022eb-66fa-4fca-a1fe-a253dbe58de9', 'ip_version': 4, 'cidr': '126.116.110.192/26', 'allocation_pools': [{'start': '126.116.110.194', 'end': '126.116.110.254'}], 'gateway_ip': '126.116.110.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '126.116.110.194', 'tags': [], 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9'}} 2025-09-11 02:51:35,980 - INFO - Created VN ctest-mgmt_vn-18940281 2025-09-11 02:51:35,995 - DEBUG - VN ctest-mgmt_vn-18940281 UUID is 4b2022eb-66fa-4fca-a1fe-a253dbe58de9 2025-09-11 02:51:36,061 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:36,356 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:36,384 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:36,397 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:36,487 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/4b2022eb-66fa-4fca-a1fe-a253dbe58de9 2025-09-11 02:51:36,505 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/4b2022eb-66fa-4fca-a1fe-a253dbe58de9 2025-09-11 02:51:36,514 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a566c0d6-6b9f-4fd0-9a9f-121512011ace 2025-09-11 02:51:36,521 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a566c0d6-6b9f-4fd0-9a9f-121512011ace 2025-09-11 02:51:36,529 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/7f0543f9-ea27-4e11-90bf-1ab4051f8aef 2025-09-11 02:51:36,535 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:51:36,535 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/4b2022eb-66fa-4fca-a1fe-a253dbe58de9 2025-09-11 02:51:36,544 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a566c0d6-6b9f-4fd0-9a9f-121512011ace 2025-09-11 02:51:36,559 - INFO - Verified VN network id 15 for VN 4b2022eb-66fa-4fca-a1fe-a253dbe58de9 2025-09-11 02:51:36,559 - INFO - Verifications in API Server for VN ctest-mgmt_vn-18940281 passed 2025-09-11 02:51:36,559 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/4b2022eb-66fa-4fca-a1fe-a253dbe58de9 2025-09-11 02:51:36,569 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a566c0d6-6b9f-4fd0-9a9f-121512011ace 2025-09-11 02:51:36,576 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a566c0d6-6b9f-4fd0-9a9f-121512011ace 2025-09-11 02:51:36,582 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/7f0543f9-ea27-4e11-90bf-1ab4051f8aef 2025-09-11 02:51:36,596 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5413365146539675594', 'uuid-lslong': '11672945765246143977'}, 'enable': 'true', 'created': '2025-09-11T02:51:35', 'last-modified': '2025-09-11T02:51:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.678178'} 2025-09-11 02:51:36,601 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:51:36,606 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5413365146539675594', 'uuid-lslong': '11672945765246143977'}, 'enable': 'true', 'created': '2025-09-11T02:51:35', 'last-modified': '2025-09-11T02:51:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.693438'} 2025-09-11 02:51:36,612 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:51:36,618 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5413365146539675594', 'uuid-lslong': '11672945765246143977'}, 'enable': 'true', 'created': '2025-09-11T02:51:35', 'last-modified': '2025-09-11T02:51:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.700819'} 2025-09-11 02:51:36,624 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:51:36,624 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-18940281 passed 2025-09-11 02:51:36,624 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-18940281 in API_Server ====== 2025-09-11 02:51:36,624 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:36,630 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:36,641 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:36,731 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/4b2022eb-66fa-4fca-a1fe-a253dbe58de9 2025-09-11 02:51:36,743 - DEBUG - =>VN ctest-mgmt_vn-18940281 has no policy to be verified 2025-09-11 02:51:36,743 - DEBUG - Verifying the vn in opserver 2025-09-11 02:51:36,743 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281 virtual network link through opserver 10.0.0.249 2025-09-11 02:51:36,744 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:51:37,035 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:51:37,089 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281?flat'} 2025-09-11 02:51:37,089 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281 virtual network link through opserver 10.0.0.22 2025-09-11 02:51:37,089 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:51:37,383 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:51:37,437 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281?flat'} 2025-09-11 02:51:37,437 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281 virtual network link through opserver 10.0.0.49 2025-09-11 02:51:37,438 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:51:37,729 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:51:37,782 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281?flat'} 2025-09-11 02:51:37,782 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-18940281 is found in opserver 2025-09-11 02:51:37,804 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:51:37,813 - DEBUG - VRF ids for VN ctest-mgmt_vn-18940281: {} 2025-09-11 02:51:38,053 - DEBUG - Response for create_network : {'network': {'id': 'a6b6e3ee-048d-4281-ac90-3c17987463a4', 'name': 'ctest-left_vn-55707255', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-11850212', 'ctest-left_vn-55707255'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:51:38,270 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f6615ea3-fe2b-4369-b919-69103c6c9d38', 'name': '', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'network_id': 'a6b6e3ee-048d-4281-ac90-3c17987463a4', 'ip_version': 4, 'cidr': '63.156.165.64/26', 'allocation_pools': [{'start': '63.156.165.66', 'end': '63.156.165.126'}], 'gateway_ip': '63.156.165.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '63.156.165.66', 'tags': [], 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9'}} 2025-09-11 02:51:38,293 - INFO - Created VN ctest-left_vn-55707255 2025-09-11 02:51:38,309 - DEBUG - VN ctest-left_vn-55707255 UUID is a6b6e3ee-048d-4281-ac90-3c17987463a4 2025-09-11 02:51:38,380 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:38,386 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:38,398 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:38,496 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a6b6e3ee-048d-4281-ac90-3c17987463a4 2025-09-11 02:51:38,508 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a6b6e3ee-048d-4281-ac90-3c17987463a4 2025-09-11 02:51:38,520 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f88648f2-9cae-492d-9f70-3afe36c4f5ed 2025-09-11 02:51:38,529 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f88648f2-9cae-492d-9f70-3afe36c4f5ed 2025-09-11 02:51:38,538 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/9dd1d464-6499-4cb8-97cb-b4c6718a6582 2025-09-11 02:51:38,544 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:51:38,545 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a6b6e3ee-048d-4281-ac90-3c17987463a4 2025-09-11 02:51:38,555 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f88648f2-9cae-492d-9f70-3afe36c4f5ed 2025-09-11 02:51:38,570 - INFO - Verified VN network id 16 for VN a6b6e3ee-048d-4281-ac90-3c17987463a4 2025-09-11 02:51:38,571 - INFO - Verifications in API Server for VN ctest-left_vn-55707255 passed 2025-09-11 02:51:38,571 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a6b6e3ee-048d-4281-ac90-3c17987463a4 2025-09-11 02:51:38,581 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f88648f2-9cae-492d-9f70-3afe36c4f5ed 2025-09-11 02:51:38,587 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f88648f2-9cae-492d-9f70-3afe36c4f5ed 2025-09-11 02:51:38,594 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/9dd1d464-6499-4cb8-97cb-b4c6718a6582 2025-09-11 02:51:38,605 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12013039667475464833', 'uuid-lslong': '12434504643209618340'}, 'enable': 'true', 'created': '2025-09-11T02:51:38', 'last-modified': '2025-09-11T02:51:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.382506'} 2025-09-11 02:51:38,610 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:51:38,615 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12013039667475464833', 'uuid-lslong': '12434504643209618340'}, 'enable': 'true', 'created': '2025-09-11T02:51:38', 'last-modified': '2025-09-11T02:51:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.391142'} 2025-09-11 02:51:38,621 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:51:38,627 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12013039667475464833', 'uuid-lslong': '12434504643209618340'}, 'enable': 'true', 'created': '2025-09-11T02:51:38', 'last-modified': '2025-09-11T02:51:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.401487'} 2025-09-11 02:51:38,633 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:51:38,633 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-55707255 passed 2025-09-11 02:51:38,633 - DEBUG - ====Verifying policy data for ctest-left_vn-55707255 in API_Server ====== 2025-09-11 02:51:38,633 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:38,640 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:38,651 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:38,745 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a6b6e3ee-048d-4281-ac90-3c17987463a4 2025-09-11 02:51:38,754 - DEBUG - =>VN ctest-left_vn-55707255 has no policy to be verified 2025-09-11 02:51:38,754 - DEBUG - Verifying the vn in opserver 2025-09-11 02:51:38,755 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255 virtual network link through opserver 10.0.0.249 2025-09-11 02:51:38,755 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:51:38,807 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255?flat'} 2025-09-11 02:51:38,807 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255 virtual network link through opserver 10.0.0.22 2025-09-11 02:51:38,807 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:51:38,863 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255?flat'} 2025-09-11 02:51:38,863 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255 virtual network link through opserver 10.0.0.49 2025-09-11 02:51:38,863 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:51:38,915 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255?flat'} 2025-09-11 02:51:38,915 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-55707255 is found in opserver 2025-09-11 02:51:38,937 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:51:38,949 - DEBUG - VRF ids for VN ctest-left_vn-55707255: {} 2025-09-11 02:51:39,202 - DEBUG - Response for create_network : {'network': {'id': '395441fc-e812-4e47-b01d-c685db486e27', 'name': 'ctest-right_vn-60191672', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-11850212', 'ctest-right_vn-60191672'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:51:39,411 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a66c3f56-9921-4eb4-b9ed-92bcd8cbe404', 'name': '', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'network_id': '395441fc-e812-4e47-b01d-c685db486e27', 'ip_version': 4, 'cidr': '38.237.116.64/26', 'allocation_pools': [{'start': '38.237.116.66', 'end': '38.237.116.126'}], 'gateway_ip': '38.237.116.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '38.237.116.66', 'tags': [], 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9'}} 2025-09-11 02:51:39,432 - INFO - Created VN ctest-right_vn-60191672 2025-09-11 02:51:39,443 - DEBUG - VN ctest-right_vn-60191672 UUID is 395441fc-e812-4e47-b01d-c685db486e27 2025-09-11 02:51:39,512 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:39,519 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:39,531 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:39,624 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/395441fc-e812-4e47-b01d-c685db486e27 2025-09-11 02:51:39,635 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/395441fc-e812-4e47-b01d-c685db486e27 2025-09-11 02:51:39,644 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be0e5846-d554-4be2-b5c5-8aecc7ae5392 2025-09-11 02:51:39,652 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be0e5846-d554-4be2-b5c5-8aecc7ae5392 2025-09-11 02:51:39,660 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/3a77df2c-e91e-4568-ae5f-74766bd53fbc 2025-09-11 02:51:39,666 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:51:39,666 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/395441fc-e812-4e47-b01d-c685db486e27 2025-09-11 02:51:39,676 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be0e5846-d554-4be2-b5c5-8aecc7ae5392 2025-09-11 02:51:39,691 - INFO - Verified VN network id 17 for VN 395441fc-e812-4e47-b01d-c685db486e27 2025-09-11 02:51:39,692 - INFO - Verifications in API Server for VN ctest-right_vn-60191672 passed 2025-09-11 02:51:39,692 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/395441fc-e812-4e47-b01d-c685db486e27 2025-09-11 02:51:39,704 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be0e5846-d554-4be2-b5c5-8aecc7ae5392 2025-09-11 02:51:39,714 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be0e5846-d554-4be2-b5c5-8aecc7ae5392 2025-09-11 02:51:39,723 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/3a77df2c-e91e-4568-ae5f-74766bd53fbc 2025-09-11 02:51:39,735 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4130999312686665287', 'uuid-lslong': '12690517603211832871'}, 'enable': 'true', 'created': '2025-09-11T02:51:39', 'last-modified': '2025-09-11T02:51:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.377381'} 2025-09-11 02:51:39,740 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:51:39,745 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4130999312686665287', 'uuid-lslong': '12690517603211832871'}, 'enable': 'true', 'created': '2025-09-11T02:51:39', 'last-modified': '2025-09-11T02:51:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.384979'} 2025-09-11 02:51:39,750 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:51:39,756 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4130999312686665287', 'uuid-lslong': '12690517603211832871'}, 'enable': 'true', 'created': '2025-09-11T02:51:39', 'last-modified': '2025-09-11T02:51:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.397732'} 2025-09-11 02:51:39,762 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:51:39,762 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-60191672 passed 2025-09-11 02:51:39,762 - DEBUG - ====Verifying policy data for ctest-right_vn-60191672 in API_Server ====== 2025-09-11 02:51:39,762 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:39,767 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:39,779 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:39,878 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/395441fc-e812-4e47-b01d-c685db486e27 2025-09-11 02:51:39,895 - DEBUG - =>VN ctest-right_vn-60191672 has no policy to be verified 2025-09-11 02:51:39,895 - DEBUG - Verifying the vn in opserver 2025-09-11 02:51:39,895 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672 virtual network link through opserver 10.0.0.249 2025-09-11 02:51:39,896 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:51:39,950 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672?flat'} 2025-09-11 02:51:39,950 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672 virtual network link through opserver 10.0.0.22 2025-09-11 02:51:39,950 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:51:40,003 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672?flat'} 2025-09-11 02:51:40,003 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672 virtual network link through opserver 10.0.0.49 2025-09-11 02:51:40,003 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:51:40,056 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672?flat'} 2025-09-11 02:51:40,056 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-60191672 is found in opserver 2025-09-11 02:51:40,083 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:51:40,097 - DEBUG - VRF ids for VN ctest-right_vn-60191672: {} 2025-09-11 02:51:41,322 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-2) 2025-09-11 02:51:42,655 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-1) 2025-09-11 02:51:42,655 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-38360171'] 2025-09-11 02:51:42,939 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-38360171'] created succesfully 2025-09-11 02:51:43,340 - DEBUG - Image by name tiny_nat_fw not found 2025-09-11 02:51:43,340 - DEBUG - Installing image tiny_nat_fw 2025-09-11 02:51:43,341 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-09-11 02:51:43,341 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz 2025-09-11 02:51:43,341 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz 2025-09-11 02:51:43,361 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz -O /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:51:43,428 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:51:43,428 - DEBUG - Unzip image 2025-09-11 02:51:43,428 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:51:43,461 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-09-11 02:51:43,461 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-38360171'] 2025-09-11 02:51:43,583 - INFO - Service template: ['default-domain', 'ctest-service_template_1-38360171'] deleted successfully. 2025-09-11 02:51:43,583 - INFO - Skip interface_detach for VM ctest-right_vm-26383850 in state BUILD 2025-09-11 02:51:43,583 - INFO - Deleting VM ctest-right_vm-26383850 2025-09-11 02:51:43,614 - ERROR - VM ctest-right_vm-26383850 has failed to come up 2025-09-11 02:51:43,614 - ERROR - Nova failed to get host of the VM 2025-09-11 02:51:43,614 - ERROR - VM ctest-right_vm-26383850 has failed to come up 2025-09-11 02:51:43,614 - ERROR - Nova failed to get host of the VM 2025-09-11 02:51:43,691 - INFO - Skip interface_detach for VM ctest-left_vm-52531963 in state ERROR 2025-09-11 02:51:43,691 - INFO - Deleting VM ctest-left_vm-52531963 2025-09-11 02:51:43,691 - ERROR - VM ctest-left_vm-52531963 has failed to come up 2025-09-11 02:51:43,691 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-09-11T02:51:41Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-09-11 02:51:43,691 - INFO - Deleting VN ctest-right_vn-60191672 2025-09-11 02:51:43,729 - DEBUG - VN 395441fc-e812-4e47-b01d-c685db486e27 still in use: Unable to complete operation on network 395441fc-e812-4e47-b01d-c685db486e27. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-33a2992f-8a6a-4053-8797-548bca1cebc5'] 2025-09-11 02:51:43,730 - WARNING - Deleting VN ctest-right_vn-60191672 failed..Will retry 2025-09-11 02:51:45,931 - DEBUG - Response for deleting network () 2025-09-11 02:51:45,931 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be0e5846-d554-4be2-b5c5-8aecc7ae5392 2025-09-11 02:51:45,939 - DEBUG - Response Code: 404 2025-09-11 02:51:45,939 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:45,948 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:46,008 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:46,100 - INFO - Validated that VN ctest-right_vn-60191672 is not found in API Server 2025-09-11 02:51:46,153 - DEBUG - VN ctest-right_vn-60191672 is not present in Agent 10.0.0.254 2025-09-11 02:51:46,165 - DEBUG - VN ctest-right_vn-60191672 is not present in Agent 10.0.0.19 2025-09-11 02:51:46,165 - INFO - Validated that VN ctest-right_vn-60191672 is not in any agent 2025-09-11 02:51:46,207 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-60191672 info 2025-09-11 02:51:46,207 - INFO - Deleting VN ctest-left_vn-55707255 2025-09-11 02:51:46,389 - DEBUG - Response for deleting network () 2025-09-11 02:51:46,390 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f88648f2-9cae-492d-9f70-3afe36c4f5ed 2025-09-11 02:51:46,397 - DEBUG - Response Code: 404 2025-09-11 02:51:46,397 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:46,403 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:46,461 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:46,569 - INFO - Validated that VN ctest-left_vn-55707255 is not found in API Server 2025-09-11 02:51:46,581 - DEBUG - VN ctest-left_vn-55707255 is not present in Agent 10.0.0.254 2025-09-11 02:51:46,591 - DEBUG - VN ctest-left_vn-55707255 is not present in Agent 10.0.0.19 2025-09-11 02:51:46,591 - INFO - Validated that VN ctest-left_vn-55707255 is not in any agent 2025-09-11 02:51:46,625 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-55707255 info 2025-09-11 02:51:46,625 - INFO - Deleting VN ctest-mgmt_vn-18940281 2025-09-11 02:51:46,793 - DEBUG - Response for deleting network () 2025-09-11 02:51:46,793 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a566c0d6-6b9f-4fd0-9a9f-121512011ace 2025-09-11 02:51:46,798 - DEBUG - Response Code: 404 2025-09-11 02:51:46,799 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:46,807 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:46,821 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:46,916 - INFO - Validated that VN ctest-mgmt_vn-18940281 is not found in API Server 2025-09-11 02:51:46,928 - DEBUG - VN ctest-mgmt_vn-18940281 is not present in Agent 10.0.0.254 2025-09-11 02:51:46,939 - DEBUG - VN ctest-mgmt_vn-18940281 is not present in Agent 10.0.0.19 2025-09-11 02:51:46,939 - INFO - Validated that VN ctest-mgmt_vn-18940281 is not in any agent 2025-09-11 02:51:46,972 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-18940281 info 2025-09-11 02:51:46,972 - INFO - Deleting VM ctest-vm-in-third-vn-07068277 2025-09-11 02:51:47,047 - INFO - Deleting VN ctest-third-vn-39974078 2025-09-11 02:51:47,089 - DEBUG - VN 79aa5a85-b7c5-4e55-9b6e-3956052e076c still in use: Unable to complete operation on network 79aa5a85-b7c5-4e55-9b6e-3956052e076c. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-417cef1b-fe65-4a22-bae5-cd8b17c97062'] 2025-09-11 02:51:47,089 - WARNING - Deleting VN ctest-third-vn-39974078 failed..Will retry 2025-09-11 02:51:49,245 - DEBUG - Response for deleting network () 2025-09-11 02:51:50,516 - DEBUG - No XMPP flaps were noticed during the test 2025-09-11 02:51:50,516 - INFO - 2025-09-11 02:51:50,516 - INFO - END TEST : test_svc_in_net_nat_with_static_routes : SKIPPED[0:00:24] 2025-09-11 02:51:50,516 - INFO - -------------------------------------------------------------------------------- 2025-09-11 02:51:50,519 - INFO - ================================================================================ 2025-09-11 02:51:50,519 - INFO - STARTING TEST : test_svc_v2_transparent_datapath 2025-09-11 02:51:51,803 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.19': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-09-11 02:51:51,803 - INFO - Initial checks done. Running the testcase now 2025-09-11 02:51:51,803 - INFO - 2025-09-11 02:51:52,041 - DEBUG - Response for create_network : {'network': {'id': 'c152c43a-856b-4874-a9b1-d20f0e5b04c3', 'name': 'ctest-mgmt_vn-57043583', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-11850212', 'ctest-mgmt_vn-57043583'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:51:52,238 - DEBUG - Response for create_subnet : {'subnet': {'id': '1844a70f-a507-4cee-9894-9828baccd958', 'name': '', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'network_id': 'c152c43a-856b-4874-a9b1-d20f0e5b04c3', 'ip_version': 4, 'cidr': '142.248.236.128/26', 'allocation_pools': [{'start': '142.248.236.130', 'end': '142.248.236.190'}], 'gateway_ip': '142.248.236.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '142.248.236.130', 'tags': [], 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9'}} 2025-09-11 02:51:52,258 - INFO - Created VN ctest-mgmt_vn-57043583 2025-09-11 02:51:52,273 - DEBUG - VN ctest-mgmt_vn-57043583 UUID is c152c43a-856b-4874-a9b1-d20f0e5b04c3 2025-09-11 02:51:52,342 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:52,348 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:52,359 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:52,472 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c152c43a-856b-4874-a9b1-d20f0e5b04c3 2025-09-11 02:51:52,483 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c152c43a-856b-4874-a9b1-d20f0e5b04c3 2025-09-11 02:51:52,493 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/194d8e0a-cdf9-411c-8d1a-d3dafa54ad6d 2025-09-11 02:51:52,501 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/194d8e0a-cdf9-411c-8d1a-d3dafa54ad6d 2025-09-11 02:51:52,508 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/7a6091d7-af86-4ab6-9d88-9ee425856de7 2025-09-11 02:51:52,514 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:51:52,514 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c152c43a-856b-4874-a9b1-d20f0e5b04c3 2025-09-11 02:51:52,522 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/194d8e0a-cdf9-411c-8d1a-d3dafa54ad6d 2025-09-11 02:51:52,538 - INFO - Verified VN network id 14 for VN c152c43a-856b-4874-a9b1-d20f0e5b04c3 2025-09-11 02:51:52,538 - INFO - Verifications in API Server for VN ctest-mgmt_vn-57043583 passed 2025-09-11 02:51:52,538 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c152c43a-856b-4874-a9b1-d20f0e5b04c3 2025-09-11 02:51:52,550 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/194d8e0a-cdf9-411c-8d1a-d3dafa54ad6d 2025-09-11 02:51:52,558 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/194d8e0a-cdf9-411c-8d1a-d3dafa54ad6d 2025-09-11 02:51:52,566 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/7a6091d7-af86-4ab6-9d88-9ee425856de7 2025-09-11 02:51:52,576 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13930412353035913332', 'uuid-lslong': '12227785425394795715'}, 'enable': 'true', 'created': '2025-09-11T02:51:51', 'last-modified': '2025-09-11T02:51:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.383625'} 2025-09-11 02:51:52,582 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:51:52,586 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13930412353035913332', 'uuid-lslong': '12227785425394795715'}, 'enable': 'true', 'created': '2025-09-11T02:51:51', 'last-modified': '2025-09-11T02:51:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.396062'} 2025-09-11 02:51:52,592 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:51:52,597 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13930412353035913332', 'uuid-lslong': '12227785425394795715'}, 'enable': 'true', 'created': '2025-09-11T02:51:51', 'last-modified': '2025-09-11T02:51:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405241'} 2025-09-11 02:51:52,602 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:51:52,602 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-57043583 passed 2025-09-11 02:51:52,603 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-57043583 in API_Server ====== 2025-09-11 02:51:52,603 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:52,609 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:52,619 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:52,713 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c152c43a-856b-4874-a9b1-d20f0e5b04c3 2025-09-11 02:51:52,727 - DEBUG - =>VN ctest-mgmt_vn-57043583 has no policy to be verified 2025-09-11 02:51:52,728 - DEBUG - Verifying the vn in opserver 2025-09-11 02:51:52,728 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583 virtual network link through opserver 10.0.0.249 2025-09-11 02:51:52,728 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:51:52,740 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583?flat'} 2025-09-11 02:51:52,740 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583 virtual network link through opserver 10.0.0.22 2025-09-11 02:51:52,741 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:51:52,752 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583?flat'} 2025-09-11 02:51:52,752 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583 virtual network link through opserver 10.0.0.49 2025-09-11 02:51:52,752 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:51:52,763 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583?flat'} 2025-09-11 02:51:52,763 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-11850212:ctest-mgmt_vn-57043583 is found in opserver 2025-09-11 02:51:52,782 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:51:52,793 - DEBUG - VRF ids for VN ctest-mgmt_vn-57043583: {} 2025-09-11 02:51:53,059 - DEBUG - Response for create_network : {'network': {'id': 'e2fb2ef1-d417-4201-a6f9-61546849310f', 'name': 'ctest-left_vn-51965565', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-11850212', 'ctest-left_vn-51965565'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:51:53,268 - DEBUG - Response for create_subnet : {'subnet': {'id': '17ff1e2f-4b0d-4fbd-8e5b-9a05597bd44c', 'name': '', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'network_id': 'e2fb2ef1-d417-4201-a6f9-61546849310f', 'ip_version': 4, 'cidr': '221.11.43.64/26', 'allocation_pools': [{'start': '221.11.43.66', 'end': '221.11.43.126'}], 'gateway_ip': '221.11.43.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '221.11.43.66', 'tags': [], 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9'}} 2025-09-11 02:51:53,290 - INFO - Created VN ctest-left_vn-51965565 2025-09-11 02:51:53,301 - DEBUG - VN ctest-left_vn-51965565 UUID is e2fb2ef1-d417-4201-a6f9-61546849310f 2025-09-11 02:51:53,370 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:53,375 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:53,385 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:53,470 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e2fb2ef1-d417-4201-a6f9-61546849310f 2025-09-11 02:51:53,486 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e2fb2ef1-d417-4201-a6f9-61546849310f 2025-09-11 02:51:53,495 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9bbaee2a-4f61-49fd-8feb-41df09111630 2025-09-11 02:51:53,504 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9bbaee2a-4f61-49fd-8feb-41df09111630 2025-09-11 02:51:53,511 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/17dcaa51-be9b-470e-adb7-9a7b32096032 2025-09-11 02:51:53,518 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:51:53,518 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e2fb2ef1-d417-4201-a6f9-61546849310f 2025-09-11 02:51:53,528 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9bbaee2a-4f61-49fd-8feb-41df09111630 2025-09-11 02:51:53,544 - INFO - Verified VN network id 15 for VN e2fb2ef1-d417-4201-a6f9-61546849310f 2025-09-11 02:51:53,544 - INFO - Verifications in API Server for VN ctest-left_vn-51965565 passed 2025-09-11 02:51:53,544 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e2fb2ef1-d417-4201-a6f9-61546849310f 2025-09-11 02:51:53,554 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9bbaee2a-4f61-49fd-8feb-41df09111630 2025-09-11 02:51:53,561 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9bbaee2a-4f61-49fd-8feb-41df09111630 2025-09-11 02:51:53,569 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/17dcaa51-be9b-470e-adb7-9a7b32096032 2025-09-11 02:51:53,582 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16355718087906378241', 'uuid-lslong': '12031754894651765007'}, 'enable': 'true', 'created': '2025-09-11T02:51:53', 'last-modified': '2025-09-11T02:51:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.356527'} 2025-09-11 02:51:53,588 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:51:53,593 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16355718087906378241', 'uuid-lslong': '12031754894651765007'}, 'enable': 'true', 'created': '2025-09-11T02:51:53', 'last-modified': '2025-09-11T02:51:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.372159'} 2025-09-11 02:51:53,599 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:51:53,604 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16355718087906378241', 'uuid-lslong': '12031754894651765007'}, 'enable': 'true', 'created': '2025-09-11T02:51:53', 'last-modified': '2025-09-11T02:51:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.382932'} 2025-09-11 02:51:53,610 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:51:53,611 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-51965565 passed 2025-09-11 02:51:53,611 - DEBUG - ====Verifying policy data for ctest-left_vn-51965565 in API_Server ====== 2025-09-11 02:51:53,611 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:53,617 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:53,628 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:53,720 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e2fb2ef1-d417-4201-a6f9-61546849310f 2025-09-11 02:51:53,729 - DEBUG - =>VN ctest-left_vn-51965565 has no policy to be verified 2025-09-11 02:51:53,729 - DEBUG - Verifying the vn in opserver 2025-09-11 02:51:53,729 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565 virtual network link through opserver 10.0.0.249 2025-09-11 02:51:53,729 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:51:53,741 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565?flat'} 2025-09-11 02:51:53,741 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565 virtual network link through opserver 10.0.0.22 2025-09-11 02:51:53,741 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:51:53,753 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565?flat'} 2025-09-11 02:51:53,753 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565 virtual network link through opserver 10.0.0.49 2025-09-11 02:51:53,753 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:51:53,767 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565?flat'} 2025-09-11 02:51:53,767 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-11850212:ctest-left_vn-51965565 is found in opserver 2025-09-11 02:51:53,789 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:51:53,802 - DEBUG - VRF ids for VN ctest-left_vn-51965565: {} 2025-09-11 02:51:54,058 - DEBUG - Response for create_network : {'network': {'id': '28f04718-71b1-4520-a4f6-120daecae948', 'name': 'ctest-right_vn-55620537', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-11850212', 'ctest-right_vn-55620537'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:51:54,267 - DEBUG - Response for create_subnet : {'subnet': {'id': '6a919973-8229-4524-9ddd-9cf5a707766f', 'name': '', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'network_id': '28f04718-71b1-4520-a4f6-120daecae948', 'ip_version': 4, 'cidr': '164.218.198.192/26', 'allocation_pools': [{'start': '164.218.198.194', 'end': '164.218.198.254'}], 'gateway_ip': '164.218.198.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '164.218.198.194', 'tags': [], 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9'}} 2025-09-11 02:51:54,287 - INFO - Created VN ctest-right_vn-55620537 2025-09-11 02:51:54,298 - DEBUG - VN ctest-right_vn-55620537 UUID is 28f04718-71b1-4520-a4f6-120daecae948 2025-09-11 02:51:54,371 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:54,376 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:54,387 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:54,472 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/28f04718-71b1-4520-a4f6-120daecae948 2025-09-11 02:51:54,484 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/28f04718-71b1-4520-a4f6-120daecae948 2025-09-11 02:51:54,493 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84bf68a3-3352-49cb-955e-3ef4557706a5 2025-09-11 02:51:54,499 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84bf68a3-3352-49cb-955e-3ef4557706a5 2025-09-11 02:51:54,506 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/863b1cfe-cfd6-4503-9ea1-554138af9834 2025-09-11 02:51:54,513 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:51:54,513 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/28f04718-71b1-4520-a4f6-120daecae948 2025-09-11 02:51:54,522 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84bf68a3-3352-49cb-955e-3ef4557706a5 2025-09-11 02:51:54,536 - INFO - Verified VN network id 16 for VN 28f04718-71b1-4520-a4f6-120daecae948 2025-09-11 02:51:54,536 - INFO - Verifications in API Server for VN ctest-right_vn-55620537 passed 2025-09-11 02:51:54,537 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/28f04718-71b1-4520-a4f6-120daecae948 2025-09-11 02:51:54,546 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84bf68a3-3352-49cb-955e-3ef4557706a5 2025-09-11 02:51:54,553 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84bf68a3-3352-49cb-955e-3ef4557706a5 2025-09-11 02:51:54,561 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/863b1cfe-cfd6-4503-9ea1-554138af9834 2025-09-11 02:51:54,574 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2949935926239905056', 'uuid-lslong': '11886708116467411272'}, 'enable': 'true', 'created': '2025-09-11T02:51:54', 'last-modified': '2025-09-11T02:51:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.364013'} 2025-09-11 02:51:54,581 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:51:54,586 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2949935926239905056', 'uuid-lslong': '11886708116467411272'}, 'enable': 'true', 'created': '2025-09-11T02:51:54', 'last-modified': '2025-09-11T02:51:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.379003'} 2025-09-11 02:51:54,592 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:51:54,598 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2949935926239905056', 'uuid-lslong': '11886708116467411272'}, 'enable': 'true', 'created': '2025-09-11T02:51:54', 'last-modified': '2025-09-11T02:51:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.389467'} 2025-09-11 02:51:54,605 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:51:54,605 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-55620537 passed 2025-09-11 02:51:54,606 - DEBUG - ====Verifying policy data for ctest-right_vn-55620537 in API_Server ====== 2025-09-11 02:51:54,606 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:54,613 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:54,627 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:54,726 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/28f04718-71b1-4520-a4f6-120daecae948 2025-09-11 02:51:54,738 - DEBUG - =>VN ctest-right_vn-55620537 has no policy to be verified 2025-09-11 02:51:54,738 - DEBUG - Verifying the vn in opserver 2025-09-11 02:51:54,738 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537 virtual network link through opserver 10.0.0.249 2025-09-11 02:51:54,738 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:51:54,750 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537?flat'} 2025-09-11 02:51:54,750 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537 virtual network link through opserver 10.0.0.22 2025-09-11 02:51:54,750 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:51:54,763 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537?flat'} 2025-09-11 02:51:54,763 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537 virtual network link through opserver 10.0.0.49 2025-09-11 02:51:54,763 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:51:54,777 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537?flat'} 2025-09-11 02:51:54,777 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-11850212:ctest-right_vn-55620537 is found in opserver 2025-09-11 02:51:54,804 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:51:54,816 - DEBUG - VRF ids for VN ctest-right_vn-55620537: {} 2025-09-11 02:51:55,083 - DEBUG - Response for create_network : {'network': {'id': '165b0284-583a-4653-91dc-42ebd162d90d', 'name': 'ctest-trans_left_vn-70294476', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-11850212', 'ctest-trans_left_vn-70294476'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:51:55,338 - DEBUG - Response for create_subnet : {'subnet': {'id': '9c1d63e7-e015-4cf4-863d-9dfb82d1be03', 'name': '', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'network_id': '165b0284-583a-4653-91dc-42ebd162d90d', 'ip_version': 4, 'cidr': '147.10.3.0/26', 'allocation_pools': [{'start': '147.10.3.2', 'end': '147.10.3.62'}], 'gateway_ip': '147.10.3.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '147.10.3.2', 'tags': [], 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9'}} 2025-09-11 02:51:55,360 - INFO - Created VN ctest-trans_left_vn-70294476 2025-09-11 02:51:55,374 - DEBUG - VN ctest-trans_left_vn-70294476 UUID is 165b0284-583a-4653-91dc-42ebd162d90d 2025-09-11 02:51:55,442 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:55,448 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:55,458 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:55,557 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/165b0284-583a-4653-91dc-42ebd162d90d 2025-09-11 02:51:55,567 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/165b0284-583a-4653-91dc-42ebd162d90d 2025-09-11 02:51:55,576 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f1c9d5fb-aa42-428f-8872-3ef882439ed2 2025-09-11 02:51:55,585 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f1c9d5fb-aa42-428f-8872-3ef882439ed2 2025-09-11 02:51:55,592 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6ba98de9-000e-42fe-876f-c251408b7038 2025-09-11 02:51:55,598 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:51:55,598 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/165b0284-583a-4653-91dc-42ebd162d90d 2025-09-11 02:51:55,607 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f1c9d5fb-aa42-428f-8872-3ef882439ed2 2025-09-11 02:51:55,623 - INFO - Verified VN network id 17 for VN 165b0284-583a-4653-91dc-42ebd162d90d 2025-09-11 02:51:55,623 - INFO - Verifications in API Server for VN ctest-trans_left_vn-70294476 passed 2025-09-11 02:51:55,623 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/165b0284-583a-4653-91dc-42ebd162d90d 2025-09-11 02:51:55,632 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f1c9d5fb-aa42-428f-8872-3ef882439ed2 2025-09-11 02:51:55,641 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f1c9d5fb-aa42-428f-8872-3ef882439ed2 2025-09-11 02:51:55,648 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6ba98de9-000e-42fe-876f-c251408b7038 2025-09-11 02:51:55,660 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1610884059154237011', 'uuid-lslong': '10510349210973559053'}, 'enable': 'true', 'created': '2025-09-11T02:51:55', 'last-modified': '2025-09-11T02:51:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.390796'} 2025-09-11 02:51:55,667 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:51:55,672 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1610884059154237011', 'uuid-lslong': '10510349210973559053'}, 'enable': 'true', 'created': '2025-09-11T02:51:55', 'last-modified': '2025-09-11T02:51:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402901'} 2025-09-11 02:51:55,677 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:51:55,683 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1610884059154237011', 'uuid-lslong': '10510349210973559053'}, 'enable': 'true', 'created': '2025-09-11T02:51:55', 'last-modified': '2025-09-11T02:51:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.411985'} 2025-09-11 02:51:55,689 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-11 02:51:55,689 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-70294476 passed 2025-09-11 02:51:55,689 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-70294476 in API_Server ====== 2025-09-11 02:51:55,689 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:55,695 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:55,706 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:55,815 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/165b0284-583a-4653-91dc-42ebd162d90d 2025-09-11 02:51:55,826 - DEBUG - =>VN ctest-trans_left_vn-70294476 has no policy to be verified 2025-09-11 02:51:55,826 - DEBUG - Verifying the vn in opserver 2025-09-11 02:51:55,827 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476 virtual network link through opserver 10.0.0.249 2025-09-11 02:51:55,827 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:51:55,838 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476?flat'} 2025-09-11 02:51:55,838 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476 virtual network link through opserver 10.0.0.22 2025-09-11 02:51:55,838 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:51:55,850 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476?flat'} 2025-09-11 02:51:55,850 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476 virtual network link through opserver 10.0.0.49 2025-09-11 02:51:55,851 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:51:55,862 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476?flat'} 2025-09-11 02:51:55,862 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-11850212:ctest-trans_left_vn-70294476 is found in opserver 2025-09-11 02:51:55,884 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:51:55,893 - DEBUG - VRF ids for VN ctest-trans_left_vn-70294476: {} 2025-09-11 02:51:56,149 - DEBUG - Response for create_network : {'network': {'id': '8c2fb6ac-78b7-4266-8d19-f80dd9e5fa1f', 'name': 'ctest-trans_right_vn-86852063', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-11850212', 'ctest-trans_right_vn-86852063'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:51:56,389 - DEBUG - Response for create_subnet : {'subnet': {'id': '83cda50b-e799-4627-9fb3-42630b8398c0', 'name': '', 'tenant_id': '77c1b57aa5f5487d8160eb7e9758b9b9', 'network_id': '8c2fb6ac-78b7-4266-8d19-f80dd9e5fa1f', 'ip_version': 4, 'cidr': '191.173.233.0/26', 'allocation_pools': [{'start': '191.173.233.2', 'end': '191.173.233.62'}], 'gateway_ip': '191.173.233.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '191.173.233.2', 'tags': [], 'project_id': '77c1b57aa5f5487d8160eb7e9758b9b9'}} 2025-09-11 02:51:56,409 - INFO - Created VN ctest-trans_right_vn-86852063 2025-09-11 02:51:56,421 - DEBUG - VN ctest-trans_right_vn-86852063 UUID is 8c2fb6ac-78b7-4266-8d19-f80dd9e5fa1f 2025-09-11 02:51:56,488 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:56,494 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:56,505 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:56,612 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/8c2fb6ac-78b7-4266-8d19-f80dd9e5fa1f 2025-09-11 02:51:56,622 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/8c2fb6ac-78b7-4266-8d19-f80dd9e5fa1f 2025-09-11 02:51:56,631 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/233d8288-466d-480c-901d-ffb84ce7db8f 2025-09-11 02:51:56,639 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/233d8288-466d-480c-901d-ffb84ce7db8f 2025-09-11 02:51:56,646 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/065c4e63-9c0f-4fab-9782-066caa1596c2 2025-09-11 02:51:56,652 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-11 02:51:56,652 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/8c2fb6ac-78b7-4266-8d19-f80dd9e5fa1f 2025-09-11 02:51:56,661 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/233d8288-466d-480c-901d-ffb84ce7db8f 2025-09-11 02:51:56,678 - INFO - Verified VN network id 18 for VN 8c2fb6ac-78b7-4266-8d19-f80dd9e5fa1f 2025-09-11 02:51:56,678 - INFO - Verifications in API Server for VN ctest-trans_right_vn-86852063 passed 2025-09-11 02:51:56,678 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/8c2fb6ac-78b7-4266-8d19-f80dd9e5fa1f 2025-09-11 02:51:56,687 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/233d8288-466d-480c-901d-ffb84ce7db8f 2025-09-11 02:51:56,694 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/233d8288-466d-480c-901d-ffb84ce7db8f 2025-09-11 02:51:56,701 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/065c4e63-9c0f-4fab-9782-066caa1596c2 2025-09-11 02:51:56,712 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10101493341091218022', 'uuid-lslong': '10167430372139596319'}, 'enable': 'true', 'created': '2025-09-11T02:51:56', 'last-modified': '2025-09-11T02:51:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.369790'} 2025-09-11 02:51:56,718 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-11 02:51:56,722 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10101493341091218022', 'uuid-lslong': '10167430372139596319'}, 'enable': 'true', 'created': '2025-09-11T02:51:56', 'last-modified': '2025-09-11T02:51:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.374746'} 2025-09-11 02:51:56,727 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-11 02:51:56,733 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-11850212', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10101493341091218022', 'uuid-lslong': '10167430372139596319'}, 'enable': 'true', 'created': '2025-09-11T02:51:56', 'last-modified': '2025-09-11T02:51:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.386537'} 2025-09-11 02:51:56,738 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-11 02:51:56,738 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-86852063 passed 2025-09-11 02:51:56,738 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-86852063 in API_Server ====== 2025-09-11 02:51:56,738 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:51:56,744 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:51:56,755 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:51:56,846 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/8c2fb6ac-78b7-4266-8d19-f80dd9e5fa1f 2025-09-11 02:51:56,859 - DEBUG - =>VN ctest-trans_right_vn-86852063 has no policy to be verified 2025-09-11 02:51:56,860 - DEBUG - Verifying the vn in opserver 2025-09-11 02:51:56,860 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063 virtual network link through opserver 10.0.0.249 2025-09-11 02:51:56,860 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:51:56,872 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063?flat'} 2025-09-11 02:51:56,872 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063 virtual network link through opserver 10.0.0.22 2025-09-11 02:51:56,872 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:51:56,884 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063?flat'} 2025-09-11 02:51:56,884 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063 virtual network link through opserver 10.0.0.49 2025-09-11 02:51:56,884 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:51:56,896 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063?flat'} 2025-09-11 02:51:56,896 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-11850212:ctest-trans_right_vn-86852063 is found in opserver 2025-09-11 02:51:56,918 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:51:56,929 - DEBUG - VRF ids for VN ctest-trans_right_vn-86852063: {} 2025-09-11 02:51:58,149 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-1) 2025-09-11 02:51:59,460 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-2) 2025-09-11 02:51:59,460 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-97823401'] 2025-09-11 02:51:59,761 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-97823401'] created succesfully 2025-09-11 02:52:00,093 - DEBUG - Image by name tiny_trans_fw not found 2025-09-11 02:52:00,093 - DEBUG - Installing image tiny_trans_fw 2025-09-11 02:52:00,093 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-09-11 02:52:00,093 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz 2025-09-11 02:52:00,094 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz 2025-09-11 02:52:00,115 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz -O /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-11 02:52:00,142 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-11 02:52:00,142 - DEBUG - Unzip image 2025-09-11 02:52:00,142 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-11 02:52:00,160 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-09-11 02:52:00,161 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-97823401'] 2025-09-11 02:52:00,251 - INFO - Service template: ['default-domain', 'ctest-service_template_1-97823401'] deleted successfully. 2025-09-11 02:52:00,251 - INFO - Skip interface_detach for VM ctest-right_vm-86794261 in state ERROR 2025-09-11 02:52:00,251 - INFO - Deleting VM ctest-right_vm-86794261 2025-09-11 02:52:00,251 - ERROR - VM ctest-right_vm-86794261 has failed to come up 2025-09-11 02:52:00,252 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-09-11T02:51:59Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-09-11 02:52:00,252 - INFO - Skip interface_detach for VM ctest-left_vm-43895139 in state BUILD 2025-09-11 02:52:00,252 - INFO - Deleting VM ctest-left_vm-43895139 2025-09-11 02:52:00,252 - ERROR - VM ctest-left_vm-43895139 has failed to come up 2025-09-11 02:52:00,252 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:00,252 - ERROR - VM ctest-left_vm-43895139 has failed to come up 2025-09-11 02:52:00,252 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:00,332 - INFO - Deleting VN ctest-trans_right_vn-86852063 2025-09-11 02:52:00,494 - DEBUG - Response for deleting network () 2025-09-11 02:52:00,495 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/233d8288-466d-480c-901d-ffb84ce7db8f 2025-09-11 02:52:00,500 - DEBUG - Response Code: 404 2025-09-11 02:52:00,500 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:00,506 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:00,562 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:52:00,670 - INFO - Validated that VN ctest-trans_right_vn-86852063 is not found in API Server 2025-09-11 02:52:00,682 - DEBUG - VN ctest-trans_right_vn-86852063 is not present in Agent 10.0.0.254 2025-09-11 02:52:00,694 - DEBUG - VN ctest-trans_right_vn-86852063 is not present in Agent 10.0.0.19 2025-09-11 02:52:00,694 - INFO - Validated that VN ctest-trans_right_vn-86852063 is not in any agent 2025-09-11 02:52:00,733 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-86852063 info 2025-09-11 02:52:00,733 - INFO - Deleting VN ctest-trans_left_vn-70294476 2025-09-11 02:52:00,886 - DEBUG - Response for deleting network () 2025-09-11 02:52:00,886 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f1c9d5fb-aa42-428f-8872-3ef882439ed2 2025-09-11 02:52:00,904 - DEBUG - Response Code: 404 2025-09-11 02:52:00,904 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:00,931 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:00,952 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:52:01,070 - INFO - Validated that VN ctest-trans_left_vn-70294476 is not found in API Server 2025-09-11 02:52:01,083 - DEBUG - VN ctest-trans_left_vn-70294476 is not present in Agent 10.0.0.254 2025-09-11 02:52:01,094 - DEBUG - VN ctest-trans_left_vn-70294476 is not present in Agent 10.0.0.19 2025-09-11 02:52:01,094 - INFO - Validated that VN ctest-trans_left_vn-70294476 is not in any agent 2025-09-11 02:52:01,144 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-70294476 info 2025-09-11 02:52:01,144 - INFO - Deleting VN ctest-right_vn-55620537 2025-09-11 02:52:01,353 - DEBUG - Response for deleting network () 2025-09-11 02:52:01,353 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84bf68a3-3352-49cb-955e-3ef4557706a5 2025-09-11 02:52:01,359 - DEBUG - Response Code: 404 2025-09-11 02:52:01,360 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:01,376 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:01,391 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:52:01,499 - INFO - Validated that VN ctest-right_vn-55620537 is not found in API Server 2025-09-11 02:52:01,509 - DEBUG - VN ctest-right_vn-55620537 is not present in Agent 10.0.0.254 2025-09-11 02:52:01,522 - DEBUG - VN ctest-right_vn-55620537 is not present in Agent 10.0.0.19 2025-09-11 02:52:01,522 - INFO - Validated that VN ctest-right_vn-55620537 is not in any agent 2025-09-11 02:52:01,573 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-55620537 info 2025-09-11 02:52:01,573 - INFO - Deleting VN ctest-left_vn-51965565 2025-09-11 02:52:01,731 - DEBUG - Response for deleting network () 2025-09-11 02:52:01,731 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/9bbaee2a-4f61-49fd-8feb-41df09111630 2025-09-11 02:52:01,737 - DEBUG - Response Code: 404 2025-09-11 02:52:01,737 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:01,752 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:01,808 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:52:01,890 - INFO - Validated that VN ctest-left_vn-51965565 is not found in API Server 2025-09-11 02:52:01,905 - DEBUG - VN ctest-left_vn-51965565 is not present in Agent 10.0.0.254 2025-09-11 02:52:01,916 - DEBUG - VN ctest-left_vn-51965565 is not present in Agent 10.0.0.19 2025-09-11 02:52:01,916 - INFO - Validated that VN ctest-left_vn-51965565 is not in any agent 2025-09-11 02:52:01,952 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-51965565 info 2025-09-11 02:52:01,953 - INFO - Deleting VN ctest-mgmt_vn-57043583 2025-09-11 02:52:02,094 - DEBUG - Response for deleting network () 2025-09-11 02:52:02,095 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/194d8e0a-cdf9-411c-8d1a-d3dafa54ad6d 2025-09-11 02:52:02,100 - DEBUG - Response Code: 404 2025-09-11 02:52:02,101 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:02,114 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:02,140 - DEBUG - Requesting: http://10.0.0.249:8082/project/77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:52:02,227 - INFO - Validated that VN ctest-mgmt_vn-57043583 is not found in API Server 2025-09-11 02:52:02,246 - DEBUG - VN ctest-mgmt_vn-57043583 is not present in Agent 10.0.0.254 2025-09-11 02:52:02,258 - DEBUG - VN ctest-mgmt_vn-57043583 is not present in Agent 10.0.0.19 2025-09-11 02:52:02,258 - INFO - Validated that VN ctest-mgmt_vn-57043583 is not in any agent 2025-09-11 02:52:02,294 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-57043583 info 2025-09-11 02:52:03,580 - DEBUG - No XMPP flaps were noticed during the test 2025-09-11 02:52:03,580 - INFO - 2025-09-11 02:52:03,580 - INFO - END TEST : test_svc_v2_transparent_datapath : SKIPPED[0:00:13] 2025-09-11 02:52:03,580 - INFO - -------------------------------------------------------------------------------- 2025-09-11 02:52:04,293 - INFO - Deleted project: ctest-TestSvcRegr-11850212, ID : 77c1b57a-a5f5-487d-8160-eb7e9758b9b9 2025-09-11 02:52:04,485 - INFO - Domain Default found not creating 2025-09-11 02:52:04,653 - INFO - Project ctest-TestSvcRegr-43407358 not found, creating it 2025-09-11 02:52:05,177 - INFO - Created Project:ctest-TestSvcRegr-43407358, ID : c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:06,711 - INFO - ================================================================================ 2025-09-11 02:52:06,711 - INFO - STARTING TEST : test_svc_CEM_22032 2025-09-11 02:52:07,988 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.19': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-09-11 02:52:07,989 - INFO - Initial checks done. Running the testcase now 2025-09-11 02:52:07,989 - INFO - 2025-09-11 02:52:08,621 - DEBUG - Response for create_network : {'network': {'id': 'b59c5e5f-5d8b-4a97-ad03-1848ee886ce5', 'name': 'ctest-mgmt_vn-05519693', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'project_id': 'c622585963604a5f8efc65b54b8817ca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43407358', 'ctest-mgmt_vn-05519693'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:08,891 - DEBUG - Response for create_subnet : {'subnet': {'id': '08a0ea4b-8769-4538-baa2-9f0d0db561d0', 'name': '', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'network_id': 'b59c5e5f-5d8b-4a97-ad03-1848ee886ce5', 'ip_version': 4, 'cidr': '195.134.106.192/26', 'allocation_pools': [{'start': '195.134.106.194', 'end': '195.134.106.254'}], 'gateway_ip': '195.134.106.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '195.134.106.194', 'tags': [], 'project_id': 'c622585963604a5f8efc65b54b8817ca'}} 2025-09-11 02:52:08,912 - INFO - Created VN ctest-mgmt_vn-05519693 2025-09-11 02:52:08,924 - DEBUG - VN ctest-mgmt_vn-05519693 UUID is b59c5e5f-5d8b-4a97-ad03-1848ee886ce5 2025-09-11 02:52:09,002 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:09,322 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:09,348 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:09,362 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:09,456 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/b59c5e5f-5d8b-4a97-ad03-1848ee886ce5 2025-09-11 02:52:09,473 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/b59c5e5f-5d8b-4a97-ad03-1848ee886ce5 2025-09-11 02:52:09,484 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84dc9750-9f94-436f-b016-6c29cb415e5b 2025-09-11 02:52:09,495 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84dc9750-9f94-436f-b016-6c29cb415e5b 2025-09-11 02:52:09,508 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/25279ba4-2d22-4268-af12-f40bfb8608e4 2025-09-11 02:52:09,516 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:09,516 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/b59c5e5f-5d8b-4a97-ad03-1848ee886ce5 2025-09-11 02:52:09,527 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84dc9750-9f94-436f-b016-6c29cb415e5b 2025-09-11 02:52:09,541 - INFO - Verified VN network id 14 for VN b59c5e5f-5d8b-4a97-ad03-1848ee886ce5 2025-09-11 02:52:09,541 - INFO - Verifications in API Server for VN ctest-mgmt_vn-05519693 passed 2025-09-11 02:52:09,541 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/b59c5e5f-5d8b-4a97-ad03-1848ee886ce5 2025-09-11 02:52:09,551 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84dc9750-9f94-436f-b016-6c29cb415e5b 2025-09-11 02:52:09,558 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84dc9750-9f94-436f-b016-6c29cb415e5b 2025-09-11 02:52:09,566 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/25279ba4-2d22-4268-af12-f40bfb8608e4 2025-09-11 02:52:09,578 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13086438380916132503', 'uuid-lslong': '12466834895010295013'}, 'enable': 'true', 'created': '2025-09-11T02:52:08', 'last-modified': '2025-09-11T02:52:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.733429'} 2025-09-11 02:52:09,585 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:09,591 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13086438380916132503', 'uuid-lslong': '12466834895010295013'}, 'enable': 'true', 'created': '2025-09-11T02:52:08', 'last-modified': '2025-09-11T02:52:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.734867'} 2025-09-11 02:52:09,597 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:09,604 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13086438380916132503', 'uuid-lslong': '12466834895010295013'}, 'enable': 'true', 'created': '2025-09-11T02:52:08', 'last-modified': '2025-09-11T02:52:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.750503'} 2025-09-11 02:52:09,609 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:09,609 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-05519693 passed 2025-09-11 02:52:09,610 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-05519693 in API_Server ====== 2025-09-11 02:52:09,610 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:09,616 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:09,627 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:09,723 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/b59c5e5f-5d8b-4a97-ad03-1848ee886ce5 2025-09-11 02:52:09,735 - DEBUG - =>VN ctest-mgmt_vn-05519693 has no policy to be verified 2025-09-11 02:52:09,735 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:09,735 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:09,735 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:10,027 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:10,080 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693?flat'} 2025-09-11 02:52:10,080 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:10,080 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:10,369 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:10,421 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693?flat'} 2025-09-11 02:52:10,421 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:10,421 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:10,712 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:10,764 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693?flat'} 2025-09-11 02:52:10,764 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-05519693 is found in opserver 2025-09-11 02:52:10,784 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:10,795 - DEBUG - VRF ids for VN ctest-mgmt_vn-05519693: {} 2025-09-11 02:52:11,061 - DEBUG - Response for create_network : {'network': {'id': 'd2d0a119-6496-4440-93ae-13c2bb242d9e', 'name': 'service-left-vn-71407253', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'project_id': 'c622585963604a5f8efc65b54b8817ca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43407358', 'service-left-vn-71407253'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:11,296 - DEBUG - Response for create_subnet : {'subnet': {'id': '6a1830d1-869a-4a53-97fc-65a01b49855d', 'name': '', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'network_id': 'd2d0a119-6496-4440-93ae-13c2bb242d9e', 'ip_version': 4, 'cidr': '132.68.177.192/26', 'allocation_pools': [{'start': '132.68.177.194', 'end': '132.68.177.254'}], 'gateway_ip': '132.68.177.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '132.68.177.194', 'tags': [], 'project_id': 'c622585963604a5f8efc65b54b8817ca'}} 2025-09-11 02:52:11,316 - INFO - Created VN service-left-vn-71407253 2025-09-11 02:52:11,330 - DEBUG - VN service-left-vn-71407253 UUID is d2d0a119-6496-4440-93ae-13c2bb242d9e 2025-09-11 02:52:11,395 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:11,401 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:11,411 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:11,502 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d2d0a119-6496-4440-93ae-13c2bb242d9e 2025-09-11 02:52:11,513 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d2d0a119-6496-4440-93ae-13c2bb242d9e 2025-09-11 02:52:11,522 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/90f3c640-4161-431e-a0f5-4280e1a6a92c 2025-09-11 02:52:11,529 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/90f3c640-4161-431e-a0f5-4280e1a6a92c 2025-09-11 02:52:11,536 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/85351cb2-fae4-47f9-92ed-b020c02216d4 2025-09-11 02:52:11,542 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:11,542 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d2d0a119-6496-4440-93ae-13c2bb242d9e 2025-09-11 02:52:11,549 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/90f3c640-4161-431e-a0f5-4280e1a6a92c 2025-09-11 02:52:11,564 - INFO - Verified VN network id 15 for VN d2d0a119-6496-4440-93ae-13c2bb242d9e 2025-09-11 02:52:11,565 - INFO - Verifications in API Server for VN service-left-vn-71407253 passed 2025-09-11 02:52:11,565 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d2d0a119-6496-4440-93ae-13c2bb242d9e 2025-09-11 02:52:11,574 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/90f3c640-4161-431e-a0f5-4280e1a6a92c 2025-09-11 02:52:11,584 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/90f3c640-4161-431e-a0f5-4280e1a6a92c 2025-09-11 02:52:11,592 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/85351cb2-fae4-47f9-92ed-b020c02216d4 2025-09-11 02:52:11,608 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15190818673554506816', 'uuid-lslong': '10641464696607354270'}, 'enable': 'true', 'created': '2025-09-11T02:52:11', 'last-modified': '2025-09-11T02:52:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.345944'} 2025-09-11 02:52:11,615 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:11,620 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15190818673554506816', 'uuid-lslong': '10641464696607354270'}, 'enable': 'true', 'created': '2025-09-11T02:52:11', 'last-modified': '2025-09-11T02:52:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.362033'} 2025-09-11 02:52:11,626 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:11,631 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15190818673554506816', 'uuid-lslong': '10641464696607354270'}, 'enable': 'true', 'created': '2025-09-11T02:52:11', 'last-modified': '2025-09-11T02:52:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.372448'} 2025-09-11 02:52:11,636 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:11,637 - INFO - On all control nodes, Config, RI and RT verification for VN service-left-vn-71407253 passed 2025-09-11 02:52:11,637 - DEBUG - ====Verifying policy data for service-left-vn-71407253 in API_Server ====== 2025-09-11 02:52:11,637 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:11,642 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:11,652 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:11,742 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d2d0a119-6496-4440-93ae-13c2bb242d9e 2025-09-11 02:52:11,764 - DEBUG - =>VN service-left-vn-71407253 has no policy to be verified 2025-09-11 02:52:11,765 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:11,765 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:11,765 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:11,831 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253?flat'} 2025-09-11 02:52:11,831 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:11,831 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:11,896 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253?flat'} 2025-09-11 02:52:11,896 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:11,896 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:11,949 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253?flat'} 2025-09-11 02:52:11,949 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43407358:service-left-vn-71407253 is found in opserver 2025-09-11 02:52:11,970 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:11,979 - DEBUG - VRF ids for VN service-left-vn-71407253: {} 2025-09-11 02:52:12,234 - DEBUG - Response for create_network : {'network': {'id': '917b83f1-0697-45d0-a2f0-58efc367f3b0', 'name': 'service-right-vn-50691737', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'project_id': 'c622585963604a5f8efc65b54b8817ca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43407358', 'service-right-vn-50691737'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:12,483 - DEBUG - Response for create_subnet : {'subnet': {'id': '4be363b5-55ca-4b5d-b59d-0a54943d69cf', 'name': '', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'network_id': '917b83f1-0697-45d0-a2f0-58efc367f3b0', 'ip_version': 4, 'cidr': '66.97.112.0/26', 'allocation_pools': [{'start': '66.97.112.2', 'end': '66.97.112.62'}], 'gateway_ip': '66.97.112.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '66.97.112.2', 'tags': [], 'project_id': 'c622585963604a5f8efc65b54b8817ca'}} 2025-09-11 02:52:12,505 - INFO - Created VN service-right-vn-50691737 2025-09-11 02:52:12,515 - DEBUG - VN service-right-vn-50691737 UUID is 917b83f1-0697-45d0-a2f0-58efc367f3b0 2025-09-11 02:52:12,586 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:12,592 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:12,602 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:12,691 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/917b83f1-0697-45d0-a2f0-58efc367f3b0 2025-09-11 02:52:12,702 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/917b83f1-0697-45d0-a2f0-58efc367f3b0 2025-09-11 02:52:12,711 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08be0af6-4de1-4ed2-ace4-1d4bd9f4081e 2025-09-11 02:52:12,720 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08be0af6-4de1-4ed2-ace4-1d4bd9f4081e 2025-09-11 02:52:12,727 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/558d84ee-8da3-4a11-b879-ab371980451e 2025-09-11 02:52:12,733 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:12,733 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/917b83f1-0697-45d0-a2f0-58efc367f3b0 2025-09-11 02:52:12,742 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08be0af6-4de1-4ed2-ace4-1d4bd9f4081e 2025-09-11 02:52:12,757 - INFO - Verified VN network id 16 for VN 917b83f1-0697-45d0-a2f0-58efc367f3b0 2025-09-11 02:52:12,757 - INFO - Verifications in API Server for VN service-right-vn-50691737 passed 2025-09-11 02:52:12,757 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/917b83f1-0697-45d0-a2f0-58efc367f3b0 2025-09-11 02:52:12,766 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08be0af6-4de1-4ed2-ace4-1d4bd9f4081e 2025-09-11 02:52:12,773 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08be0af6-4de1-4ed2-ace4-1d4bd9f4081e 2025-09-11 02:52:12,780 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/558d84ee-8da3-4a11-b879-ab371980451e 2025-09-11 02:52:12,790 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10483117628855895504', 'uuid-lslong': '11740982015353680816'}, 'enable': 'true', 'created': '2025-09-11T02:52:12', 'last-modified': '2025-09-11T02:52:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.346188'} 2025-09-11 02:52:12,797 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:12,802 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10483117628855895504', 'uuid-lslong': '11740982015353680816'}, 'enable': 'true', 'created': '2025-09-11T02:52:12', 'last-modified': '2025-09-11T02:52:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.363749'} 2025-09-11 02:52:12,808 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:12,813 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10483117628855895504', 'uuid-lslong': '11740982015353680816'}, 'enable': 'true', 'created': '2025-09-11T02:52:12', 'last-modified': '2025-09-11T02:52:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.374855'} 2025-09-11 02:52:12,819 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:12,819 - INFO - On all control nodes, Config, RI and RT verification for VN service-right-vn-50691737 passed 2025-09-11 02:52:12,819 - DEBUG - ====Verifying policy data for service-right-vn-50691737 in API_Server ====== 2025-09-11 02:52:12,819 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:12,825 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:12,835 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:12,925 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/917b83f1-0697-45d0-a2f0-58efc367f3b0 2025-09-11 02:52:12,934 - DEBUG - =>VN service-right-vn-50691737 has no policy to be verified 2025-09-11 02:52:12,934 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:12,934 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:12,934 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:12,989 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737?flat'} 2025-09-11 02:52:12,989 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:12,989 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:13,041 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737?flat'} 2025-09-11 02:52:13,041 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:13,042 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:13,092 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737?flat'} 2025-09-11 02:52:13,092 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43407358:service-right-vn-50691737 is found in opserver 2025-09-11 02:52:13,114 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:13,126 - DEBUG - VRF ids for VN service-right-vn-50691737: {} 2025-09-11 02:52:13,306 - DEBUG - Services list from nova: [, , , ] 2025-09-11 02:52:14,356 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-1) 2025-09-11 02:52:15,724 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-2) 2025-09-11 02:52:15,724 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-85981799'] 2025-09-11 02:52:16,009 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-85981799'] created succesfully 2025-09-11 02:52:16,364 - DEBUG - Image by name tiny_nat_fw not found 2025-09-11 02:52:16,364 - DEBUG - Installing image tiny_nat_fw 2025-09-11 02:52:16,364 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-09-11 02:52:16,364 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:52:16,364 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:52:16,364 - DEBUG - Unzip image 2025-09-11 02:52:16,364 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:52:16,382 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-09-11 02:52:16,382 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-85981799'] 2025-09-11 02:52:16,471 - INFO - Service template: ['default-domain', 'ctest-service_template_1-85981799'] deleted successfully. 2025-09-11 02:52:16,471 - INFO - Skip interface_detach for VM ctest-right_vm-74056272 in state BUILD 2025-09-11 02:52:16,471 - INFO - Deleting VM ctest-right_vm-74056272 2025-09-11 02:52:16,496 - ERROR - VM ctest-right_vm-74056272 has failed to come up 2025-09-11 02:52:16,497 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:16,497 - ERROR - VM ctest-right_vm-74056272 has failed to come up 2025-09-11 02:52:16,497 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:16,708 - INFO - Skip interface_detach for VM ctest-left_vm-28840157 in state BUILD 2025-09-11 02:52:16,708 - INFO - Deleting VM ctest-left_vm-28840157 2025-09-11 02:52:16,708 - ERROR - VM ctest-left_vm-28840157 has failed to come up 2025-09-11 02:52:16,708 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:16,708 - ERROR - VM ctest-left_vm-28840157 has failed to come up 2025-09-11 02:52:16,708 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:16,780 - INFO - Deleting VN service-right-vn-50691737 2025-09-11 02:52:16,912 - DEBUG - Response for deleting network () 2025-09-11 02:52:16,913 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08be0af6-4de1-4ed2-ace4-1d4bd9f4081e 2025-09-11 02:52:16,919 - DEBUG - Response Code: 404 2025-09-11 02:52:16,919 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:16,930 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:16,945 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:17,020 - INFO - Validated that VN service-right-vn-50691737 is not found in API Server 2025-09-11 02:52:17,033 - DEBUG - VN service-right-vn-50691737 is not present in Agent 10.0.0.254 2025-09-11 02:52:17,045 - DEBUG - VN service-right-vn-50691737 is not present in Agent 10.0.0.19 2025-09-11 02:52:17,045 - INFO - Validated that VN service-right-vn-50691737 is not in any agent 2025-09-11 02:52:17,080 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-right-vn-50691737 info 2025-09-11 02:52:17,080 - INFO - Deleting VN service-left-vn-71407253 2025-09-11 02:52:17,118 - DEBUG - VN d2d0a119-6496-4440-93ae-13c2bb242d9e still in use: Unable to complete operation on network d2d0a119-6496-4440-93ae-13c2bb242d9e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-4e088112-f78a-4a8c-8c69-ed6d88d670f6'] 2025-09-11 02:52:17,119 - WARNING - Deleting VN service-left-vn-71407253 failed..Will retry 2025-09-11 02:52:19,279 - DEBUG - Response for deleting network () 2025-09-11 02:52:19,279 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/90f3c640-4161-431e-a0f5-4280e1a6a92c 2025-09-11 02:52:19,283 - DEBUG - Response Code: 404 2025-09-11 02:52:19,284 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:19,288 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:19,307 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:19,398 - INFO - Validated that VN service-left-vn-71407253 is not found in API Server 2025-09-11 02:52:19,408 - DEBUG - VN service-left-vn-71407253 is not present in Agent 10.0.0.254 2025-09-11 02:52:19,418 - DEBUG - VN service-left-vn-71407253 is not present in Agent 10.0.0.19 2025-09-11 02:52:19,418 - INFO - Validated that VN service-left-vn-71407253 is not in any agent 2025-09-11 02:52:19,452 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-left-vn-71407253 info 2025-09-11 02:52:19,452 - INFO - Deleting VN ctest-mgmt_vn-05519693 2025-09-11 02:52:19,579 - DEBUG - Response for deleting network () 2025-09-11 02:52:19,579 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/84dc9750-9f94-436f-b016-6c29cb415e5b 2025-09-11 02:52:19,585 - DEBUG - Response Code: 404 2025-09-11 02:52:19,585 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:19,590 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:19,608 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:19,699 - INFO - Validated that VN ctest-mgmt_vn-05519693 is not found in API Server 2025-09-11 02:52:19,711 - DEBUG - VN ctest-mgmt_vn-05519693 is not present in Agent 10.0.0.254 2025-09-11 02:52:19,723 - DEBUG - VN ctest-mgmt_vn-05519693 is not present in Agent 10.0.0.19 2025-09-11 02:52:19,723 - INFO - Validated that VN ctest-mgmt_vn-05519693 is not in any agent 2025-09-11 02:52:19,757 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-05519693 info 2025-09-11 02:52:21,037 - DEBUG - No XMPP flaps were noticed during the test 2025-09-11 02:52:21,037 - INFO - 2025-09-11 02:52:21,037 - INFO - END TEST : test_svc_CEM_22032 : SKIPPED[0:00:15] 2025-09-11 02:52:21,037 - INFO - -------------------------------------------------------------------------------- 2025-09-11 02:52:21,040 - INFO - ================================================================================ 2025-09-11 02:52:21,040 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-09-11 02:52:22,305 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.19': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-09-11 02:52:22,305 - INFO - Initial checks done. Running the testcase now 2025-09-11 02:52:22,305 - INFO - 2025-09-11 02:52:22,597 - DEBUG - Response for create_network : {'network': {'id': '93dbb395-7c4c-4b20-a586-6a1dc5bf0223', 'name': 'ctest-mgmt_vn-89634566', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'project_id': 'c622585963604a5f8efc65b54b8817ca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43407358', 'ctest-mgmt_vn-89634566'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:22,864 - DEBUG - Response for create_subnet : {'subnet': {'id': '86e1036a-61dd-457e-b13f-d501369e8c6c', 'name': '', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'network_id': '93dbb395-7c4c-4b20-a586-6a1dc5bf0223', 'ip_version': 4, 'cidr': '142.165.159.128/26', 'allocation_pools': [{'start': '142.165.159.130', 'end': '142.165.159.190'}], 'gateway_ip': '142.165.159.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '142.165.159.130', 'tags': [], 'project_id': 'c622585963604a5f8efc65b54b8817ca'}} 2025-09-11 02:52:22,885 - INFO - Created VN ctest-mgmt_vn-89634566 2025-09-11 02:52:22,896 - DEBUG - VN ctest-mgmt_vn-89634566 UUID is 93dbb395-7c4c-4b20-a586-6a1dc5bf0223 2025-09-11 02:52:22,971 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:22,978 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:22,990 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:23,072 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/93dbb395-7c4c-4b20-a586-6a1dc5bf0223 2025-09-11 02:52:23,085 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/93dbb395-7c4c-4b20-a586-6a1dc5bf0223 2025-09-11 02:52:23,104 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/123e4122-cb25-49f9-b540-fa58e31d00a6 2025-09-11 02:52:23,115 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/123e4122-cb25-49f9-b540-fa58e31d00a6 2025-09-11 02:52:23,123 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/bef679c3-df9e-47a7-b76d-6640c7f3a14f 2025-09-11 02:52:23,130 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:23,130 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/93dbb395-7c4c-4b20-a586-6a1dc5bf0223 2025-09-11 02:52:23,139 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/123e4122-cb25-49f9-b540-fa58e31d00a6 2025-09-11 02:52:23,154 - INFO - Verified VN network id 14 for VN 93dbb395-7c4c-4b20-a586-6a1dc5bf0223 2025-09-11 02:52:23,154 - INFO - Verifications in API Server for VN ctest-mgmt_vn-89634566 passed 2025-09-11 02:52:23,154 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/93dbb395-7c4c-4b20-a586-6a1dc5bf0223 2025-09-11 02:52:23,165 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/123e4122-cb25-49f9-b540-fa58e31d00a6 2025-09-11 02:52:23,175 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/123e4122-cb25-49f9-b540-fa58e31d00a6 2025-09-11 02:52:23,182 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/bef679c3-df9e-47a7-b76d-6640c7f3a14f 2025-09-11 02:52:23,200 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10654306798091914016', 'uuid-lslong': '11927337339241562659'}, 'enable': 'true', 'created': '2025-09-11T02:52:22', 'last-modified': '2025-09-11T02:52:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.396913'} 2025-09-11 02:52:23,210 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:23,215 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10654306798091914016', 'uuid-lslong': '11927337339241562659'}, 'enable': 'true', 'created': '2025-09-11T02:52:22', 'last-modified': '2025-09-11T02:52:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419970'} 2025-09-11 02:52:23,221 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:23,227 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10654306798091914016', 'uuid-lslong': '11927337339241562659'}, 'enable': 'true', 'created': '2025-09-11T02:52:22', 'last-modified': '2025-09-11T02:52:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.429081'} 2025-09-11 02:52:23,246 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-11 02:52:23,246 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-89634566 passed 2025-09-11 02:52:23,246 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-89634566 in API_Server ====== 2025-09-11 02:52:23,246 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:23,252 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:23,264 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:23,354 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/93dbb395-7c4c-4b20-a586-6a1dc5bf0223 2025-09-11 02:52:23,364 - DEBUG - =>VN ctest-mgmt_vn-89634566 has no policy to be verified 2025-09-11 02:52:23,364 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:23,364 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:23,364 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:23,383 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566?flat'} 2025-09-11 02:52:23,383 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:23,383 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:23,394 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566?flat'} 2025-09-11 02:52:23,395 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:23,395 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:23,408 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566?flat'} 2025-09-11 02:52:23,408 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43407358:ctest-mgmt_vn-89634566 is found in opserver 2025-09-11 02:52:23,436 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:23,447 - DEBUG - VRF ids for VN ctest-mgmt_vn-89634566: {} 2025-09-11 02:52:23,801 - DEBUG - Response for create_network : {'network': {'id': 'a7515521-812e-4a45-b93d-cfc18687f849', 'name': 'ctest-left_vn-94352846', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'project_id': 'c622585963604a5f8efc65b54b8817ca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43407358', 'ctest-left_vn-94352846'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:24,086 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c4a81a89-ea08-435c-9bbc-71d5353ab57f', 'name': '', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'network_id': 'a7515521-812e-4a45-b93d-cfc18687f849', 'ip_version': 4, 'cidr': '120.123.38.64/26', 'allocation_pools': [{'start': '120.123.38.66', 'end': '120.123.38.126'}], 'gateway_ip': '120.123.38.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '120.123.38.66', 'tags': [], 'project_id': 'c622585963604a5f8efc65b54b8817ca'}} 2025-09-11 02:52:24,110 - INFO - Created VN ctest-left_vn-94352846 2025-09-11 02:52:24,121 - DEBUG - VN ctest-left_vn-94352846 UUID is a7515521-812e-4a45-b93d-cfc18687f849 2025-09-11 02:52:24,199 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:24,206 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:24,218 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:24,317 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a7515521-812e-4a45-b93d-cfc18687f849 2025-09-11 02:52:24,333 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a7515521-812e-4a45-b93d-cfc18687f849 2025-09-11 02:52:24,345 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/894614d6-3d84-4c84-ac6b-ce6566eca21b 2025-09-11 02:52:24,353 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/894614d6-3d84-4c84-ac6b-ce6566eca21b 2025-09-11 02:52:24,360 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/ec0380d4-c2e1-4bb9-9e40-0ff6b791553a 2025-09-11 02:52:24,366 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:24,366 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a7515521-812e-4a45-b93d-cfc18687f849 2025-09-11 02:52:24,375 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/894614d6-3d84-4c84-ac6b-ce6566eca21b 2025-09-11 02:52:24,390 - INFO - Verified VN network id 15 for VN a7515521-812e-4a45-b93d-cfc18687f849 2025-09-11 02:52:24,390 - INFO - Verifications in API Server for VN ctest-left_vn-94352846 passed 2025-09-11 02:52:24,391 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a7515521-812e-4a45-b93d-cfc18687f849 2025-09-11 02:52:24,405 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/894614d6-3d84-4c84-ac6b-ce6566eca21b 2025-09-11 02:52:24,415 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/894614d6-3d84-4c84-ac6b-ce6566eca21b 2025-09-11 02:52:24,423 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/ec0380d4-c2e1-4bb9-9e40-0ff6b791553a 2025-09-11 02:52:24,439 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12056511279837104709', 'uuid-lslong': '13348053300688713801'}, 'enable': 'true', 'created': '2025-09-11T02:52:23', 'last-modified': '2025-09-11T02:52:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422614'} 2025-09-11 02:52:24,449 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:24,454 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12056511279837104709', 'uuid-lslong': '13348053300688713801'}, 'enable': 'true', 'created': '2025-09-11T02:52:23', 'last-modified': '2025-09-11T02:52:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.438656'} 2025-09-11 02:52:24,459 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:24,464 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12056511279837104709', 'uuid-lslong': '13348053300688713801'}, 'enable': 'true', 'created': '2025-09-11T02:52:23', 'last-modified': '2025-09-11T02:52:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.448788'} 2025-09-11 02:52:24,471 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-11 02:52:24,471 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-94352846 passed 2025-09-11 02:52:24,472 - DEBUG - ====Verifying policy data for ctest-left_vn-94352846 in API_Server ====== 2025-09-11 02:52:24,472 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:24,477 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:24,488 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:24,580 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a7515521-812e-4a45-b93d-cfc18687f849 2025-09-11 02:52:24,590 - DEBUG - =>VN ctest-left_vn-94352846 has no policy to be verified 2025-09-11 02:52:24,590 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:24,590 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:24,590 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:24,601 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846?flat'} 2025-09-11 02:52:24,601 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:24,601 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:24,612 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846?flat'} 2025-09-11 02:52:24,612 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:24,612 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:24,624 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846?flat'} 2025-09-11 02:52:24,624 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43407358:ctest-left_vn-94352846 is found in opserver 2025-09-11 02:52:24,647 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:24,661 - DEBUG - VRF ids for VN ctest-left_vn-94352846: {} 2025-09-11 02:52:24,919 - DEBUG - Response for create_network : {'network': {'id': '7bdcf784-cabb-4591-9f11-f88c3fbf19e3', 'name': 'ctest-right_vn-63136708', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'project_id': 'c622585963604a5f8efc65b54b8817ca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43407358', 'ctest-right_vn-63136708'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 02:52:25,205 - DEBUG - Response for create_subnet : {'subnet': {'id': '3b2f35e3-8417-455e-8200-16a873e6bbdd', 'name': '', 'tenant_id': 'c622585963604a5f8efc65b54b8817ca', 'network_id': '7bdcf784-cabb-4591-9f11-f88c3fbf19e3', 'ip_version': 4, 'cidr': '82.168.222.0/26', 'allocation_pools': [{'start': '82.168.222.2', 'end': '82.168.222.62'}], 'gateway_ip': '82.168.222.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '82.168.222.2', 'tags': [], 'project_id': 'c622585963604a5f8efc65b54b8817ca'}} 2025-09-11 02:52:25,231 - INFO - Created VN ctest-right_vn-63136708 2025-09-11 02:52:25,244 - DEBUG - VN ctest-right_vn-63136708 UUID is 7bdcf784-cabb-4591-9f11-f88c3fbf19e3 2025-09-11 02:52:25,313 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:25,319 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:25,331 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:25,420 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/7bdcf784-cabb-4591-9f11-f88c3fbf19e3 2025-09-11 02:52:25,433 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/7bdcf784-cabb-4591-9f11-f88c3fbf19e3 2025-09-11 02:52:25,442 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/afa527f4-d041-49f3-935a-2c7418a4e1ad 2025-09-11 02:52:25,449 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/afa527f4-d041-49f3-935a-2c7418a4e1ad 2025-09-11 02:52:25,457 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/4bdef6f5-10ae-4d1a-b203-b9cb22ad0eab 2025-09-11 02:52:25,465 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:25,465 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/7bdcf784-cabb-4591-9f11-f88c3fbf19e3 2025-09-11 02:52:25,473 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/afa527f4-d041-49f3-935a-2c7418a4e1ad 2025-09-11 02:52:25,488 - INFO - Verified VN network id 16 for VN 7bdcf784-cabb-4591-9f11-f88c3fbf19e3 2025-09-11 02:52:25,489 - INFO - Verifications in API Server for VN ctest-right_vn-63136708 passed 2025-09-11 02:52:25,489 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/7bdcf784-cabb-4591-9f11-f88c3fbf19e3 2025-09-11 02:52:25,501 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/afa527f4-d041-49f3-935a-2c7418a4e1ad 2025-09-11 02:52:25,509 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/afa527f4-d041-49f3-935a-2c7418a4e1ad 2025-09-11 02:52:25,527 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/4bdef6f5-10ae-4d1a-b203-b9cb22ad0eab 2025-09-11 02:52:25,539 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8925280711250494865', 'uuid-lslong': '11462215807883221475'}, 'enable': 'true', 'created': '2025-09-11T02:52:24', 'last-modified': '2025-09-11T02:52:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.394115'} 2025-09-11 02:52:25,546 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:25,551 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8925280711250494865', 'uuid-lslong': '11462215807883221475'}, 'enable': 'true', 'created': '2025-09-11T02:52:24', 'last-modified': '2025-09-11T02:52:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405466'} 2025-09-11 02:52:25,564 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:25,569 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43407358', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8925280711250494865', 'uuid-lslong': '11462215807883221475'}, 'enable': 'true', 'created': '2025-09-11T02:52:24', 'last-modified': '2025-09-11T02:52:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419305'} 2025-09-11 02:52:25,576 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-11 02:52:25,576 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-63136708 passed 2025-09-11 02:52:25,576 - DEBUG - ====Verifying policy data for ctest-right_vn-63136708 in API_Server ====== 2025-09-11 02:52:25,576 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:25,582 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:25,593 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:25,684 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/7bdcf784-cabb-4591-9f11-f88c3fbf19e3 2025-09-11 02:52:25,694 - DEBUG - =>VN ctest-right_vn-63136708 has no policy to be verified 2025-09-11 02:52:25,694 - DEBUG - Verifying the vn in opserver 2025-09-11 02:52:25,694 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708 virtual network link through opserver 10.0.0.249 2025-09-11 02:52:25,694 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-09-11 02:52:25,706 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708?flat'} 2025-09-11 02:52:25,706 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708 virtual network link through opserver 10.0.0.22 2025-09-11 02:52:25,706 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-11 02:52:25,717 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708?flat'} 2025-09-11 02:52:25,718 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708 virtual network link through opserver 10.0.0.49 2025-09-11 02:52:25,718 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-09-11 02:52:25,729 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708?flat'} 2025-09-11 02:52:25,729 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43407358:ctest-right_vn-63136708 is found in opserver 2025-09-11 02:52:25,751 - DEBUG - Do not have enough data to verify VN in agent 2025-09-11 02:52:25,761 - DEBUG - VRF ids for VN ctest-right_vn-63136708: {} 2025-09-11 02:52:26,942 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-2) 2025-09-11 02:52:28,057 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-1) 2025-09-11 02:52:28,057 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-55848066'] 2025-09-11 02:52:28,361 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-55848066'] created succesfully 2025-09-11 02:52:28,756 - DEBUG - Image by name tiny_nat_fw not found 2025-09-11 02:52:28,756 - DEBUG - Installing image tiny_nat_fw 2025-09-11 02:52:28,756 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-09-11 02:52:28,756 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:52:28,757 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:52:28,757 - DEBUG - Unzip image 2025-09-11 02:52:28,757 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-11 02:52:28,783 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-09-11 02:52:28,783 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-55848066'] 2025-09-11 02:52:28,911 - INFO - Service template: ['default-domain', 'ctest-service_template_1-55848066'] deleted successfully. 2025-09-11 02:52:28,911 - INFO - Skip interface_detach for VM ctest-right_vm-40388807 in state BUILD 2025-09-11 02:52:28,912 - INFO - Deleting VM ctest-right_vm-40388807 2025-09-11 02:52:28,912 - ERROR - VM ctest-right_vm-40388807 has failed to come up 2025-09-11 02:52:28,912 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:28,912 - ERROR - VM ctest-right_vm-40388807 has failed to come up 2025-09-11 02:52:28,912 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:28,979 - INFO - Skip interface_detach for VM ctest-left_vm-50602172 in state BUILD 2025-09-11 02:52:28,979 - INFO - Deleting VM ctest-left_vm-50602172 2025-09-11 02:52:28,979 - ERROR - VM ctest-left_vm-50602172 has failed to come up 2025-09-11 02:52:28,979 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:28,979 - ERROR - VM ctest-left_vm-50602172 has failed to come up 2025-09-11 02:52:28,979 - ERROR - Nova failed to get host of the VM 2025-09-11 02:52:29,140 - INFO - Deleting VN ctest-right_vn-63136708 2025-09-11 02:52:29,182 - DEBUG - VN 7bdcf784-cabb-4591-9f11-f88c3fbf19e3 still in use: Unable to complete operation on network 7bdcf784-cabb-4591-9f11-f88c3fbf19e3. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-8bb3f104-75e8-46c7-8efb-0371579a4d4a'] 2025-09-11 02:52:29,182 - WARNING - Deleting VN ctest-right_vn-63136708 failed..Will retry 2025-09-11 02:52:31,351 - DEBUG - Response for deleting network () 2025-09-11 02:52:31,351 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/afa527f4-d041-49f3-935a-2c7418a4e1ad 2025-09-11 02:52:31,357 - DEBUG - Response Code: 404 2025-09-11 02:52:31,358 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:31,363 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:31,385 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:31,492 - INFO - Validated that VN ctest-right_vn-63136708 is not found in API Server 2025-09-11 02:52:31,502 - DEBUG - VN ctest-right_vn-63136708 is not present in Agent 10.0.0.254 2025-09-11 02:52:31,512 - DEBUG - VN ctest-right_vn-63136708 is not present in Agent 10.0.0.19 2025-09-11 02:52:31,512 - INFO - Validated that VN ctest-right_vn-63136708 is not in any agent 2025-09-11 02:52:31,544 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-63136708 info 2025-09-11 02:52:31,544 - INFO - Deleting VN ctest-left_vn-94352846 2025-09-11 02:52:31,687 - DEBUG - Response for deleting network () 2025-09-11 02:52:31,687 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/894614d6-3d84-4c84-ac6b-ce6566eca21b 2025-09-11 02:52:31,693 - DEBUG - Response Code: 404 2025-09-11 02:52:31,693 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:31,702 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:31,728 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:31,847 - INFO - Validated that VN ctest-left_vn-94352846 is not found in API Server 2025-09-11 02:52:31,857 - DEBUG - VN ctest-left_vn-94352846 is not present in Agent 10.0.0.254 2025-09-11 02:52:31,868 - DEBUG - VN ctest-left_vn-94352846 is not present in Agent 10.0.0.19 2025-09-11 02:52:31,868 - INFO - Validated that VN ctest-left_vn-94352846 is not in any agent 2025-09-11 02:52:31,913 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-94352846 info 2025-09-11 02:52:31,913 - INFO - Deleting VN ctest-mgmt_vn-89634566 2025-09-11 02:52:32,084 - DEBUG - Response for deleting network () 2025-09-11 02:52:32,084 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/123e4122-cb25-49f9-b540-fa58e31d00a6 2025-09-11 02:52:32,091 - DEBUG - Response Code: 404 2025-09-11 02:52:32,091 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-09-11 02:52:32,100 - DEBUG - Requesting: http://10.0.0.249:8082/domain/6cefd47d-baca-4df6-a10c-ec963319da07 2025-09-11 02:52:32,157 - DEBUG - Requesting: http://10.0.0.249:8082/project/c6225859-6360-4a5f-8efc-65b54b8817ca 2025-09-11 02:52:32,264 - INFO - Validated that VN ctest-mgmt_vn-89634566 is not found in API Server 2025-09-11 02:52:32,275 - DEBUG - VN ctest-mgmt_vn-89634566 is not present in Agent 10.0.0.254 2025-09-11 02:52:32,285 - DEBUG - VN ctest-mgmt_vn-89634566 is not present in Agent 10.0.0.19 2025-09-11 02:52:32,285 - INFO - Validated that VN ctest-mgmt_vn-89634566 is not in any agent 2025-09-11 02:52:32,327 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-89634566 info 2025-09-11 02:52:33,591 - DEBUG - No XMPP flaps were noticed during the test 2025-09-11 02:52:33,591 - INFO - 2025-09-11 02:52:33,591 - INFO - END TEST : test_svc_in_network_datapath : SKIPPED[0:00:12] 2025-09-11 02:52:33,591 - INFO - -------------------------------------------------------------------------------- 2025-09-11 02:52:34,339 - INFO - Deleted project: ctest-TestSvcRegr-43407358, ID : c6225859-6360-4a5f-8efc-65b54b8817ca