2025-08-10 11:30:38,353 - INFO - Domain Default found not creating 2025-08-10 11:30:38,478 - INFO - Project ctest-TestDetailedPolicy1-37233455 not found, creating it 2025-08-10 11:30:38,960 - INFO - Created Project:ctest-TestDetailedPolicy1-37233455, ID : 28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:40,274 - INFO - ================================================================================ 2025-08-10 11:30:40,274 - INFO - STARTING TEST : test_multi_vn_repeated_policy_update_with_ping 2025-08-10 11:30:40,274 - INFO - TEST DESCRIPTION : Call repeated_policy_update_test_with_ping with multi VN scenario. 2025-08-10 11:30:41,526 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.14': '0', '10.20.0.25': '0'}, '10.0.0.56': {'10.20.0.14': '0', '10.20.0.25': '0'}} with 2025-08-10 11:30:41,526 - INFO - Initial checks done. Running the testcase now 2025-08-10 11:30:41,526 - INFO - 2025-08-10 11:30:41,526 - INFO - Scenario for the test used is: 2025-08-10 11:30:41,526 - DEBUG - Starting setup 2025-08-10 11:30:42,230 - INFO - Using existing project ['default-domain', 'ctest-TestDetailedPolicy1-37233455'](28a856e1-1777-44e3-b7d2-57b4adb7a32f) 2025-08-10 11:30:42,230 - INFO - provision user admin with role as admin in tenant ctest-TestDetailedPolicy1-37233455 2025-08-10 11:30:43,180 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:43,504 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:43,556 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:43,581 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:43,677 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-10 11:30:43,969 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-10 11:30:44,003 - DEBUG - Requesting: http://10.0.0.254:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:44,038 - DEBUG - Requesting: http://10.0.0.254:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:44,146 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-08-10 11:30:44,439 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-08-10 11:30:44,464 - DEBUG - Requesting: http://10.0.0.57:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:44,477 - DEBUG - Requesting: http://10.0.0.57:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:44,564 - INFO - Verification of project ctest-TestDetailedPolicy1-37233455 in API Server 10.0.0.57 passed 2025-08-10 11:30:44,848 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:44,854 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:44,864 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:44,947 - DEBUG - Requesting: http://10.0.0.49:8082/network-ipam/e1462911-cd35-4ce8-acd1-64811760bbaf 2025-08-10 11:30:44,955 - INFO - Verifications in API Server for IPAM: ctest-TestDetailedPolicy1-37233455-default-ipam passed 2025-08-10 11:30:44,960 - DEBUG - Control-node 10.0.0.49 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestDetailedPolicy1-37233455:ctest-TestDetailedPolicy1-37233455-default-ipam', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestDetailedPolicy1-37233455', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16232707063337536744', 'uuid-lslong': '12452844950261906351'}, 'enable': 'true', 'created': '2025-08-10T11:30:44', 'last-modified': '2025-08-10T11:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.148140'} 2025-08-10 11:30:44,966 - DEBUG - Control-node 10.0.0.254 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestDetailedPolicy1-37233455:ctest-TestDetailedPolicy1-37233455-default-ipam', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestDetailedPolicy1-37233455', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16232707063337536744', 'uuid-lslong': '12452844950261906351'}, 'enable': 'true', 'created': '2025-08-10T11:30:44', 'last-modified': '2025-08-10T11:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.152193'} 2025-08-10 11:30:44,971 - DEBUG - Control-node 10.0.0.57 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestDetailedPolicy1-37233455:ctest-TestDetailedPolicy1-37233455-default-ipam', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestDetailedPolicy1-37233455', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16232707063337536744', 'uuid-lslong': '12452844950261906351'}, 'enable': 'true', 'created': '2025-08-10T11:30:44', 'last-modified': '2025-08-10T11:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.158130'} 2025-08-10 11:30:44,971 - INFO - Verifications in Control node for IPAM: ctest-TestDetailedPolicy1-37233455-default-ipam passed 2025-08-10 11:30:45,557 - DEBUG - Response for create_network : {'network': {'id': 'fccfbd00-3193-4aae-85d8-4dea9dbfab9c', 'name': 'ctest-vnet0-12343925', 'tenant_id': '28a856e1177744e3b7d257b4adb7a32f', 'project_id': '28a856e1177744e3b7d257b4adb7a32f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'ctest-vnet0-12343925'], 'port_security_enabled': True, 'description': ''}} 2025-08-10 11:30:45,837 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd66813ec-9a78-43af-a90a-e032d6aea66b', 'name': '', 'tenant_id': '28a856e1177744e3b7d257b4adb7a32f', 'network_id': 'fccfbd00-3193-4aae-85d8-4dea9dbfab9c', 'ip_version': 4, 'cidr': '10.1.1.0/24', 'allocation_pools': [{'start': '10.1.1.2', 'end': '10.1.1.254'}], 'gateway_ip': '10.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '10.1.1.2', 'tags': [], 'project_id': '28a856e1177744e3b7d257b4adb7a32f'}} 2025-08-10 11:30:46,013 - DEBUG - Response for create_subnet : {'subnet': {'id': '7242a413-93c1-4d0e-9e3e-a89742041a2f', 'name': '', 'tenant_id': '28a856e1177744e3b7d257b4adb7a32f', 'network_id': 'fccfbd00-3193-4aae-85d8-4dea9dbfab9c', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '28a856e1177744e3b7d257b4adb7a32f'}} 2025-08-10 11:30:46,033 - INFO - Created VN ctest-vnet0-12343925 2025-08-10 11:30:46,044 - DEBUG - VN ctest-vnet0-12343925 UUID is fccfbd00-3193-4aae-85d8-4dea9dbfab9c 2025-08-10 11:30:46,122 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:46,410 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:46,434 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:46,445 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:46,555 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/fccfbd00-3193-4aae-85d8-4dea9dbfab9c 2025-08-10 11:30:46,578 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/fccfbd00-3193-4aae-85d8-4dea9dbfab9c 2025-08-10 11:30:46,590 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/e52fa9be-d604-487b-8606-10a77304eb35 2025-08-10 11:30:46,597 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/e52fa9be-d604-487b-8606-10a77304eb35 2025-08-10 11:30:46,603 - DEBUG - Requesting: http://10.0.0.49:8082/route-target/658597e2-f265-4cb1-a272-8e5b12b157cb 2025-08-10 11:30:46,610 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 11:30:46,610 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/fccfbd00-3193-4aae-85d8-4dea9dbfab9c 2025-08-10 11:30:46,620 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/e52fa9be-d604-487b-8606-10a77304eb35 2025-08-10 11:30:46,636 - INFO - Verified VN network id 15 for VN fccfbd00-3193-4aae-85d8-4dea9dbfab9c 2025-08-10 11:30:46,637 - INFO - Verifications in API Server for VN ctest-vnet0-12343925 passed 2025-08-10 11:30:46,637 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/fccfbd00-3193-4aae-85d8-4dea9dbfab9c 2025-08-10 11:30:46,647 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/e52fa9be-d604-487b-8606-10a77304eb35 2025-08-10 11:30:46,653 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/e52fa9be-d604-487b-8606-10a77304eb35 2025-08-10 11:30:46,660 - DEBUG - Requesting: http://10.0.0.49:8082/route-target/658597e2-f265-4cb1-a272-8e5b12b157cb 2025-08-10 11:30:46,672 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'admin', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18216986826266331822', 'uuid-lslong': '9644544272078187420'}, 'enable': 'true', 'created': '2025-08-10T11:30:45', 'last-modified': '2025-08-10T11:30:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.711827'} 2025-08-10 11:30:46,679 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 11:30:46,684 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'admin', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18216986826266331822', 'uuid-lslong': '9644544272078187420'}, 'enable': 'true', 'created': '2025-08-10T11:30:45', 'last-modified': '2025-08-10T11:30:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.724858'} 2025-08-10 11:30:46,690 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 11:30:46,696 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'admin', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18216986826266331822', 'uuid-lslong': '9644544272078187420'}, 'enable': 'true', 'created': '2025-08-10T11:30:45', 'last-modified': '2025-08-10T11:30:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.740294'} 2025-08-10 11:30:46,702 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 11:30:46,702 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vnet0-12343925 passed 2025-08-10 11:30:46,702 - DEBUG - ====Verifying policy data for ctest-vnet0-12343925 in API_Server ====== 2025-08-10 11:30:46,702 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:46,707 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:46,718 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:46,815 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/fccfbd00-3193-4aae-85d8-4dea9dbfab9c 2025-08-10 11:30:46,828 - DEBUG - =>VN ctest-vnet0-12343925 has no policy to be verified 2025-08-10 11:30:46,828 - DEBUG - Verifying the vn in opserver 2025-08-10 11:30:46,828 - DEBUG - Verifying the default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 virtual network link through opserver 10.0.0.49 2025-08-10 11:30:46,828 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-08-10 11:30:47,119 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-08-10 11:30:47,166 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925?flat'} 2025-08-10 11:30:47,166 - DEBUG - Verifying the default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 virtual network link through opserver 10.0.0.254 2025-08-10 11:30:47,166 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-10 11:30:47,451 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-10 11:30:47,497 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925?flat'} 2025-08-10 11:30:47,497 - DEBUG - Verifying the default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 virtual network link through opserver 10.0.0.57 2025-08-10 11:30:47,497 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-08-10 11:30:47,781 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-08-10 11:30:47,831 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925?flat'} 2025-08-10 11:30:47,831 - INFO - Validated that VN default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is found in opserver 2025-08-10 11:30:47,851 - DEBUG - Do not have enough data to verify VN in agent 2025-08-10 11:30:47,860 - DEBUG - VRF ids for VN ctest-vnet0-12343925: {} 2025-08-10 11:30:48,096 - DEBUG - Response for create_network : {'network': {'id': '6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02', 'name': 'ctest-vnet1-45384744', 'tenant_id': '28a856e1177744e3b7d257b4adb7a32f', 'project_id': '28a856e1177744e3b7d257b4adb7a32f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'ctest-vnet1-45384744'], 'port_security_enabled': True, 'description': ''}} 2025-08-10 11:30:48,330 - DEBUG - Response for create_subnet : {'subnet': {'id': '61f50b31-548b-4c1c-8600-8ec2a2a93cb1', 'name': '', 'tenant_id': '28a856e1177744e3b7d257b4adb7a32f', 'network_id': '6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02', 'ip_version': 4, 'cidr': '12.1.1.0/24', 'allocation_pools': [{'start': '12.1.1.2', 'end': '12.1.1.254'}], 'gateway_ip': '12.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '12.1.1.2', 'tags': [], 'project_id': '28a856e1177744e3b7d257b4adb7a32f'}} 2025-08-10 11:30:48,553 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ec3462e6-209b-4c8c-aa47-97ab3a9b4896', 'name': '', 'tenant_id': '28a856e1177744e3b7d257b4adb7a32f', 'network_id': '6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02', 'ip_version': 4, 'cidr': '13.1.1.0/24', 'allocation_pools': [{'start': '13.1.1.2', 'end': '13.1.1.254'}], 'gateway_ip': '13.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '13.1.1.2', 'tags': [], 'project_id': '28a856e1177744e3b7d257b4adb7a32f'}} 2025-08-10 11:30:48,586 - INFO - Created VN ctest-vnet1-45384744 2025-08-10 11:30:48,605 - DEBUG - VN ctest-vnet1-45384744 UUID is 6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02 2025-08-10 11:30:48,691 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:48,696 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:48,707 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:48,792 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02 2025-08-10 11:30:48,803 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02 2025-08-10 11:30:48,812 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/8c197f8a-8272-43aa-a36d-de9d328a18f1 2025-08-10 11:30:48,819 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/8c197f8a-8272-43aa-a36d-de9d328a18f1 2025-08-10 11:30:48,825 - DEBUG - Requesting: http://10.0.0.49:8082/route-target/087e680b-a96c-4793-8c4d-a1e22cdac826 2025-08-10 11:30:48,831 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-10 11:30:48,831 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02 2025-08-10 11:30:48,840 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/8c197f8a-8272-43aa-a36d-de9d328a18f1 2025-08-10 11:30:48,854 - INFO - Verified VN network id 16 for VN 6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02 2025-08-10 11:30:48,854 - INFO - Verifications in API Server for VN ctest-vnet1-45384744 passed 2025-08-10 11:30:48,854 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02 2025-08-10 11:30:48,864 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/8c197f8a-8272-43aa-a36d-de9d328a18f1 2025-08-10 11:30:48,870 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/8c197f8a-8272-43aa-a36d-de9d328a18f1 2025-08-10 11:30:48,876 - DEBUG - Requesting: http://10.0.0.49:8082/route-target/087e680b-a96c-4793-8c4d-a1e22cdac826 2025-08-10 11:30:48,889 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'admin', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7817415095141158347', 'uuid-lslong': '10231161124560014082'}, 'enable': 'true', 'created': '2025-08-10T11:30:48', 'last-modified': '2025-08-10T11:30:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.385581'} 2025-08-10 11:30:48,894 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-10 11:30:48,899 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'admin', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7817415095141158347', 'uuid-lslong': '10231161124560014082'}, 'enable': 'true', 'created': '2025-08-10T11:30:48', 'last-modified': '2025-08-10T11:30:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.388316'} 2025-08-10 11:30:48,905 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-10 11:30:48,910 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'admin', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7817415095141158347', 'uuid-lslong': '10231161124560014082'}, 'enable': 'true', 'created': '2025-08-10T11:30:48', 'last-modified': '2025-08-10T11:30:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404288'} 2025-08-10 11:30:48,916 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-10 11:30:48,916 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vnet1-45384744 passed 2025-08-10 11:30:48,916 - DEBUG - ====Verifying policy data for ctest-vnet1-45384744 in API_Server ====== 2025-08-10 11:30:48,917 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:48,922 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:48,941 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:49,033 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02 2025-08-10 11:30:49,043 - DEBUG - =>VN ctest-vnet1-45384744 has no policy to be verified 2025-08-10 11:30:49,043 - DEBUG - Verifying the vn in opserver 2025-08-10 11:30:49,043 - DEBUG - Verifying the default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744 virtual network link through opserver 10.0.0.49 2025-08-10 11:30:49,043 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-08-10 11:30:49,090 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744?flat'} 2025-08-10 11:30:49,090 - DEBUG - Verifying the default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744 virtual network link through opserver 10.0.0.254 2025-08-10 11:30:49,091 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-10 11:30:49,134 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744?flat'} 2025-08-10 11:30:49,134 - DEBUG - Verifying the default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744 virtual network link through opserver 10.0.0.57 2025-08-10 11:30:49,134 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-08-10 11:30:49,177 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744?flat'} 2025-08-10 11:30:49,177 - INFO - Validated that VN default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744 is found in opserver 2025-08-10 11:30:49,197 - DEBUG - Do not have enough data to verify VN in agent 2025-08-10 11:30:49,205 - DEBUG - VRF ids for VN ctest-vnet1-45384744: {} 2025-08-10 11:30:49,211 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = tcp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 11:30:49,420 - DEBUG - ====Verifying data for policy0 in API_Server ====== 2025-08-10 11:30:49,420 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:49,425 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:49,436 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:49,527 - DEBUG - Requesting: http://10.0.0.49:8082/network-policy/9ce0ccf3-95f4-4b79-9c6a-d64254fc8b48 2025-08-10 11:30:49,537 - INFO - Verified policy policy0 in API Server, Result: True 2025-08-10 11:30:49,584 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = tcp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 11:30:49,806 - DEBUG - ====Verifying data for policy1 in API_Server ====== 2025-08-10 11:30:49,806 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:49,812 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:49,832 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:49,908 - DEBUG - Requesting: http://10.0.0.49:8082/network-policy/0a7dd1c9-7f56-4e44-98b6-f6680489840a 2025-08-10 11:30:49,923 - INFO - Verified policy policy1 in API Server, Result: True 2025-08-10 11:30:49,972 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = tcp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 11:30:50,224 - DEBUG - ====Verifying data for policy2 in API_Server ====== 2025-08-10 11:30:50,224 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:50,230 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:50,243 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:50,332 - DEBUG - Requesting: http://10.0.0.49:8082/network-policy/31e21504-6894-483e-a121-99301e4126d5 2025-08-10 11:30:50,347 - INFO - Verified policy policy2 in API Server, Result: True 2025-08-10 11:30:50,396 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = tcp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 11:30:50,656 - DEBUG - ====Verifying data for policy3 in API_Server ====== 2025-08-10 11:30:50,656 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:50,661 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:50,672 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:50,760 - DEBUG - Requesting: http://10.0.0.49:8082/network-policy/bc48d1df-3df8-4a34-bcef-48c77757dd33 2025-08-10 11:30:50,770 - INFO - Verified policy policy3 in API Server, Result: True 2025-08-10 11:30:50,777 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 11:30:50,979 - DEBUG - ====Verifying data for policy100 in API_Server ====== 2025-08-10 11:30:50,979 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:50,985 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:50,995 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:51,081 - DEBUG - Requesting: http://10.0.0.49:8082/network-policy/98d83790-4f02-4781-9a6f-fb9d062fcb44 2025-08-10 11:30:51,088 - INFO - Verified policy policy100 in API Server, Result: True 2025-08-10 11:30:51,093 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = tcp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 11:30:51,352 - DEBUG - ====Verifying data for policy10 in API_Server ====== 2025-08-10 11:30:51,352 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:51,358 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:51,368 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:51,454 - DEBUG - Requesting: http://10.0.0.49:8082/network-policy/b012898c-f1b6-4b63-9e19-878066d32b22 2025-08-10 11:30:51,464 - INFO - Verified policy policy10 in API Server, Result: True 2025-08-10 11:30:51,512 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = tcp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 11:30:51,763 - DEBUG - ====Verifying data for policy11 in API_Server ====== 2025-08-10 11:30:51,763 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:51,769 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:51,779 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:51,870 - DEBUG - Requesting: http://10.0.0.49:8082/network-policy/acd29208-e124-4c7b-af58-af341450b9a6 2025-08-10 11:30:51,880 - INFO - Verified policy policy11 in API Server, Result: True 2025-08-10 11:30:51,885 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = tcp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 11:30:52,140 - DEBUG - ====Verifying data for policy12 in API_Server ====== 2025-08-10 11:30:52,140 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:52,146 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:52,156 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:52,248 - DEBUG - Requesting: http://10.0.0.49:8082/network-policy/d1eb7705-ffbd-4530-942b-9affa147bdf6 2025-08-10 11:30:52,258 - INFO - Verified policy policy12 in API Server, Result: True 2025-08-10 11:30:52,263 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = tcp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet1-45384744, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 11:30:52,525 - DEBUG - ====Verifying data for policy13 in API_Server ====== 2025-08-10 11:30:52,525 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:52,530 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:52,540 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:52,634 - DEBUG - Requesting: http://10.0.0.49:8082/network-policy/6e6e0acc-e69a-4b2d-9dd4-5cce9b9ea4a0 2025-08-10 11:30:52,647 - INFO - Verified policy policy13 in API Server, Result: True 2025-08-10 11:30:52,653 - DEBUG - Policy np_rules : [] 2025-08-10 11:30:52,908 - DEBUG - ====Verifying data for policy1000 in API_Server ====== 2025-08-10 11:30:52,908 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:52,914 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:52,925 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:53,013 - DEBUG - Requesting: http://10.0.0.49:8082/network-policy/1c270b62-eeb2-429f-be1d-2fae91eaaaf8 2025-08-10 11:30:53,020 - INFO - Verified policy policy1000 in API Server, Result: True 2025-08-10 11:30:53,020 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:53,025 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:53,035 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:53,122 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/fccfbd00-3193-4aae-85d8-4dea9dbfab9c 2025-08-10 11:30:53,132 - DEBUG - Setup step: Associating the policy to VN' 2025-08-10 11:30:53,264 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'fccfbd00-3193-4aae-85d8-4dea9dbfab9c', 'name': 'ctest-vnet0-12343925', 'tenant_id': '28a856e1177744e3b7d257b4adb7a32f', 'project_id': '28a856e1177744e3b7d257b4adb7a32f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['d66813ec-9a78-43af-a90a-e032d6aea66b', '7242a413-93c1-4d0e-9e3e-a89742041a2f'], 'fq_name': ['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'ctest-vnet0-12343925'], 'policys': [['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'policy0']], 'subnet_ipam': [{'subnet_cidr': '10.1.1.0/24', 'ipam_fq_name': ['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'ctest-TestDetailedPolicy1-37233455-default-ipam']}, {'subnet_cidr': '11.1.1.0/24', 'ipam_fq_name': ['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'ctest-TestDetailedPolicy1-37233455-default-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-08-10 11:30:53,359 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'policy0']] to ctest-vnet0-12343925 2025-08-10 11:30:53,359 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:30:53,368 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:30:53,383 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:30:53,474 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02 2025-08-10 11:30:53,483 - DEBUG - Setup step: Associating the policy to VN' 2025-08-10 11:30:53,612 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02', 'name': 'ctest-vnet1-45384744', 'tenant_id': '28a856e1177744e3b7d257b4adb7a32f', 'project_id': '28a856e1177744e3b7d257b4adb7a32f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['61f50b31-548b-4c1c-8600-8ec2a2a93cb1', 'ec3462e6-209b-4c8c-aa47-97ab3a9b4896'], 'fq_name': ['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'ctest-vnet1-45384744'], 'policys': [['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'policy100']], 'subnet_ipam': [{'subnet_cidr': '12.1.1.0/24', 'ipam_fq_name': ['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'ctest-TestDetailedPolicy1-37233455-default-ipam']}, {'subnet_cidr': '13.1.1.0/24', 'ipam_fq_name': ['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'ctest-TestDetailedPolicy1-37233455-default-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-08-10 11:30:53,722 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'policy100']] to ctest-vnet1-45384744 2025-08-10 11:30:53,743 - DEBUG - Services list from nova: [, , , ] 2025-08-10 11:30:53,743 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3786-1', 'an-jenkins-deploy-platform-ansible-os-3786-2']} 2025-08-10 11:30:53,829 - DEBUG - Services list from nova: [, , , ] 2025-08-10 11:30:54,813 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3786-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3786-1) 2025-08-10 11:30:56,159 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3786-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3786-2) 2025-08-10 11:30:56,159 - DEBUG - Setup step: Verify VM status and install Traffic package... 2025-08-10 11:30:56,160 - INFO - Waiting for VM ctest-vmc0-79642275 to be up.. 2025-08-10 11:30:56,255 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-10 11:31:01,320 - DEBUG - VM is in ACTIVE state now 2025-08-10 11:31:01,320 - INFO - VM name : ctest-vmc0-79642275 2025-08-10 11:31:01,384 - DEBUG - VM ctest-vmc0-79642275 ID is c76fd623-4d2a-4f12-9b81-20b9a74cf6eb 2025-08-10 11:31:01,403 - DEBUG - VM ctest-vmc0-79642275 launched on Node an-jenkins-deploy-platform-ansible-os-3786-1 2025-08-10 11:31:01,464 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-machine/c76fd623-4d2a-4f12-9b81-20b9a74cf6eb 2025-08-10 11:31:01,757 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-machine/c76fd623-4d2a-4f12-9b81-20b9a74cf6eb 2025-08-10 11:31:01,789 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-machine-interface/93d0f060-93bf-4f11-b6bf-4e4e3851ad71 2025-08-10 11:31:05,015 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-08-10 11:31:05,015 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vmc0-79642275 failed! 2025-08-10 11:31:05,028 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 10.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:05,028 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 11.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:09,116 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-08-10 11:31:09,116 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vmc0-79642275 failed! 2025-08-10 11:31:09,129 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 10.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:09,129 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 11.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:13,211 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-10 11:31:13,211 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vmc0-79642275 failed! 2025-08-10 11:31:13,225 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 10.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:13,225 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 11.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:17,313 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-08-10 11:31:17,313 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vmc0-79642275 failed! 2025-08-10 11:31:17,327 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 10.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:17,327 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 11.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:21,398 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-08-10 11:31:21,398 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vmc0-79642275 failed! 2025-08-10 11:31:21,412 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 10.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:21,412 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 11.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:25,499 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-08-10 11:31:25,499 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vmc0-79642275 failed! 2025-08-10 11:31:25,515 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 10.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:25,515 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 11.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:29,600 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-10 11:31:29,600 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vmc0-79642275 failed! 2025-08-10 11:31:29,616 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 10.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:29,616 - DEBUG - Gateway for vn default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 is 11.1.1.1 and allocation pool is NOT set 2025-08-10 11:31:31,682 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.34 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.70 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.698/3.520/5.342/1.822 ms') 2025-08-10 11:31:31,682 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vmc0-79642275 passed 2025-08-10 11:31:31,791 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 11:31:31,791 - DEBUG - Waiting to SSH to VM ctest-vmc0-79642275, IP 10.1.1.3, Port 22 2025-08-10 11:31:31,848 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-10 11:31:31,919 - DEBUG - VM ctest-vmc0-79642275 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-10 11:31:36,920 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 11:31:36,920 - DEBUG - Waiting to SSH to VM ctest-vmc0-79642275, IP 10.1.1.3, Port 22 2025-08-10 11:31:36,982 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-10 11:31:37,054 - DEBUG - VM ctest-vmc0-79642275 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-10 11:31:42,055 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 11:31:42,055 - DEBUG - Waiting to SSH to VM ctest-vmc0-79642275, IP 10.1.1.3, Port 22 2025-08-10 11:31:42,123 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-10 11:31:42,188 - DEBUG - VM ctest-vmc0-79642275 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-10 11:31:47,189 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 11:31:47,189 - DEBUG - Waiting to SSH to VM ctest-vmc0-79642275, IP 10.1.1.3, Port 22 2025-08-10 11:31:47,344 - DEBUG - VM ctest-vmc0-79642275 is ready for SSH connections 2025-08-10 11:31:47,344 - INFO - Waiting for VM ctest-vmc1-32623636 to be up.. 2025-08-10 11:31:47,442 - DEBUG - VM is in ERROR state now 2025-08-10 11:31:47,442 - ERROR - VM in error state. 2025-08-10 11:31:47,442 - ERROR - VM is not in ACTIVE state 2025-08-10 11:31:47,566 - DEBUG - VM console log not formed yet 2025-08-10 11:31:47,566 - DEBUG - None 2025-08-10 11:31:47,568 - INFO - Skip interface_detach for VM ctest-vmc1-32623636 in state ERROR 2025-08-10 11:31:47,568 - INFO - Deleting VM ctest-vmc1-32623636 2025-08-10 11:31:47,626 - INFO - Deleting VM ctest-vmc0-79642275 2025-08-10 11:31:47,683 - DEBUG - Verifying in api server 10.0.0.57 2025-08-10 11:31:47,683 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-machine/c76fd623-4d2a-4f12-9b81-20b9a74cf6eb 2025-08-10 11:31:47,691 - DEBUG - VM ID c76fd623-4d2a-4f12-9b81-20b9a74cf6eb of VM ctest-vmc0-79642275 is still found in API Server 2025-08-10 11:31:49,692 - DEBUG - Verifying in api server 10.0.0.57 2025-08-10 11:31:49,692 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-machine/c76fd623-4d2a-4f12-9b81-20b9a74cf6eb 2025-08-10 11:31:49,699 - DEBUG - Response Code: 404 2025-08-10 11:31:49,699 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-machine/c76fd623-4d2a-4f12-9b81-20b9a74cf6eb 2025-08-10 11:31:49,705 - DEBUG - Response Code: 404 2025-08-10 11:31:49,705 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-machine/c76fd623-4d2a-4f12-9b81-20b9a74cf6eb 2025-08-10 11:31:49,710 - DEBUG - Response Code: 404 2025-08-10 11:31:49,710 - INFO - VM ctest-vmc0-79642275 is fully removed in API-Server 2025-08-10 11:31:49,863 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-08-10 11:31:49,908 - DEBUG - Validated that vrouter 10.0.0.65 does not have VMs route for VN default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 2025-08-10 11:31:49,924 - DEBUG - Validated that vrouter 10.0.0.56 does not have VMs route for VN default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 2025-08-10 11:31:49,924 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 2025-08-10 11:31:49,924 - INFO - VM ctest-vmc0-79642275 is removed in Compute, and routes are removed in all compute nodes 2025-08-10 11:31:50,151 - INFO - Routes for VM ctest-vmc0-79642275 is removed in all control-nodes 2025-08-10 11:31:50,152 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3786-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 11:31:50,226 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3786-1?flat 2025-08-10 11:31:50,258 - DEBUG - VM c76fd623-4d2a-4f12-9b81-20b9a74cf6eb is still present in vrouter an-jenkins-deploy-platform-ansible-os-3786-1 uve 2025-08-10 11:31:50,258 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 11:31:50,258 - DEBUG - interface for vm c76fd623-4d2a-4f12-9b81-20b9a74cf6eb deleted from vrouter uve ... 2025-08-10 11:31:50,258 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 11:31:53,259 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3786-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 11:31:53,298 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3786-1?flat 2025-08-10 11:31:53,331 - DEBUG - VM c76fd623-4d2a-4f12-9b81-20b9a74cf6eb is still present in vrouter an-jenkins-deploy-platform-ansible-os-3786-1 uve 2025-08-10 11:31:53,332 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 11:31:53,332 - DEBUG - interface for vm c76fd623-4d2a-4f12-9b81-20b9a74cf6eb deleted from vrouter uve ... 2025-08-10 11:31:53,332 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 11:31:56,332 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3786-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 11:31:56,375 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3786-1?flat 2025-08-10 11:31:56,449 - DEBUG - VM c76fd623-4d2a-4f12-9b81-20b9a74cf6eb is still present in vrouter an-jenkins-deploy-platform-ansible-os-3786-1 uve 2025-08-10 11:31:56,449 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 11:31:56,449 - DEBUG - interface for vm c76fd623-4d2a-4f12-9b81-20b9a74cf6eb deleted from vrouter uve ... 2025-08-10 11:31:56,449 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 11:31:59,449 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3786-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 11:31:59,491 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3786-1?flat 2025-08-10 11:31:59,524 - DEBUG - VM c76fd623-4d2a-4f12-9b81-20b9a74cf6eb is still present in vrouter an-jenkins-deploy-platform-ansible-os-3786-1 uve 2025-08-10 11:31:59,524 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 11:31:59,524 - DEBUG - interface for vm c76fd623-4d2a-4f12-9b81-20b9a74cf6eb deleted from vrouter uve ... 2025-08-10 11:31:59,524 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 11:32:02,525 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3786-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 11:32:02,565 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3786-1?flat 2025-08-10 11:32:02,605 - DEBUG - VM c76fd623-4d2a-4f12-9b81-20b9a74cf6eb is not present in vrouter an-jenkins-deploy-platform-ansible-os-3786-1 uve 2025-08-10 11:32:02,605 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 11:32:02,605 - DEBUG - interface for vm c76fd623-4d2a-4f12-9b81-20b9a74cf6eb deleted from vrouter uve ... 2025-08-10 11:32:02,605 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 11:32:02,605 - DEBUG - Validated that VM c76fd623-4d2a-4f12-9b81-20b9a74cf6eb is removed in Vrouter UVE 2025-08-10 11:32:02,605 - DEBUG - Verifying through opserver in 10.0.0.49 2025-08-10 11:32:02,606 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925?flat 2025-08-10 11:32:02,629 - DEBUG - c76fd623-4d2a-4f12-9b81-20b9a74cf6eb BM not in default-domain:ctest-TestDetailedPolicy1-37233455:ctest-vnet0-12343925 uve 2025-08-10 11:32:02,629 - DEBUG - Validated that VM c76fd623-4d2a-4f12-9b81-20b9a74cf6eb is not present in the VN UVE 2025-08-10 11:32:02,629 - DEBUG - Verifying the c76fd623-4d2a-4f12-9b81-20b9a74cf6eb virtual network link through opserver 10.0.0.49 2025-08-10 11:32:02,629 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-08-10 11:32:02,641 - DEBUG - No links retuned for c76fd623-4d2a-4f12-9b81-20b9a74cf6eb 2025-08-10 11:32:02,641 - INFO - c76fd623-4d2a-4f12-9b81-20b9a74cf6eb vm uve deleted from opserver 2025-08-10 11:32:02,641 - DEBUG - Verifying the c76fd623-4d2a-4f12-9b81-20b9a74cf6eb virtual network link through opserver 10.0.0.254 2025-08-10 11:32:02,641 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-08-10 11:32:02,651 - DEBUG - No links retuned for c76fd623-4d2a-4f12-9b81-20b9a74cf6eb 2025-08-10 11:32:02,651 - INFO - c76fd623-4d2a-4f12-9b81-20b9a74cf6eb vm uve deleted from opserver 2025-08-10 11:32:02,651 - DEBUG - Verifying the c76fd623-4d2a-4f12-9b81-20b9a74cf6eb virtual network link through opserver 10.0.0.57 2025-08-10 11:32:02,651 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-machines 2025-08-10 11:32:02,662 - DEBUG - No links retuned for c76fd623-4d2a-4f12-9b81-20b9a74cf6eb 2025-08-10 11:32:02,662 - INFO - c76fd623-4d2a-4f12-9b81-20b9a74cf6eb vm uve deleted from opserver 2025-08-10 11:32:02,662 - INFO - Validated that VM c76fd623-4d2a-4f12-9b81-20b9a74cf6eb is removed from Opserver 2025-08-10 11:32:02,662 - DEBUG - Detaching the Policy for VN :ctest-vnet1-45384744 2025-08-10 11:32:02,662 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:32:02,667 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:32:02,700 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:32:02,795 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/6c7d099c-4faa-4dcb-8dfc-62d5f52f8b02 2025-08-10 11:32:02,946 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'policy100']] from ctest-vnet1-45384744 2025-08-10 11:32:02,946 - DEBUG - Detaching the Policy for VN :ctest-vnet0-12343925 2025-08-10 11:32:02,946 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:32:02,957 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:32:02,972 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:32:03,058 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/fccfbd00-3193-4aae-85d8-4dea9dbfab9c 2025-08-10 11:32:03,218 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestDetailedPolicy1-37233455', 'policy0']] from ctest-vnet0-12343925 2025-08-10 11:32:03,270 - INFO - Deleted policy policy1000 2025-08-10 11:32:03,407 - DEBUG - policy policy1000 is not found in API Server 2025-08-10 11:32:03,447 - INFO - Deleted policy policy13 2025-08-10 11:32:03,582 - DEBUG - policy policy13 is not found in API Server 2025-08-10 11:32:03,618 - INFO - Deleted policy policy12 2025-08-10 11:32:03,754 - DEBUG - policy policy12 is not found in API Server 2025-08-10 11:32:03,788 - INFO - Deleted policy policy11 2025-08-10 11:32:03,964 - DEBUG - policy policy11 is not found in API Server 2025-08-10 11:32:04,000 - INFO - Deleted policy policy10 2025-08-10 11:32:04,172 - DEBUG - policy policy10 is not found in API Server 2025-08-10 11:32:04,210 - INFO - Deleted policy policy100 2025-08-10 11:32:04,388 - DEBUG - policy policy100 is not found in API Server 2025-08-10 11:32:04,420 - INFO - Deleted policy policy3 2025-08-10 11:32:04,604 - DEBUG - policy policy3 is not found in API Server 2025-08-10 11:32:04,639 - INFO - Deleted policy policy2 2025-08-10 11:32:04,820 - DEBUG - policy policy2 is not found in API Server 2025-08-10 11:32:04,855 - INFO - Deleted policy policy1 2025-08-10 11:32:05,040 - DEBUG - policy policy1 is not found in API Server 2025-08-10 11:32:05,074 - INFO - Deleted policy policy0 2025-08-10 11:32:05,248 - DEBUG - policy policy0 is not found in API Server 2025-08-10 11:32:05,248 - INFO - Deleting VN ctest-vnet1-45384744 2025-08-10 11:32:05,417 - DEBUG - Response for deleting network () 2025-08-10 11:32:05,417 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/8c197f8a-8272-43aa-a36d-de9d328a18f1 2025-08-10 11:32:05,423 - DEBUG - Response Code: 404 2025-08-10 11:32:05,423 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:32:05,428 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:32:05,439 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:32:05,524 - INFO - Validated that VN ctest-vnet1-45384744 is not found in API Server 2025-08-10 11:32:05,534 - DEBUG - VN ctest-vnet1-45384744 is not present in Agent 10.0.0.65 2025-08-10 11:32:05,544 - DEBUG - VN ctest-vnet1-45384744 is not present in Agent 10.0.0.56 2025-08-10 11:32:05,544 - INFO - Validated that VN ctest-vnet1-45384744 is not in any agent 2025-08-10 11:32:05,572 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vnet1-45384744 info 2025-08-10 11:32:05,572 - INFO - Deleting VN ctest-vnet0-12343925 2025-08-10 11:32:05,723 - DEBUG - Response for deleting network () 2025-08-10 11:32:05,723 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/e52fa9be-d604-487b-8606-10a77304eb35 2025-08-10 11:32:05,733 - DEBUG - Response Code: 404 2025-08-10 11:32:05,734 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-08-10 11:32:05,739 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228 2025-08-10 11:32:05,752 - DEBUG - Requesting: http://10.0.0.49:8082/project/28a856e1-1777-44e3-b7d2-57b4adb7a32f 2025-08-10 11:32:05,841 - INFO - Validated that VN ctest-vnet0-12343925 is not found in API Server 2025-08-10 11:32:05,852 - DEBUG - VN ctest-vnet0-12343925 is not present in Agent 10.0.0.65 2025-08-10 11:32:05,862 - DEBUG - VN ctest-vnet0-12343925 is not present in Agent 10.0.0.56 2025-08-10 11:32:05,862 - INFO - Validated that VN ctest-vnet0-12343925 is not in any agent 2025-08-10 11:32:05,892 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vnet0-12343925 info 2025-08-10 11:32:05,980 - INFO - IPAM: ctest-TestDetailedPolicy1-37233455-default-ipam is not found in API Server 2025-08-10 11:32:06,001 - INFO - IPAM:ctest-TestDetailedPolicy1-37233455-default-ipam is not found in control node 2025-08-10 11:32:06,448 - DEBUG - Skipping the deletion of Project ['default-domain', 'ctest-TestDetailedPolicy1-37233455'] 2025-08-10 11:32:06,448 - DEBUG - Skipping the deletion of User admin 2025-08-10 11:32:07,429 - ERROR - [Errno 104] Connection reset by peer Traceback (most recent call last): File "/contrail-test/tcutils/cores.py", line 42, in get_cores_node if exists(CORE_DIR): File "/usr/local/lib/python3.6/site-packages/fabric/contrib/files.py", line 31, in exists cmd = 'stat %s' % _expand_path(path) File "/usr/local/lib/python3.6/site-packages/fabric/contrib/files.py", line 485, in _expand_path return path if is_win() else '"$(echo %s)"' % path File "/usr/local/lib/python3.6/site-packages/fabric/contrib/files.py", line 472, in is_win return '"' in run('echo "Will you echo quotation marks"') File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1095, in run shell_escape=shell_escape, capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 923, in open_session timeout=timeout, File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/usr/local/lib/python3.6/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/usr/local/lib/python3.6/site-packages/paramiko/packet.py", line 301, in read_all x = self.__socket.recv(n) File "/usr/local/lib64/python3.6/site-packages/gevent/_socket3.py", line 443, in recv return self._sock.recv(*args) ConnectionResetError: [Errno 104] Connection reset by peer 2025-08-10 11:32:07,438 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Sun Aug 10 11:31:47 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/policy/test_policy_detailed.py in test_multi_vn_repeated_policy_update_with_ping(self=) 58 except NameError: 59 topo = topology_class_name() 60 return self.repeated_policy_update_test_with_ping(topo) 61 62 def repeated_policy_update_test_with_ping(self, topo): self = self.repeated_policy_update_test_with_ping = > topo = /contrail-test/scripts/policy/test_policy_detailed.py in repeated_policy_update_test_with_ping(self=, topo=) 73 setup_obj = self.useFixture( 74 sdnTopoSetupFixture(self.connections, topo)) 75 out = setup_obj.topo_setup() 76 #out= setup_obj.topo_setup(vm_verify='yes', skip_cleanup='yes') 77 self.logger.info("Setup completed with result %s" % (out['result'])) out undefined setup_obj = setup_obj.topo_setup = > /contrail-test/tcutils/topo/sdn_topo_setup.py in topo_setup(self=, config_option='openstack', skip_verify='no', flavor='contrail_flavor_small', vms_on_single_compute=False, VmToNodeMapping=None) 92 self, config_option, vms_on_single_compute, VmToNodeMapping) 93 else: 94 topo_steps.createVMNova(self, config_option, vms_on_single_compute) 95 topo_steps.createPublicVN(self) 96 topo_steps.verifySystemPolicy(self) global topo_steps = topo_steps.createVMNova = self = config_option = 'openstack' vms_on_single_compute = False /contrail-test/tcutils/topo/topo_steps.py in createVMNova(self=, option='openstack', vms_on_single_compute=False, VmToNodeMapping=None) 528 for vm in self.topo.vmc_list: 529 assert self.vm_fixture[vm].wait_till_vm_is_up(),( 530 'VM Failed to come up') 531 #Even though VM verification is not run, we need to set verify_is_run 532 #to make sure cleanup is verified in VM fixture AssertionError: VM Failed to come up __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('VM Failed to come up',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/policy/test_policy_detailed.py", line 60, in test_multi_vn_repeated_policy_update_with_ping return self.repeated_policy_update_test_with_ping(topo) File "/contrail-test/scripts/policy/test_policy_detailed.py", line 75, in repeated_policy_update_test_with_ping out = setup_obj.topo_setup() File "/contrail-test/tcutils/topo/sdn_topo_setup.py", line 94, in topo_setup topo_steps.createVMNova(self, config_option, vms_on_single_compute) File "/contrail-test/tcutils/topo/topo_steps.py", line 530, in createVMNova 'VM Failed to come up') AssertionError: VM Failed to come up 2025-08-10 11:32:07,450 - ERROR - XMPP status is {'10.0.0.65': {'10.20.0.14': '0', '10.20.0.25': '0'}, '10.0.0.56': {'10.20.0.254': '0', '10.20.0.14': '0'}}, Expected: {'10.0.0.65': {'10.20.0.14': '0', '10.20.0.25': '0'}, '10.0.0.56': {'10.20.0.14': '0', '10.20.0.25': '0'}} 2025-08-10 11:32:07,450 - INFO - 2025-08-10 11:32:07,450 - INFO - END TEST : test_multi_vn_repeated_policy_update_with_ping : FAILED[0:01:27] 2025-08-10 11:32:07,450 - INFO - -------------------------------------------------------------------------------- 2025-08-10 11:32:08,878 - INFO - Deleted project: ctest-TestDetailedPolicy1-37233455, ID : 28a856e1-1777-44e3-b7d2-57b4adb7a32f