2025-11-13 15:34:10,947 - DEBUG - [10.0.0.38]: Running cmd : hostname 2025-11-13 15:34:11,132 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4723-1 2025-11-13 15:34:11,133 - DEBUG - [10.0.0.38]: Running cmd : hostname -f 2025-11-13 15:34:11,193 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4723-1. 2025-11-13 15:34:11,193 - DEBUG - [10.0.0.38]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-11-13 15:34:11,283 - DEBUG - Output : NAMES contrail_test_meBiZPzlh vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_dns_1 control_nodemgr_1 webui_web_1 webui_job_1 config_devicemgr_1 config_svcmonitor_1 config_schema_1 config_nodemgr_1 config_api_1 config_dnsmasq_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox 2025-11-13 15:34:11,284 - DEBUG - [10.0.0.38]: Running cmd : getent hosts 10.0.0.38 | head -n 1 | awk '{print $2}' 2025-11-13 15:34:11,345 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4723-1. 2025-11-13 15:34:11,345 - DEBUG - [10.0.0.38]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-11-13 15:34:11,404 - DEBUG - Output : 127.0.0.1/8 10.0.0.38/24 172.17.0.1/16 10.20.0.17/24 2025-11-13 15:34:11,405 - DEBUG - [10.0.0.38]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-11-13 15:34:11,469 - DEBUG - Output : 10.20.0.17/24 2025-11-13 15:34:11,469 - DEBUG - [10.0.0.38]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}' 2025-11-13 15:34:11,529 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4723-1-test 2025-11-13 15:34:12,342 - DEBUG - Not creating keypair since it exists 2025-11-13 15:34:12,393 - INFO - Domain Default found not creating 2025-11-13 15:34:12,875 - INFO - Project ctest-TestRbac-76390426 not found, creating it 2025-11-13 15:34:13,318 - INFO - Created Project:ctest-TestRbac-76390426, ID : b49ac6b6-1096-4b40-bbe7-417156d5b679 2025-11-13 15:34:14,820 - DEBUG - [10.0.0.38]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2025-11-13 15:34:14,968 - DEBUG - Output : rbac 2025-11-13 15:34:17,129 - INFO - ================================================================================ 2025-11-13 15:34:17,129 - INFO - STARTING TEST : test_perms2_global_share 2025-11-13 15:34:17,129 - INFO - TEST DESCRIPTION : Test perms2 global shared property of an object steps: 1. Add user1 as role1 in project1 and project2 2. Add *.* role1:CRUD to domain acl 3. Create a Shared virtual-network in project1 4. Verify global shared flag is set on VN's perms2 4. Using shared VN try to launch a VM in project2 2025-11-13 15:34:17,251 - DEBUG - Skipping xmpp flap check 2025-11-13 15:34:17,252 - DEBUG - Requesting: http://10.0.0.38:8082/aaa-mode 2025-11-13 15:34:17,566 - DEBUG - Requesting: http://10.0.0.38:8082/aaa-mode 2025-11-13 15:34:17,590 - INFO - Initial checks done. Running the testcase now 2025-11-13 15:34:17,590 - INFO - 2025-11-13 15:34:17,951 - INFO - Project ctest-TestRbac-44889553 not found, creating it 2025-11-13 15:34:18,382 - INFO - Created Project:ctest-TestRbac-44889553, ID : 18b3756a-a45e-4063-8899-5a3f863466c6 2025-11-13 15:34:18,758 - INFO - Project ctest-TestRbac-94135085 not found, creating it 2025-11-13 15:34:19,213 - INFO - Created Project:ctest-TestRbac-94135085, ID : 89789ee4-b97f-47d1-8c64-b2f962f913ac 2025-11-13 15:34:21,042 - DEBUG - Requesting: http://10.0.0.38:8082/api-access-list/a1651bbc-c390-4efa-90c2-f7555fb5b81e 2025-11-13 15:34:21,378 - DEBUG - Requesting: http://10.0.0.38:8082/api-access-list/a1651bbc-c390-4efa-90c2-f7555fb5b81e 2025-11-13 15:34:21,429 - DEBUG - API access-list (a1651bbc-c390-4efa-90c2-f7555fb5b81e) found in api server 2025-11-13 15:34:21,429 - INFO - API access-list a1651bbc-c390-4efa-90c2-f7555fb5b81e verify on api server passed 2025-11-13 15:34:22,010 - INFO - Created VN ctest-TestRbac-44889553-23483107, UUID :e49d3b79-6425-4167-9be6-a5fa3a9ec756 2025-11-13 15:34:22,363 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e49d3b79-6425-4167-9be6-a5fa3a9ec756 2025-11-13 15:34:22,677 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e49d3b79-6425-4167-9be6-a5fa3a9ec756 2025-11-13 15:34:22,719 - INFO - API Server: Read VN e49d3b79-6425-4167-9be6-a5fa3a9ec756 2025-11-13 15:34:22,719 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e49d3b79-6425-4167-9be6-a5fa3a9ec756 2025-11-13 15:34:23,032 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e49d3b79-6425-4167-9be6-a5fa3a9ec756 2025-11-13 15:34:23,069 - INFO - API Server: Read VN e49d3b79-6425-4167-9be6-a5fa3a9ec756 2025-11-13 15:34:23,069 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestRbac-44889553:ctest-TestRbac-44889553-23483107?flat 2025-11-13 15:34:23,388 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestRbac-44889553:ctest-TestRbac-44889553-23483107?flat 2025-11-13 15:34:23,889 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-13 15:34:24,000 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestRbac-44889553:ctest-TestRbac-44889553-23483107?flat 2025-11-13 15:34:24,311 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestRbac-44889553:ctest-TestRbac-44889553-23483107?flat 2025-11-13 15:34:24,469 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-11-13 15:34:25,309 - WARNING - Unable to get the list of compute nodes 2025-11-13 15:34:26,369 - INFO - VM ([]) created on node: (None), Zone: (None) 2025-11-13 15:34:26,406 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-13 15:34:31,453 - DEBUG - VM is in ERROR state now 2025-11-13 15:34:31,453 - WARNING - VM in error state. Asserting... 2025-11-13 15:34:31,457 - INFO - Skip interface_detach for VM ctest-TestRbac-94135085-47700968 in state ERROR 2025-11-13 15:34:31,457 - INFO - Deleting VM ctest-TestRbac-94135085-47700968 2025-11-13 15:34:31,479 - ERROR - VM ctest-TestRbac-94135085-47700968 has failed to come up 2025-11-13 15:34:31,479 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-11-13T15:34:27Z', 'message': 'Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance f54d07f8-9dea-4a67-a836-9132c727cd6a.', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 705, in build_instances\n raise exception.MaxRetriesExceeded(reason=msg)\nnova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance f54d07f8-9dea-4a67-a836-9132c727cd6a.\n'} 2025-11-13 15:34:31,480 - INFO - Deleting VN ctest-TestRbac-44889553-23483107 2025-11-13 15:34:31,562 - DEBUG - Requesting: http://10.0.0.38:8082/api-access-list/a1651bbc-c390-4efa-90c2-f7555fb5b81e 2025-11-13 15:34:31,567 - DEBUG - Response Code: 404 2025-11-13 15:34:31,567 - INFO - API access-list (a1651bbc-c390-4efa-90c2-f7555fb5b81e) got deleted in api server 2025-11-13 15:34:32,439 - INFO - Deleted project: ctest-TestRbac-94135085, ID : 89789ee4-b97f-47d1-8c64-b2f962f913ac 2025-11-13 15:34:33,120 - INFO - Deleted project: ctest-TestRbac-44889553, ID : 18b3756a-a45e-4063-8899-5a3f863466c6 2025-11-13 15:34:33,238 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Thu Nov 13 15:34:31 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/rbac/test_rbac.py in test_perms2_global_share(self=) 60 assert self.get_vn_from_analytics(u1_p2_conn, vn.vn_fq_name) 61 assert vn.vn_fq_name in self.list_vn_from_analytics(u1_p2_conn) 62 vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn) 63 assert vm, 'VM creation failed on shared VN' 64 vm undefined self = self.create_vm = > connections undefined u1_p2_conn = vn_fixture undefined vn = /contrail-test/serial_scripts/rbac/base.py in create_vm(self=, vn_fixture=, connections=, verify=True) 232 admin_connections=self.connections) 233 if vm_fixture and verify: 234 assert vm_fixture.verify_on_setup(), 'VM verification failed' 235 return vm_fixture 236 vm_fixture = vm_fixture.verify_on_setup = > AssertionError: VM verification failed __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('VM verification failed',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/rbac/test_rbac.py", line 62, in test_perms2_global_share vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn) File "/contrail-test/serial_scripts/rbac/base.py", line 234, in create_vm assert vm_fixture.verify_on_setup(), 'VM verification failed' AssertionError: VM verification failed 2025-11-13 15:34:33,239 - DEBUG - Skipping xmpp flap check 2025-11-13 15:34:33,239 - INFO -
2025-11-13 15:34:33,239 - INFO - END TEST : test_perms2_global_share : FAILED[0:00:16]
2025-11-13 15:34:33,239 - INFO - -------------------------------------------------------------------------------- 2025-11-13 15:34:34,579 - INFO - Deleted project: ctest-TestRbac-76390426, ID : b49ac6b6-1096-4b40-bbe7-417156d5b679 2025-11-13 15:34:37,076 - DEBUG - [10.0.0.38]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2025-11-13 15:34:37,193 - DEBUG - Output : rbac 2025-11-13 15:34:39,511 - DEBUG - Requesting: http://10.0.0.38:8082/aaa-mode 2025-11-13 15:35:49,523 - DEBUG - Requesting: http://10.0.0.38:8082/aaa-mode 2025-11-13 15:36:57,908 - DEBUG - [10.0.0.38]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-11-13 15:36:58,004 - DEBUG - Output : contrail_test_meBiZPzlh vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_alarm_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_dns_1 control_nodemgr_1 control_provisioner_1 webui_web_1 webui_job_1 config_devicemgr_1 config_svcmonitor_1 config_schema_1 config_nodemgr_1 config_api_1 config_provisioner_1 config_dnsmasq_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_nodemgr_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox