2025-10-11 16:58:42,971 - DEBUG - [10.0.0.254]: Running cmd : hostname 2025-10-11 16:58:43,165 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4287-1 2025-10-11 16:58:43,165 - DEBUG - [10.0.0.254]: Running cmd : hostname -f 2025-10-11 16:58:43,224 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4287-1. 2025-10-11 16:58:43,225 - DEBUG - [10.0.0.254]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-10-11 16:58:43,316 - DEBUG - Output : NAMES contrail_test_TNKqt5Y9X vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_api_1 analytics_collector_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_dns_1 control_nodemgr_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_api_1 config_dnsmasq_1 config_nodemgr_1 config_svcmonitor_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-10-11 16:58:43,317 - DEBUG - [10.0.0.254]: Running cmd : getent hosts 10.0.0.254 | head -n 1 | awk '{print $2}' 2025-10-11 16:58:43,381 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4287-1. 2025-10-11 16:58:43,381 - DEBUG - [10.0.0.254]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-10-11 16:58:43,444 - DEBUG - Output : 127.0.0.1/8 10.0.0.254/24 172.17.0.1/16 10.20.0.254/24 2025-10-11 16:58:43,445 - DEBUG - [10.0.0.254]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-10-11 16:58:43,519 - DEBUG - Output : 10.20.0.254/24 2025-10-11 16:58:43,519 - DEBUG - [10.0.0.254]: Running cmd : getent hosts 10.20.0.254 | head -n 1 | awk '{print $2}' 2025-10-11 16:58:43,587 - DEBUG - Output : 2025-10-11 16:58:44,355 - DEBUG - Not creating keypair since it exists 2025-10-11 16:58:44,422 - INFO - Domain Default found not creating 2025-10-11 16:58:44,885 - INFO - Project ctest-TestRbac-64375598 not found, creating it 2025-10-11 16:58:45,343 - INFO - Created Project:ctest-TestRbac-64375598, ID : 35414850-998b-43a0-9163-059035d07373 2025-10-11 16:58:47,249 - DEBUG - [10.0.0.254]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2025-10-11 16:58:47,334 - DEBUG - Output : /bin/bash: line 1: crudini: command not found 2025-10-11 16:58:49,391 - INFO - ================================================================================ 2025-10-11 16:58:49,391 - INFO - STARTING TEST : test_perms2_global_share 2025-10-11 16:58:49,391 - INFO - TEST DESCRIPTION : Test perms2 global shared property of an object steps: 1. Add user1 as role1 in project1 and project2 2. Add *.* role1:CRUD to domain acl 3. Create a Shared virtual-network in project1 4. Verify global shared flag is set on VN's perms2 4. Using shared VN try to launch a VM in project2 2025-10-11 16:58:49,515 - DEBUG - Skipping xmpp flap check 2025-10-11 16:58:49,515 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode 2025-10-11 16:58:49,804 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode 2025-10-11 16:58:49,829 - INFO - Initial checks done. Running the testcase now 2025-10-11 16:58:49,829 - INFO - 2025-10-11 16:58:50,171 - INFO - Project ctest-TestRbac-05563078 not found, creating it 2025-10-11 16:58:50,618 - INFO - Created Project:ctest-TestRbac-05563078, ID : c41f75af-6afc-4b82-9d72-cf3147c31ad1 2025-10-11 16:58:50,972 - INFO - Project ctest-TestRbac-17455337 not found, creating it 2025-10-11 16:58:51,414 - INFO - Created Project:ctest-TestRbac-17455337, ID : 287fa72e-149a-409c-bc49-38ec1d98eefd 2025-10-11 16:58:53,162 - DEBUG - Requesting: http://10.0.0.254:8082/api-access-list/6e5b6e3b-d912-4227-87fb-960beae0f86f 2025-10-11 16:58:53,476 - DEBUG - Requesting: http://10.0.0.254:8082/api-access-list/6e5b6e3b-d912-4227-87fb-960beae0f86f 2025-10-11 16:58:53,530 - DEBUG - API access-list (6e5b6e3b-d912-4227-87fb-960beae0f86f) found in api server 2025-10-11 16:58:53,530 - INFO - API access-list 6e5b6e3b-d912-4227-87fb-960beae0f86f verify on api server passed 2025-10-11 16:58:54,097 - INFO - Created VN ctest-TestRbac-05563078-60647670, UUID :3bcc42fb-7263-4135-b32e-b7dfad031e28 2025-10-11 16:58:54,494 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/3bcc42fb-7263-4135-b32e-b7dfad031e28 2025-10-11 16:58:54,786 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/3bcc42fb-7263-4135-b32e-b7dfad031e28 2025-10-11 16:58:54,825 - INFO - API Server: Read VN 3bcc42fb-7263-4135-b32e-b7dfad031e28 2025-10-11 16:58:54,825 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/3bcc42fb-7263-4135-b32e-b7dfad031e28 2025-10-11 16:58:55,113 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/3bcc42fb-7263-4135-b32e-b7dfad031e28 2025-10-11 16:58:55,154 - INFO - API Server: Read VN 3bcc42fb-7263-4135-b32e-b7dfad031e28 2025-10-11 16:58:55,944 - WARNING - Unable to get the list of compute nodes 2025-10-11 16:58:57,085 - INFO - VM ([]) created on node: (None), Zone: (None) 2025-10-11 16:58:57,125 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-11 16:59:02,183 - DEBUG - VM is in ERROR state now 2025-10-11 16:59:02,183 - WARNING - VM in error state. Asserting... 2025-10-11 16:59:02,188 - INFO - Skip interface_detach for VM ctest-TestRbac-17455337-23480730 in state ERROR 2025-10-11 16:59:02,188 - INFO - Deleting VM ctest-TestRbac-17455337-23480730 2025-10-11 16:59:02,216 - ERROR - VM ctest-TestRbac-17455337-23480730 has failed to come up 2025-10-11 16:59:02,216 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-10-11T16:58:58Z', 'message': 'Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 6a8b699f-d5a0-4f0c-8fe0-60a81d67171e.', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 703, in build_instances\n raise exception.MaxRetriesExceeded(reason=msg)\nnova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 6a8b699f-d5a0-4f0c-8fe0-60a81d67171e.\n'} 2025-10-11 16:59:02,217 - INFO - Deleting VN ctest-TestRbac-05563078-60647670 2025-10-11 16:59:02,327 - DEBUG - Requesting: http://10.0.0.254:8082/api-access-list/6e5b6e3b-d912-4227-87fb-960beae0f86f 2025-10-11 16:59:02,333 - DEBUG - Response Code: 404 2025-10-11 16:59:02,333 - INFO - API access-list (6e5b6e3b-d912-4227-87fb-960beae0f86f) got deleted in api server 2025-10-11 16:59:03,321 - INFO - Deleted project: ctest-TestRbac-17455337, ID : 287fa72e-149a-409c-bc49-38ec1d98eefd 2025-10-11 16:59:04,024 - INFO - Deleted project: ctest-TestRbac-05563078, ID : c41f75af-6afc-4b82-9d72-cf3147c31ad1 2025-10-11 16:59:04,147 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Sat Oct 11 16:59:02 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/rbac/test_rbac.py in test_perms2_global_share(self=) 60 assert self.get_vn_from_analytics(u1_p2_conn, vn.vn_fq_name) 61 assert vn.vn_fq_name in self.list_vn_from_analytics(u1_p2_conn) 62 vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn) 63 assert vm, 'VM creation failed on shared VN' 64 vm undefined self = self.create_vm = > connections undefined u1_p2_conn = vn_fixture undefined vn = /contrail-test/serial_scripts/rbac/base.py in create_vm(self=, vn_fixture=, connections=, verify=True) 232 admin_connections=self.connections) 233 if vm_fixture and verify: 234 assert vm_fixture.verify_on_setup(), 'VM verification failed' 235 return vm_fixture 236 vm_fixture = vm_fixture.verify_on_setup = > AssertionError: VM verification failed __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('VM verification failed',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/rbac/test_rbac.py", line 62, in test_perms2_global_share vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn) File "/contrail-test/serial_scripts/rbac/base.py", line 234, in create_vm assert vm_fixture.verify_on_setup(), 'VM verification failed' AssertionError: VM verification failed 2025-10-11 16:59:04,147 - DEBUG - Skipping xmpp flap check 2025-10-11 16:59:04,147 - INFO - 2025-10-11 16:59:04,147 - INFO - END TEST : test_perms2_global_share : FAILED[0:00:15] 2025-10-11 16:59:04,147 - INFO - -------------------------------------------------------------------------------- 2025-10-11 16:59:05,598 - INFO - Deleted project: ctest-TestRbac-64375598, ID : 35414850-998b-43a0-9163-059035d07373 2025-10-11 16:59:07,791 - DEBUG - [10.0.0.254]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2025-10-11 16:59:07,867 - DEBUG - Output : /bin/bash: line 1: crudini: command not found 2025-10-11 16:59:09,919 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode 2025-10-11 16:59:18,443 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode 2025-10-11 16:59:28,863 - DEBUG - [10.0.0.254]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-10-11 16:59:28,972 - DEBUG - Output : contrail_test_TNKqt5Y9X vrouter_vrouter-agent_1 vrouter_provisioner_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_cassandra_1 control_named_1 control_provisioner_1 control_control_1 control_dns_1 control_nodemgr_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_api_1 config_provisioner_1 config_dnsmasq_1 config_nodemgr_1 config_svcmonitor_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd