2025-10-11 16:58:42,971 - DEBUG - [10.0.0.254]: Running cmd : hostname
2025-10-11 16:58:43,165 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4287-1
2025-10-11 16:58:43,165 - DEBUG - [10.0.0.254]: Running cmd : hostname -f
2025-10-11 16:58:43,224 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4287-1.
2025-10-11 16:58:43,225 - DEBUG - [10.0.0.254]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-10-11 16:58:43,316 - DEBUG - Output : NAMES
contrail_test_TNKqt5Y9X
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_snmp_snmp-collector_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_nodemgr_1
analytics_api_1
analytics_collector_1
analytics_database_nodemgr_1
analytics_database_query-engine_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_dns_1
control_nodemgr_1
webui_web_1
webui_job_1
config_devicemgr_1
config_schema_1
config_api_1
config_dnsmasq_1
config_nodemgr_1
config_svcmonitor_1
config_database_nodemgr_1
config_database_rabbitmq_1
config_database_zookeeper_1
config_database_cassandra_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-10-11 16:58:43,317 - DEBUG - [10.0.0.254]: Running cmd : getent hosts 10.0.0.254 | head -n 1 | awk '{print $2}'
2025-10-11 16:58:43,381 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4287-1.
2025-10-11 16:58:43,381 - DEBUG - [10.0.0.254]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2025-10-11 16:58:43,444 - DEBUG - Output : 127.0.0.1/8
10.0.0.254/24
172.17.0.1/16
10.20.0.254/24
2025-10-11 16:58:43,445 - DEBUG - [10.0.0.254]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2025-10-11 16:58:43,519 - DEBUG - Output : 10.20.0.254/24
2025-10-11 16:58:43,519 - DEBUG - [10.0.0.254]: Running cmd : getent hosts 10.20.0.254 | head -n 1 | awk '{print $2}'
2025-10-11 16:58:43,587 - DEBUG - Output :
2025-10-11 16:58:44,355 - DEBUG - Not creating keypair since it exists
2025-10-11 16:58:44,422 - INFO - Domain Default found not creating
2025-10-11 16:58:44,885 - INFO - Project ctest-TestRbac-64375598 not found, creating it
2025-10-11 16:58:45,343 - INFO - Created Project:ctest-TestRbac-64375598, ID : 35414850-998b-43a0-9163-059035d07373
2025-10-11 16:58:47,249 - DEBUG - [10.0.0.254]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode'
2025-10-11 16:58:47,334 - DEBUG - Output : /bin/bash: line 1: crudini: command not found
2025-10-11 16:58:49,391 - INFO - ================================================================================
2025-10-11 16:58:49,391 - INFO - STARTING TEST : test_perms2_global_share
2025-10-11 16:58:49,391 - INFO - TEST DESCRIPTION :
Test perms2 global shared property of an object
steps:
1. Add user1 as role1 in project1 and project2
2. Add *.* role1:CRUD to domain acl
3. Create a Shared virtual-network in project1
4. Verify global shared flag is set on VN's perms2
4. Using shared VN try to launch a VM in project2
2025-10-11 16:58:49,515 - DEBUG - Skipping xmpp flap check
2025-10-11 16:58:49,515 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode
2025-10-11 16:58:49,804 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode
2025-10-11 16:58:49,829 - INFO - Initial checks done. Running the testcase now
2025-10-11 16:58:49,829 - INFO -
2025-10-11 16:58:50,171 - INFO - Project ctest-TestRbac-05563078 not found, creating it
2025-10-11 16:58:50,618 - INFO - Created Project:ctest-TestRbac-05563078, ID : c41f75af-6afc-4b82-9d72-cf3147c31ad1
2025-10-11 16:58:50,972 - INFO - Project ctest-TestRbac-17455337 not found, creating it
2025-10-11 16:58:51,414 - INFO - Created Project:ctest-TestRbac-17455337, ID : 287fa72e-149a-409c-bc49-38ec1d98eefd
2025-10-11 16:58:53,162 - DEBUG - Requesting: http://10.0.0.254:8082/api-access-list/6e5b6e3b-d912-4227-87fb-960beae0f86f
2025-10-11 16:58:53,476 - DEBUG - Requesting: http://10.0.0.254:8082/api-access-list/6e5b6e3b-d912-4227-87fb-960beae0f86f
2025-10-11 16:58:53,530 - DEBUG - API access-list (6e5b6e3b-d912-4227-87fb-960beae0f86f) found in api server
2025-10-11 16:58:53,530 - INFO - API access-list 6e5b6e3b-d912-4227-87fb-960beae0f86f verify on api server passed
2025-10-11 16:58:54,097 - INFO - Created VN ctest-TestRbac-05563078-60647670, UUID :3bcc42fb-7263-4135-b32e-b7dfad031e28
2025-10-11 16:58:54,494 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/3bcc42fb-7263-4135-b32e-b7dfad031e28
2025-10-11 16:58:54,786 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/3bcc42fb-7263-4135-b32e-b7dfad031e28
2025-10-11 16:58:54,825 - INFO - API Server: Read VN 3bcc42fb-7263-4135-b32e-b7dfad031e28
2025-10-11 16:58:54,825 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/3bcc42fb-7263-4135-b32e-b7dfad031e28
2025-10-11 16:58:55,113 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/3bcc42fb-7263-4135-b32e-b7dfad031e28
2025-10-11 16:58:55,154 - INFO - API Server: Read VN 3bcc42fb-7263-4135-b32e-b7dfad031e28
2025-10-11 16:58:55,944 - WARNING - Unable to get the list of compute nodes
2025-10-11 16:58:57,085 - INFO - VM ([]) created on node: (None), Zone: (None)
2025-10-11 16:58:57,125 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-11 16:59:02,183 - DEBUG - VM is in ERROR state now
2025-10-11 16:59:02,183 - WARNING - VM in error state. Asserting...
2025-10-11 16:59:02,188 - INFO - Skip interface_detach for VM ctest-TestRbac-17455337-23480730 in state ERROR
2025-10-11 16:59:02,188 - INFO - Deleting VM ctest-TestRbac-17455337-23480730
2025-10-11 16:59:02,216 - ERROR - VM ctest-TestRbac-17455337-23480730 has failed to come up
2025-10-11 16:59:02,216 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-10-11T16:58:58Z', 'message': 'Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 6a8b699f-d5a0-4f0c-8fe0-60a81d67171e.', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 703, in build_instances\n raise exception.MaxRetriesExceeded(reason=msg)\nnova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 6a8b699f-d5a0-4f0c-8fe0-60a81d67171e.\n'}
2025-10-11 16:59:02,217 - INFO - Deleting VN ctest-TestRbac-05563078-60647670
2025-10-11 16:59:02,327 - DEBUG - Requesting: http://10.0.0.254:8082/api-access-list/6e5b6e3b-d912-4227-87fb-960beae0f86f
2025-10-11 16:59:02,333 - DEBUG - Response Code: 404
2025-10-11 16:59:02,333 - INFO - API access-list (6e5b6e3b-d912-4227-87fb-960beae0f86f) got deleted in api server
2025-10-11 16:59:03,321 - INFO - Deleted project: ctest-TestRbac-17455337, ID : 287fa72e-149a-409c-bc49-38ec1d98eefd
2025-10-11 16:59:04,024 - INFO - Deleted project: ctest-TestRbac-05563078, ID : c41f75af-6afc-4b82-9d72-cf3147c31ad1
2025-10-11 16:59:04,147 - ERROR - AssertionError
Python 3.9.21: /usr/bin/python3
Sat Oct 11 16:59:02 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/serial_scripts/rbac/test_rbac.py in test_perms2_global_share(self=)
60 assert self.get_vn_from_analytics(u1_p2_conn, vn.vn_fq_name)
61 assert vn.vn_fq_name in self.list_vn_from_analytics(u1_p2_conn)
62 vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn)
63 assert vm, 'VM creation failed on shared VN'
64
vm undefined
self =
self.create_vm = >
connections undefined
u1_p2_conn =
vn_fixture undefined
vn =
/contrail-test/serial_scripts/rbac/base.py in create_vm(self=, vn_fixture=, connections=, verify=True)
232 admin_connections=self.connections)
233 if vm_fixture and verify:
234 assert vm_fixture.verify_on_setup(), 'VM verification failed'
235 return vm_fixture
236
vm_fixture =
vm_fixture.verify_on_setup = >
AssertionError: VM verification failed
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ('VM verification failed',)
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/rbac/test_rbac.py", line 62, in test_perms2_global_share
vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn)
File "/contrail-test/serial_scripts/rbac/base.py", line 234, in create_vm
assert vm_fixture.verify_on_setup(), 'VM verification failed'
AssertionError: VM verification failed
2025-10-11 16:59:04,147 - DEBUG - Skipping xmpp flap check
2025-10-11 16:59:04,147 - INFO -
2025-10-11 16:59:04,147 - INFO - END TEST : test_perms2_global_share : FAILED[0:00:15]
2025-10-11 16:59:04,147 - INFO - --------------------------------------------------------------------------------
2025-10-11 16:59:05,598 - INFO - Deleted project: ctest-TestRbac-64375598, ID : 35414850-998b-43a0-9163-059035d07373
2025-10-11 16:59:07,791 - DEBUG - [10.0.0.254]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode'
2025-10-11 16:59:07,867 - DEBUG - Output : /bin/bash: line 1: crudini: command not found
2025-10-11 16:59:09,919 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode
2025-10-11 16:59:18,443 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode
2025-10-11 16:59:28,863 - DEBUG - [10.0.0.254]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2025-10-11 16:59:28,972 - DEBUG - Output : contrail_test_TNKqt5Y9X
vrouter_vrouter-agent_1
vrouter_provisioner_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_snmp_snmp-collector_1
analytics_snmp_provisioner_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_provisioner_1
analytics_alarm_kafka_1
analytics_nodemgr_1
analytics_provisioner_1
analytics_api_1
analytics_collector_1
analytics_database_nodemgr_1
analytics_database_query-engine_1
analytics_database_provisioner_1
analytics_database_cassandra_1
control_named_1
control_provisioner_1
control_control_1
control_dns_1
control_nodemgr_1
webui_web_1
webui_job_1
config_devicemgr_1
config_schema_1
config_api_1
config_provisioner_1
config_dnsmasq_1
config_nodemgr_1
config_svcmonitor_1
config_database_nodemgr_1
config_database_provisioner_1
config_database_rabbitmq_1
config_database_zookeeper_1
config_database_cassandra_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd