2025-11-13 16:34:19,789 - DEBUG - [10.0.0.22]: Running cmd : hostname 2025-11-13 16:34:19,991 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4724-1 2025-11-13 16:34:19,991 - DEBUG - [10.0.0.22]: Running cmd : hostname -f 2025-11-13 16:34:20,055 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4724-1. 2025-11-13 16:34:20,055 - DEBUG - [10.0.0.22]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-11-13 16:34:20,172 - DEBUG - Output : NAMES contrail_test_rSebjXSaV vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_collector_1 analytics_nodemgr_1 analytics_database_query-engine_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_dns_1 webui_job_1 webui_web_1 config_devicemgr_1 config_schema_1 config_svcmonitor_1 config_api_1 config_nodemgr_1 config_dnsmasq_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-11-13 16:34:20,173 - DEBUG - [10.0.0.22]: Running cmd : getent hosts 10.0.0.22 | head -n 1 | awk '{print $2}' 2025-11-13 16:34:20,246 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4724-1. 2025-11-13 16:34:20,246 - DEBUG - [10.0.0.22]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-11-13 16:34:20,302 - DEBUG - Output : 127.0.0.1/8 10.0.0.22/24 172.17.0.1/16 10.20.0.254/24 2025-11-13 16:34:20,303 - DEBUG - [10.0.0.22]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-11-13 16:34:20,366 - DEBUG - Output : 10.20.0.254/24 2025-11-13 16:34:20,367 - DEBUG - [10.0.0.22]: Running cmd : getent hosts 10.20.0.254 | head -n 1 | awk '{print $2}' 2025-11-13 16:34:20,431 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4724-1-test 2025-11-13 16:34:21,290 - DEBUG - Not creating keypair since it exists 2025-11-13 16:34:21,347 - INFO - Domain Default found not creating 2025-11-13 16:34:21,883 - INFO - Project ctest-TestRbac-48174385 not found, creating it 2025-11-13 16:34:22,379 - INFO - Created Project:ctest-TestRbac-48174385, ID : 1b4be467-182a-461d-a063-16d884fd2daf 2025-11-13 16:34:23,883 - DEBUG - [10.0.0.22]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2025-11-13 16:34:24,033 - DEBUG - Output : rbac 2025-11-13 16:34:26,341 - INFO - ================================================================================ 2025-11-13 16:34:26,341 - INFO - STARTING TEST : test_perms2_global_share 2025-11-13 16:34:26,342 - INFO - TEST DESCRIPTION : Test perms2 global shared property of an object steps: 1. Add user1 as role1 in project1 and project2 2. Add *.* role1:CRUD to domain acl 3. Create a Shared virtual-network in project1 4. Verify global shared flag is set on VN's perms2 4. Using shared VN try to launch a VM in project2 2025-11-13 16:34:26,465 - DEBUG - Skipping xmpp flap check 2025-11-13 16:34:26,465 - DEBUG - Requesting: http://10.0.0.22:8082/aaa-mode 2025-11-13 16:34:26,792 - DEBUG - Requesting: http://10.0.0.22:8082/aaa-mode 2025-11-13 16:34:26,811 - INFO - Initial checks done. Running the testcase now 2025-11-13 16:34:26,811 - INFO - 2025-11-13 16:34:27,208 - INFO - Project ctest-TestRbac-24359158 not found, creating it 2025-11-13 16:34:27,675 - INFO - Created Project:ctest-TestRbac-24359158, ID : 77154a1d-335e-4f6f-975e-d082ae7985c3 2025-11-13 16:34:28,056 - INFO - Project ctest-TestRbac-63747446 not found, creating it 2025-11-13 16:34:28,523 - INFO - Created Project:ctest-TestRbac-63747446, ID : 6dfbd6e4-1d4d-4cf0-9406-1bdc30398496 2025-11-13 16:34:30,407 - DEBUG - Requesting: http://10.0.0.22:8082/api-access-list/89bfa3bc-4036-4f28-8a25-3514201527f7 2025-11-13 16:34:30,763 - DEBUG - Requesting: http://10.0.0.22:8082/api-access-list/89bfa3bc-4036-4f28-8a25-3514201527f7 2025-11-13 16:34:30,821 - DEBUG - API access-list (89bfa3bc-4036-4f28-8a25-3514201527f7) found in api server 2025-11-13 16:34:30,821 - INFO - API access-list 89bfa3bc-4036-4f28-8a25-3514201527f7 verify on api server passed 2025-11-13 16:34:31,451 - INFO - Created VN ctest-TestRbac-24359158-79843319, UUID :29ffd837-b096-46bb-a7ec-773f0200a3a9 2025-11-13 16:34:31,861 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/29ffd837-b096-46bb-a7ec-773f0200a3a9 2025-11-13 16:34:32,196 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/29ffd837-b096-46bb-a7ec-773f0200a3a9 2025-11-13 16:34:32,235 - INFO - API Server: Read VN 29ffd837-b096-46bb-a7ec-773f0200a3a9 2025-11-13 16:34:32,235 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/29ffd837-b096-46bb-a7ec-773f0200a3a9 2025-11-13 16:34:32,558 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/29ffd837-b096-46bb-a7ec-773f0200a3a9 2025-11-13 16:34:32,610 - INFO - API Server: Read VN 29ffd837-b096-46bb-a7ec-773f0200a3a9 2025-11-13 16:34:32,610 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestRbac-24359158:ctest-TestRbac-24359158-79843319?flat 2025-11-13 16:34:32,944 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestRbac-24359158:ctest-TestRbac-24359158-79843319?flat 2025-11-13 16:34:33,492 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-13 16:34:33,614 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestRbac-24359158:ctest-TestRbac-24359158-79843319?flat 2025-11-13 16:34:33,934 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestRbac-24359158:ctest-TestRbac-24359158-79843319?flat 2025-11-13 16:34:34,095 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-13 16:34:35,005 - WARNING - Unable to get the list of compute nodes 2025-11-13 16:34:36,209 - INFO - VM ([]) created on node: (None), Zone: (None) 2025-11-13 16:34:36,253 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-11-13 16:34:41,318 - DEBUG - VM is in ERROR state now 2025-11-13 16:34:41,318 - WARNING - VM in error state. Asserting... 2025-11-13 16:34:41,322 - INFO - Skip interface_detach for VM ctest-TestRbac-63747446-37748214 in state ERROR 2025-11-13 16:34:41,322 - INFO - Deleting VM ctest-TestRbac-63747446-37748214 2025-11-13 16:34:41,352 - ERROR - VM ctest-TestRbac-63747446-37748214 has failed to come up 2025-11-13 16:34:41,352 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-11-13T16:34:37Z', 'message': 'Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 81b7d9b8-0bf7-4ba8-af99-0f91ac88c379.', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 705, in build_instances\n raise exception.MaxRetriesExceeded(reason=msg)\nnova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 81b7d9b8-0bf7-4ba8-af99-0f91ac88c379.\n'} 2025-11-13 16:34:41,353 - INFO - Deleting VN ctest-TestRbac-24359158-79843319 2025-11-13 16:34:41,551 - DEBUG - Requesting: http://10.0.0.22:8082/api-access-list/89bfa3bc-4036-4f28-8a25-3514201527f7 2025-11-13 16:34:41,558 - DEBUG - Response Code: 404 2025-11-13 16:34:41,558 - INFO - API access-list (89bfa3bc-4036-4f28-8a25-3514201527f7) got deleted in api server 2025-11-13 16:34:42,515 - INFO - Deleted project: ctest-TestRbac-63747446, ID : 6dfbd6e4-1d4d-4cf0-9406-1bdc30398496 2025-11-13 16:34:43,287 - INFO - Deleted project: ctest-TestRbac-24359158, ID : 77154a1d-335e-4f6f-975e-d082ae7985c3 2025-11-13 16:34:43,412 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Thu Nov 13 16:34:41 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/rbac/test_rbac.py in test_perms2_global_share(self=) 60 assert self.get_vn_from_analytics(u1_p2_conn, vn.vn_fq_name) 61 assert vn.vn_fq_name in self.list_vn_from_analytics(u1_p2_conn) 62 vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn) 63 assert vm, 'VM creation failed on shared VN' 64 vm undefined self = self.create_vm = > connections undefined u1_p2_conn = vn_fixture undefined vn = /contrail-test/serial_scripts/rbac/base.py in create_vm(self=, vn_fixture=, connections=, verify=True) 232 admin_connections=self.connections) 233 if vm_fixture and verify: 234 assert vm_fixture.verify_on_setup(), 'VM verification failed' 235 return vm_fixture 236 vm_fixture = vm_fixture.verify_on_setup = > AssertionError: VM verification failed __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('VM verification failed',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/rbac/test_rbac.py", line 62, in test_perms2_global_share vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn) File "/contrail-test/serial_scripts/rbac/base.py", line 234, in create_vm assert vm_fixture.verify_on_setup(), 'VM verification failed' AssertionError: VM verification failed 2025-11-13 16:34:43,412 - DEBUG - Skipping xmpp flap check 2025-11-13 16:34:43,412 - INFO -
2025-11-13 16:34:43,413 - INFO - END TEST : test_perms2_global_share : FAILED[0:00:17]
2025-11-13 16:34:43,413 - INFO - -------------------------------------------------------------------------------- 2025-11-13 16:34:44,864 - INFO - Deleted project: ctest-TestRbac-48174385, ID : 1b4be467-182a-461d-a063-16d884fd2daf 2025-11-13 16:34:47,301 - DEBUG - [10.0.0.22]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2025-11-13 16:34:47,440 - DEBUG - Output : rbac 2025-11-13 16:34:49,669 - DEBUG - Requesting: http://10.0.0.22:8082/aaa-mode 2025-11-13 16:36:00,777 - DEBUG - Requesting: http://10.0.0.22:8082/aaa-mode 2025-11-13 16:37:10,012 - DEBUG - [10.0.0.22]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-11-13 16:37:10,119 - DEBUG - Output : contrail_test_rSebjXSaV vrouter_vrouter-agent_1 vrouter_provisioner_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_kafka_1 analytics_api_1 analytics_collector_1 analytics_provisioner_1 analytics_nodemgr_1 analytics_database_query-engine_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_cassandra_1 control_named_1 control_provisioner_1 control_control_1 control_nodemgr_1 control_dns_1 webui_job_1 webui_web_1 config_devicemgr_1 config_schema_1 config_svcmonitor_1 config_api_1 config_provisioner_1 config_nodemgr_1 config_dnsmasq_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_nodemgr_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd