2025-10-10 12:15:14,518 - DEBUG - [10.0.0.27]: Running cmd : hostname 2025-10-10 12:15:15,150 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4285-1 2025-10-10 12:15:15,150 - DEBUG - [10.0.0.27]: Running cmd : hostname -f 2025-10-10 12:15:15,214 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4285-1. 2025-10-10 12:15:15,214 - DEBUG - [10.0.0.27]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-10-10 12:15:15,345 - DEBUG - Output : NAMES contrail_test_fBcfQJU3z vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_alarm_alarm-gen_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_api_1 analytics_collector_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_nodemgr_1 control_control_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_api_1 config_svcmonitor_1 config_nodemgr_1 config_dnsmasq_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-10-10 12:15:15,346 - DEBUG - [10.0.0.27]: Running cmd : getent hosts 10.0.0.27 | head -n 1 | awk '{print $2}' 2025-10-10 12:15:15,406 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4285-1. 2025-10-10 12:15:15,406 - DEBUG - [10.0.0.27]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-10-10 12:15:15,481 - DEBUG - Output : 127.0.0.1/8 10.0.0.27/24 172.17.0.1/16 10.20.0.254/24 2025-10-10 12:15:15,482 - DEBUG - [10.0.0.27]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-10-10 12:15:15,537 - DEBUG - Output : 10.20.0.254/24 2025-10-10 12:15:15,538 - DEBUG - [10.0.0.27]: Running cmd : getent hosts 10.20.0.254 | head -n 1 | awk '{print $2}' 2025-10-10 12:15:15,612 - DEBUG - Output : 2025-10-10 12:15:16,460 - DEBUG - Not creating keypair since it exists 2025-10-10 12:15:16,523 - INFO - Domain Default found not creating 2025-10-10 12:15:17,071 - INFO - Project ctest-TestRbac-20030484 not found, creating it 2025-10-10 12:15:17,594 - INFO - Created Project:ctest-TestRbac-20030484, ID : ab566865-ea87-43e0-be91-c3c89a0ccde0 2025-10-10 12:15:19,151 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2025-10-10 12:15:19,250 - DEBUG - Output : /bin/bash: line 1: crudini: command not found 2025-10-10 12:15:21,792 - INFO - ================================================================================ 2025-10-10 12:15:21,792 - INFO - STARTING TEST : test_perms2_global_share 2025-10-10 12:15:21,792 - INFO - TEST DESCRIPTION : Test perms2 global shared property of an object steps: 1. Add user1 as role1 in project1 and project2 2. Add *.* role1:CRUD to domain acl 3. Create a Shared virtual-network in project1 4. Verify global shared flag is set on VN's perms2 4. Using shared VN try to launch a VM in project2 2025-10-10 12:15:21,916 - DEBUG - Skipping xmpp flap check 2025-10-10 12:15:21,916 - DEBUG - Requesting: http://10.0.0.27:8082/aaa-mode 2025-10-10 12:15:22,222 - DEBUG - Requesting: http://10.0.0.27:8082/aaa-mode 2025-10-10 12:15:22,255 - INFO - Initial checks done. Running the testcase now 2025-10-10 12:15:22,255 - INFO - 2025-10-10 12:15:22,619 - INFO - Project ctest-TestRbac-15052617 not found, creating it 2025-10-10 12:15:23,134 - INFO - Created Project:ctest-TestRbac-15052617, ID : 7fc80159-fa37-47e1-b75c-d903cc7eca12 2025-10-10 12:15:23,494 - INFO - Project ctest-TestRbac-54572388 not found, creating it 2025-10-10 12:15:23,996 - INFO - Created Project:ctest-TestRbac-54572388, ID : 0cc44b3d-582a-4487-8e67-ea80f6ea02f4 2025-10-10 12:15:25,967 - DEBUG - Requesting: http://10.0.0.27:8082/api-access-list/23534dc0-30d1-4efb-a76b-9aa19ca57b52 2025-10-10 12:15:26,314 - DEBUG - Requesting: http://10.0.0.27:8082/api-access-list/23534dc0-30d1-4efb-a76b-9aa19ca57b52 2025-10-10 12:15:26,393 - DEBUG - API access-list (23534dc0-30d1-4efb-a76b-9aa19ca57b52) found in api server 2025-10-10 12:15:26,393 - INFO - API access-list 23534dc0-30d1-4efb-a76b-9aa19ca57b52 verify on api server passed 2025-10-10 12:15:27,014 - INFO - Created VN ctest-TestRbac-15052617-88356715, UUID :a976313b-c3fd-4406-ad42-3f603fc46941 2025-10-10 12:15:27,456 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a976313b-c3fd-4406-ad42-3f603fc46941 2025-10-10 12:15:27,767 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a976313b-c3fd-4406-ad42-3f603fc46941 2025-10-10 12:15:27,817 - INFO - API Server: Read VN a976313b-c3fd-4406-ad42-3f603fc46941 2025-10-10 12:15:27,818 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a976313b-c3fd-4406-ad42-3f603fc46941 2025-10-10 12:15:28,126 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a976313b-c3fd-4406-ad42-3f603fc46941 2025-10-10 12:15:28,177 - INFO - API Server: Read VN a976313b-c3fd-4406-ad42-3f603fc46941 2025-10-10 12:15:29,064 - WARNING - Unable to get the list of compute nodes 2025-10-10 12:15:30,338 - INFO - VM ([]) created on node: (None), Zone: (None) 2025-10-10 12:15:30,391 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-10 12:15:35,456 - DEBUG - VM is in ERROR state now 2025-10-10 12:15:35,456 - WARNING - VM in error state. Asserting... 2025-10-10 12:15:35,461 - INFO - Skip interface_detach for VM ctest-TestRbac-54572388-78774061 in state ERROR 2025-10-10 12:15:35,461 - INFO - Deleting VM ctest-TestRbac-54572388-78774061 2025-10-10 12:15:35,493 - ERROR - VM ctest-TestRbac-54572388-78774061 has failed to come up 2025-10-10 12:15:35,493 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-10-10T12:15:32Z', 'message': 'Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 4e2fd326-0890-4b28-ae92-bc3da0872044.', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 703, in build_instances\n raise exception.MaxRetriesExceeded(reason=msg)\nnova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 4e2fd326-0890-4b28-ae92-bc3da0872044.\n'} 2025-10-10 12:15:35,494 - INFO - Deleting VN ctest-TestRbac-15052617-88356715 2025-10-10 12:15:35,618 - DEBUG - Requesting: http://10.0.0.27:8082/api-access-list/23534dc0-30d1-4efb-a76b-9aa19ca57b52 2025-10-10 12:15:35,625 - DEBUG - Response Code: 404 2025-10-10 12:15:35,626 - INFO - API access-list (23534dc0-30d1-4efb-a76b-9aa19ca57b52) got deleted in api server 2025-10-10 12:15:36,631 - INFO - Deleted project: ctest-TestRbac-54572388, ID : 0cc44b3d-582a-4487-8e67-ea80f6ea02f4 2025-10-10 12:15:37,399 - INFO - Deleted project: ctest-TestRbac-15052617, ID : 7fc80159-fa37-47e1-b75c-d903cc7eca12 2025-10-10 12:15:37,534 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Fri Oct 10 12:15:35 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/rbac/test_rbac.py in test_perms2_global_share(self=) 60 assert self.get_vn_from_analytics(u1_p2_conn, vn.vn_fq_name) 61 assert vn.vn_fq_name in self.list_vn_from_analytics(u1_p2_conn) 62 vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn) 63 assert vm, 'VM creation failed on shared VN' 64 vm undefined self = self.create_vm = > connections undefined u1_p2_conn = vn_fixture undefined vn = /contrail-test/serial_scripts/rbac/base.py in create_vm(self=, vn_fixture=, connections=, verify=True) 232 admin_connections=self.connections) 233 if vm_fixture and verify: 234 assert vm_fixture.verify_on_setup(), 'VM verification failed' 235 return vm_fixture 236 vm_fixture = vm_fixture.verify_on_setup = > AssertionError: VM verification failed __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('VM verification failed',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/rbac/test_rbac.py", line 62, in test_perms2_global_share vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn) File "/contrail-test/serial_scripts/rbac/base.py", line 234, in create_vm assert vm_fixture.verify_on_setup(), 'VM verification failed' AssertionError: VM verification failed 2025-10-10 12:15:37,535 - DEBUG - Skipping xmpp flap check 2025-10-10 12:15:37,535 - INFO -
2025-10-10 12:15:37,535 - INFO - END TEST : test_perms2_global_share : FAILED[0:00:16]
2025-10-10 12:15:37,535 - INFO - -------------------------------------------------------------------------------- 2025-10-10 12:15:39,135 - INFO - Deleted project: ctest-TestRbac-20030484, ID : ab566865-ea87-43e0-be91-c3c89a0ccde0 2025-10-10 12:15:41,597 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2025-10-10 12:15:41,683 - DEBUG - Output : /bin/bash: line 1: crudini: command not found 2025-10-10 12:15:43,830 - DEBUG - Requesting: http://10.0.0.27:8082/aaa-mode 2025-10-10 12:15:53,493 - DEBUG - Requesting: http://10.0.0.27:8082/aaa-mode 2025-10-10 12:16:05,211 - DEBUG - [10.0.0.27]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-10-10 12:16:05,321 - DEBUG - Output : contrail_test_fBcfQJU3z vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_nodemgr_1 control_control_1 control_provisioner_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_api_1 config_svcmonitor_1 config_provisioner_1 config_nodemgr_1 config_dnsmasq_1 config_database_provisioner_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd