2025-09-18 10:30:50,010 - DEBUG - [10.0.0.254]: Running cmd : hostname 2025-09-18 10:30:50,514 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4136-1 2025-09-18 10:30:50,514 - DEBUG - [10.0.0.254]: Running cmd : hostname -f 2025-09-18 10:30:50,574 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4136-1. 2025-09-18 10:30:50,574 - DEBUG - [10.0.0.254]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-09-18 10:30:50,665 - DEBUG - Output : NAMES contrail_test_qRGHyAG0X vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_control_1 control_nodemgr_1 webui_job_1 webui_web_1 config_devicemgr_1 config_api_1 config_svcmonitor_1 config_schema_1 config_nodemgr_1 config_dnsmasq_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-09-18 10:30:50,665 - DEBUG - [10.0.0.254]: Running cmd : getent hosts 10.0.0.254 | head -n 1 | awk '{print $2}' 2025-09-18 10:30:50,726 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4136-1. 2025-09-18 10:30:50,727 - DEBUG - [10.0.0.254]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-09-18 10:30:50,786 - DEBUG - Output : 127.0.0.1/8 10.0.0.254/24 172.17.0.1/16 10.20.0.17/24 2025-09-18 10:30:50,787 - DEBUG - [10.0.0.254]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-09-18 10:30:50,846 - DEBUG - Output : 10.20.0.17/24 2025-09-18 10:30:50,846 - DEBUG - [10.0.0.254]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}' 2025-09-18 10:30:50,906 - DEBUG - Output : 2025-09-18 10:30:51,636 - DEBUG - Not creating keypair since it exists 2025-09-18 10:30:51,687 - INFO - Domain Default found not creating 2025-09-18 10:30:52,131 - INFO - Project ctest-TestRbac-25769873 not found, creating it 2025-09-18 10:30:52,549 - INFO - Created Project:ctest-TestRbac-25769873, ID : d03f21af-d03f-4d3f-8cf1-325f76c478ce 2025-09-18 10:30:53,910 - DEBUG - [10.0.0.254]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2025-09-18 10:30:53,985 - DEBUG - Output : /bin/bash: line 1: crudini: command not found 2025-09-18 10:30:55,994 - INFO - ================================================================================ 2025-09-18 10:30:55,994 - INFO - STARTING TEST : test_perms2_global_share 2025-09-18 10:30:55,994 - INFO - TEST DESCRIPTION : Test perms2 global shared property of an object steps: 1. Add user1 as role1 in project1 and project2 2. Add *.* role1:CRUD to domain acl 3. Create a Shared virtual-network in project1 4. Verify global shared flag is set on VN's perms2 4. Using shared VN try to launch a VM in project2 2025-09-18 10:30:56,112 - DEBUG - Skipping xmpp flap check 2025-09-18 10:30:56,112 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode 2025-09-18 10:30:56,404 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode 2025-09-18 10:30:56,428 - INFO - Initial checks done. Running the testcase now 2025-09-18 10:30:56,428 - INFO - 2025-09-18 10:30:56,766 - INFO - Project ctest-TestRbac-00171895 not found, creating it 2025-09-18 10:30:57,187 - INFO - Created Project:ctest-TestRbac-00171895, ID : f84fa072-0abd-4f8a-a434-0615b5fc9beb 2025-09-18 10:30:57,533 - INFO - Project ctest-TestRbac-29355233 not found, creating it 2025-09-18 10:30:57,963 - INFO - Created Project:ctest-TestRbac-29355233, ID : 35d2f47b-7214-4ff6-b656-ba88b72f65fc 2025-09-18 10:30:59,664 - DEBUG - Requesting: http://10.0.0.254:8082/api-access-list/4262022e-41f8-4a57-9466-a8f324669d16 2025-09-18 10:30:59,978 - DEBUG - Requesting: http://10.0.0.254:8082/api-access-list/4262022e-41f8-4a57-9466-a8f324669d16 2025-09-18 10:31:00,033 - DEBUG - API access-list (4262022e-41f8-4a57-9466-a8f324669d16) found in api server 2025-09-18 10:31:00,033 - INFO - API access-list 4262022e-41f8-4a57-9466-a8f324669d16 verify on api server passed 2025-09-18 10:31:00,615 - INFO - Created VN ctest-TestRbac-00171895-04770268, UUID :95f92ebc-34be-4df2-a7bf-afe041dcfe60 2025-09-18 10:31:01,002 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/95f92ebc-34be-4df2-a7bf-afe041dcfe60 2025-09-18 10:31:01,291 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/95f92ebc-34be-4df2-a7bf-afe041dcfe60 2025-09-18 10:31:01,336 - INFO - API Server: Read VN 95f92ebc-34be-4df2-a7bf-afe041dcfe60 2025-09-18 10:31:01,336 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/95f92ebc-34be-4df2-a7bf-afe041dcfe60 2025-09-18 10:31:01,627 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/95f92ebc-34be-4df2-a7bf-afe041dcfe60 2025-09-18 10:31:01,667 - INFO - API Server: Read VN 95f92ebc-34be-4df2-a7bf-afe041dcfe60 2025-09-18 10:31:02,526 - WARNING - Unable to get the list of compute nodes 2025-09-18 10:31:03,642 - INFO - VM ([]) created on node: (None), Zone: (None) 2025-09-18 10:31:03,680 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-18 10:31:08,732 - DEBUG - VM is in ERROR state now 2025-09-18 10:31:08,732 - WARNING - VM in error state. Asserting... 2025-09-18 10:31:08,736 - INFO - Skip interface_detach for VM ctest-TestRbac-29355233-71931301 in state ERROR 2025-09-18 10:31:08,736 - INFO - Deleting VM ctest-TestRbac-29355233-71931301 2025-09-18 10:31:08,764 - ERROR - VM ctest-TestRbac-29355233-71931301 has failed to come up 2025-09-18 10:31:08,765 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-09-18T10:31:05Z', 'message': 'Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 4fb04739-23db-44b3-8821-a227024b569a.', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 703, in build_instances\n raise exception.MaxRetriesExceeded(reason=msg)\nnova.exception.MaxRetriesExceeded: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 4fb04739-23db-44b3-8821-a227024b569a.\n'} 2025-09-18 10:31:08,765 - INFO - Deleting VN ctest-TestRbac-00171895-04770268 2025-09-18 10:31:08,861 - DEBUG - Requesting: http://10.0.0.254:8082/api-access-list/4262022e-41f8-4a57-9466-a8f324669d16 2025-09-18 10:31:08,866 - DEBUG - Response Code: 404 2025-09-18 10:31:08,866 - INFO - API access-list (4262022e-41f8-4a57-9466-a8f324669d16) got deleted in api server 2025-09-18 10:31:09,726 - INFO - Deleted project: ctest-TestRbac-29355233, ID : 35d2f47b-7214-4ff6-b656-ba88b72f65fc 2025-09-18 10:31:10,405 - INFO - Deleted project: ctest-TestRbac-00171895, ID : f84fa072-0abd-4f8a-a434-0615b5fc9beb 2025-09-18 10:31:10,525 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Thu Sep 18 10:31:08 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/rbac/test_rbac.py in test_perms2_global_share(self=) 60 assert self.get_vn_from_analytics(u1_p2_conn, vn.vn_fq_name) 61 assert vn.vn_fq_name in self.list_vn_from_analytics(u1_p2_conn) 62 vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn) 63 assert vm, 'VM creation failed on shared VN' 64 vm undefined self = self.create_vm = > connections undefined u1_p2_conn = vn_fixture undefined vn = /contrail-test/serial_scripts/rbac/base.py in create_vm(self=, vn_fixture=, connections=, verify=True) 232 admin_connections=self.connections) 233 if vm_fixture and verify: 234 assert vm_fixture.verify_on_setup(), 'VM verification failed' 235 return vm_fixture 236 vm_fixture = vm_fixture.verify_on_setup = > AssertionError: VM verification failed __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('VM verification failed',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/rbac/test_rbac.py", line 62, in test_perms2_global_share vm = self.create_vm(connections=u1_p2_conn, vn_fixture=vn) File "/contrail-test/serial_scripts/rbac/base.py", line 234, in create_vm assert vm_fixture.verify_on_setup(), 'VM verification failed' AssertionError: VM verification failed 2025-09-18 10:31:10,525 - DEBUG - Skipping xmpp flap check 2025-09-18 10:31:10,525 - INFO -
2025-09-18 10:31:10,525 - INFO - END TEST : test_perms2_global_share : FAILED[0:00:15]
2025-09-18 10:31:10,525 - INFO - -------------------------------------------------------------------------------- 2025-09-18 10:31:11,844 - INFO - Deleted project: ctest-TestRbac-25769873, ID : d03f21af-d03f-4d3f-8cf1-325f76c478ce 2025-09-18 10:31:13,957 - DEBUG - [10.0.0.254]: Running cmd : docker exec --privileged -it analytics_api_1 /bin/bash -c 'crudini --get /etc/contrail/contrail-analytics-api.conf DEFAULTS aaa_mode' 2025-09-18 10:31:14,042 - DEBUG - Output : /bin/bash: line 1: crudini: command not found 2025-09-18 10:31:16,104 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode 2025-09-18 10:31:24,352 - DEBUG - Requesting: http://10.0.0.254:8082/aaa-mode 2025-09-18 10:31:34,992 - DEBUG - [10.0.0.254]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-09-18 10:31:35,089 - DEBUG - Output : contrail_test_qRGHyAG0X vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_provisioner_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_api_1 analytics_provisioner_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_control_1 control_provisioner_1 control_nodemgr_1 webui_job_1 webui_web_1 config_devicemgr_1 config_provisioner_1 config_api_1 config_svcmonitor_1 config_schema_1 config_nodemgr_1 config_dnsmasq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_rabbitmq_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd