2026-06-10 13:55:40,421 - DEBUG - [10.0.0.50]: Running cmd : hostname
2026-06-10 13:55:40,631 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5925-1
2026-06-10 13:55:40,631 - DEBUG - [10.0.0.50]: Running cmd : hostname -f
2026-06-10 13:55:40,755 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5925-1.
2026-06-10 13:55:40,755 - DEBUG - [10.0.0.50]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2026-06-10 13:55:40,859 - DEBUG - Output : NAMES
contrail_test_Nu3cp19KO
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_snmp-collector_1
analytics_snmp_topology_1
analytics_snmp_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_nodemgr_1
analytics_alarm_kafka_1
analytics_api_1
analytics_nodemgr_1
analytics_collector_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_nodemgr_1
control_dns_1
control_control_1
webui_job_1
webui_web_1
config_devicemgr_1
config_api_1
config_schema_1
config_nodemgr_1
config_dnsmasq_1
config_svcmonitor_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
mariadb_clustercheck
cron
kolla_toolbox
fluentd
2026-06-10 13:55:40,860 - DEBUG - [10.0.0.50]: Running cmd : getent hosts 10.0.0.50 | head -n 1 | awk '{print $2}'
2026-06-10 13:55:40,938 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5925-1.
2026-06-10 13:55:40,938 - DEBUG - [10.0.0.50]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2026-06-10 13:55:41,069 - DEBUG - Output : 127.0.0.1/8
10.0.0.50/24
172.17.0.1/16
10.20.0.254/24
2026-06-10 13:55:41,070 - DEBUG - [10.0.0.50]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2026-06-10 13:55:41,138 - DEBUG - Output : 10.20.0.254/24
2026-06-10 13:55:41,138 - DEBUG - [10.0.0.50]: Running cmd : getent hosts 10.20.0.254 | head -n 1 | awk '{print $2}'
2026-06-10 13:55:41,205 - DEBUG - Output :
2026-06-10 13:55:43,130 - INFO - Using existing project ['default-domain', 'admin'](5897c61c-4a24-4c58-a70e-b470836a7b32)
2026-06-10 13:55:43,291 - INFO - ================================================================================
2026-06-10 13:55:43,292 - INFO - STARTING TEST : test_contrail_status
2026-06-10 13:55:43,292 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-06-10 13:55:43,440 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:55:43,446 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0'}} with
2026-06-10 13:55:43,446 - INFO - Initial checks done. Running the testcase now
2026-06-10 13:55:43,446 - INFO -
2026-06-10 13:55:43,447 - DEBUG - [10.0.0.50]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2026-06-10 13:55:43,540 - DEBUG - Output : contrail_test_Nu3cp19KO
vrouter_vrouter-agent_1
vrouter_nodemgr_1
vrouter_provisioner_1
rsyslogd_rsyslogd_1
analytics_snmp_snmp-collector_1
analytics_snmp_topology_1
analytics_snmp_provisioner_1
analytics_snmp_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_nodemgr_1
analytics_alarm_provisioner_1
analytics_alarm_kafka_1
analytics_api_1
analytics_provisioner_1
analytics_nodemgr_1
analytics_collector_1
analytics_database_provisioner_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_nodemgr_1
control_dns_1
control_provisioner_1
control_control_1
webui_job_1
webui_web_1
config_devicemgr_1
config_api_1
config_schema_1
config_nodemgr_1
config_provisioner_1
config_dnsmasq_1
config_svcmonitor_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_provisioner_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_api_cfn
heat_api
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
mariadb_clustercheck
cron
kolla_toolbox
fluentd
2026-06-10 13:55:43,540 - INFO - 10.0.0.50
2026-06-10 13:55:43,540 - INFO - config
2026-06-10 13:55:43,547 - INFO - config-nodemgr:active
2026-06-10 13:55:43,552 - INFO - api-server:active
2026-06-10 13:55:43,556 - INFO - schema:active
2026-06-10 13:55:43,560 - INFO - svc-monitor:active
2026-06-10 13:55:43,564 - INFO - device-manager:active
2026-06-10 13:55:43,565 - INFO - config-database
2026-06-10 13:55:43,565 - INFO - config-cassandra:active
2026-06-10 13:55:43,565 - INFO - config-zookeeper:active
2026-06-10 13:55:43,565 - INFO - config-rabbitmq:active
2026-06-10 13:55:43,565 - INFO - vrouter
2026-06-10 13:55:43,569 - INFO - vrouter-nodemgr:active
2026-06-10 13:55:43,574 - INFO - agent:active
2026-06-10 13:55:43,574 - INFO - control
2026-06-10 13:55:43,579 - INFO - control-nodemgr:active
2026-06-10 13:55:43,584 - INFO - control:active
2026-06-10 13:55:43,584 - INFO - named:active
2026-06-10 13:55:43,590 - INFO - dns:active
2026-06-10 13:55:43,590 - INFO - analytics
2026-06-10 13:55:43,594 - INFO - analytics-nodemgr:active
2026-06-10 13:55:43,598 - INFO - analytics-api:active
2026-06-10 13:55:43,603 - INFO - collector:active
2026-06-10 13:55:43,603 - INFO - analytics-database
2026-06-10 13:55:43,603 - INFO - analytics-cassandra:active
2026-06-10 13:55:43,609 - INFO - analyticsdb-nodemgr:active
2026-06-10 13:55:43,614 - INFO - query-engine:active
2026-06-10 13:55:43,614 - INFO - webui
2026-06-10 13:55:43,614 - INFO - webui:active
2026-06-10 13:55:43,614 - INFO - webui-middleware:active
2026-06-10 13:55:43,614 - INFO - redis:active
2026-06-10 13:55:43,614 - INFO - analytics_snmp
2026-06-10 13:55:43,618 - INFO - snmp-collector:active
2026-06-10 13:55:43,618 - INFO - snmp-topology:active
2026-06-10 13:55:43,618 - INFO - analytics_alarm
2026-06-10 13:55:43,618 - INFO - alarmgen:active
2026-06-10 13:55:43,618 - INFO - All the contrail services are up on all nodes
2026-06-10 13:55:43,618 - INFO - contrail-status passed
2026-06-10 13:55:43,745 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:55:43,751 - DEBUG - No XMPP flaps were noticed during the test
2026-06-10 13:55:43,751 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2026-06-10 13:55:43,751 - INFO - --------------------------------------------------------------------------------
2026-06-10 13:55:46,279 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:55:46,881 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:55:48,004 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:55:48,012 - DEBUG - [10.0.0.50]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check'
2026-06-10 13:55:51,555 - DEBUG - Output : 2026-06-10 13:55:50,706 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success
2026-06-10 13:55:50,734 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success
2026-06-10 13:55:50,837 INFO: (v1.41) Checker check_obj_mandatory_fields: Success
2026-06-10 13:55:51,020 INFO: (v1.41) Checker check_orphan_resources: Success
2026-06-10 13:55:51,230 INFO: (v1.41) Checker check_fq_name_uuid_match: Success
2026-06-10 13:55:51,230 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before.
2026-06-10 13:55:51,329 INFO: (v1.41) Checker check_duplicate_fq_name: Success
2026-06-10 13:55:51,341 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success
2026-06-10 13:55:51,347 INFO: (v1.41) Checker check_subnet_uuid: Success
2026-06-10 13:55:51,364 INFO: (v1.41) Checker check_subnet_addr_alloc: Success
2026-06-10 13:55:51,391 INFO: (v1.41) Checker check_route_targets_id: Success
2026-06-10 13:55:51,399 INFO: (v1.41) Checker check_virtual_networks_id: Success
2026-06-10 13:55:51,406 INFO: (v1.41) Checker check_security_groups_id: Success
2026-06-10 13:55:51,409 INFO: (v1.41) Checker check_ipam_subnet_method: Success
2026-06-10 13:55:51,411 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success
2026-06-10 13:55:51,727 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:55:51,925 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:55:52,088 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:55:52,267 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:55:52,429 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:55:55,513 - INFO - admin user already present
2026-06-10 13:55:56,349 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:55:56,998 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:56:01,161 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:01,388 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:08,185 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:08,801 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:08,965 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:09,186 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:12,496 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:13,095 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:16,401 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:18,016 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:21,441 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:22,033 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:25,271 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:25,428 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:26,389 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:26,558 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:29,889 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:30,506 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:33,972 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:34,578 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:38,001 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:38,606 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:41,940 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:44,235 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:47,553 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:48,159 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:51,413 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:52,013 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:52,177 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:52,749 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:52,923 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 13:57:53,517 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2026-06-10 14:01:46,480 - INFO - Using existing project ['default-domain', 'admin'](5897c61c-4a24-4c58-a70e-b470836a7b32)
2026-06-10 14:01:46,489 - INFO - ================================================================================
2026-06-10 14:01:46,489 - INFO - STARTING TEST : test_contrail_status
2026-06-10 14:01:46,489 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-06-10 14:01:46,622 - DEBUG - Skipping xmpp flap check
2026-06-10 14:01:46,623 - INFO - Initial checks done. Running the testcase now
2026-06-10 14:01:46,623 - INFO -
2026-06-10 14:01:46,731 - INFO - 10.0.0.50
2026-06-10 14:01:46,731 - INFO - config
2026-06-10 14:01:46,739 - INFO - config-nodemgr:active
2026-06-10 14:01:46,744 - INFO - api-server:active
2026-06-10 14:01:46,748 - INFO - schema:active
2026-06-10 14:01:46,752 - INFO - svc-monitor:active
2026-06-10 14:01:46,756 - INFO - device-manager:active
2026-06-10 14:01:46,757 - INFO - config-database
2026-06-10 14:01:46,757 - INFO - config-cassandra:active
2026-06-10 14:01:46,757 - INFO - config-zookeeper:active
2026-06-10 14:01:46,757 - INFO - config-rabbitmq:active
2026-06-10 14:01:46,757 - INFO - vrouter
2026-06-10 14:01:46,761 - INFO - vrouter-nodemgr:active
2026-06-10 14:01:46,766 - INFO - agent:active
2026-06-10 14:01:46,766 - INFO - control
2026-06-10 14:01:46,771 - INFO - control-nodemgr:active
2026-06-10 14:01:46,776 - INFO - control:active
2026-06-10 14:01:46,776 - INFO - named:active
2026-06-10 14:01:46,781 - INFO - dns:active
2026-06-10 14:01:46,781 - INFO - analytics
2026-06-10 14:01:46,786 - INFO - analytics-nodemgr:active
2026-06-10 14:01:46,790 - INFO - analytics-api:active
2026-06-10 14:01:46,795 - INFO - collector:active
2026-06-10 14:01:46,795 - INFO - analytics-database
2026-06-10 14:01:46,795 - INFO - analytics-cassandra:active
2026-06-10 14:01:46,800 - INFO - analyticsdb-nodemgr:active
2026-06-10 14:01:46,805 - INFO - query-engine:active
2026-06-10 14:01:46,805 - INFO - webui
2026-06-10 14:01:46,806 - INFO - webui:active
2026-06-10 14:01:46,806 - INFO - webui-middleware:active
2026-06-10 14:01:46,806 - INFO - redis:active
2026-06-10 14:01:46,806 - INFO - analytics_snmp
2026-06-10 14:01:46,810 - INFO - snmp-collector:active
2026-06-10 14:01:46,810 - INFO - snmp-topology:active
2026-06-10 14:01:46,810 - INFO - analytics_alarm
2026-06-10 14:01:46,810 - INFO - alarmgen:active
2026-06-10 14:01:46,810 - INFO - All the contrail services are up on all nodes
2026-06-10 14:01:46,810 - INFO - contrail-status passed
2026-06-10 14:01:46,932 - DEBUG - Skipping xmpp flap check
2026-06-10 14:01:46,932 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2026-06-10 14:01:46,932 - INFO - --------------------------------------------------------------------------------