2026-04-02 12:35:03,727 - DEBUG - [10.0.0.141]: Running cmd : hostname 2026-04-02 12:35:03,940 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5580-1 2026-04-02 12:35:03,940 - DEBUG - [10.0.0.141]: Running cmd : hostname -f 2026-04-02 12:35:04,003 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5580-1. 2026-04-02 12:35:04,004 - DEBUG - [10.0.0.141]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2026-04-02 12:35:04,105 - DEBUG - Output : NAMES contrail_test_s7tsZXIHb vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_nodemgr_1 analytics_collector_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_devicemgr_1 config_api_1 config_schema_1 config_nodemgr_1 config_dnsmasq_1 config_svcmonitor_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_api_cfn heat_api nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb mariadb_clustercheck cron kolla_toolbox fluentd 2026-04-02 12:35:04,105 - DEBUG - [10.0.0.141]: Running cmd : getent hosts 10.0.0.141 | head -n 1 | awk '{print $2}' 2026-04-02 12:35:04,164 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5580-1. 2026-04-02 12:35:04,164 - DEBUG - [10.0.0.141]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2026-04-02 12:35:04,228 - DEBUG - Output : 127.0.0.1/8 10.0.0.141/24 172.17.0.1/16 10.20.0.254/24 2026-04-02 12:35:04,228 - DEBUG - [10.0.0.141]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2026-04-02 12:35:04,292 - DEBUG - Output : 10.20.0.254/24 2026-04-02 12:35:04,292 - DEBUG - [10.0.0.141]: Running cmd : getent hosts 10.20.0.254 | head -n 1 | awk '{print $2}' 2026-04-02 12:35:04,366 - DEBUG - Output : 2026-04-02 12:35:06,139 - INFO - Using existing project ['default-domain', 'admin'](694d8336-de2c-4e5e-a3f4-a190c0d6ca3b) 2026-04-02 12:35:06,273 - INFO - ================================================================================ 2026-04-02 12:35:06,273 - INFO - STARTING TEST : test_contrail_status 2026-04-02 12:35:06,274 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2026-04-02 12:35:06,408 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:06,415 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.254': '0'}} with 2026-04-02 12:35:06,415 - INFO - Initial checks done. Running the testcase now 2026-04-02 12:35:06,415 - INFO - 2026-04-02 12:35:06,415 - DEBUG - [10.0.0.141]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2026-04-02 12:35:06,514 - DEBUG - Output : contrail_test_s7tsZXIHb vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_collector_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_provisioner_1 control_dns_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_devicemgr_1 config_api_1 config_schema_1 config_nodemgr_1 config_dnsmasq_1 config_svcmonitor_1 config_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_api_cfn heat_api nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb mariadb_clustercheck cron kolla_toolbox fluentd 2026-04-02 12:35:06,514 - INFO - 10.0.0.141 2026-04-02 12:35:06,514 - INFO - config 2026-04-02 12:35:06,520 - INFO - config-nodemgr:active 2026-04-02 12:35:06,524 - INFO - api-server:active 2026-04-02 12:35:06,527 - INFO - schema:active 2026-04-02 12:35:06,531 - INFO - svc-monitor:active 2026-04-02 12:35:06,535 - INFO - device-manager:active 2026-04-02 12:35:06,535 - INFO - config-database 2026-04-02 12:35:06,535 - INFO - config-cassandra:active 2026-04-02 12:35:06,535 - INFO - config-zookeeper:active 2026-04-02 12:35:06,535 - INFO - config-rabbitmq:active 2026-04-02 12:35:06,535 - INFO - vrouter 2026-04-02 12:35:06,539 - INFO - vrouter-nodemgr:active 2026-04-02 12:35:06,544 - INFO - agent:active 2026-04-02 12:35:06,544 - INFO - control 2026-04-02 12:35:06,549 - INFO - control-nodemgr:active 2026-04-02 12:35:06,554 - INFO - control:active 2026-04-02 12:35:06,554 - INFO - named:active 2026-04-02 12:35:06,559 - INFO - dns:active 2026-04-02 12:35:06,559 - INFO - analytics 2026-04-02 12:35:06,563 - INFO - analytics-nodemgr:active 2026-04-02 12:35:06,567 - INFO - analytics-api:active 2026-04-02 12:35:06,571 - INFO - collector:active 2026-04-02 12:35:06,571 - INFO - analytics-database 2026-04-02 12:35:06,571 - INFO - analytics-cassandra:active 2026-04-02 12:35:06,576 - INFO - analyticsdb-nodemgr:active 2026-04-02 12:35:06,582 - INFO - query-engine:active 2026-04-02 12:35:06,582 - INFO - webui 2026-04-02 12:35:06,582 - INFO - webui:active 2026-04-02 12:35:06,582 - INFO - webui-middleware:active 2026-04-02 12:35:06,583 - INFO - redis:active 2026-04-02 12:35:06,583 - INFO - analytics_snmp 2026-04-02 12:35:06,587 - INFO - snmp-collector:active 2026-04-02 12:35:06,587 - INFO - snmp-topology:active 2026-04-02 12:35:06,587 - INFO - analytics_alarm 2026-04-02 12:35:06,587 - INFO - alarmgen:active 2026-04-02 12:35:06,587 - INFO - All the contrail services are up on all nodes 2026-04-02 12:35:06,587 - INFO - contrail-status passed 2026-04-02 12:35:06,706 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:06,711 - DEBUG - No XMPP flaps were noticed during the test 2026-04-02 12:35:06,711 - INFO - END TEST : test_contrail_status : PASSED[0:00:00] 2026-04-02 12:35:06,711 - INFO - -------------------------------------------------------------------------------- 2026-04-02 12:35:09,118 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:09,765 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:10,894 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:10,902 - DEBUG - [10.0.0.141]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check' 2026-04-02 12:35:14,285 - DEBUG - Output : 2026-04-02 12:35:13,478 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success 2026-04-02 12:35:13,501 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success 2026-04-02 12:35:13,592 INFO: (v1.41) Checker check_obj_mandatory_fields: Success 2026-04-02 12:35:13,774 INFO: (v1.41) Checker check_orphan_resources: Success 2026-04-02 12:35:13,979 INFO: (v1.41) Checker check_fq_name_uuid_match: Success 2026-04-02 12:35:13,979 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before. 2026-04-02 12:35:14,082 INFO: (v1.41) Checker check_duplicate_fq_name: Success 2026-04-02 12:35:14,093 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success 2026-04-02 12:35:14,100 INFO: (v1.41) Checker check_subnet_uuid: Success 2026-04-02 12:35:14,109 INFO: (v1.41) Checker check_subnet_addr_alloc: Success 2026-04-02 12:35:14,148 INFO: (v1.41) Checker check_route_targets_id: Success 2026-04-02 12:35:14,156 INFO: (v1.41) Checker check_virtual_networks_id: Success 2026-04-02 12:35:14,164 INFO: (v1.41) Checker check_security_groups_id: Success 2026-04-02 12:35:14,167 INFO: (v1.41) Checker check_ipam_subnet_method: Success 2026-04-02 12:35:14,169 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success 2026-04-02 12:35:14,446 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:14,634 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:14,798 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:14,957 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:15,132 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:17,847 - INFO - admin user already present 2026-04-02 12:35:18,631 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:19,279 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:35:22,549 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:22,770 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:29,013 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:29,621 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:29,777 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:30,006 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:33,170 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:33,774 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:37,077 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:38,854 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:42,042 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:42,614 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:45,802 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:45,981 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:46,999 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:47,199 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:50,414 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:50,999 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:54,210 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:54,817 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:58,110 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:36:58,712 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:37:02,072 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:37:04,212 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:37:07,402 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:37:07,991 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:37:11,073 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:37:11,655 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:37:11,814 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:37:12,403 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:37:12,562 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:37:13,175 - DEBUG - Requesting: http://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2026-04-02 12:41:03,864 - INFO - Using existing project ['default-domain', 'admin'](694d8336-de2c-4e5e-a3f4-a190c0d6ca3b) 2026-04-02 12:41:03,872 - INFO - ================================================================================ 2026-04-02 12:41:03,872 - INFO - STARTING TEST : test_contrail_status 2026-04-02 12:41:03,873 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2026-04-02 12:41:03,995 - DEBUG - Skipping xmpp flap check 2026-04-02 12:41:04,008 - INFO - Initial checks done. Running the testcase now 2026-04-02 12:41:04,008 - INFO - 2026-04-02 12:41:04,114 - INFO - 10.0.0.141 2026-04-02 12:41:04,114 - INFO - config 2026-04-02 12:41:04,120 - INFO - config-nodemgr:active 2026-04-02 12:41:04,123 - INFO - api-server:active 2026-04-02 12:41:04,127 - INFO - schema:active 2026-04-02 12:41:04,131 - INFO - svc-monitor:active 2026-04-02 12:41:04,134 - INFO - device-manager:active 2026-04-02 12:41:04,134 - INFO - config-database 2026-04-02 12:41:04,135 - INFO - config-cassandra:active 2026-04-02 12:41:04,135 - INFO - config-zookeeper:active 2026-04-02 12:41:04,135 - INFO - config-rabbitmq:active 2026-04-02 12:41:04,135 - INFO - vrouter 2026-04-02 12:41:04,140 - INFO - vrouter-nodemgr:active 2026-04-02 12:41:04,144 - INFO - agent:active 2026-04-02 12:41:04,144 - INFO - control 2026-04-02 12:41:04,148 - INFO - control-nodemgr:active 2026-04-02 12:41:04,153 - INFO - control:active 2026-04-02 12:41:04,153 - INFO - named:active 2026-04-02 12:41:04,157 - INFO - dns:active 2026-04-02 12:41:04,167 - INFO - analytics 2026-04-02 12:41:04,171 - INFO - analytics-nodemgr:active 2026-04-02 12:41:04,175 - INFO - analytics-api:active 2026-04-02 12:41:04,179 - INFO - collector:active 2026-04-02 12:41:04,179 - INFO - analytics-database 2026-04-02 12:41:04,179 - INFO - analytics-cassandra:active 2026-04-02 12:41:04,183 - INFO - analyticsdb-nodemgr:active 2026-04-02 12:41:04,188 - INFO - query-engine:active 2026-04-02 12:41:04,188 - INFO - webui 2026-04-02 12:41:04,188 - INFO - webui:active 2026-04-02 12:41:04,188 - INFO - webui-middleware:active 2026-04-02 12:41:04,188 - INFO - redis:active 2026-04-02 12:41:04,188 - INFO - analytics_snmp 2026-04-02 12:41:04,191 - INFO - snmp-collector:active 2026-04-02 12:41:04,191 - INFO - snmp-topology:active 2026-04-02 12:41:04,191 - INFO - analytics_alarm 2026-04-02 12:41:04,191 - INFO - alarmgen:active 2026-04-02 12:41:04,191 - INFO - All the contrail services are up on all nodes 2026-04-02 12:41:04,191 - INFO - contrail-status passed 2026-04-02 12:41:04,313 - DEBUG - Skipping xmpp flap check 2026-04-02 12:41:04,313 - INFO - END TEST : test_contrail_status : PASSED[0:00:01] 2026-04-02 12:41:04,313 - INFO - --------------------------------------------------------------------------------