2026-04-01 17:57:53,749 - DEBUG - [10.0.0.22]: Running cmd : hostname
2026-04-01 17:57:54,265 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5572-1
2026-04-01 17:57:54,265 - DEBUG - [10.0.0.22]: Running cmd : hostname -f
2026-04-01 17:57:54,330 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5572-1.
2026-04-01 17:57:54,330 - DEBUG - [10.0.0.22]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2026-04-01 17:57:54,424 - DEBUG - Output : NAMES
contrail_test_KuOnfw1tb
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_snmp_snmp-collector_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_nodemgr_1
analytics_api_1
analytics_collector_1
analytics_database_nodemgr_1
analytics_database_query-engine_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_dns_1
control_nodemgr_1
webui_job_1
webui_web_1
config_devicemgr_1
config_schema_1
config_nodemgr_1
config_svcmonitor_1
config_dnsmasq_1
config_api_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_api_cfn
heat_api
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
mariadb_clustercheck
cron
kolla_toolbox
fluentd
2026-04-01 17:57:54,424 - DEBUG - [10.0.0.22]: Running cmd : getent hosts 10.0.0.22 | head -n 1 | awk '{print $2}'
2026-04-01 17:57:54,494 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5572-1.
2026-04-01 17:57:54,494 - DEBUG - [10.0.0.22]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2026-04-01 17:57:54,562 - DEBUG - Output : 127.0.0.1/8
10.0.0.22/24
172.17.0.1/16
10.20.0.14/24
2026-04-01 17:57:54,562 - DEBUG - [10.0.0.22]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2026-04-01 17:57:54,626 - DEBUG - Output : 10.20.0.14/24
2026-04-01 17:57:54,626 - DEBUG - [10.0.0.22]: Running cmd : getent hosts 10.20.0.14 | head -n 1 | awk '{print $2}'
2026-04-01 17:57:54,700 - DEBUG - Output :
2026-04-01 17:57:56,718 - INFO - Using existing project ['default-domain', 'admin'](1b26dbbb-2f76-440c-832f-88b986281b26)
2026-04-01 17:57:56,843 - INFO - ================================================================================
2026-04-01 17:57:56,843 - INFO - STARTING TEST : test_contrail_status
2026-04-01 17:57:56,844 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-04-01 17:57:56,982 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:57:56,988 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.20.0.14': '0'}} with
2026-04-01 17:57:56,988 - INFO - Initial checks done. Running the testcase now
2026-04-01 17:57:56,988 - INFO -
2026-04-01 17:57:56,989 - DEBUG - [10.0.0.22]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2026-04-01 17:57:57,079 - DEBUG - Output : contrail_test_KuOnfw1tb
vrouter_vrouter-agent_1
vrouter_provisioner_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_provisioner_1
analytics_snmp_topology_1
analytics_snmp_snmp-collector_1
analytics_alarm_provisioner_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_nodemgr_1
analytics_provisioner_1
analytics_api_1
analytics_collector_1
analytics_database_nodemgr_1
analytics_database_query-engine_1
analytics_database_provisioner_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_dns_1
control_nodemgr_1
control_provisioner_1
webui_job_1
webui_web_1
config_devicemgr_1
config_schema_1
config_provisioner_1
config_nodemgr_1
config_svcmonitor_1
config_dnsmasq_1
config_api_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_provisioner_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_api_cfn
heat_api
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
mariadb_clustercheck
cron
kolla_toolbox
fluentd
2026-04-01 17:57:57,079 - INFO - 10.0.0.22
2026-04-01 17:57:57,079 - INFO - config
2026-04-01 17:57:57,084 - INFO - config-nodemgr:active
2026-04-01 17:57:57,088 - INFO - api-server:active
2026-04-01 17:57:57,091 - INFO - schema:active
2026-04-01 17:57:57,095 - INFO - svc-monitor:active
2026-04-01 17:57:57,098 - INFO - device-manager:active
2026-04-01 17:57:57,098 - INFO - config-database
2026-04-01 17:57:57,098 - INFO - config-cassandra:active
2026-04-01 17:57:57,098 - INFO - config-zookeeper:active
2026-04-01 17:57:57,098 - INFO - config-rabbitmq:active
2026-04-01 17:57:57,098 - INFO - vrouter
2026-04-01 17:57:57,102 - INFO - vrouter-nodemgr:active
2026-04-01 17:57:57,107 - INFO - agent:active
2026-04-01 17:57:57,107 - INFO - control
2026-04-01 17:57:57,111 - INFO - control-nodemgr:active
2026-04-01 17:57:57,115 - INFO - control:active
2026-04-01 17:57:57,115 - INFO - named:active
2026-04-01 17:57:57,120 - INFO - dns:active
2026-04-01 17:57:57,120 - INFO - analytics
2026-04-01 17:57:57,124 - INFO - analytics-nodemgr:active
2026-04-01 17:57:57,127 - INFO - analytics-api:active
2026-04-01 17:57:57,131 - INFO - collector:active
2026-04-01 17:57:57,131 - INFO - analytics-database
2026-04-01 17:57:57,131 - INFO - analytics-cassandra:active
2026-04-01 17:57:57,135 - INFO - analyticsdb-nodemgr:active
2026-04-01 17:57:57,139 - INFO - query-engine:active
2026-04-01 17:57:57,139 - INFO - webui
2026-04-01 17:57:57,139 - INFO - webui:active
2026-04-01 17:57:57,140 - INFO - webui-middleware:active
2026-04-01 17:57:57,140 - INFO - redis:active
2026-04-01 17:57:57,140 - INFO - analytics_snmp
2026-04-01 17:57:57,143 - INFO - snmp-collector:active
2026-04-01 17:57:57,143 - INFO - snmp-topology:active
2026-04-01 17:57:57,143 - INFO - analytics_alarm
2026-04-01 17:57:57,143 - INFO - alarmgen:active
2026-04-01 17:57:57,143 - INFO - All the contrail services are up on all nodes
2026-04-01 17:57:57,143 - INFO - contrail-status passed
2026-04-01 17:57:57,272 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:57:57,276 - DEBUG - No XMPP flaps were noticed during the test
2026-04-01 17:57:57,277 - INFO - END TEST : test_contrail_status : PASSED[0:00:01]
2026-04-01 17:57:57,277 - INFO - --------------------------------------------------------------------------------
2026-04-01 17:57:59,624 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:58:00,201 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:58:01,200 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:58:01,205 - DEBUG - [10.0.0.22]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check'
2026-04-01 17:58:04,532 - DEBUG - Output : 2026-04-01 17:58:03,684 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success
2026-04-01 17:58:03,714 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success
2026-04-01 17:58:03,839 INFO: (v1.41) Checker check_obj_mandatory_fields: Success
2026-04-01 17:58:04,012 INFO: (v1.41) Checker check_orphan_resources: Success
2026-04-01 17:58:04,224 INFO: (v1.41) Checker check_fq_name_uuid_match: Success
2026-04-01 17:58:04,224 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before.
2026-04-01 17:58:04,345 INFO: (v1.41) Checker check_duplicate_fq_name: Success
2026-04-01 17:58:04,358 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success
2026-04-01 17:58:04,364 INFO: (v1.41) Checker check_subnet_uuid: Success
2026-04-01 17:58:04,372 INFO: (v1.41) Checker check_subnet_addr_alloc: Success
2026-04-01 17:58:04,395 INFO: (v1.41) Checker check_route_targets_id: Success
2026-04-01 17:58:04,403 INFO: (v1.41) Checker check_virtual_networks_id: Success
2026-04-01 17:58:04,410 INFO: (v1.41) Checker check_security_groups_id: Success
2026-04-01 17:58:04,413 INFO: (v1.41) Checker check_ipam_subnet_method: Success
2026-04-01 17:58:04,414 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success
2026-04-01 17:58:04,684 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:58:04,904 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:58:05,068 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:58:05,231 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:58:05,396 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:58:07,927 - INFO - admin user already present
2026-04-01 17:58:08,700 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:58:09,305 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:58:12,508 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:12,728 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:18,668 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:19,237 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:19,400 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:19,613 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:22,656 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:23,233 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:26,387 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:27,841 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:30,828 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:31,489 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:34,512 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:34,672 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:35,597 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:35,760 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:38,885 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:39,445 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:42,590 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:43,269 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:46,620 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:47,313 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:50,320 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:52,412 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:55,432 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:56,034 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:58,992 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:59,556 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 17:59:59,712 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 18:00:00,265 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 18:00:00,424 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 18:00:01,019 - DEBUG - Requesting: http://10.0.0.22:8085/Snh_AgentXmppConnectionStatusReq?
2026-04-01 18:03:49,191 - INFO - Using existing project ['default-domain', 'admin'](1b26dbbb-2f76-440c-832f-88b986281b26)
2026-04-01 18:03:49,199 - INFO - ================================================================================
2026-04-01 18:03:49,199 - INFO - STARTING TEST : test_contrail_status
2026-04-01 18:03:49,199 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-04-01 18:03:49,316 - DEBUG - Skipping xmpp flap check
2026-04-01 18:03:49,316 - INFO - Initial checks done. Running the testcase now
2026-04-01 18:03:49,316 - INFO -
2026-04-01 18:03:49,413 - INFO - 10.0.0.22
2026-04-01 18:03:49,413 - INFO - config
2026-04-01 18:03:49,419 - INFO - config-nodemgr:active
2026-04-01 18:03:49,423 - INFO - api-server:active
2026-04-01 18:03:49,427 - INFO - schema:active
2026-04-01 18:03:49,430 - INFO - svc-monitor:active
2026-04-01 18:03:49,433 - INFO - device-manager:active
2026-04-01 18:03:49,433 - INFO - config-database
2026-04-01 18:03:49,433 - INFO - config-cassandra:active
2026-04-01 18:03:49,433 - INFO - config-zookeeper:active
2026-04-01 18:03:49,433 - INFO - config-rabbitmq:active
2026-04-01 18:03:49,433 - INFO - vrouter
2026-04-01 18:03:49,439 - INFO - vrouter-nodemgr:active
2026-04-01 18:03:49,442 - INFO - agent:active
2026-04-01 18:03:49,443 - INFO - control
2026-04-01 18:03:49,447 - INFO - control-nodemgr:active
2026-04-01 18:03:49,451 - INFO - control:active
2026-04-01 18:03:49,451 - INFO - named:active
2026-04-01 18:03:49,456 - INFO - dns:active
2026-04-01 18:03:49,456 - INFO - analytics
2026-04-01 18:03:49,460 - INFO - analytics-nodemgr:active
2026-04-01 18:03:49,463 - INFO - analytics-api:active
2026-04-01 18:03:49,467 - INFO - collector:active
2026-04-01 18:03:49,467 - INFO - analytics-database
2026-04-01 18:03:49,468 - INFO - analytics-cassandra:active
2026-04-01 18:03:49,472 - INFO - analyticsdb-nodemgr:active
2026-04-01 18:03:49,476 - INFO - query-engine:active
2026-04-01 18:03:49,476 - INFO - webui
2026-04-01 18:03:49,476 - INFO - webui:active
2026-04-01 18:03:49,476 - INFO - webui-middleware:active
2026-04-01 18:03:49,476 - INFO - redis:active
2026-04-01 18:03:49,476 - INFO - analytics_snmp
2026-04-01 18:03:49,480 - INFO - snmp-collector:active
2026-04-01 18:03:49,480 - INFO - snmp-topology:active
2026-04-01 18:03:49,480 - INFO - analytics_alarm
2026-04-01 18:03:49,480 - INFO - alarmgen:active
2026-04-01 18:03:49,480 - INFO - All the contrail services are up on all nodes
2026-04-01 18:03:49,480 - INFO - contrail-status passed
2026-04-01 18:03:49,600 - DEBUG - Skipping xmpp flap check
2026-04-01 18:03:49,600 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2026-04-01 18:03:49,600 - INFO - --------------------------------------------------------------------------------