2025-08-24 07:43:28,880 - DEBUG - [10.0.0.254]: Running cmd : hostname
2025-08-24 07:43:29,411 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3914-1
2025-08-24 07:43:29,411 - DEBUG - [10.0.0.254]: Running cmd : hostname -f
2025-08-24 07:43:29,471 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3914-1.
2025-08-24 07:43:29,471 - DEBUG - [10.0.0.254]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-08-24 07:43:29,582 - DEBUG - Output : NAMES
contrail_test_zRhwo34j0
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_topology_1
analytics_snmp_nodemgr_1
analytics_snmp_snmp-collector_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_collector_1
analytics_nodemgr_1
analytics_api_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_dns_1
control_nodemgr_1
control_control_1
webui_job_1
webui_web_1
config_devicemgr_1
config_api_1
config_svcmonitor_1
config_nodemgr_1
config_dnsmasq_1
config_schema_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-08-24 07:43:29,582 - DEBUG - [10.0.0.254]: Running cmd : getent hosts 10.0.0.254 | head -n 1 | awk '{print $2}'
2025-08-24 07:43:29,642 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3914-1.
2025-08-24 07:43:29,642 - DEBUG - [10.0.0.254]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2025-08-24 07:43:29,702 - DEBUG - Output : 127.0.0.1/8
10.0.0.254/24
172.17.0.1/16
10.20.0.17/24
2025-08-24 07:43:29,702 - DEBUG - [10.0.0.254]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2025-08-24 07:43:29,763 - DEBUG - Output : 10.20.0.17/24
2025-08-24 07:43:29,763 - DEBUG - [10.0.0.254]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}'
2025-08-24 07:43:29,827 - DEBUG - Output :
2025-08-24 07:43:31,588 - INFO - Using existing project ['default-domain', 'admin'](5e97ff72-75a1-4518-970f-f28b22ee1c7b)
2025-08-24 07:43:31,757 - INFO - ================================================================================
2025-08-24 07:43:31,757 - INFO - STARTING TEST : test_contrail_status
2025-08-24 07:43:31,758 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-08-24 07:43:31,890 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:43:31,898 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with
2025-08-24 07:43:31,899 - INFO - Initial checks done. Running the testcase now
2025-08-24 07:43:31,899 - INFO -
2025-08-24 07:43:31,899 - DEBUG - [10.0.0.254]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2025-08-24 07:43:31,996 - DEBUG - Output : contrail_test_zRhwo34j0
vrouter_vrouter-agent_1
vrouter_nodemgr_1
vrouter_provisioner_1
rsyslogd_rsyslogd_1
analytics_snmp_topology_1
analytics_snmp_nodemgr_1
analytics_snmp_snmp-collector_1
analytics_snmp_provisioner_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_provisioner_1
analytics_alarm_kafka_1
analytics_collector_1
analytics_nodemgr_1
analytics_provisioner_1
analytics_api_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_provisioner_1
analytics_database_cassandra_1
control_named_1
control_dns_1
control_nodemgr_1
control_control_1
control_provisioner_1
webui_job_1
webui_web_1
config_devicemgr_1
config_provisioner_1
config_api_1
config_svcmonitor_1
config_nodemgr_1
config_dnsmasq_1
config_schema_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_provisioner_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-08-24 07:43:31,996 - INFO - 10.0.0.254
2025-08-24 07:43:31,996 - INFO - config
2025-08-24 07:43:32,003 - INFO - config-nodemgr:active
2025-08-24 07:43:32,007 - INFO - api-server:active
2025-08-24 07:43:32,011 - INFO - schema:active
2025-08-24 07:43:32,017 - INFO - svc-monitor:active
2025-08-24 07:43:32,022 - INFO - device-manager:active
2025-08-24 07:43:32,022 - INFO - config-database
2025-08-24 07:43:32,022 - INFO - config-cassandra:active
2025-08-24 07:43:32,022 - INFO - config-zookeeper:active
2025-08-24 07:43:32,022 - INFO - config-rabbitmq:active
2025-08-24 07:43:32,022 - INFO - vrouter
2025-08-24 07:43:32,028 - INFO - vrouter-nodemgr:active
2025-08-24 07:43:32,035 - INFO - agent:active
2025-08-24 07:43:32,035 - INFO - control
2025-08-24 07:43:32,040 - INFO - control-nodemgr:active
2025-08-24 07:43:32,046 - INFO - control:active
2025-08-24 07:43:32,046 - INFO - named:active
2025-08-24 07:43:32,052 - INFO - dns:active
2025-08-24 07:43:32,053 - INFO - analytics
2025-08-24 07:43:32,059 - INFO - analytics-nodemgr:active
2025-08-24 07:43:32,065 - INFO - analytics-api:active
2025-08-24 07:43:32,072 - INFO - collector:active
2025-08-24 07:43:32,072 - INFO - analytics-database
2025-08-24 07:43:32,072 - INFO - analytics-cassandra:active
2025-08-24 07:43:32,078 - INFO - analyticsdb-nodemgr:active
2025-08-24 07:43:32,084 - INFO - query-engine:active
2025-08-24 07:43:32,084 - INFO - webui
2025-08-24 07:43:32,084 - INFO - webui:active
2025-08-24 07:43:32,084 - INFO - webui-middleware:active
2025-08-24 07:43:32,084 - INFO - redis:active
2025-08-24 07:43:32,084 - INFO - analytics_snmp
2025-08-24 07:43:32,088 - INFO - snmp-collector:active
2025-08-24 07:43:32,088 - INFO - snmp-topology:active
2025-08-24 07:43:32,088 - INFO - analytics_alarm
2025-08-24 07:43:32,088 - INFO - alarmgen:active
2025-08-24 07:43:32,088 - INFO - All the contrail services are up on all nodes
2025-08-24 07:43:32,088 - INFO - contrail-status passed
2025-08-24 07:43:32,212 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:43:32,219 - DEBUG - No XMPP flaps were noticed during the test
2025-08-24 07:43:32,219 - INFO - END TEST : test_contrail_status : PASSED[0:00:01]
2025-08-24 07:43:32,219 - INFO - --------------------------------------------------------------------------------
2025-08-24 07:43:34,400 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:43:36,346 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:43:37,341 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:43:37,348 - DEBUG - [10.0.0.254]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check'
2025-08-24 07:43:41,596 - DEBUG - Output : 2025-08-24 07:43:39,642 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success
2025-08-24 07:43:39,679 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success
2025-08-24 07:43:39,971 INFO: (v1.41) Checker check_obj_mandatory_fields: Success
2025-08-24 07:43:40,580 INFO: (v1.41) Checker check_orphan_resources: Success
2025-08-24 07:43:41,086 INFO: (v1.41) Checker check_fq_name_uuid_match: Success
2025-08-24 07:43:41,086 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before.
2025-08-24 07:43:41,401 INFO: (v1.41) Checker check_duplicate_fq_name: Success
2025-08-24 07:43:41,415 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success
2025-08-24 07:43:41,422 INFO: (v1.41) Checker check_subnet_uuid: Success
2025-08-24 07:43:41,432 INFO: (v1.41) Checker check_subnet_addr_alloc: Success
2025-08-24 07:43:41,468 INFO: (v1.41) Checker check_route_targets_id: Success
2025-08-24 07:43:41,479 INFO: (v1.41) Checker check_virtual_networks_id: Success
2025-08-24 07:43:41,488 INFO: (v1.41) Checker check_security_groups_id: Success
2025-08-24 07:43:41,490 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success
2025-08-24 07:43:41,753 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:43:44,478 - INFO - admin user already present
2025-08-24 07:43:45,336 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:43:47,171 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:43:50,361 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:43:50,612 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:43:57,412 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:43:59,906 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:03,037 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:04,896 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:05,064 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:05,961 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:08,925 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:12,205 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:15,244 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:18,157 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:21,241 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:24,721 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:27,648 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:27,816 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:30,129 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:30,293 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:33,353 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:36,593 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:39,672 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:41,941 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:46,121 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:48,001 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:51,024 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:53,925 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:56,897 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:44:58,245 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:45:01,301 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:45:02,673 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:45:02,832 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:45:04,186 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:45:04,348 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:45:05,634 - DEBUG - Requesting: http://10.0.0.254:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-24 07:48:53,956 - INFO - Using existing project ['default-domain', 'admin'](5e97ff72-75a1-4518-970f-f28b22ee1c7b)
2025-08-24 07:48:53,967 - INFO - ================================================================================
2025-08-24 07:48:53,967 - INFO - STARTING TEST : test_contrail_status
2025-08-24 07:48:53,967 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-08-24 07:48:54,092 - DEBUG - Skipping xmpp flap check
2025-08-24 07:48:54,092 - INFO - Initial checks done. Running the testcase now
2025-08-24 07:48:54,092 - INFO -
2025-08-24 07:48:54,188 - INFO - 10.0.0.254
2025-08-24 07:48:54,188 - INFO - config
2025-08-24 07:48:54,194 - INFO - config-nodemgr:active
2025-08-24 07:48:54,198 - INFO - api-server:active
2025-08-24 07:48:54,202 - INFO - schema:active
2025-08-24 07:48:54,206 - INFO - svc-monitor:active
2025-08-24 07:48:54,209 - INFO - device-manager:active
2025-08-24 07:48:54,210 - INFO - config-database
2025-08-24 07:48:54,210 - INFO - config-cassandra:active
2025-08-24 07:48:54,210 - INFO - config-zookeeper:active
2025-08-24 07:48:54,210 - INFO - config-rabbitmq:active
2025-08-24 07:48:54,210 - INFO - vrouter
2025-08-24 07:48:54,214 - INFO - vrouter-nodemgr:active
2025-08-24 07:48:54,219 - INFO - agent:active
2025-08-24 07:48:54,219 - INFO - control
2025-08-24 07:48:54,224 - INFO - control-nodemgr:active
2025-08-24 07:48:54,229 - INFO - control:active
2025-08-24 07:48:54,229 - INFO - named:active
2025-08-24 07:48:54,233 - INFO - dns:active
2025-08-24 07:48:54,234 - INFO - analytics
2025-08-24 07:48:54,238 - INFO - analytics-nodemgr:active
2025-08-24 07:48:54,242 - INFO - analytics-api:active
2025-08-24 07:48:54,247 - INFO - collector:active
2025-08-24 07:48:54,247 - INFO - analytics-database
2025-08-24 07:48:54,247 - INFO - analytics-cassandra:active
2025-08-24 07:48:54,252 - INFO - analyticsdb-nodemgr:active
2025-08-24 07:48:54,257 - INFO - query-engine:active
2025-08-24 07:48:54,258 - INFO - webui
2025-08-24 07:48:54,258 - INFO - webui:active
2025-08-24 07:48:54,258 - INFO - webui-middleware:active
2025-08-24 07:48:54,258 - INFO - redis:active
2025-08-24 07:48:54,258 - INFO - analytics_snmp
2025-08-24 07:48:54,262 - INFO - snmp-collector:active
2025-08-24 07:48:54,262 - INFO - snmp-topology:active
2025-08-24 07:48:54,262 - INFO - analytics_alarm
2025-08-24 07:48:54,262 - INFO - alarmgen:active
2025-08-24 07:48:54,262 - INFO - All the contrail services are up on all nodes
2025-08-24 07:48:54,262 - INFO - contrail-status passed
2025-08-24 07:48:54,380 - DEBUG - Skipping xmpp flap check
2025-08-24 07:48:54,380 - INFO - END TEST : test_contrail_status : PASSED[0:00:01]
2025-08-24 07:48:54,380 - INFO - --------------------------------------------------------------------------------