2025-08-27 14:15:20,067 - DEBUG - [10.0.0.38]: Running cmd : hostname 2025-08-27 14:15:20,278 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3949-1 2025-08-27 14:15:20,278 - DEBUG - [10.0.0.38]: Running cmd : hostname -f 2025-08-27 14:15:20,345 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3949-1. 2025-08-27 14:15:20,346 - DEBUG - [10.0.0.38]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-08-27 14:15:20,440 - DEBUG - Output : NAMES contrail_test_ooNjbm7BJ vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_nodemgr_1 control_dns_1 control_control_1 webui_web_1 webui_job_1 config_devicemgr_1 config_dnsmasq_1 config_svcmonitor_1 config_nodemgr_1 config_schema_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-08-27 14:15:20,440 - DEBUG - [10.0.0.38]: Running cmd : getent hosts 10.0.0.38 | head -n 1 | awk '{print $2}' 2025-08-27 14:15:20,497 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3949-1. 2025-08-27 14:15:20,498 - DEBUG - [10.0.0.38]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-08-27 14:15:20,561 - DEBUG - Output : 127.0.0.1/8 10.0.0.38/24 172.17.0.1/16 10.20.0.254/24 2025-08-27 14:15:20,562 - DEBUG - [10.0.0.38]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-08-27 14:15:20,622 - DEBUG - Output : 10.20.0.254/24 2025-08-27 14:15:20,622 - DEBUG - [10.0.0.38]: Running cmd : getent hosts 10.20.0.254 | head -n 1 | awk '{print $2}' 2025-08-27 14:15:20,686 - DEBUG - Output : 2025-08-27 14:15:22,313 - INFO - Using existing project ['default-domain', 'admin'](65d16c8a-da9c-4977-9c0b-58a29126930a) 2025-08-27 14:15:22,441 - INFO - ================================================================================ 2025-08-27 14:15:22,441 - INFO - STARTING TEST : test_contrail_status 2025-08-27 14:15:22,441 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-08-27 14:15:22,574 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:22,580 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.254': '0'}} with 2025-08-27 14:15:22,581 - INFO - Initial checks done. Running the testcase now 2025-08-27 14:15:22,581 - INFO - 2025-08-27 14:15:22,581 - DEBUG - [10.0.0.38]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-08-27 14:15:22,652 - DEBUG - Output : contrail_test_ooNjbm7BJ vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_snmp_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_cassandra_1 control_named_1 control_provisioner_1 control_nodemgr_1 control_dns_1 control_control_1 webui_web_1 webui_job_1 config_devicemgr_1 config_dnsmasq_1 config_svcmonitor_1 config_provisioner_1 config_nodemgr_1 config_schema_1 config_api_1 config_database_provisioner_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-08-27 14:15:22,652 - INFO - 10.0.0.38 2025-08-27 14:15:22,652 - INFO - config 2025-08-27 14:15:22,658 - INFO - config-nodemgr:active 2025-08-27 14:15:22,662 - INFO - api-server:active 2025-08-27 14:15:22,665 - INFO - schema:active 2025-08-27 14:15:22,669 - INFO - svc-monitor:active 2025-08-27 14:15:22,672 - INFO - device-manager:active 2025-08-27 14:15:22,672 - INFO - config-database 2025-08-27 14:15:22,672 - INFO - config-cassandra:active 2025-08-27 14:15:22,672 - INFO - config-zookeeper:active 2025-08-27 14:15:22,672 - INFO - config-rabbitmq:active 2025-08-27 14:15:22,672 - INFO - vrouter 2025-08-27 14:15:22,676 - INFO - vrouter-nodemgr:active 2025-08-27 14:15:22,680 - INFO - agent:active 2025-08-27 14:15:22,680 - INFO - control 2025-08-27 14:15:22,684 - INFO - control-nodemgr:active 2025-08-27 14:15:22,689 - INFO - control:active 2025-08-27 14:15:22,689 - INFO - named:active 2025-08-27 14:15:22,693 - INFO - dns:active 2025-08-27 14:15:22,693 - INFO - analytics 2025-08-27 14:15:22,697 - INFO - analytics-nodemgr:active 2025-08-27 14:15:22,701 - INFO - analytics-api:active 2025-08-27 14:15:22,706 - INFO - collector:active 2025-08-27 14:15:22,706 - INFO - analytics-database 2025-08-27 14:15:22,706 - INFO - analytics-cassandra:active 2025-08-27 14:15:22,710 - INFO - analyticsdb-nodemgr:active 2025-08-27 14:15:22,714 - INFO - query-engine:active 2025-08-27 14:15:22,715 - INFO - webui 2025-08-27 14:15:22,715 - INFO - webui:active 2025-08-27 14:15:22,715 - INFO - webui-middleware:active 2025-08-27 14:15:22,715 - INFO - redis:active 2025-08-27 14:15:22,715 - INFO - analytics_snmp 2025-08-27 14:15:22,719 - INFO - snmp-collector:active 2025-08-27 14:15:22,719 - INFO - snmp-topology:active 2025-08-27 14:15:22,719 - INFO - analytics_alarm 2025-08-27 14:15:22,719 - INFO - alarmgen:active 2025-08-27 14:15:22,719 - INFO - All the contrail services are up on all nodes 2025-08-27 14:15:22,719 - INFO - contrail-status passed 2025-08-27 14:15:22,835 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:22,841 - DEBUG - No XMPP flaps were noticed during the test 2025-08-27 14:15:22,841 - INFO - END TEST : test_contrail_status : PASSED[0:00:00] 2025-08-27 14:15:22,841 - INFO - -------------------------------------------------------------------------------- 2025-08-27 14:15:25,008 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:26,852 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:27,820 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:27,825 - DEBUG - [10.0.0.38]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check' 2025-08-27 14:15:31,748 - DEBUG - Output : 2025-08-27 14:15:30,157 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success 2025-08-27 14:15:30,176 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success 2025-08-27 14:15:30,422 INFO: (v1.41) Checker check_obj_mandatory_fields: Success 2025-08-27 14:15:30,911 INFO: (v1.41) Checker check_orphan_resources: Success 2025-08-27 14:15:31,369 INFO: (v1.41) Checker check_fq_name_uuid_match: Success 2025-08-27 14:15:31,369 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before. 2025-08-27 14:15:31,575 INFO: (v1.41) Checker check_duplicate_fq_name: Success 2025-08-27 14:15:31,587 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success 2025-08-27 14:15:31,594 INFO: (v1.41) Checker check_subnet_uuid: Success 2025-08-27 14:15:31,603 INFO: (v1.41) Checker check_subnet_addr_alloc: Success 2025-08-27 14:15:31,627 INFO: (v1.41) Checker check_route_targets_id: Success 2025-08-27 14:15:31,634 INFO: (v1.41) Checker check_virtual_networks_id: Success 2025-08-27 14:15:31,640 INFO: (v1.41) Checker check_security_groups_id: Success 2025-08-27 14:15:31,641 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success 2025-08-27 14:15:31,904 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:34,343 - INFO - admin user already present 2025-08-27 14:15:35,115 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:36,648 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:39,656 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:39,912 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:46,244 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:48,332 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:51,320 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:52,968 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:53,128 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:54,008 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:15:56,964 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:05,261 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:08,156 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:10,780 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:13,687 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:16,900 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:19,787 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:19,948 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:22,128 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:22,304 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:25,308 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:29,208 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:32,760 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:34,892 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:37,736 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:39,192 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:42,132 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:44,768 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:47,636 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:48,807 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:51,631 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:52,892 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:53,047 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:54,236 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:54,395 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:16:55,496 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-27 14:20:40,896 - INFO - Using existing project ['default-domain', 'admin'](65d16c8a-da9c-4977-9c0b-58a29126930a) 2025-08-27 14:20:40,905 - INFO - ================================================================================ 2025-08-27 14:20:40,905 - INFO - STARTING TEST : test_contrail_status 2025-08-27 14:20:40,905 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-08-27 14:20:41,027 - DEBUG - Skipping xmpp flap check 2025-08-27 14:20:41,028 - INFO - Initial checks done. Running the testcase now 2025-08-27 14:20:41,028 - INFO - 2025-08-27 14:20:41,125 - INFO - 10.0.0.38 2025-08-27 14:20:41,125 - INFO - config 2025-08-27 14:20:41,130 - INFO - config-nodemgr:active 2025-08-27 14:20:41,134 - INFO - api-server:active 2025-08-27 14:20:41,137 - INFO - schema:active 2025-08-27 14:20:41,140 - INFO - svc-monitor:active 2025-08-27 14:20:41,143 - INFO - device-manager:active 2025-08-27 14:20:41,143 - INFO - config-database 2025-08-27 14:20:41,143 - INFO - config-cassandra:active 2025-08-27 14:20:41,144 - INFO - config-zookeeper:active 2025-08-27 14:20:41,144 - INFO - config-rabbitmq:active 2025-08-27 14:20:41,144 - INFO - vrouter 2025-08-27 14:20:41,147 - INFO - vrouter-nodemgr:active 2025-08-27 14:20:41,151 - INFO - agent:active 2025-08-27 14:20:41,151 - INFO - control 2025-08-27 14:20:41,155 - INFO - control-nodemgr:active 2025-08-27 14:20:41,159 - INFO - control:active 2025-08-27 14:20:41,159 - INFO - named:active 2025-08-27 14:20:41,164 - INFO - dns:active 2025-08-27 14:20:41,164 - INFO - analytics 2025-08-27 14:20:41,167 - INFO - analytics-nodemgr:active 2025-08-27 14:20:41,171 - INFO - analytics-api:active 2025-08-27 14:20:41,175 - INFO - collector:active 2025-08-27 14:20:41,175 - INFO - analytics-database 2025-08-27 14:20:41,175 - INFO - analytics-cassandra:active 2025-08-27 14:20:41,179 - INFO - analyticsdb-nodemgr:active 2025-08-27 14:20:41,183 - INFO - query-engine:active 2025-08-27 14:20:41,183 - INFO - webui 2025-08-27 14:20:41,183 - INFO - webui:active 2025-08-27 14:20:41,183 - INFO - webui-middleware:active 2025-08-27 14:20:41,183 - INFO - redis:active 2025-08-27 14:20:41,183 - INFO - analytics_snmp 2025-08-27 14:20:41,187 - INFO - snmp-collector:active 2025-08-27 14:20:41,187 - INFO - snmp-topology:active 2025-08-27 14:20:41,187 - INFO - analytics_alarm 2025-08-27 14:20:41,187 - INFO - alarmgen:active 2025-08-27 14:20:41,187 - INFO - All the contrail services are up on all nodes 2025-08-27 14:20:41,187 - INFO - contrail-status passed 2025-08-27 14:20:41,307 - DEBUG - Skipping xmpp flap check 2025-08-27 14:20:41,308 - INFO - END TEST : test_contrail_status : PASSED[0:00:01] 2025-08-27 14:20:41,308 - INFO - --------------------------------------------------------------------------------