2026-06-15 02:00:14,721 - INFO - Using existing project ['default-domain', 'admin'](1d8d7ea5-0ef0-481f-ab3f-951cbad462e5) 2026-06-15 02:00:14,730 - INFO - ================================================================================ 2026-06-15 02:00:14,730 - INFO - STARTING TEST : test_contrail_status 2026-06-15 02:00:14,730 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2026-06-15 02:00:15,376 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.193': '0', '10.20.0.25': '0'}, '10.0.0.130': {'10.20.0.25': '0', '10.20.0.129': '0'}} with 2026-06-15 02:00:15,376 - INFO - Initial checks done. Running the testcase now 2026-06-15 02:00:15,376 - INFO - 2026-06-15 02:00:15,457 - INFO - 10.0.0.23 2026-06-15 02:00:15,457 - INFO - config 2026-06-15 02:00:15,463 - INFO - config-nodemgr:active 2026-06-15 02:00:15,469 - INFO - api-server:active 2026-06-15 02:00:15,475 - INFO - schema:backup 2026-06-15 02:00:15,480 - INFO - svc-monitor:backup 2026-06-15 02:00:15,484 - INFO - device-manager:backup 2026-06-15 02:00:15,485 - INFO - config-database 2026-06-15 02:00:15,485 - INFO - config-cassandra:active 2026-06-15 02:00:15,486 - INFO - config-zookeeper:active 2026-06-15 02:00:15,486 - INFO - config-rabbitmq:active 2026-06-15 02:00:15,487 - INFO - control 2026-06-15 02:00:15,494 - INFO - control-nodemgr:active 2026-06-15 02:00:15,500 - INFO - control:active 2026-06-15 02:00:15,500 - INFO - named:active 2026-06-15 02:00:15,508 - INFO - dns:active 2026-06-15 02:00:15,509 - INFO - analytics 2026-06-15 02:00:15,515 - INFO - analytics-nodemgr:active 2026-06-15 02:00:15,521 - INFO - analytics-api:active 2026-06-15 02:00:15,527 - INFO - collector:active 2026-06-15 02:00:15,527 - INFO - analytics-database 2026-06-15 02:00:15,527 - INFO - analytics-cassandra:active 2026-06-15 02:00:15,533 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:15,541 - INFO - query-engine:active 2026-06-15 02:00:15,541 - INFO - webui 2026-06-15 02:00:15,541 - INFO - webui:active 2026-06-15 02:00:15,541 - INFO - webui-middleware:active 2026-06-15 02:00:15,541 - INFO - redis:active 2026-06-15 02:00:15,541 - INFO - analytics_snmp 2026-06-15 02:00:15,546 - INFO - snmp-collector:active 2026-06-15 02:00:15,546 - INFO - snmp-topology:active 2026-06-15 02:00:15,546 - INFO - analytics_alarm 2026-06-15 02:00:15,546 - INFO - alarmgen:active 2026-06-15 02:00:15,593 - INFO - 10.0.0.33 2026-06-15 02:00:15,593 - INFO - config 2026-06-15 02:00:15,599 - INFO - config-nodemgr:active 2026-06-15 02:00:15,604 - INFO - api-server:initializing (Generic Connection:Keystone[Error: Unable to establish connection to http://10.0.0.23:5000/v3/domains? at UTC 2026-06-15 01:59:43.872740] connection down) 2026-06-15 02:00:15,610 - INFO - schema:backup 2026-06-15 02:00:15,615 - INFO - svc-monitor:backup 2026-06-15 02:00:15,621 - INFO - device-manager:backup 2026-06-15 02:00:15,622 - INFO - config-database 2026-06-15 02:00:15,622 - INFO - config-cassandra:active 2026-06-15 02:00:15,623 - INFO - config-zookeeper:active 2026-06-15 02:00:15,623 - INFO - config-rabbitmq:active 2026-06-15 02:00:15,623 - INFO - control 2026-06-15 02:00:15,632 - INFO - control-nodemgr:active 2026-06-15 02:00:15,639 - INFO - control:active 2026-06-15 02:00:15,639 - INFO - named:active 2026-06-15 02:00:15,646 - INFO - dns:active 2026-06-15 02:00:15,646 - INFO - analytics 2026-06-15 02:00:15,651 - INFO - analytics-nodemgr:active 2026-06-15 02:00:15,656 - INFO - analytics-api:active 2026-06-15 02:00:15,661 - INFO - collector:active 2026-06-15 02:00:15,661 - INFO - analytics-database 2026-06-15 02:00:15,661 - INFO - analytics-cassandra:active 2026-06-15 02:00:15,667 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:15,673 - INFO - query-engine:active 2026-06-15 02:00:15,673 - INFO - webui 2026-06-15 02:00:15,673 - INFO - webui:active 2026-06-15 02:00:15,673 - INFO - webui-middleware:active 2026-06-15 02:00:15,673 - INFO - redis:active 2026-06-15 02:00:15,673 - INFO - analytics_snmp 2026-06-15 02:00:15,678 - INFO - snmp-collector:active 2026-06-15 02:00:15,678 - INFO - snmp-topology:active 2026-06-15 02:00:15,678 - INFO - analytics_alarm 2026-06-15 02:00:15,678 - INFO - alarmgen:active 2026-06-15 02:00:15,735 - INFO - 10.0.0.65 2026-06-15 02:00:15,735 - INFO - config 2026-06-15 02:00:15,743 - INFO - config-nodemgr:active 2026-06-15 02:00:15,748 - INFO - api-server:active 2026-06-15 02:00:15,753 - INFO - schema:active 2026-06-15 02:00:15,758 - INFO - svc-monitor:active 2026-06-15 02:00:15,762 - INFO - device-manager:active 2026-06-15 02:00:15,762 - INFO - config-database 2026-06-15 02:00:15,762 - INFO - config-cassandra:active 2026-06-15 02:00:15,762 - INFO - config-zookeeper:active 2026-06-15 02:00:15,763 - INFO - config-rabbitmq:active 2026-06-15 02:00:15,763 - INFO - control 2026-06-15 02:00:15,771 - INFO - control-nodemgr:active 2026-06-15 02:00:15,777 - INFO - control:active 2026-06-15 02:00:15,777 - INFO - named:active 2026-06-15 02:00:15,783 - INFO - dns:active 2026-06-15 02:00:15,783 - INFO - analytics 2026-06-15 02:00:15,788 - INFO - analytics-nodemgr:active 2026-06-15 02:00:15,794 - INFO - analytics-api:active 2026-06-15 02:00:15,799 - INFO - collector:active 2026-06-15 02:00:15,800 - INFO - analytics-database 2026-06-15 02:00:15,800 - INFO - analytics-cassandra:active 2026-06-15 02:00:15,805 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:15,811 - INFO - query-engine:active 2026-06-15 02:00:15,811 - INFO - webui 2026-06-15 02:00:15,811 - INFO - webui:active 2026-06-15 02:00:15,811 - INFO - webui-middleware:active 2026-06-15 02:00:15,811 - INFO - redis:active 2026-06-15 02:00:15,811 - INFO - analytics_snmp 2026-06-15 02:00:15,816 - INFO - snmp-collector:active 2026-06-15 02:00:15,816 - INFO - snmp-topology:active 2026-06-15 02:00:15,816 - INFO - analytics_alarm 2026-06-15 02:00:15,816 - INFO - alarmgen:active 2026-06-15 02:00:15,862 - INFO - 10.0.0.141 2026-06-15 02:00:15,862 - INFO - vrouter 2026-06-15 02:00:15,868 - INFO - vrouter-nodemgr:active 2026-06-15 02:00:15,876 - INFO - agent:active 2026-06-15 02:00:15,922 - INFO - 10.0.0.130 2026-06-15 02:00:15,923 - INFO - vrouter 2026-06-15 02:00:15,929 - INFO - vrouter-nodemgr:active 2026-06-15 02:00:15,937 - INFO - agent:active 2026-06-15 02:00:15,938 - DEBUG - defaultdict(, {'10.0.0.33': {'api-server': {'status': 'initializing', 'description': 'Generic Connection:Keystone[Error: Unable to establish connection to http://10.0.0.23:5000/v3/domains? at UTC 2026-06-15 01:59:43.872740] connection down'}}}) 2026-06-15 02:00:15,938 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 0 2026-06-15 02:00:26,007 - INFO - 10.0.0.23 2026-06-15 02:00:26,007 - INFO - config 2026-06-15 02:00:26,014 - INFO - config-nodemgr:active 2026-06-15 02:00:26,020 - INFO - api-server:active 2026-06-15 02:00:26,023 - INFO - schema:backup 2026-06-15 02:00:26,026 - INFO - svc-monitor:backup 2026-06-15 02:00:26,029 - INFO - device-manager:backup 2026-06-15 02:00:26,030 - INFO - config-database 2026-06-15 02:00:26,030 - INFO - config-cassandra:active 2026-06-15 02:00:26,030 - INFO - config-zookeeper:active 2026-06-15 02:00:26,030 - INFO - config-rabbitmq:active 2026-06-15 02:00:26,030 - INFO - control 2026-06-15 02:00:26,035 - INFO - control-nodemgr:active 2026-06-15 02:00:26,040 - INFO - control:active 2026-06-15 02:00:26,040 - INFO - named:active 2026-06-15 02:00:26,045 - INFO - dns:active 2026-06-15 02:00:26,045 - INFO - analytics 2026-06-15 02:00:26,050 - INFO - analytics-nodemgr:active 2026-06-15 02:00:26,057 - INFO - analytics-api:active 2026-06-15 02:00:26,062 - INFO - collector:active 2026-06-15 02:00:26,062 - INFO - analytics-database 2026-06-15 02:00:26,062 - INFO - analytics-cassandra:active 2026-06-15 02:00:26,068 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:26,074 - INFO - query-engine:active 2026-06-15 02:00:26,074 - INFO - webui 2026-06-15 02:00:26,075 - INFO - webui:active 2026-06-15 02:00:26,075 - INFO - webui-middleware:active 2026-06-15 02:00:26,075 - INFO - redis:active 2026-06-15 02:00:26,075 - INFO - analytics_snmp 2026-06-15 02:00:26,080 - INFO - snmp-collector:active 2026-06-15 02:00:26,080 - INFO - snmp-topology:active 2026-06-15 02:00:26,080 - INFO - analytics_alarm 2026-06-15 02:00:26,080 - INFO - alarmgen:active 2026-06-15 02:00:26,137 - INFO - 10.0.0.33 2026-06-15 02:00:26,137 - INFO - config 2026-06-15 02:00:26,144 - INFO - config-nodemgr:active 2026-06-15 02:00:26,149 - INFO - api-server:initializing (Generic Connection:Keystone[Error: Unable to establish connection to http://10.0.0.23:5000/v3/domains? at UTC 2026-06-15 01:59:43.872740] connection down) 2026-06-15 02:00:26,153 - INFO - schema:backup 2026-06-15 02:00:26,157 - INFO - svc-monitor:backup 2026-06-15 02:00:26,161 - INFO - device-manager:backup 2026-06-15 02:00:26,161 - INFO - config-database 2026-06-15 02:00:26,161 - INFO - config-cassandra:active 2026-06-15 02:00:26,161 - INFO - config-zookeeper:active 2026-06-15 02:00:26,161 - INFO - config-rabbitmq:active 2026-06-15 02:00:26,161 - INFO - control 2026-06-15 02:00:26,167 - INFO - control-nodemgr:active 2026-06-15 02:00:26,172 - INFO - control:active 2026-06-15 02:00:26,172 - INFO - named:active 2026-06-15 02:00:26,177 - INFO - dns:active 2026-06-15 02:00:26,177 - INFO - analytics 2026-06-15 02:00:26,182 - INFO - analytics-nodemgr:active 2026-06-15 02:00:26,186 - INFO - analytics-api:active 2026-06-15 02:00:26,191 - INFO - collector:active 2026-06-15 02:00:26,191 - INFO - analytics-database 2026-06-15 02:00:26,191 - INFO - analytics-cassandra:active 2026-06-15 02:00:26,196 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:26,203 - INFO - query-engine:active 2026-06-15 02:00:26,203 - INFO - webui 2026-06-15 02:00:26,203 - INFO - webui:active 2026-06-15 02:00:26,203 - INFO - webui-middleware:active 2026-06-15 02:00:26,204 - INFO - redis:active 2026-06-15 02:00:26,204 - INFO - analytics_snmp 2026-06-15 02:00:26,208 - INFO - snmp-collector:active 2026-06-15 02:00:26,208 - INFO - snmp-topology:active 2026-06-15 02:00:26,208 - INFO - analytics_alarm 2026-06-15 02:00:26,208 - INFO - alarmgen:active 2026-06-15 02:00:26,264 - INFO - 10.0.0.65 2026-06-15 02:00:26,264 - INFO - config 2026-06-15 02:00:26,270 - INFO - config-nodemgr:active 2026-06-15 02:00:26,275 - INFO - api-server:active 2026-06-15 02:00:26,280 - INFO - schema:active 2026-06-15 02:00:26,284 - INFO - svc-monitor:active 2026-06-15 02:00:26,288 - INFO - device-manager:active 2026-06-15 02:00:26,288 - INFO - config-database 2026-06-15 02:00:26,288 - INFO - config-cassandra:active 2026-06-15 02:00:26,288 - INFO - config-zookeeper:active 2026-06-15 02:00:26,289 - INFO - config-rabbitmq:active 2026-06-15 02:00:26,289 - INFO - control 2026-06-15 02:00:26,293 - INFO - control-nodemgr:active 2026-06-15 02:00:26,298 - INFO - control:active 2026-06-15 02:00:26,299 - INFO - named:active 2026-06-15 02:00:26,303 - INFO - dns:active 2026-06-15 02:00:26,304 - INFO - analytics 2026-06-15 02:00:26,308 - INFO - analytics-nodemgr:active 2026-06-15 02:00:26,313 - INFO - analytics-api:active 2026-06-15 02:00:26,318 - INFO - collector:active 2026-06-15 02:00:26,319 - INFO - analytics-database 2026-06-15 02:00:26,319 - INFO - analytics-cassandra:active 2026-06-15 02:00:26,324 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:26,329 - INFO - query-engine:active 2026-06-15 02:00:26,330 - INFO - webui 2026-06-15 02:00:26,330 - INFO - webui:active 2026-06-15 02:00:26,330 - INFO - webui-middleware:active 2026-06-15 02:00:26,330 - INFO - redis:active 2026-06-15 02:00:26,330 - INFO - analytics_snmp 2026-06-15 02:00:26,334 - INFO - snmp-collector:active 2026-06-15 02:00:26,335 - INFO - snmp-topology:active 2026-06-15 02:00:26,335 - INFO - analytics_alarm 2026-06-15 02:00:26,335 - INFO - alarmgen:active 2026-06-15 02:00:26,380 - INFO - 10.0.0.141 2026-06-15 02:00:26,380 - INFO - vrouter 2026-06-15 02:00:26,384 - INFO - vrouter-nodemgr:active 2026-06-15 02:00:26,389 - INFO - agent:active 2026-06-15 02:00:26,435 - INFO - 10.0.0.130 2026-06-15 02:00:26,435 - INFO - vrouter 2026-06-15 02:00:26,440 - INFO - vrouter-nodemgr:active 2026-06-15 02:00:26,446 - INFO - agent:active 2026-06-15 02:00:26,446 - DEBUG - defaultdict(, {'10.0.0.33': {'api-server': {'status': 'initializing', 'description': 'Generic Connection:Keystone[Error: Unable to establish connection to http://10.0.0.23:5000/v3/domains? at UTC 2026-06-15 01:59:43.872740] connection down'}}}) 2026-06-15 02:00:26,446 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 1 2026-06-15 02:00:36,525 - INFO - 10.0.0.23 2026-06-15 02:00:36,525 - INFO - config 2026-06-15 02:00:36,532 - INFO - config-nodemgr:active 2026-06-15 02:00:36,537 - INFO - api-server:active 2026-06-15 02:00:36,541 - INFO - schema:backup 2026-06-15 02:00:36,546 - INFO - svc-monitor:backup 2026-06-15 02:00:36,550 - INFO - device-manager:backup 2026-06-15 02:00:36,550 - INFO - config-database 2026-06-15 02:00:36,550 - INFO - config-cassandra:active 2026-06-15 02:00:36,550 - INFO - config-zookeeper:active 2026-06-15 02:00:36,551 - INFO - config-rabbitmq:active 2026-06-15 02:00:36,551 - INFO - control 2026-06-15 02:00:36,557 - INFO - control-nodemgr:active 2026-06-15 02:00:36,565 - INFO - control:active 2026-06-15 02:00:36,565 - INFO - named:active 2026-06-15 02:00:36,574 - INFO - dns:active 2026-06-15 02:00:36,575 - INFO - analytics 2026-06-15 02:00:36,582 - INFO - analytics-nodemgr:active 2026-06-15 02:00:36,586 - INFO - analytics-api:active 2026-06-15 02:00:36,593 - INFO - collector:active 2026-06-15 02:00:36,593 - INFO - analytics-database 2026-06-15 02:00:36,593 - INFO - analytics-cassandra:active 2026-06-15 02:00:36,601 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:36,607 - INFO - query-engine:active 2026-06-15 02:00:36,608 - INFO - webui 2026-06-15 02:00:36,608 - INFO - webui:active 2026-06-15 02:00:36,608 - INFO - webui-middleware:active 2026-06-15 02:00:36,608 - INFO - redis:active 2026-06-15 02:00:36,608 - INFO - analytics_snmp 2026-06-15 02:00:36,613 - INFO - snmp-collector:active 2026-06-15 02:00:36,613 - INFO - snmp-topology:active 2026-06-15 02:00:36,614 - INFO - analytics_alarm 2026-06-15 02:00:36,614 - INFO - alarmgen:active 2026-06-15 02:00:36,659 - INFO - 10.0.0.33 2026-06-15 02:00:36,659 - INFO - config 2026-06-15 02:00:36,665 - INFO - config-nodemgr:active 2026-06-15 02:00:36,671 - INFO - api-server:initializing (Generic Connection:Keystone[Error: Unable to establish connection to http://10.0.0.23:5000/v3/domains? at UTC 2026-06-15 01:59:43.872740] connection down) 2026-06-15 02:00:36,676 - INFO - schema:backup 2026-06-15 02:00:36,679 - INFO - svc-monitor:backup 2026-06-15 02:00:36,683 - INFO - device-manager:backup 2026-06-15 02:00:36,683 - INFO - config-database 2026-06-15 02:00:36,683 - INFO - config-cassandra:active 2026-06-15 02:00:36,683 - INFO - config-zookeeper:active 2026-06-15 02:00:36,683 - INFO - config-rabbitmq:active 2026-06-15 02:00:36,683 - INFO - control 2026-06-15 02:00:36,688 - INFO - control-nodemgr:active 2026-06-15 02:00:36,694 - INFO - control:active 2026-06-15 02:00:36,694 - INFO - named:active 2026-06-15 02:00:36,701 - INFO - dns:active 2026-06-15 02:00:36,701 - INFO - analytics 2026-06-15 02:00:36,706 - INFO - analytics-nodemgr:active 2026-06-15 02:00:36,711 - INFO - analytics-api:active 2026-06-15 02:00:36,716 - INFO - collector:active 2026-06-15 02:00:36,716 - INFO - analytics-database 2026-06-15 02:00:36,716 - INFO - analytics-cassandra:active 2026-06-15 02:00:36,721 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:36,730 - INFO - query-engine:active 2026-06-15 02:00:36,730 - INFO - webui 2026-06-15 02:00:36,730 - INFO - webui:active 2026-06-15 02:00:36,730 - INFO - webui-middleware:active 2026-06-15 02:00:36,730 - INFO - redis:active 2026-06-15 02:00:36,730 - INFO - analytics_snmp 2026-06-15 02:00:36,734 - INFO - snmp-collector:active 2026-06-15 02:00:36,735 - INFO - snmp-topology:active 2026-06-15 02:00:36,735 - INFO - analytics_alarm 2026-06-15 02:00:36,735 - INFO - alarmgen:active 2026-06-15 02:00:36,790 - INFO - 10.0.0.65 2026-06-15 02:00:36,791 - INFO - config 2026-06-15 02:00:36,796 - INFO - config-nodemgr:active 2026-06-15 02:00:36,801 - INFO - api-server:active 2026-06-15 02:00:36,806 - INFO - schema:active 2026-06-15 02:00:36,811 - INFO - svc-monitor:active 2026-06-15 02:00:36,816 - INFO - device-manager:active 2026-06-15 02:00:36,816 - INFO - config-database 2026-06-15 02:00:36,816 - INFO - config-cassandra:active 2026-06-15 02:00:36,816 - INFO - config-zookeeper:active 2026-06-15 02:00:36,816 - INFO - config-rabbitmq:active 2026-06-15 02:00:36,817 - INFO - control 2026-06-15 02:00:36,822 - INFO - control-nodemgr:active 2026-06-15 02:00:36,828 - INFO - control:active 2026-06-15 02:00:36,828 - INFO - named:active 2026-06-15 02:00:36,834 - INFO - dns:active 2026-06-15 02:00:36,834 - INFO - analytics 2026-06-15 02:00:36,838 - INFO - analytics-nodemgr:active 2026-06-15 02:00:36,843 - INFO - analytics-api:active 2026-06-15 02:00:36,847 - INFO - collector:active 2026-06-15 02:00:36,847 - INFO - analytics-database 2026-06-15 02:00:36,848 - INFO - analytics-cassandra:active 2026-06-15 02:00:36,852 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:36,857 - INFO - query-engine:active 2026-06-15 02:00:36,857 - INFO - webui 2026-06-15 02:00:36,857 - INFO - webui:active 2026-06-15 02:00:36,857 - INFO - webui-middleware:active 2026-06-15 02:00:36,857 - INFO - redis:active 2026-06-15 02:00:36,857 - INFO - analytics_snmp 2026-06-15 02:00:36,861 - INFO - snmp-collector:active 2026-06-15 02:00:36,861 - INFO - snmp-topology:active 2026-06-15 02:00:36,861 - INFO - analytics_alarm 2026-06-15 02:00:36,862 - INFO - alarmgen:active 2026-06-15 02:00:36,908 - INFO - 10.0.0.141 2026-06-15 02:00:36,908 - INFO - vrouter 2026-06-15 02:00:36,914 - INFO - vrouter-nodemgr:active 2026-06-15 02:00:36,919 - INFO - agent:active 2026-06-15 02:00:36,976 - INFO - 10.0.0.130 2026-06-15 02:00:36,976 - INFO - vrouter 2026-06-15 02:00:36,989 - INFO - vrouter-nodemgr:active 2026-06-15 02:00:36,994 - INFO - agent:active 2026-06-15 02:00:36,995 - DEBUG - defaultdict(, {'10.0.0.33': {'api-server': {'status': 'initializing', 'description': 'Generic Connection:Keystone[Error: Unable to establish connection to http://10.0.0.23:5000/v3/domains? at UTC 2026-06-15 01:59:43.872740] connection down'}}}) 2026-06-15 02:00:36,995 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 2 2026-06-15 02:00:47,077 - INFO - 10.0.0.23 2026-06-15 02:00:47,077 - INFO - config 2026-06-15 02:00:47,085 - INFO - config-nodemgr:active 2026-06-15 02:00:47,090 - INFO - api-server:active 2026-06-15 02:00:47,095 - INFO - schema:backup 2026-06-15 02:00:47,098 - INFO - svc-monitor:backup 2026-06-15 02:00:47,100 - INFO - device-manager:backup 2026-06-15 02:00:47,100 - INFO - config-database 2026-06-15 02:00:47,100 - INFO - config-cassandra:active 2026-06-15 02:00:47,100 - INFO - config-zookeeper:active 2026-06-15 02:00:47,100 - INFO - config-rabbitmq:active 2026-06-15 02:00:47,101 - INFO - control 2026-06-15 02:00:47,105 - INFO - control-nodemgr:active 2026-06-15 02:00:47,112 - INFO - control:active 2026-06-15 02:00:47,112 - INFO - named:active 2026-06-15 02:00:47,122 - INFO - dns:active 2026-06-15 02:00:47,122 - INFO - analytics 2026-06-15 02:00:47,129 - INFO - analytics-nodemgr:active 2026-06-15 02:00:47,134 - INFO - analytics-api:active 2026-06-15 02:00:47,141 - INFO - collector:active 2026-06-15 02:00:47,141 - INFO - analytics-database 2026-06-15 02:00:47,141 - INFO - analytics-cassandra:active 2026-06-15 02:00:47,149 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:47,164 - INFO - query-engine:active 2026-06-15 02:00:47,165 - INFO - webui 2026-06-15 02:00:47,166 - INFO - webui:active 2026-06-15 02:00:47,166 - INFO - webui-middleware:active 2026-06-15 02:00:47,167 - INFO - redis:active 2026-06-15 02:00:47,167 - INFO - analytics_snmp 2026-06-15 02:00:47,175 - INFO - snmp-collector:active 2026-06-15 02:00:47,176 - INFO - snmp-topology:active 2026-06-15 02:00:47,176 - INFO - analytics_alarm 2026-06-15 02:00:47,176 - INFO - alarmgen:active 2026-06-15 02:00:47,242 - INFO - 10.0.0.33 2026-06-15 02:00:47,243 - INFO - config 2026-06-15 02:00:47,248 - INFO - config-nodemgr:active 2026-06-15 02:00:47,253 - INFO - api-server:active 2026-06-15 02:00:47,259 - INFO - schema:backup 2026-06-15 02:00:47,264 - INFO - svc-monitor:backup 2026-06-15 02:00:47,268 - INFO - device-manager:backup 2026-06-15 02:00:47,268 - INFO - config-database 2026-06-15 02:00:47,268 - INFO - config-cassandra:active 2026-06-15 02:00:47,268 - INFO - config-zookeeper:active 2026-06-15 02:00:47,268 - INFO - config-rabbitmq:active 2026-06-15 02:00:47,268 - INFO - control 2026-06-15 02:00:47,273 - INFO - control-nodemgr:active 2026-06-15 02:00:47,279 - INFO - control:active 2026-06-15 02:00:47,279 - INFO - named:active 2026-06-15 02:00:47,286 - INFO - dns:active 2026-06-15 02:00:47,286 - INFO - analytics 2026-06-15 02:00:47,291 - INFO - analytics-nodemgr:active 2026-06-15 02:00:47,295 - INFO - analytics-api:active 2026-06-15 02:00:47,300 - INFO - collector:active 2026-06-15 02:00:47,300 - INFO - analytics-database 2026-06-15 02:00:47,300 - INFO - analytics-cassandra:active 2026-06-15 02:00:47,310 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:47,316 - INFO - query-engine:active 2026-06-15 02:00:47,316 - INFO - webui 2026-06-15 02:00:47,316 - INFO - webui:active 2026-06-15 02:00:47,316 - INFO - webui-middleware:active 2026-06-15 02:00:47,316 - INFO - redis:active 2026-06-15 02:00:47,317 - INFO - analytics_snmp 2026-06-15 02:00:47,321 - INFO - snmp-collector:active 2026-06-15 02:00:47,321 - INFO - snmp-topology:active 2026-06-15 02:00:47,321 - INFO - analytics_alarm 2026-06-15 02:00:47,321 - INFO - alarmgen:active 2026-06-15 02:00:47,377 - INFO - 10.0.0.65 2026-06-15 02:00:47,378 - INFO - config 2026-06-15 02:00:47,384 - INFO - config-nodemgr:active 2026-06-15 02:00:47,390 - INFO - api-server:active 2026-06-15 02:00:47,396 - INFO - schema:active 2026-06-15 02:00:47,402 - INFO - svc-monitor:active 2026-06-15 02:00:47,410 - INFO - device-manager:active 2026-06-15 02:00:47,410 - INFO - config-database 2026-06-15 02:00:47,410 - INFO - config-cassandra:active 2026-06-15 02:00:47,411 - INFO - config-zookeeper:active 2026-06-15 02:00:47,411 - INFO - config-rabbitmq:active 2026-06-15 02:00:47,411 - INFO - control 2026-06-15 02:00:47,416 - INFO - control-nodemgr:active 2026-06-15 02:00:47,423 - INFO - control:active 2026-06-15 02:00:47,423 - INFO - named:active 2026-06-15 02:00:47,429 - INFO - dns:active 2026-06-15 02:00:47,429 - INFO - analytics 2026-06-15 02:00:47,434 - INFO - analytics-nodemgr:active 2026-06-15 02:00:47,439 - INFO - analytics-api:active 2026-06-15 02:00:47,445 - INFO - collector:active 2026-06-15 02:00:47,445 - INFO - analytics-database 2026-06-15 02:00:47,445 - INFO - analytics-cassandra:active 2026-06-15 02:00:47,451 - INFO - analyticsdb-nodemgr:active 2026-06-15 02:00:47,461 - INFO - query-engine:active 2026-06-15 02:00:47,461 - INFO - webui 2026-06-15 02:00:47,461 - INFO - webui:active 2026-06-15 02:00:47,461 - INFO - webui-middleware:active 2026-06-15 02:00:47,461 - INFO - redis:active 2026-06-15 02:00:47,462 - INFO - analytics_snmp 2026-06-15 02:00:47,473 - INFO - snmp-collector:active 2026-06-15 02:00:47,473 - INFO - snmp-topology:active 2026-06-15 02:00:47,473 - INFO - analytics_alarm 2026-06-15 02:00:47,474 - INFO - alarmgen:active 2026-06-15 02:00:47,519 - INFO - 10.0.0.141 2026-06-15 02:00:47,519 - INFO - vrouter 2026-06-15 02:00:47,526 - INFO - vrouter-nodemgr:active 2026-06-15 02:00:47,532 - INFO - agent:active 2026-06-15 02:00:47,579 - INFO - 10.0.0.130 2026-06-15 02:00:47,579 - INFO - vrouter 2026-06-15 02:00:47,586 - INFO - vrouter-nodemgr:active 2026-06-15 02:00:47,591 - INFO - agent:active 2026-06-15 02:00:47,591 - INFO - All the contrail services are up on all nodes 2026-06-15 02:00:47,592 - INFO - contrail-status passed 2026-06-15 02:00:48,232 - DEBUG - No XMPP flaps were noticed during the test 2026-06-15 02:00:48,232 - INFO - END TEST : test_contrail_status : PASSED[0:00:34] 2026-06-15 02:00:48,232 - INFO - -------------------------------------------------------------------------------- 2026-06-15 03:42:48,309 - INFO - Using existing project ['default-domain', 'admin'](1d8d7ea5-0ef0-481f-ab3f-951cbad462e5) 2026-06-15 03:42:48,318 - INFO - ================================================================================ 2026-06-15 03:42:48,318 - INFO - STARTING TEST : test_contrail_status 2026-06-15 03:42:48,318 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2026-06-15 03:42:49,617 - DEBUG - Skipping xmpp flap check 2026-06-15 03:42:49,617 - INFO - Initial checks done. Running the testcase now 2026-06-15 03:42:49,618 - INFO - 2026-06-15 03:42:49,886 - INFO - 10.0.0.23 2026-06-15 03:42:49,886 - INFO - config 2026-06-15 03:42:49,892 - INFO - config-nodemgr:active 2026-06-15 03:42:49,897 - INFO - api-server:active 2026-06-15 03:42:49,899 - INFO - schema:backup 2026-06-15 03:42:49,902 - INFO - svc-monitor:backup 2026-06-15 03:42:49,904 - INFO - device-manager:backup 2026-06-15 03:42:49,904 - INFO - config-database 2026-06-15 03:42:49,905 - INFO - config-cassandra:active 2026-06-15 03:42:49,905 - INFO - config-zookeeper:active 2026-06-15 03:42:49,905 - INFO - config-rabbitmq:active 2026-06-15 03:42:49,905 - INFO - control 2026-06-15 03:42:49,909 - INFO - control-nodemgr:active 2026-06-15 03:42:49,915 - INFO - control:active 2026-06-15 03:42:49,915 - INFO - named:active 2026-06-15 03:42:49,932 - INFO - dns:active 2026-06-15 03:42:49,932 - INFO - analytics 2026-06-15 03:42:49,937 - INFO - analytics-nodemgr:active 2026-06-15 03:42:49,942 - INFO - analytics-api:active 2026-06-15 03:42:49,961 - INFO - collector:active 2026-06-15 03:42:49,961 - INFO - analytics-database 2026-06-15 03:42:49,961 - INFO - analytics-cassandra:active 2026-06-15 03:42:49,968 - INFO - analyticsdb-nodemgr:active 2026-06-15 03:42:50,003 - INFO - query-engine:active 2026-06-15 03:42:50,003 - INFO - webui 2026-06-15 03:42:50,003 - INFO - webui:active 2026-06-15 03:42:50,004 - INFO - webui-middleware:active 2026-06-15 03:42:50,004 - INFO - redis:active 2026-06-15 03:42:50,004 - INFO - analytics_snmp 2026-06-15 03:42:50,009 - INFO - snmp-collector:active 2026-06-15 03:42:50,009 - INFO - snmp-topology:active 2026-06-15 03:42:50,009 - INFO - analytics_alarm 2026-06-15 03:42:50,009 - INFO - alarmgen:active 2026-06-15 03:42:50,112 - INFO - 10.0.0.33 2026-06-15 03:42:50,112 - INFO - config 2026-06-15 03:42:50,118 - INFO - config-nodemgr:active 2026-06-15 03:42:50,125 - INFO - api-server:active 2026-06-15 03:42:50,129 - INFO - schema:backup 2026-06-15 03:42:50,133 - INFO - svc-monitor:backup 2026-06-15 03:42:50,137 - INFO - device-manager:backup 2026-06-15 03:42:50,137 - INFO - config-database 2026-06-15 03:42:50,137 - INFO - config-cassandra:active 2026-06-15 03:42:50,137 - INFO - config-zookeeper:active 2026-06-15 03:42:50,138 - INFO - config-rabbitmq:active 2026-06-15 03:42:50,138 - INFO - control 2026-06-15 03:42:50,143 - INFO - control-nodemgr:active 2026-06-15 03:42:50,150 - INFO - control:active 2026-06-15 03:42:50,150 - INFO - named:active 2026-06-15 03:42:50,155 - INFO - dns:active 2026-06-15 03:42:50,155 - INFO - analytics 2026-06-15 03:42:50,160 - INFO - analytics-nodemgr:active 2026-06-15 03:42:50,165 - INFO - analytics-api:active 2026-06-15 03:42:50,171 - INFO - collector:active 2026-06-15 03:42:50,171 - INFO - analytics-database 2026-06-15 03:42:50,171 - INFO - analytics-cassandra:active 2026-06-15 03:42:50,176 - INFO - analyticsdb-nodemgr:active 2026-06-15 03:42:50,181 - INFO - query-engine:active 2026-06-15 03:42:50,181 - INFO - webui 2026-06-15 03:42:50,181 - INFO - webui:active 2026-06-15 03:42:50,181 - INFO - webui-middleware:active 2026-06-15 03:42:50,181 - INFO - redis:active 2026-06-15 03:42:50,181 - INFO - analytics_snmp 2026-06-15 03:42:50,186 - INFO - snmp-collector:active 2026-06-15 03:42:50,186 - INFO - snmp-topology:active 2026-06-15 03:42:50,186 - INFO - analytics_alarm 2026-06-15 03:42:50,186 - INFO - alarmgen:active 2026-06-15 03:42:50,285 - INFO - 10.0.0.65 2026-06-15 03:42:50,285 - INFO - config 2026-06-15 03:42:50,291 - INFO - config-nodemgr:active 2026-06-15 03:42:50,296 - INFO - api-server:active 2026-06-15 03:42:50,301 - INFO - schema:active 2026-06-15 03:42:50,306 - INFO - svc-monitor:active 2026-06-15 03:42:50,311 - INFO - device-manager:active 2026-06-15 03:42:50,312 - INFO - config-database 2026-06-15 03:42:50,312 - INFO - config-cassandra:active 2026-06-15 03:42:50,312 - INFO - config-zookeeper:active 2026-06-15 03:42:50,312 - INFO - config-rabbitmq:active 2026-06-15 03:42:50,312 - INFO - control 2026-06-15 03:42:50,318 - INFO - control-nodemgr:active 2026-06-15 03:42:50,323 - INFO - control:active 2026-06-15 03:42:50,323 - INFO - named:active 2026-06-15 03:42:50,328 - INFO - dns:active 2026-06-15 03:42:50,328 - INFO - analytics 2026-06-15 03:42:50,335 - INFO - analytics-nodemgr:active 2026-06-15 03:42:50,340 - INFO - analytics-api:active 2026-06-15 03:42:50,345 - INFO - collector:active 2026-06-15 03:42:50,346 - INFO - analytics-database 2026-06-15 03:42:50,346 - INFO - analytics-cassandra:active 2026-06-15 03:42:50,352 - INFO - analyticsdb-nodemgr:active 2026-06-15 03:42:50,358 - INFO - query-engine:active 2026-06-15 03:42:50,358 - INFO - webui 2026-06-15 03:42:50,358 - INFO - webui:active 2026-06-15 03:42:50,358 - INFO - webui-middleware:active 2026-06-15 03:42:50,358 - INFO - redis:active 2026-06-15 03:42:50,358 - INFO - analytics_snmp 2026-06-15 03:42:50,363 - INFO - snmp-collector:active 2026-06-15 03:42:50,363 - INFO - snmp-topology:active 2026-06-15 03:42:50,363 - INFO - analytics_alarm 2026-06-15 03:42:50,363 - INFO - alarmgen:active 2026-06-15 03:42:50,453 - INFO - 10.0.0.141 2026-06-15 03:42:50,453 - INFO - vrouter 2026-06-15 03:42:50,459 - INFO - vrouter-nodemgr:active 2026-06-15 03:42:50,464 - INFO - agent:active 2026-06-15 03:42:50,551 - INFO - 10.0.0.130 2026-06-15 03:42:50,551 - INFO - vrouter 2026-06-15 03:42:50,557 - INFO - vrouter-nodemgr:active 2026-06-15 03:42:50,562 - INFO - agent:active 2026-06-15 03:42:50,562 - INFO - All the contrail services are up on all nodes 2026-06-15 03:42:50,562 - INFO - contrail-status passed 2026-06-15 03:42:51,833 - DEBUG - Skipping xmpp flap check 2026-06-15 03:42:51,833 - INFO - END TEST : test_contrail_status : PASSED[0:00:03] 2026-06-15 03:42:51,834 - INFO - --------------------------------------------------------------------------------