2026-01-29 02:11:58,879 - INFO - Using existing project ['default-domain', 'admin'](8a3a7390-7ec8-4fa8-965f-346af397f354)
2026-01-29 02:11:58,886 - INFO - ================================================================================
2026-01-29 02:11:58,886 - INFO - STARTING TEST : test_contrail_status
2026-01-29 02:11:58,886 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-01-29 02:11:59,536 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.193': '0', '10.20.0.254': '0'}, '10.0.0.128': {'10.20.0.254': '0', '10.20.0.14': '0'}} with
2026-01-29 02:11:59,536 - INFO - Initial checks done. Running the testcase now
2026-01-29 02:11:59,536 - INFO -
2026-01-29 02:11:59,615 - INFO - 10.0.0.23
2026-01-29 02:11:59,615 - INFO - config
2026-01-29 02:11:59,620 - INFO - config-nodemgr:active
2026-01-29 02:11:59,625 - INFO - api-server:active
2026-01-29 02:11:59,627 - INFO - schema:backup
2026-01-29 02:11:59,632 - INFO - svc-monitor:active
2026-01-29 02:11:59,635 - INFO - device-manager:backup
2026-01-29 02:11:59,635 - INFO - config-database
2026-01-29 02:11:59,635 - INFO - config-cassandra:active
2026-01-29 02:11:59,635 - INFO - config-zookeeper:active
2026-01-29 02:11:59,635 - INFO - config-rabbitmq:active
2026-01-29 02:11:59,635 - INFO - control
2026-01-29 02:11:59,640 - INFO - control-nodemgr:active
2026-01-29 02:11:59,644 - INFO - control:active
2026-01-29 02:11:59,644 - INFO - named:active
2026-01-29 02:11:59,648 - INFO - dns:active
2026-01-29 02:11:59,648 - INFO - analytics
2026-01-29 02:11:59,652 - INFO - analytics-nodemgr:active
2026-01-29 02:11:59,656 - INFO - analytics-api:active
2026-01-29 02:11:59,660 - INFO - collector:active
2026-01-29 02:11:59,661 - INFO - analytics-database
2026-01-29 02:11:59,661 - INFO - analytics-cassandra:active
2026-01-29 02:11:59,665 - INFO - analyticsdb-nodemgr:active
2026-01-29 02:11:59,672 - INFO - query-engine:active
2026-01-29 02:11:59,673 - INFO - webui
2026-01-29 02:11:59,673 - INFO - webui:active
2026-01-29 02:11:59,673 - INFO - webui-middleware:active
2026-01-29 02:11:59,673 - INFO - redis:active
2026-01-29 02:11:59,673 - INFO - analytics_snmp
2026-01-29 02:11:59,677 - INFO - snmp-collector:active
2026-01-29 02:11:59,677 - INFO - snmp-topology:active
2026-01-29 02:11:59,677 - INFO - analytics_alarm
2026-01-29 02:11:59,678 - INFO - alarmgen:active
2026-01-29 02:11:59,744 - INFO - 10.0.0.147
2026-01-29 02:11:59,744 - INFO - config
2026-01-29 02:11:59,749 - INFO - config-nodemgr:active
2026-01-29 02:11:59,754 - INFO - api-server:active
2026-01-29 02:11:59,758 - INFO - schema:active
2026-01-29 02:11:59,762 - INFO - svc-monitor:backup
2026-01-29 02:11:59,765 - INFO - device-manager:active
2026-01-29 02:11:59,765 - INFO - config-database
2026-01-29 02:11:59,765 - INFO - config-cassandra:active
2026-01-29 02:11:59,766 - INFO - config-zookeeper:active
2026-01-29 02:11:59,766 - INFO - config-rabbitmq:active
2026-01-29 02:11:59,766 - INFO - control
2026-01-29 02:11:59,770 - INFO - control-nodemgr:active
2026-01-29 02:11:59,776 - INFO - control:active
2026-01-29 02:11:59,776 - INFO - named:active
2026-01-29 02:11:59,781 - INFO - dns:active
2026-01-29 02:11:59,781 - INFO - analytics
2026-01-29 02:11:59,785 - INFO - analytics-nodemgr:active
2026-01-29 02:11:59,789 - INFO - analytics-api:active
2026-01-29 02:11:59,794 - INFO - collector:active
2026-01-29 02:11:59,794 - INFO - analytics-database
2026-01-29 02:11:59,794 - INFO - analytics-cassandra:active
2026-01-29 02:11:59,799 - INFO - analyticsdb-nodemgr:active
2026-01-29 02:11:59,804 - INFO - query-engine:active
2026-01-29 02:11:59,804 - INFO - webui
2026-01-29 02:11:59,805 - INFO - webui:active
2026-01-29 02:11:59,805 - INFO - webui-middleware:active
2026-01-29 02:11:59,805 - INFO - redis:active
2026-01-29 02:11:59,805 - INFO - analytics_snmp
2026-01-29 02:11:59,808 - INFO - snmp-collector:active
2026-01-29 02:11:59,808 - INFO - snmp-topology:active
2026-01-29 02:11:59,808 - INFO - analytics_alarm
2026-01-29 02:11:59,808 - INFO - alarmgen:active
2026-01-29 02:11:59,853 - INFO - 10.0.0.240
2026-01-29 02:11:59,853 - INFO - config
2026-01-29 02:11:59,858 - INFO - config-nodemgr:active
2026-01-29 02:11:59,863 - INFO - api-server:active
2026-01-29 02:11:59,868 - INFO - schema:backup
2026-01-29 02:11:59,873 - INFO - svc-monitor:backup
2026-01-29 02:11:59,877 - INFO - device-manager:backup
2026-01-29 02:11:59,877 - INFO - config-database
2026-01-29 02:11:59,877 - INFO - config-cassandra:active
2026-01-29 02:11:59,877 - INFO - config-zookeeper:active
2026-01-29 02:11:59,877 - INFO - config-rabbitmq:active
2026-01-29 02:11:59,877 - INFO - control
2026-01-29 02:11:59,882 - INFO - control-nodemgr:active
2026-01-29 02:11:59,887 - INFO - control:active
2026-01-29 02:11:59,887 - INFO - named:active
2026-01-29 02:11:59,892 - INFO - dns:active
2026-01-29 02:11:59,892 - INFO - analytics
2026-01-29 02:11:59,896 - INFO - analytics-nodemgr:active
2026-01-29 02:11:59,900 - INFO - analytics-api:active
2026-01-29 02:11:59,906 - INFO - collector:active
2026-01-29 02:11:59,906 - INFO - analytics-database
2026-01-29 02:11:59,906 - INFO - analytics-cassandra:active
2026-01-29 02:11:59,911 - INFO - analyticsdb-nodemgr:active
2026-01-29 02:11:59,917 - INFO - query-engine:active
2026-01-29 02:11:59,918 - INFO - webui
2026-01-29 02:11:59,918 - INFO - webui:active
2026-01-29 02:11:59,918 - INFO - webui-middleware:active
2026-01-29 02:11:59,918 - INFO - redis:active
2026-01-29 02:11:59,918 - INFO - analytics_snmp
2026-01-29 02:11:59,922 - INFO - snmp-collector:active
2026-01-29 02:11:59,922 - INFO - snmp-topology:active
2026-01-29 02:11:59,923 - INFO - analytics_alarm
2026-01-29 02:11:59,923 - INFO - alarmgen:active
2026-01-29 02:11:59,989 - INFO - 10.0.0.49
2026-01-29 02:11:59,989 - INFO - vrouter
2026-01-29 02:11:59,995 - INFO - vrouter-nodemgr:active
2026-01-29 02:12:00,001 - INFO - agent:active
2026-01-29 02:12:00,059 - INFO - 10.0.0.128
2026-01-29 02:12:00,059 - INFO - vrouter
2026-01-29 02:12:00,065 - INFO - vrouter-nodemgr:active
2026-01-29 02:12:00,072 - INFO - agent:active
2026-01-29 02:12:00,072 - INFO - All the contrail services are up on all nodes
2026-01-29 02:12:00,072 - INFO - contrail-status passed
2026-01-29 02:12:00,747 - DEBUG - No XMPP flaps were noticed during the test
2026-01-29 02:12:00,747 - INFO - END TEST : test_contrail_status : PASSED[0:00:02]
2026-01-29 02:12:00,747 - INFO - --------------------------------------------------------------------------------
2026-01-29 04:22:38,754 - INFO - Using existing project ['default-domain', 'admin'](8a3a7390-7ec8-4fa8-965f-346af397f354)
2026-01-29 04:22:38,765 - INFO - ================================================================================
2026-01-29 04:22:38,765 - INFO - STARTING TEST : test_contrail_status
2026-01-29 04:22:38,765 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-01-29 04:22:40,052 - DEBUG - Skipping xmpp flap check
2026-01-29 04:22:40,052 - INFO - Initial checks done. Running the testcase now
2026-01-29 04:22:40,052 - INFO -
2026-01-29 04:22:40,277 - INFO - 10.0.0.23
2026-01-29 04:22:40,277 - INFO - config
2026-01-29 04:22:40,283 - INFO - config-nodemgr:active
2026-01-29 04:22:40,287 - INFO - api-server:active
2026-01-29 04:22:40,291 - INFO - schema:backup
2026-01-29 04:22:40,294 - INFO - svc-monitor:active
2026-01-29 04:22:40,297 - INFO - device-manager:backup
2026-01-29 04:22:40,297 - INFO - config-database
2026-01-29 04:22:40,297 - INFO - config-cassandra:active
2026-01-29 04:22:40,297 - INFO - config-zookeeper:active
2026-01-29 04:22:40,297 - INFO - config-rabbitmq:active
2026-01-29 04:22:40,297 - INFO - control
2026-01-29 04:22:40,302 - INFO - control-nodemgr:active
2026-01-29 04:22:40,307 - INFO - control:active
2026-01-29 04:22:40,307 - INFO - named:active
2026-01-29 04:22:40,318 - INFO - dns:active
2026-01-29 04:22:40,318 - INFO - analytics
2026-01-29 04:22:40,322 - INFO - analytics-nodemgr:active
2026-01-29 04:22:40,326 - INFO - analytics-api:active
2026-01-29 04:22:40,347 - INFO - collector:active
2026-01-29 04:22:40,347 - INFO - analytics-database
2026-01-29 04:22:40,347 - INFO - analytics-cassandra:active
2026-01-29 04:22:40,352 - INFO - analyticsdb-nodemgr:active
2026-01-29 04:22:40,368 - INFO - query-engine:active
2026-01-29 04:22:40,368 - INFO - webui
2026-01-29 04:22:40,369 - INFO - webui:active
2026-01-29 04:22:40,369 - INFO - webui-middleware:active
2026-01-29 04:22:40,369 - INFO - redis:active
2026-01-29 04:22:40,369 - INFO - analytics_snmp
2026-01-29 04:22:40,373 - INFO - snmp-collector:active
2026-01-29 04:22:40,373 - INFO - snmp-topology:active
2026-01-29 04:22:40,374 - INFO - analytics_alarm
2026-01-29 04:22:40,374 - INFO - alarmgen:active
2026-01-29 04:22:40,475 - INFO - 10.0.0.147
2026-01-29 04:22:40,475 - INFO - config
2026-01-29 04:22:40,485 - INFO - config-nodemgr:active
2026-01-29 04:22:40,489 - INFO - api-server:active
2026-01-29 04:22:40,494 - INFO - schema:active
2026-01-29 04:22:40,497 - INFO - svc-monitor:backup
2026-01-29 04:22:40,500 - INFO - device-manager:active
2026-01-29 04:22:40,501 - INFO - config-database
2026-01-29 04:22:40,501 - INFO - config-cassandra:active
2026-01-29 04:22:40,501 - INFO - config-zookeeper:active
2026-01-29 04:22:40,501 - INFO - config-rabbitmq:active
2026-01-29 04:22:40,501 - INFO - control
2026-01-29 04:22:40,507 - INFO - control-nodemgr:active
2026-01-29 04:22:40,512 - INFO - control:active
2026-01-29 04:22:40,512 - INFO - named:active
2026-01-29 04:22:40,517 - INFO - dns:active
2026-01-29 04:22:40,517 - INFO - analytics
2026-01-29 04:22:40,524 - INFO - analytics-nodemgr:active
2026-01-29 04:22:40,529 - INFO - analytics-api:active
2026-01-29 04:22:40,535 - INFO - collector:active
2026-01-29 04:22:40,536 - INFO - analytics-database
2026-01-29 04:22:40,536 - INFO - analytics-cassandra:active
2026-01-29 04:22:40,541 - INFO - analyticsdb-nodemgr:active
2026-01-29 04:22:40,547 - INFO - query-engine:active
2026-01-29 04:22:40,548 - INFO - webui
2026-01-29 04:22:40,548 - INFO - webui:active
2026-01-29 04:22:40,548 - INFO - webui-middleware:active
2026-01-29 04:22:40,548 - INFO - redis:active
2026-01-29 04:22:40,548 - INFO - analytics_snmp
2026-01-29 04:22:40,555 - INFO - snmp-collector:active
2026-01-29 04:22:40,555 - INFO - snmp-topology:active
2026-01-29 04:22:40,555 - INFO - analytics_alarm
2026-01-29 04:22:40,555 - INFO - alarmgen:active
2026-01-29 04:22:40,668 - INFO - 10.0.0.240
2026-01-29 04:22:40,668 - INFO - config
2026-01-29 04:22:40,674 - INFO - config-nodemgr:active
2026-01-29 04:22:40,679 - INFO - api-server:active
2026-01-29 04:22:40,682 - INFO - schema:backup
2026-01-29 04:22:40,685 - INFO - svc-monitor:backup
2026-01-29 04:22:40,688 - INFO - device-manager:backup
2026-01-29 04:22:40,688 - INFO - config-database
2026-01-29 04:22:40,688 - INFO - config-cassandra:active
2026-01-29 04:22:40,688 - INFO - config-zookeeper:active
2026-01-29 04:22:40,688 - INFO - config-rabbitmq:active
2026-01-29 04:22:40,688 - INFO - control
2026-01-29 04:22:40,693 - INFO - control-nodemgr:active
2026-01-29 04:22:40,698 - INFO - control:active
2026-01-29 04:22:40,698 - INFO - named:active
2026-01-29 04:22:40,703 - INFO - dns:active
2026-01-29 04:22:40,703 - INFO - analytics
2026-01-29 04:22:40,709 - INFO - analytics-nodemgr:active
2026-01-29 04:22:40,714 - INFO - analytics-api:active
2026-01-29 04:22:40,718 - INFO - collector:active
2026-01-29 04:22:40,719 - INFO - analytics-database
2026-01-29 04:22:40,719 - INFO - analytics-cassandra:active
2026-01-29 04:22:40,724 - INFO - analyticsdb-nodemgr:active
2026-01-29 04:22:40,729 - INFO - query-engine:active
2026-01-29 04:22:40,730 - INFO - webui
2026-01-29 04:22:40,730 - INFO - webui:active
2026-01-29 04:22:40,730 - INFO - webui-middleware:active
2026-01-29 04:22:40,730 - INFO - redis:active
2026-01-29 04:22:40,730 - INFO - analytics_snmp
2026-01-29 04:22:40,735 - INFO - snmp-collector:active
2026-01-29 04:22:40,735 - INFO - snmp-topology:active
2026-01-29 04:22:40,735 - INFO - analytics_alarm
2026-01-29 04:22:40,735 - INFO - alarmgen:active
2026-01-29 04:22:40,835 - INFO - 10.0.0.49
2026-01-29 04:22:40,835 - INFO - vrouter
2026-01-29 04:22:40,841 - INFO - vrouter-nodemgr:active
2026-01-29 04:22:40,846 - INFO - agent:active
2026-01-29 04:22:40,945 - INFO - 10.0.0.128
2026-01-29 04:22:40,945 - INFO - vrouter
2026-01-29 04:22:40,952 - INFO - vrouter-nodemgr:active
2026-01-29 04:22:40,960 - INFO - agent:active
2026-01-29 04:22:40,960 - INFO - All the contrail services are up on all nodes
2026-01-29 04:22:40,960 - INFO - contrail-status passed
2026-01-29 04:22:42,262 - DEBUG - Skipping xmpp flap check
2026-01-29 04:22:42,262 - INFO - END TEST : test_contrail_status : PASSED[0:00:04]
2026-01-29 04:22:42,262 - INFO - --------------------------------------------------------------------------------