2025-07-31 12:48:09,211 - DEBUG - [10.0.0.50]: Running cmd : hostname
2025-07-31 12:48:09,740 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3735-1
2025-07-31 12:48:09,741 - DEBUG - [10.0.0.50]: Running cmd : hostname -f
2025-07-31 12:48:09,798 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3735-1.
2025-07-31 12:48:09,799 - DEBUG - [10.0.0.50]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-07-31 12:48:09,909 - DEBUG - Output : NAMES
contrail_test_K3X8PUa3a
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_snmp_snmp-collector_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_nodemgr_1
analytics_collector_1
analytics_api_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_nodemgr_1
control_dns_1
webui_web_1
webui_job_1
config_devicemgr_1
config_svcmonitor_1
config_dnsmasq_1
config_nodemgr_1
config_schema_1
config_api_1
config_database_nodemgr_1
config_database_rabbitmq_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-07-31 12:48:09,910 - DEBUG - [10.0.0.50]: Running cmd : getent hosts 10.0.0.50 | head -n 1 | awk '{print $2}'
2025-07-31 12:48:09,973 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3735-1.
2025-07-31 12:48:09,973 - DEBUG - [10.0.0.50]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}'
2025-07-31 12:48:10,038 - DEBUG - Output : 10.0.0.50/24
172.17.0.1/16
10.20.0.17/24
2025-07-31 12:48:10,038 - DEBUG - [10.0.0.50]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}'
2025-07-31 12:48:10,102 - DEBUG - Output : 10.20.0.17/24
2025-07-31 12:48:10,102 - DEBUG - [10.0.0.50]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}'
2025-07-31 12:48:10,166 - DEBUG - Output :
2025-07-31 12:48:11,957 - INFO - Using existing project ['default-domain', 'admin'](d76e3eda-6171-46e2-8478-df3c7a5a4661)
2025-07-31 12:48:12,123 - INFO - ================================================================================
2025-07-31 12:48:12,123 - INFO - STARTING TEST : test_contrail_status
2025-07-31 12:48:12,124 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-07-31 12:48:12,259 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:48:12,266 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.17': '0'}} with
2025-07-31 12:48:12,266 - INFO - Initial checks done. Running the testcase now
2025-07-31 12:48:12,266 - INFO -
2025-07-31 12:48:12,266 - DEBUG - [10.0.0.50]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2025-07-31 12:48:12,360 - DEBUG - Output : contrail_test_K3X8PUa3a
vrouter_vrouter-agent_1
vrouter_nodemgr_1
vrouter_provisioner_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_snmp_provisioner_1
analytics_snmp_snmp-collector_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_provisioner_1
analytics_alarm_kafka_1
analytics_nodemgr_1
analytics_collector_1
analytics_api_1
analytics_provisioner_1
analytics_database_query-engine_1
analytics_database_provisioner_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_nodemgr_1
control_dns_1
control_provisioner_1
webui_web_1
webui_job_1
config_devicemgr_1
config_svcmonitor_1
config_dnsmasq_1
config_provisioner_1
config_nodemgr_1
config_schema_1
config_api_1
config_database_nodemgr_1
config_database_provisioner_1
config_database_rabbitmq_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-07-31 12:48:12,360 - INFO - 10.0.0.50
2025-07-31 12:48:12,360 - INFO - config
2025-07-31 12:48:12,368 - INFO - config-nodemgr:active
2025-07-31 12:48:12,374 - INFO - api-server:active
2025-07-31 12:48:12,380 - INFO - schema:active
2025-07-31 12:48:12,386 - INFO - svc-monitor:active
2025-07-31 12:48:12,392 - INFO - device-manager:active
2025-07-31 12:48:12,392 - INFO - config-database
2025-07-31 12:48:12,392 - INFO - config-cassandra:active
2025-07-31 12:48:12,393 - INFO - config-zookeeper:active
2025-07-31 12:48:12,393 - INFO - config-rabbitmq:active
2025-07-31 12:48:12,393 - INFO - vrouter
2025-07-31 12:48:12,399 - INFO - vrouter-nodemgr:active
2025-07-31 12:48:12,404 - INFO - agent:active
2025-07-31 12:48:12,404 - INFO - control
2025-07-31 12:48:12,410 - INFO - control-nodemgr:active
2025-07-31 12:48:12,416 - INFO - control:active
2025-07-31 12:48:12,416 - INFO - named:active
2025-07-31 12:48:12,421 - INFO - dns:active
2025-07-31 12:48:12,422 - INFO - analytics
2025-07-31 12:48:12,427 - INFO - analytics-nodemgr:active
2025-07-31 12:48:12,433 - INFO - analytics-api:active
2025-07-31 12:48:12,439 - INFO - collector:active
2025-07-31 12:48:12,439 - INFO - analytics-database
2025-07-31 12:48:12,439 - INFO - analytics-cassandra:active
2025-07-31 12:48:12,444 - INFO - analyticsdb-nodemgr:active
2025-07-31 12:48:12,452 - INFO - query-engine:active
2025-07-31 12:48:12,452 - INFO - webui
2025-07-31 12:48:12,452 - INFO - webui:active
2025-07-31 12:48:12,452 - INFO - webui-middleware:active
2025-07-31 12:48:12,452 - INFO - redis:active
2025-07-31 12:48:12,452 - INFO - analytics_snmp
2025-07-31 12:48:12,456 - INFO - snmp-collector:active
2025-07-31 12:48:12,457 - INFO - snmp-topology:active
2025-07-31 12:48:12,457 - INFO - analytics_alarm
2025-07-31 12:48:12,457 - INFO - alarmgen:active
2025-07-31 12:48:12,457 - INFO - All the contrail services are up on all nodes
2025-07-31 12:48:12,457 - INFO - contrail-status passed
2025-07-31 12:48:12,580 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:48:12,594 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 12:48:12,595 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2025-07-31 12:48:12,595 - INFO - --------------------------------------------------------------------------------
2025-07-31 12:48:14,957 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:48:17,249 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-62302057:ctest-vn22-81617468:ctest-vn22-81617468
2025-07-31 12:48:17,256 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-62302057:ctest-vn22-81617468:ctest-vn22-81617468
2025-07-31 12:48:17,262 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-62302057:ctest-vn22-81617468:ctest-vn22-81617468
2025-07-31 12:48:38,411 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-62302057:ctest-vn22-81617468
2025-07-31 12:48:38,417 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-62302057:ctest-vn22-81617468:ctest-vn22-81617468
2025-07-31 12:48:38,422 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-62302057:ctest-vn22-81617468:ctest-vn22-81617468
2025-07-31 12:48:38,559 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:48:39,591 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:48:39,598 - DEBUG - [10.0.0.50]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check'
2025-07-31 12:48:44,034 - DEBUG - Output : 2025-07-31 12:48:41,987 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success
2025-07-31 12:48:42,010 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success
2025-07-31 12:48:42,334 INFO: (v1.41) Checker check_obj_mandatory_fields: Success
2025-07-31 12:48:43,001 INFO: (v1.41) Checker check_orphan_resources: Success
2025-07-31 12:48:43,556 INFO: (v1.41) Checker check_fq_name_uuid_match: Success
2025-07-31 12:48:43,557 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before.
2025-07-31 12:48:43,839 INFO: (v1.41) Checker check_duplicate_fq_name: Success
2025-07-31 12:48:43,854 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success
2025-07-31 12:48:43,863 INFO: (v1.41) Checker check_subnet_uuid: Success
2025-07-31 12:48:43,875 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed:
ZK subnet path '/api-server/subnets' does ends with a valid IP network
2025-07-31 12:48:43,906 INFO: (v1.41) Checker check_route_targets_id: Success
2025-07-31 12:48:43,916 INFO: (v1.41) Checker check_virtual_networks_id: Success
2025-07-31 12:48:43,923 INFO: (v1.41) Checker check_security_groups_id: Success
2025-07-31 12:48:43,925 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success
2025-07-31 12:48:44,187 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:48:46,783 - INFO - admin user already present
2025-07-31 12:48:47,603 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:48:49,583 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-fvn-81030361:ctest-fvn-81030361
2025-07-31 12:48:49,589 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-fvn-81030361:ctest-fvn-81030361
2025-07-31 12:48:49,598 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-fvn-81030361:ctest-fvn-81030361
2025-07-31 12:48:50,566 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-vn1-44165031:ctest-vn1-44165031
2025-07-31 12:48:50,573 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-vn1-44165031:ctest-vn1-44165031
2025-07-31 12:48:50,578 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-vn1-44165031:ctest-vn1-44165031
2025-07-31 12:48:54,052 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:44e93450-d874-4f42-ba7e-6e0dab4457c6
2025-07-31 12:48:54,059 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-vn1-44165031:ctest-vn1-44165031
2025-07-31 12:48:54,066 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:44e93450-d874-4f42-ba7e-6e0dab4457c6
2025-07-31 12:49:09,149 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:43a96d1a-2af1-44ad-8d3d-2005abf84ae4
2025-07-31 12:49:09,155 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-fvn-81030361:ctest-fvn-81030361
2025-07-31 12:49:09,160 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:43a96d1a-2af1-44ad-8d3d-2005abf84ae4
2025-07-31 12:49:10,697 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:44e93450-d874-4f42-ba7e-6e0dab4457c6
2025-07-31 12:49:10,703 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-fvn-81030361
2025-07-31 12:49:10,708 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-fvn-81030361:ctest-fvn-81030361
2025-07-31 12:49:10,714 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_Inet4UcRouteReq?x=3
2025-07-31 12:49:16,452 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-vn1-44165031
2025-07-31 12:49:16,458 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-vn1-44165031:ctest-vn1-44165031
2025-07-31 12:49:16,464 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-vn1-44165031:ctest-vn1-44165031
2025-07-31 12:49:16,730 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-fvn-81030361
2025-07-31 12:49:16,736 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-fvn-81030361:ctest-fvn-81030361
2025-07-31 12:49:16,742 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41780048:ctest-fvn-81030361:ctest-fvn-81030361
2025-07-31 12:49:17,006 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:49:21,035 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:49:21,437 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:49:28,178 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:49:30,746 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:49:33,999 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:49:36,169 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:49:36,450 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:49:43,896 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a5960341-ca95-4b74-8758-98c287469685
2025-07-31 12:49:43,904 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-69416829:ctest-vn1-94807174:ctest-vn1-94807174
2025-07-31 12:49:43,910 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a5960341-ca95-4b74-8758-98c287469685
2025-07-31 12:49:55,011 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0643e550-5c09-46c3-a137-f888c0a85749
2025-07-31 12:49:55,018 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-69416829:ctest-vn1-94807174:ctest-vn1-94807174
2025-07-31 12:49:55,023 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0643e550-5c09-46c3-a137-f888c0a85749
2025-07-31 12:50:00,218 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:50:03,839 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:50:14,081 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b921aac1-80ef-41e0-87fe-d18f7a52ef5e
2025-07-31 12:50:14,090 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-29214678:ctest-vn1-93137776:ctest-vn1-93137776
2025-07-31 12:50:14,096 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b921aac1-80ef-41e0-87fe-d18f7a52ef5e
2025-07-31 12:50:20,025 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b870aae2-13b8-4aab-85b6-62c7f7695677
2025-07-31 12:50:20,032 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-29214678:ctest-vn2-95720630:ctest-vn2-95720630
2025-07-31 12:50:20,038 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b870aae2-13b8-4aab-85b6-62c7f7695677
2025-07-31 12:50:42,079 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:50:45,343 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:50:56,435 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:491ba501-f1ad-4388-bcfc-eef785602210
2025-07-31 12:50:56,444 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-95523450:ctest-vn-96752368:ctest-vn-96752368
2025-07-31 12:50:56,451 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:491ba501-f1ad-4388-bcfc-eef785602210
2025-07-31 12:51:02,389 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:71bfb6b1-948c-42b8-bd4a-e015ef9dcc88
2025-07-31 12:51:02,395 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-95523450:ctest-ext_vn-77402018:ctest-ext_vn-77402018
2025-07-31 12:51:02,401 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:71bfb6b1-948c-42b8-bd4a-e015ef9dcc88
2025-07-31 12:51:10,639 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:51:14,071 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:51:17,969 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-70147678:ctest-vn-70147678
2025-07-31 12:51:17,975 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-70147678:ctest-vn-70147678
2025-07-31 12:51:17,982 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-70147678:ctest-vn-70147678
2025-07-31 12:51:18,359 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-55491208:ctest-vn-55491208
2025-07-31 12:51:18,365 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-55491208:ctest-vn-55491208
2025-07-31 12:51:18,372 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-55491208:ctest-vn-55491208
2025-07-31 12:51:19,045 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-55491208
2025-07-31 12:51:19,051 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-55491208:ctest-vn-55491208
2025-07-31 12:51:19,058 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-55491208:ctest-vn-55491208
2025-07-31 12:51:19,362 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-70147678
2025-07-31 12:51:19,368 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-70147678:ctest-vn-70147678
2025-07-31 12:51:19,375 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-21432239:ctest-vn-70147678:ctest-vn-70147678
2025-07-31 12:51:19,638 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:51:23,470 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:51:23,758 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:51:26,532 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-34762488:ctest-vn4-61270734:ctest-vn4-61270734
2025-07-31 12:51:26,538 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-34762488:ctest-vn4-61270734:ctest-vn4-61270734
2025-07-31 12:51:26,543 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-34762488:ctest-vn4-61270734:ctest-vn4-61270734
2025-07-31 12:51:26,936 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-34762488:ctest-vn4-61270734
2025-07-31 12:51:26,943 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-34762488:ctest-vn4-61270734:ctest-vn4-61270734
2025-07-31 12:51:26,948 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-34762488:ctest-vn4-61270734:ctest-vn4-61270734
2025-07-31 12:51:27,410 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:51:27,707 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:51:30,989 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:51:34,272 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-25965994:ctest-vn-25965994
2025-07-31 12:51:34,277 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-25965994:ctest-vn-25965994
2025-07-31 12:51:34,283 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-25965994:ctest-vn-25965994
2025-07-31 12:51:34,620 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-43438943:ctest-vn-43438943
2025-07-31 12:51:34,628 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-43438943:ctest-vn-43438943
2025-07-31 12:51:34,635 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-43438943:ctest-vn-43438943
2025-07-31 12:51:42,315 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2f5ecf75-705b-4e7b-88d6-5d6d4c4d3d4b
2025-07-31 12:51:42,323 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-25965994:ctest-vn-25965994
2025-07-31 12:51:42,329 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2f5ecf75-705b-4e7b-88d6-5d6d4c4d3d4b
2025-07-31 12:51:48,242 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7224cf5a-5aab-49a5-a95f-1ecac427fa31
2025-07-31 12:51:48,248 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-43438943:ctest-vn-43438943
2025-07-31 12:51:48,254 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7224cf5a-5aab-49a5-a95f-1ecac427fa31
2025-07-31 12:52:00,022 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-43438943
2025-07-31 12:52:00,027 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-43438943:ctest-vn-43438943
2025-07-31 12:52:00,033 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-43438943:ctest-vn-43438943
2025-07-31 12:52:00,313 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-25965994
2025-07-31 12:52:00,319 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-25965994:ctest-vn-25965994
2025-07-31 12:52:00,325 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-28473246:ctest-vn-25965994:ctest-vn-25965994
2025-07-31 12:52:00,611 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:52:03,934 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:52:06,543 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 12:52:06,831 - INFO - admin user already present
2025-07-31 12:52:06,890 - INFO - ctest-TestSvcRegr-13404112 user already added to project
2025-07-31 12:52:06,951 - INFO - ctest-TestSvcRegr-13404112 user already added to domain
2025-07-31 12:52:07,011 - INFO - admin user already added to project
2025-07-31 12:52:07,260 - INFO - admin user already present
2025-07-31 12:52:07,312 - INFO - ctest-TestvDNSBasic0-39509928 user already added to project
2025-07-31 12:52:07,369 - INFO - ctest-TestvDNSBasic0-39509928 user already added to domain
2025-07-31 12:52:07,434 - INFO - admin user already added to project
2025-07-31 12:52:07,710 - INFO - admin user already present
2025-07-31 12:52:07,777 - INFO - ctest-TestBasicVMVNx-54879112 user already added to project
2025-07-31 12:52:07,844 - INFO - ctest-TestBasicVMVNx-54879112 user already added to domain
2025-07-31 12:52:07,907 - INFO - admin user already added to project
2025-07-31 12:52:08,175 - INFO - admin user already present
2025-07-31 12:52:08,238 - INFO - ctest-TestBasicVMVN-15195273 user already added to project
2025-07-31 12:52:08,298 - INFO - ctest-TestBasicVMVN-15195273 user already added to domain
2025-07-31 12:52:08,355 - INFO - admin user already added to project
2025-07-31 12:52:17,645 - ERROR - Exception while creating project
Traceback (most recent call last):
File "/contrail-test/common/isolated_creds.py", line 166, in create_tenant
project.setUp()
File "/contrail-test/fixtures/project_test.py", line 91, in setUp
self.create()
File "/contrail-test/fixtures/project_test.py", line 115, in create
self.uuid = self.read()
File "/contrail-test/fixtures/project_test.py", line 106, in read
self.project_obj = self.vnc_lib_h.project_read(**args)
File "/usr/local/lib/python3.6/site-packages/vnc_api/vnc_api.py", line 52, in wrapper
return func(self, *args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/vnc_api/vnc_api.py", line 728, in _object_read
response = self._request_server(OP_GET, uri, query_params)
File "/usr/local/lib/python3.6/site-packages/vnc_api/vnc_api.py", line 1128, in _request_server
retry_after_authn=retry_after_authn, retry_count=retry_count)
File "/usr/local/lib/python3.6/site-packages/vnc_api/vnc_api.py", line 1208, in _request
raise HttpError(status, content)
vnc_api.exceptions.HttpError: HTTP Status: 500 Content: Internal Server Error
2025-07-31 12:52:17,812 - INFO - ================================================================================
2025-07-31 12:52:17,812 - INFO - STARTING TEST : test_contrail_status
2025-07-31 12:52:17,813 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-07-31 12:52:17,937 - DEBUG - Skipping xmpp flap check
2025-07-31 12:52:17,937 - INFO - Initial checks done. Running the testcase now
2025-07-31 12:52:17,937 - INFO -
2025-07-31 12:52:18,047 - INFO - 10.0.0.50
2025-07-31 12:52:18,047 - INFO - config
2025-07-31 12:52:18,054 - INFO - config-nodemgr:active
2025-07-31 12:52:18,059 - INFO - api-server:initializing (Database:Cassandra[] connection down)
2025-07-31 12:52:18,064 - INFO - schema:active
2025-07-31 12:52:18,069 - INFO - svc-monitor:active
2025-07-31 12:52:18,074 - INFO - device-manager:active
2025-07-31 12:52:18,075 - INFO - config-database
2025-07-31 12:52:18,075 - INFO - config-cassandra:active
2025-07-31 12:52:18,075 - INFO - config-zookeeper:active
2025-07-31 12:52:18,075 - INFO - config-rabbitmq:active
2025-07-31 12:52:18,075 - INFO - vrouter
2025-07-31 12:52:18,082 - INFO - vrouter-nodemgr:active
2025-07-31 12:52:18,089 - INFO - agent:active
2025-07-31 12:52:18,089 - INFO - control
2025-07-31 12:52:18,097 - INFO - control-nodemgr:active
2025-07-31 12:52:18,110 - INFO - control:active
2025-07-31 12:52:18,110 - INFO - named:active
2025-07-31 12:52:18,116 - INFO - dns:active
2025-07-31 12:52:18,116 - INFO - analytics
2025-07-31 12:52:18,122 - INFO - analytics-nodemgr:active
2025-07-31 12:52:18,127 - INFO - analytics-api:active
2025-07-31 12:52:18,133 - INFO - collector:initializing (Database:Cassandra connection down)
2025-07-31 12:52:18,133 - INFO - analytics-database
2025-07-31 12:52:18,133 - INFO - analytics-cassandra:active
2025-07-31 12:52:18,138 - INFO - analyticsdb-nodemgr:active
2025-07-31 12:52:18,144 - INFO - query-engine:active
2025-07-31 12:52:18,145 - INFO - webui
2025-07-31 12:52:18,145 - INFO - webui:active
2025-07-31 12:52:18,145 - INFO - webui-middleware:active
2025-07-31 12:52:18,145 - INFO - redis:active
2025-07-31 12:52:18,145 - INFO - analytics_snmp
2025-07-31 12:52:18,149 - INFO - snmp-collector:active
2025-07-31 12:52:18,149 - INFO - snmp-topology:active
2025-07-31 12:52:18,149 - INFO - analytics_alarm
2025-07-31 12:52:18,149 - INFO - alarmgen:active
2025-07-31 12:52:18,149 - DEBUG - defaultdict(, {'10.0.0.50': {'api-server': {'status': 'initializing', 'description': 'Database:Cassandra[] connection down'}, 'collector': {'status': 'initializing', 'description': 'Database:Cassandra connection down'}}})
2025-07-31 12:52:18,149 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 0
2025-07-31 12:52:28,225 - INFO - 10.0.0.50
2025-07-31 12:52:28,226 - INFO - config
2025-07-31 12:52:28,231 - INFO - config-nodemgr:active
2025-07-31 12:52:28,236 - INFO - api-server:initializing (Database:Cassandra[] connection down)
2025-07-31 12:52:28,241 - INFO - schema:active
2025-07-31 12:52:28,246 - INFO - svc-monitor:active
2025-07-31 12:52:28,251 - INFO - device-manager:active
2025-07-31 12:52:28,252 - INFO - config-database
2025-07-31 12:52:28,252 - INFO - config-cassandra:active
2025-07-31 12:52:28,252 - INFO - config-zookeeper:active
2025-07-31 12:52:28,252 - INFO - config-rabbitmq:active
2025-07-31 12:52:28,252 - INFO - vrouter
2025-07-31 12:52:28,257 - INFO - vrouter-nodemgr:active
2025-07-31 12:52:28,264 - INFO - agent:active
2025-07-31 12:52:28,264 - INFO - control
2025-07-31 12:52:28,269 - INFO - control-nodemgr:active
2025-07-31 12:52:28,276 - INFO - control:active
2025-07-31 12:52:28,276 - INFO - named:active
2025-07-31 12:52:28,283 - INFO - dns:active
2025-07-31 12:52:28,283 - INFO - analytics
2025-07-31 12:52:28,290 - INFO - analytics-nodemgr:active
2025-07-31 12:52:28,295 - INFO - analytics-api:active
2025-07-31 12:52:28,302 - INFO - collector:active
2025-07-31 12:52:28,302 - INFO - analytics-database
2025-07-31 12:52:28,302 - INFO - analytics-cassandra:active
2025-07-31 12:52:28,308 - INFO - analyticsdb-nodemgr:active
2025-07-31 12:52:28,315 - INFO - query-engine:active
2025-07-31 12:52:28,315 - INFO - webui
2025-07-31 12:52:28,315 - INFO - webui:active
2025-07-31 12:52:28,315 - INFO - webui-middleware:active
2025-07-31 12:52:28,315 - INFO - redis:active
2025-07-31 12:52:28,315 - INFO - analytics_snmp
2025-07-31 12:52:28,320 - INFO - snmp-collector:active
2025-07-31 12:52:28,320 - INFO - snmp-topology:active
2025-07-31 12:52:28,320 - INFO - analytics_alarm
2025-07-31 12:52:28,320 - INFO - alarmgen:active
2025-07-31 12:52:28,320 - DEBUG - defaultdict(, {'10.0.0.50': {'api-server': {'status': 'initializing', 'description': 'Database:Cassandra[] connection down'}}})
2025-07-31 12:52:28,320 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 1
2025-07-31 12:52:38,377 - INFO - 10.0.0.50
2025-07-31 12:52:38,377 - INFO - config
2025-07-31 12:52:38,383 - INFO - config-nodemgr:active
2025-07-31 12:52:38,387 - INFO - api-server:initializing (Database:Cassandra[] connection down)
2025-07-31 12:52:38,391 - INFO - schema:active
2025-07-31 12:52:38,395 - INFO - svc-monitor:active
2025-07-31 12:52:38,400 - INFO - device-manager:active
2025-07-31 12:52:38,400 - INFO - config-database
2025-07-31 12:52:38,400 - INFO - config-cassandra:active
2025-07-31 12:52:38,400 - INFO - config-zookeeper:active
2025-07-31 12:52:38,400 - INFO - config-rabbitmq:active
2025-07-31 12:52:38,400 - INFO - vrouter
2025-07-31 12:52:38,405 - INFO - vrouter-nodemgr:active
2025-07-31 12:52:38,411 - INFO - agent:active
2025-07-31 12:52:38,411 - INFO - control
2025-07-31 12:52:38,416 - INFO - control-nodemgr:active
2025-07-31 12:52:38,421 - INFO - control:active
2025-07-31 12:52:38,422 - INFO - named:active
2025-07-31 12:52:38,426 - INFO - dns:active
2025-07-31 12:52:38,427 - INFO - analytics
2025-07-31 12:52:38,431 - INFO - analytics-nodemgr:active
2025-07-31 12:52:38,435 - INFO - analytics-api:active
2025-07-31 12:52:38,441 - INFO - collector:active
2025-07-31 12:52:38,442 - INFO - analytics-database
2025-07-31 12:52:38,442 - INFO - analytics-cassandra:active
2025-07-31 12:52:38,447 - INFO - analyticsdb-nodemgr:active
2025-07-31 12:52:38,453 - INFO - query-engine:active
2025-07-31 12:52:38,454 - INFO - webui
2025-07-31 12:52:38,454 - INFO - webui:active
2025-07-31 12:52:38,454 - INFO - webui-middleware:active
2025-07-31 12:52:38,454 - INFO - redis:active
2025-07-31 12:52:38,454 - INFO - analytics_snmp
2025-07-31 12:52:38,458 - INFO - snmp-collector:active
2025-07-31 12:52:38,458 - INFO - snmp-topology:active
2025-07-31 12:52:38,458 - INFO - analytics_alarm
2025-07-31 12:52:38,458 - INFO - alarmgen:active
2025-07-31 12:52:38,458 - DEBUG - defaultdict(, {'10.0.0.50': {'api-server': {'status': 'initializing', 'description': 'Database:Cassandra[] connection down'}}})
2025-07-31 12:52:38,458 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 2
2025-07-31 12:52:48,527 - INFO - 10.0.0.50
2025-07-31 12:52:48,527 - INFO - config
2025-07-31 12:52:48,533 - INFO - config-nodemgr:active
2025-07-31 12:52:48,537 - INFO - api-server:initializing (Database:Cassandra[] connection down)
2025-07-31 12:52:48,541 - INFO - schema:active
2025-07-31 12:52:48,545 - INFO - svc-monitor:active
2025-07-31 12:52:48,549 - INFO - device-manager:active
2025-07-31 12:52:48,549 - INFO - config-database
2025-07-31 12:52:48,549 - INFO - config-cassandra:active
2025-07-31 12:52:48,549 - INFO - config-zookeeper:active
2025-07-31 12:52:48,549 - INFO - config-rabbitmq:active
2025-07-31 12:52:48,549 - INFO - vrouter
2025-07-31 12:52:48,553 - INFO - vrouter-nodemgr:active
2025-07-31 12:52:48,558 - INFO - agent:active
2025-07-31 12:52:48,558 - INFO - control
2025-07-31 12:52:48,563 - INFO - control-nodemgr:active
2025-07-31 12:52:48,568 - INFO - control:active
2025-07-31 12:52:48,568 - INFO - named:active
2025-07-31 12:52:48,573 - INFO - dns:active
2025-07-31 12:52:48,573 - INFO - analytics
2025-07-31 12:52:48,577 - INFO - analytics-nodemgr:active
2025-07-31 12:52:48,581 - INFO - analytics-api:active
2025-07-31 12:52:48,586 - INFO - collector:active
2025-07-31 12:52:48,586 - INFO - analytics-database
2025-07-31 12:52:48,586 - INFO - analytics-cassandra:active
2025-07-31 12:52:48,590 - INFO - analyticsdb-nodemgr:active
2025-07-31 12:52:48,596 - INFO - query-engine:active
2025-07-31 12:52:48,596 - INFO - webui
2025-07-31 12:52:48,596 - INFO - webui:active
2025-07-31 12:52:48,596 - INFO - webui-middleware:active
2025-07-31 12:52:48,596 - INFO - redis:active
2025-07-31 12:52:48,597 - INFO - analytics_snmp
2025-07-31 12:52:48,600 - INFO - snmp-collector:active
2025-07-31 12:52:48,601 - INFO - snmp-topology:active
2025-07-31 12:52:48,601 - INFO - analytics_alarm
2025-07-31 12:52:48,601 - INFO - alarmgen:active
2025-07-31 12:52:48,601 - DEBUG - defaultdict(, {'10.0.0.50': {'api-server': {'status': 'initializing', 'description': 'Database:Cassandra[] connection down'}}})
2025-07-31 12:52:48,601 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 3
2025-07-31 12:52:58,681 - INFO - 10.0.0.50
2025-07-31 12:52:58,681 - INFO - config
2025-07-31 12:52:58,687 - INFO - config-nodemgr:active
2025-07-31 12:52:58,692 - INFO - api-server:initializing (Database:Cassandra[] connection down)
2025-07-31 12:52:58,696 - INFO - schema:active
2025-07-31 12:52:58,700 - INFO - svc-monitor:active
2025-07-31 12:52:58,704 - INFO - device-manager:active
2025-07-31 12:52:58,704 - INFO - config-database
2025-07-31 12:52:58,704 - INFO - config-cassandra:active
2025-07-31 12:52:58,704 - INFO - config-zookeeper:active
2025-07-31 12:52:58,704 - INFO - config-rabbitmq:active
2025-07-31 12:52:58,704 - INFO - vrouter
2025-07-31 12:52:58,708 - INFO - vrouter-nodemgr:active
2025-07-31 12:52:58,714 - INFO - agent:active
2025-07-31 12:52:58,714 - INFO - control
2025-07-31 12:52:58,719 - INFO - control-nodemgr:active
2025-07-31 12:52:58,726 - INFO - control:active
2025-07-31 12:52:58,726 - INFO - named:active
2025-07-31 12:52:58,733 - INFO - dns:active
2025-07-31 12:52:58,733 - INFO - analytics
2025-07-31 12:52:58,739 - INFO - analytics-nodemgr:active
2025-07-31 12:52:58,744 - INFO - analytics-api:active
2025-07-31 12:52:58,754 - INFO - collector:active
2025-07-31 12:52:58,754 - INFO - analytics-database
2025-07-31 12:52:58,754 - INFO - analytics-cassandra:active
2025-07-31 12:52:58,759 - INFO - analyticsdb-nodemgr:active
2025-07-31 12:52:58,764 - INFO - query-engine:active
2025-07-31 12:52:58,764 - INFO - webui
2025-07-31 12:52:58,764 - INFO - webui:active
2025-07-31 12:52:58,764 - INFO - webui-middleware:active
2025-07-31 12:52:58,764 - INFO - redis:active
2025-07-31 12:52:58,764 - INFO - analytics_snmp
2025-07-31 12:52:58,768 - INFO - snmp-collector:active
2025-07-31 12:52:58,768 - INFO - snmp-topology:active
2025-07-31 12:52:58,768 - INFO - analytics_alarm
2025-07-31 12:52:58,768 - INFO - alarmgen:active
2025-07-31 12:52:58,769 - DEBUG - defaultdict(, {'10.0.0.50': {'api-server': {'status': 'initializing', 'description': 'Database:Cassandra[] connection down'}}})
2025-07-31 12:52:58,769 - ERROR - Not all services up , Gave up!
2025-07-31 12:52:58,769 - INFO - Failed services are : defaultdict(, {'10.0.0.50': {'api-server': {'status': 'initializing', 'description': 'Database:Cassandra[] connection down'}}})
2025-07-31 12:52:58,769 - ERROR - contrail-status failed
2025-07-31 12:52:58,892 - DEBUG - Skipping xmpp flap check
2025-07-31 12:52:58,892 - INFO -
2025-07-31 12:52:58,892 - INFO - END TEST : test_contrail_status : FAILED[0:00:41]
2025-07-31 12:52:58,892 - INFO - --------------------------------------------------------------------------------