2026-01-29 02:05:36,574 - DEBUG - [10.0.0.41]: Running cmd : hostname
2026-01-29 02:05:36,782 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5111-1
2026-01-29 02:05:36,782 - DEBUG - [10.0.0.41]: Running cmd : hostname -f
2026-01-29 02:05:36,844 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5111-1.
2026-01-29 02:05:36,844 - DEBUG - [10.0.0.41]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2026-01-29 02:05:36,946 - DEBUG - Output : NAMES
contrail_test_L9NqZF1ss
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_topology_1
analytics_snmp_nodemgr_1
analytics_snmp_snmp-collector_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_collector_1
analytics_nodemgr_1
analytics_api_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_dns_1
control_control_1
control_nodemgr_1
webui_job_1
webui_web_1
config_devicemgr_1
config_dnsmasq_1
config_schema_1
config_api_1
config_svcmonitor_1
config_nodemgr_1
config_database_nodemgr_1
config_database_rabbitmq_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2026-01-29 02:05:36,947 - DEBUG - [10.0.0.41]: Running cmd : getent hosts 10.0.0.41 | head -n 1 | awk '{print $2}'
2026-01-29 02:05:37,000 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5111-1.
2026-01-29 02:05:37,000 - DEBUG - [10.0.0.41]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2026-01-29 02:05:37,061 - DEBUG - Output : 127.0.0.1/8
10.0.0.41/24
172.17.0.1/16
10.20.0.18/24
2026-01-29 02:05:37,061 - DEBUG - [10.0.0.41]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2026-01-29 02:05:37,128 - DEBUG - Output : 10.20.0.18/24
2026-01-29 02:05:37,128 - DEBUG - [10.0.0.41]: Running cmd : getent hosts 10.20.0.18 | head -n 1 | awk '{print $2}'
2026-01-29 02:05:37,189 - DEBUG - Output :
2026-01-29 02:05:38,860 - INFO - Using existing project ['default-domain', 'admin'](54abdbbe-d1c4-4944-8054-5df33b219ff0)
2026-01-29 02:05:38,997 - INFO - ================================================================================
2026-01-29 02:05:38,997 - INFO - STARTING TEST : test_contrail_status
2026-01-29 02:05:38,998 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-01-29 02:05:39,132 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:05:39,139 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.18': '0'}} with
2026-01-29 02:05:39,139 - INFO - Initial checks done. Running the testcase now
2026-01-29 02:05:39,139 - INFO -
2026-01-29 02:05:39,139 - DEBUG - [10.0.0.41]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2026-01-29 02:05:39,230 - DEBUG - Output : contrail_test_L9NqZF1ss
vrouter_vrouter-agent_1
vrouter_provisioner_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_topology_1
analytics_snmp_nodemgr_1
analytics_snmp_provisioner_1
analytics_snmp_snmp-collector_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_provisioner_1
analytics_alarm_kafka_1
analytics_collector_1
analytics_nodemgr_1
analytics_api_1
analytics_provisioner_1
analytics_database_provisioner_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_provisioner_1
control_dns_1
control_control_1
control_nodemgr_1
webui_job_1
webui_web_1
config_devicemgr_1
config_dnsmasq_1
config_provisioner_1
config_schema_1
config_api_1
config_svcmonitor_1
config_nodemgr_1
config_database_nodemgr_1
config_database_rabbitmq_1
config_database_provisioner_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2026-01-29 02:05:39,230 - INFO - 10.0.0.41
2026-01-29 02:05:39,230 - INFO - config
2026-01-29 02:05:39,235 - INFO - config-nodemgr:active
2026-01-29 02:05:39,239 - INFO - api-server:active
2026-01-29 02:05:39,243 - INFO - schema:active
2026-01-29 02:05:39,246 - INFO - svc-monitor:active
2026-01-29 02:05:39,250 - INFO - device-manager:active
2026-01-29 02:05:39,250 - INFO - config-database
2026-01-29 02:05:39,250 - INFO - config-cassandra:active
2026-01-29 02:05:39,250 - INFO - config-zookeeper:active
2026-01-29 02:05:39,250 - INFO - config-rabbitmq:active
2026-01-29 02:05:39,250 - INFO - vrouter
2026-01-29 02:05:39,254 - INFO - vrouter-nodemgr:active
2026-01-29 02:05:39,258 - INFO - agent:active
2026-01-29 02:05:39,258 - INFO - control
2026-01-29 02:05:39,263 - INFO - control-nodemgr:active
2026-01-29 02:05:39,267 - INFO - control:active
2026-01-29 02:05:39,267 - INFO - named:active
2026-01-29 02:05:39,272 - INFO - dns:active
2026-01-29 02:05:39,272 - INFO - analytics
2026-01-29 02:05:39,276 - INFO - analytics-nodemgr:active
2026-01-29 02:05:39,280 - INFO - analytics-api:active
2026-01-29 02:05:39,285 - INFO - collector:active
2026-01-29 02:05:39,285 - INFO - analytics-database
2026-01-29 02:05:39,285 - INFO - analytics-cassandra:active
2026-01-29 02:05:39,289 - INFO - analyticsdb-nodemgr:active
2026-01-29 02:05:39,294 - INFO - query-engine:active
2026-01-29 02:05:39,294 - INFO - webui
2026-01-29 02:05:39,294 - INFO - webui:active
2026-01-29 02:05:39,294 - INFO - webui-middleware:active
2026-01-29 02:05:39,294 - INFO - redis:active
2026-01-29 02:05:39,294 - INFO - analytics_snmp
2026-01-29 02:05:39,297 - INFO - snmp-collector:active
2026-01-29 02:05:39,297 - INFO - snmp-topology:active
2026-01-29 02:05:39,298 - INFO - analytics_alarm
2026-01-29 02:05:39,298 - INFO - alarmgen:active
2026-01-29 02:05:39,298 - INFO - All the contrail services are up on all nodes
2026-01-29 02:05:39,298 - INFO - contrail-status passed
2026-01-29 02:05:39,418 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:05:39,423 - DEBUG - No XMPP flaps were noticed during the test
2026-01-29 02:05:39,423 - INFO - END TEST : test_contrail_status : PASSED[0:00:01]
2026-01-29 02:05:39,423 - INFO - --------------------------------------------------------------------------------
2026-01-29 02:05:41,707 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:05:43,978 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-44467037:ctest-vn22-74325314:ctest-vn22-74325314
2026-01-29 02:05:43,985 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-44467037:ctest-vn22-74325314:ctest-vn22-74325314
2026-01-29 02:05:43,990 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-44467037:ctest-vn22-74325314:ctest-vn22-74325314
2026-01-29 02:06:05,031 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-44467037:ctest-vn22-74325314
2026-01-29 02:06:05,037 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-44467037:ctest-vn22-74325314:ctest-vn22-74325314
2026-01-29 02:06:05,041 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-44467037:ctest-vn22-74325314:ctest-vn22-74325314
2026-01-29 02:06:05,179 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:06,214 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:06,220 - DEBUG - [10.0.0.41]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check'
2026-01-29 02:06:09,378 - DEBUG - Output : 2026-01-29 02:06:08,650 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success
2026-01-29 02:06:08,673 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success
2026-01-29 02:06:08,757 INFO: (v1.41) Checker check_obj_mandatory_fields: Success
2026-01-29 02:06:08,921 INFO: (v1.41) Checker check_orphan_resources: Success
2026-01-29 02:06:09,105 INFO: (v1.41) Checker check_fq_name_uuid_match: Success
2026-01-29 02:06:09,105 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before.
2026-01-29 02:06:09,194 INFO: (v1.41) Checker check_duplicate_fq_name: Success
2026-01-29 02:06:09,205 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success
2026-01-29 02:06:09,211 INFO: (v1.41) Checker check_subnet_uuid: Success
2026-01-29 02:06:09,221 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed:
ZK subnet path '/api-server/subnets' does ends with a valid IP network
2026-01-29 02:06:09,245 INFO: (v1.41) Checker check_route_targets_id: Success
2026-01-29 02:06:09,253 INFO: (v1.41) Checker check_virtual_networks_id: Success
2026-01-29 02:06:09,260 INFO: (v1.41) Checker check_security_groups_id: Success
2026-01-29 02:06:09,264 INFO: (v1.41) Checker check_ipam_subnet_method: Success
2026-01-29 02:06:09,265 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success
2026-01-29 02:06:09,538 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:09,806 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:09,967 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:10,131 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:10,290 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:12,983 - INFO - admin user already present
2026-01-29 02:06:13,814 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:15,807 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-fvn-58505382:ctest-fvn-58505382
2026-01-29 02:06:15,812 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-fvn-58505382:ctest-fvn-58505382
2026-01-29 02:06:15,817 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-fvn-58505382:ctest-fvn-58505382
2026-01-29 02:06:16,709 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-vn1-88138467:ctest-vn1-88138467
2026-01-29 02:06:16,715 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-vn1-88138467:ctest-vn1-88138467
2026-01-29 02:06:16,719 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-vn1-88138467:ctest-vn1-88138467
2026-01-29 02:06:25,151 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:889908db-00e1-4f79-af34-0ec807154383
2026-01-29 02:06:25,157 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-vn1-88138467:ctest-vn1-88138467
2026-01-29 02:06:25,163 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:889908db-00e1-4f79-af34-0ec807154383
2026-01-29 02:06:31,151 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d35f2980-9df8-43c3-93c3-085d69e44f7a
2026-01-29 02:06:31,157 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-fvn-58505382:ctest-fvn-58505382
2026-01-29 02:06:31,163 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d35f2980-9df8-43c3-93c3-085d69e44f7a
2026-01-29 02:06:32,687 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:889908db-00e1-4f79-af34-0ec807154383
2026-01-29 02:06:32,692 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-fvn-58505382
2026-01-29 02:06:32,697 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-fvn-58505382:ctest-fvn-58505382
2026-01-29 02:06:32,701 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_Inet4UcRouteReq?x=3
2026-01-29 02:06:38,348 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-vn1-88138467
2026-01-29 02:06:38,353 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-vn1-88138467:ctest-vn1-88138467
2026-01-29 02:06:38,358 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-vn1-88138467:ctest-vn1-88138467
2026-01-29 02:06:38,636 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-fvn-58505382
2026-01-29 02:06:38,641 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-fvn-58505382:ctest-fvn-58505382
2026-01-29 02:06:38,646 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-33386659:ctest-fvn-58505382:ctest-fvn-58505382
2026-01-29 02:06:38,909 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:42,241 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:42,629 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:49,033 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:51,509 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:54,897 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:56,993 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:06:57,281 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:07:04,455 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:01fc89cd-8f04-4cbf-a279-63829dea33cd
2026-01-29 02:07:04,460 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-21495976:ctest-vn1-12526813:ctest-vn1-12526813
2026-01-29 02:07:04,466 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:01fc89cd-8f04-4cbf-a279-63829dea33cd
2026-01-29 02:07:12,393 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8f80b2cc-5321-4a2c-8306-2ec8f122392d
2026-01-29 02:07:12,398 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-21495976:ctest-vn1-12526813:ctest-vn1-12526813
2026-01-29 02:07:12,403 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8f80b2cc-5321-4a2c-8306-2ec8f122392d
2026-01-29 02:07:17,521 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:07:20,918 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:07:30,973 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:77f6e30c-b3c0-46d4-abe8-a1395e3a0951
2026-01-29 02:07:30,979 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-46874801:ctest-vn1-71557421:ctest-vn1-71557421
2026-01-29 02:07:30,984 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:77f6e30c-b3c0-46d4-abe8-a1395e3a0951
2026-01-29 02:07:36,878 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:50121923-c158-4c2a-946d-ee33b69645b3
2026-01-29 02:07:36,884 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-46874801:ctest-vn2-03977213:ctest-vn2-03977213
2026-01-29 02:07:36,888 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:50121923-c158-4c2a-946d-ee33b69645b3
2026-01-29 02:07:58,784 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:08:02,013 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:13:34,477 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:13:37,765 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:13:41,419 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-59021539:ctest-vn-59021539
2026-01-29 02:13:41,423 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-59021539:ctest-vn-59021539
2026-01-29 02:13:41,427 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-59021539:ctest-vn-59021539
2026-01-29 02:13:41,716 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-30797100:ctest-vn-30797100
2026-01-29 02:13:41,721 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-30797100:ctest-vn-30797100
2026-01-29 02:13:41,725 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-30797100:ctest-vn-30797100
2026-01-29 02:13:42,244 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-30797100
2026-01-29 02:13:42,249 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-30797100:ctest-vn-30797100
2026-01-29 02:13:42,256 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-30797100:ctest-vn-30797100
2026-01-29 02:13:42,520 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-59021539
2026-01-29 02:13:42,525 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-59021539:ctest-vn-59021539
2026-01-29 02:13:42,530 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-52200361:ctest-vn-59021539:ctest-vn-59021539
2026-01-29 02:13:42,793 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:13:46,029 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:13:46,321 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:13:48,913 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-26674786:ctest-vn4-38324667:ctest-vn4-38324667
2026-01-29 02:13:48,918 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-26674786:ctest-vn4-38324667:ctest-vn4-38324667
2026-01-29 02:13:48,922 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-26674786:ctest-vn4-38324667:ctest-vn4-38324667
2026-01-29 02:13:49,285 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-26674786:ctest-vn4-38324667
2026-01-29 02:13:49,290 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-26674786:ctest-vn4-38324667:ctest-vn4-38324667
2026-01-29 02:13:49,295 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-26674786:ctest-vn4-38324667:ctest-vn4-38324667
2026-01-29 02:13:49,760 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:13:50,046 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:13:53,425 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:13:56,560 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-65806433:ctest-vn-65806433
2026-01-29 02:13:56,565 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-65806433:ctest-vn-65806433
2026-01-29 02:13:56,569 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-65806433:ctest-vn-65806433
2026-01-29 02:13:56,862 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-72786744:ctest-vn-72786744
2026-01-29 02:13:56,868 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-72786744:ctest-vn-72786744
2026-01-29 02:13:56,872 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-72786744:ctest-vn-72786744
2026-01-29 02:19:24,268 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-72786744
2026-01-29 02:19:24,274 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-72786744:ctest-vn-72786744
2026-01-29 02:19:24,279 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-72786744:ctest-vn-72786744
2026-01-29 02:19:24,513 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-65806433
2026-01-29 02:19:24,518 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-65806433:ctest-vn-65806433
2026-01-29 02:19:24,523 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-86516150:ctest-vn-65806433:ctest-vn-65806433
2026-01-29 02:19:24,789 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:19:28,197 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:19:33,169 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:19:36,377 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:19:38,256 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-mgmt_vn-78959945:ctest-mgmt_vn-78959945
2026-01-29 02:19:38,260 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-mgmt_vn-78959945:ctest-mgmt_vn-78959945
2026-01-29 02:19:38,264 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-mgmt_vn-78959945:ctest-mgmt_vn-78959945
2026-01-29 02:19:39,080 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-left_vn-48966026:ctest-left_vn-48966026
2026-01-29 02:19:39,085 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-left_vn-48966026:ctest-left_vn-48966026
2026-01-29 02:19:39,089 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-left_vn-48966026:ctest-left_vn-48966026
2026-01-29 02:19:39,882 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-right_vn-93654177:ctest-right_vn-93654177
2026-01-29 02:19:39,886 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-right_vn-93654177:ctest-right_vn-93654177
2026-01-29 02:19:39,890 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-right_vn-93654177:ctest-right_vn-93654177
2026-01-29 02:19:45,263 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-right_vn-93654177
2026-01-29 02:19:45,267 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-right_vn-93654177:ctest-right_vn-93654177
2026-01-29 02:19:45,272 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-right_vn-93654177:ctest-right_vn-93654177
2026-01-29 02:19:45,520 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-left_vn-48966026
2026-01-29 02:19:45,524 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-left_vn-48966026:ctest-left_vn-48966026
2026-01-29 02:19:45,529 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-left_vn-48966026:ctest-left_vn-48966026
2026-01-29 02:19:45,792 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-mgmt_vn-78959945
2026-01-29 02:19:45,797 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-mgmt_vn-78959945:ctest-mgmt_vn-78959945
2026-01-29 02:19:45,801 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-45820345:ctest-mgmt_vn-78959945:ctest-mgmt_vn-78959945
2026-01-29 02:19:46,066 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:19:49,333 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:19:58,677 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:20:02,033 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:20:06,029 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:20:09,330 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:20:12,162 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:20:12,449 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:20:14,981 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:20:15,273 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:20:19,680 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-68614796:ctest-vn-61961876:ctest-vn-61961876
2026-01-29 02:20:19,685 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-68614796:ctest-vn-61961876:ctest-vn-61961876
2026-01-29 02:20:19,690 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-68614796:ctest-vn-61961876:ctest-vn-61961876
2026-01-29 02:20:20,610 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-68614796:ctest-vn-61961876
2026-01-29 02:20:20,616 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-68614796:ctest-vn-61961876:ctest-vn-61961876
2026-01-29 02:20:20,620 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-68614796:ctest-vn-61961876:ctest-vn-61961876
2026-01-29 02:20:20,966 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2026-01-29 02:21:50,428 - INFO - Using existing project ['default-domain', 'admin'](54abdbbe-d1c4-4944-8054-5df33b219ff0)
2026-01-29 02:21:50,436 - INFO - ================================================================================
2026-01-29 02:21:50,437 - INFO - STARTING TEST : test_contrail_status
2026-01-29 02:21:50,437 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-01-29 02:21:50,559 - DEBUG - Skipping xmpp flap check
2026-01-29 02:21:50,559 - INFO - Initial checks done. Running the testcase now
2026-01-29 02:21:50,559 - INFO -
2026-01-29 02:21:50,670 - INFO - 10.0.0.41
2026-01-29 02:21:50,670 - INFO - config
2026-01-29 02:21:50,675 - INFO - config-nodemgr:active
2026-01-29 02:21:50,679 - INFO - api-server:active
2026-01-29 02:21:50,683 - INFO - schema:active
2026-01-29 02:21:50,686 - INFO - svc-monitor:active
2026-01-29 02:21:50,690 - INFO - device-manager:active
2026-01-29 02:21:50,690 - INFO - config-database
2026-01-29 02:21:50,690 - INFO - config-cassandra:active
2026-01-29 02:21:50,690 - INFO - config-zookeeper:active
2026-01-29 02:21:50,690 - INFO - config-rabbitmq:active
2026-01-29 02:21:50,690 - INFO - vrouter
2026-01-29 02:21:50,695 - INFO - vrouter-nodemgr:active
2026-01-29 02:21:50,699 - INFO - agent:active
2026-01-29 02:21:50,699 - INFO - control
2026-01-29 02:21:50,703 - INFO - control-nodemgr:active
2026-01-29 02:21:50,708 - INFO - control:active
2026-01-29 02:21:50,708 - INFO - named:active
2026-01-29 02:21:50,714 - INFO - dns:active
2026-01-29 02:21:50,714 - INFO - analytics
2026-01-29 02:21:50,719 - INFO - analytics-nodemgr:active
2026-01-29 02:21:50,723 - INFO - analytics-api:active
2026-01-29 02:21:50,728 - INFO - collector:active
2026-01-29 02:21:50,729 - INFO - analytics-database
2026-01-29 02:21:50,729 - INFO - analytics-cassandra:active
2026-01-29 02:21:50,734 - INFO - analyticsdb-nodemgr:active
2026-01-29 02:21:50,739 - INFO - query-engine:active
2026-01-29 02:21:50,739 - INFO - webui
2026-01-29 02:21:50,739 - INFO - webui:active
2026-01-29 02:21:50,739 - INFO - webui-middleware:active
2026-01-29 02:21:50,740 - INFO - redis:active
2026-01-29 02:21:50,740 - INFO - analytics_snmp
2026-01-29 02:21:50,743 - INFO - snmp-collector:active
2026-01-29 02:21:50,744 - INFO - snmp-topology:active
2026-01-29 02:21:50,744 - INFO - analytics_alarm
2026-01-29 02:21:50,744 - INFO - alarmgen:active
2026-01-29 02:21:50,744 - INFO - All the contrail services are up on all nodes
2026-01-29 02:21:50,744 - INFO - contrail-status passed
2026-01-29 02:21:50,866 - DEBUG - Skipping xmpp flap check
2026-01-29 02:21:50,867 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2026-01-29 02:21:50,867 - INFO - --------------------------------------------------------------------------------