2026-05-18 16:38:54,363 - DEBUG - [10.0.0.249]: Running cmd : hostname
2026-05-18 16:38:54,576 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5796-1
2026-05-18 16:38:54,577 - DEBUG - [10.0.0.249]: Running cmd : hostname -f
2026-05-18 16:38:54,643 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5796-1.
2026-05-18 16:38:54,643 - DEBUG - [10.0.0.249]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2026-05-18 16:38:54,759 - DEBUG - Output : NAMES
contrail_test_2PTzSrPdL
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_snmp-collector_1
analytics_snmp_topology_1
analytics_alarm_alarm-gen_1
analytics_alarm_nodemgr_1
analytics_alarm_kafka_1
analytics_collector_1
analytics_nodemgr_1
analytics_api_1
analytics_database_nodemgr_1
analytics_database_query-engine_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_nodemgr_1
control_dns_1
webui_web_1
webui_job_1
config_devicemgr_1
config_dnsmasq_1
config_svcmonitor_1
config_nodemgr_1
config_schema_1
config_api_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2026-05-18 16:38:54,760 - DEBUG - [10.0.0.249]: Running cmd : getent hosts 10.0.0.249 | head -n 1 | awk '{print $2}'
2026-05-18 16:38:54,822 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5796-1.
2026-05-18 16:38:54,822 - DEBUG - [10.0.0.249]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2026-05-18 16:38:54,897 - DEBUG - Output : 127.0.0.1/8
10.0.0.249/24
172.17.0.1/16
10.20.0.17/24
2026-05-18 16:38:54,898 - DEBUG - [10.0.0.249]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2026-05-18 16:38:54,970 - DEBUG - Output : 10.20.0.17/24
2026-05-18 16:38:54,970 - DEBUG - [10.0.0.249]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}'
2026-05-18 16:38:55,037 - DEBUG - Output :
2026-05-18 16:38:56,961 - INFO - Using existing project ['default-domain', 'admin'](2ed3c3d4-19e5-4a4c-853e-5527eed63ad5)
2026-05-18 16:38:57,107 - INFO - ================================================================================
2026-05-18 16:38:57,107 - INFO - STARTING TEST : test_contrail_status
2026-05-18 16:38:57,107 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-05-18 16:38:57,252 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:38:57,260 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.17': '0'}} with
2026-05-18 16:38:57,260 - INFO - Initial checks done. Running the testcase now
2026-05-18 16:38:57,260 - INFO -
2026-05-18 16:38:57,260 - DEBUG - [10.0.0.249]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2026-05-18 16:38:57,355 - DEBUG - Output : contrail_test_2PTzSrPdL
vrouter_vrouter-agent_1
vrouter_provisioner_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_snmp-collector_1
analytics_snmp_provisioner_1
analytics_snmp_topology_1
analytics_alarm_alarm-gen_1
analytics_alarm_nodemgr_1
analytics_alarm_provisioner_1
analytics_alarm_kafka_1
analytics_provisioner_1
analytics_collector_1
analytics_nodemgr_1
analytics_api_1
analytics_database_nodemgr_1
analytics_database_query-engine_1
analytics_database_provisioner_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_nodemgr_1
control_provisioner_1
control_dns_1
webui_web_1
webui_job_1
config_devicemgr_1
config_provisioner_1
config_dnsmasq_1
config_svcmonitor_1
config_nodemgr_1
config_schema_1
config_api_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_provisioner_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2026-05-18 16:38:57,355 - INFO - 10.0.0.249
2026-05-18 16:38:57,355 - INFO - config
2026-05-18 16:38:57,362 - INFO - config-nodemgr:active
2026-05-18 16:38:57,367 - INFO - api-server:active
2026-05-18 16:38:57,371 - INFO - schema:active
2026-05-18 16:38:57,377 - INFO - svc-monitor:active
2026-05-18 16:38:57,382 - INFO - device-manager:active
2026-05-18 16:38:57,382 - INFO - config-database
2026-05-18 16:38:57,383 - INFO - config-cassandra:active
2026-05-18 16:38:57,383 - INFO - config-zookeeper:active
2026-05-18 16:38:57,383 - INFO - config-rabbitmq:active
2026-05-18 16:38:57,383 - INFO - vrouter
2026-05-18 16:38:57,388 - INFO - vrouter-nodemgr:active
2026-05-18 16:38:57,394 - INFO - agent:active
2026-05-18 16:38:57,394 - INFO - control
2026-05-18 16:38:57,399 - INFO - control-nodemgr:active
2026-05-18 16:38:57,404 - INFO - control:active
2026-05-18 16:38:57,405 - INFO - named:active
2026-05-18 16:38:57,410 - INFO - dns:active
2026-05-18 16:38:57,410 - INFO - analytics
2026-05-18 16:38:57,415 - INFO - analytics-nodemgr:active
2026-05-18 16:38:57,419 - INFO - analytics-api:active
2026-05-18 16:38:57,424 - INFO - collector:active
2026-05-18 16:38:57,425 - INFO - analytics-database
2026-05-18 16:38:57,425 - INFO - analytics-cassandra:active
2026-05-18 16:38:57,430 - INFO - analyticsdb-nodemgr:active
2026-05-18 16:38:57,434 - INFO - query-engine:active
2026-05-18 16:38:57,434 - INFO - webui
2026-05-18 16:38:57,434 - INFO - webui:active
2026-05-18 16:38:57,434 - INFO - webui-middleware:active
2026-05-18 16:38:57,435 - INFO - redis:active
2026-05-18 16:38:57,435 - INFO - analytics_snmp
2026-05-18 16:38:57,439 - INFO - snmp-collector:active
2026-05-18 16:38:57,439 - INFO - snmp-topology:active
2026-05-18 16:38:57,439 - INFO - analytics_alarm
2026-05-18 16:38:57,439 - INFO - alarmgen:active
2026-05-18 16:38:57,439 - INFO - All the contrail services are up on all nodes
2026-05-18 16:38:57,439 - INFO - contrail-status passed
2026-05-18 16:38:57,569 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:38:57,575 - DEBUG - No XMPP flaps were noticed during the test
2026-05-18 16:38:57,575 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2026-05-18 16:38:57,575 - INFO - --------------------------------------------------------------------------------
2026-05-18 16:39:00,191 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:39:02,568 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-28463206:ctest-vn22-71498210:ctest-vn22-71498210
2026-05-18 16:39:02,575 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-28463206:ctest-vn22-71498210:ctest-vn22-71498210
2026-05-18 16:39:02,581 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-28463206:ctest-vn22-71498210:ctest-vn22-71498210
2026-05-18 16:39:23,919 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-28463206:ctest-vn22-71498210
2026-05-18 16:39:23,928 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-28463206:ctest-vn22-71498210:ctest-vn22-71498210
2026-05-18 16:39:23,935 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-28463206:ctest-vn22-71498210:ctest-vn22-71498210
2026-05-18 16:39:24,095 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:39:25,237 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:39:25,243 - DEBUG - [10.0.0.249]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check'
2026-05-18 16:39:28,918 - DEBUG - Output : 2026-05-18 16:39:27,970 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success
2026-05-18 16:39:27,998 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success
2026-05-18 16:39:28,098 INFO: (v1.41) Checker check_obj_mandatory_fields: Success
2026-05-18 16:39:28,284 INFO: (v1.41) Checker check_orphan_resources: Success
2026-05-18 16:39:28,489 INFO: (v1.41) Checker check_fq_name_uuid_match: Success
2026-05-18 16:39:28,490 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before.
2026-05-18 16:39:28,606 INFO: (v1.41) Checker check_duplicate_fq_name: Success
2026-05-18 16:39:28,621 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success
2026-05-18 16:39:28,627 INFO: (v1.41) Checker check_subnet_uuid: Success
2026-05-18 16:39:28,636 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed:
ZK subnet path '/api-server/subnets' does ends with a valid IP network
2026-05-18 16:39:28,675 INFO: (v1.41) Checker check_route_targets_id: Success
2026-05-18 16:39:28,692 INFO: (v1.41) Checker check_virtual_networks_id: Success
2026-05-18 16:39:28,703 INFO: (v1.41) Checker check_security_groups_id: Success
2026-05-18 16:39:28,716 INFO: (v1.41) Checker check_ipam_subnet_method: Success
2026-05-18 16:39:28,720 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success
2026-05-18 16:39:29,073 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:39:29,293 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:39:29,457 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:39:29,625 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:39:29,789 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:39:32,772 - INFO - admin user already present
2026-05-18 16:39:33,668 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:39:36,118 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-fvn-88587687:ctest-fvn-88587687
2026-05-18 16:39:36,123 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-fvn-88587687:ctest-fvn-88587687
2026-05-18 16:39:36,128 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-fvn-88587687:ctest-fvn-88587687
2026-05-18 16:39:37,148 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-vn1-89928695:ctest-vn1-89928695
2026-05-18 16:39:37,154 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-vn1-89928695:ctest-vn1-89928695
2026-05-18 16:39:37,160 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-vn1-89928695:ctest-vn1-89928695
2026-05-18 16:39:40,936 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7f6771a7-28c0-4424-ba6e-4f8c19c9abfa
2026-05-18 16:39:40,943 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-vn1-89928695:ctest-vn1-89928695
2026-05-18 16:39:40,949 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7f6771a7-28c0-4424-ba6e-4f8c19c9abfa
2026-05-18 16:39:56,150 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bb9bba99-1fcc-431d-b38b-bfdad53e00ab
2026-05-18 16:39:56,156 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-fvn-88587687:ctest-fvn-88587687
2026-05-18 16:39:56,161 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bb9bba99-1fcc-431d-b38b-bfdad53e00ab
2026-05-18 16:39:57,715 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7f6771a7-28c0-4424-ba6e-4f8c19c9abfa
2026-05-18 16:39:57,721 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-fvn-88587687
2026-05-18 16:39:57,727 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-fvn-88587687:ctest-fvn-88587687
2026-05-18 16:39:57,732 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Inet4UcRouteReq?x=3
2026-05-18 16:40:03,538 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-vn1-89928695
2026-05-18 16:40:03,545 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-vn1-89928695:ctest-vn1-89928695
2026-05-18 16:40:03,552 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-vn1-89928695:ctest-vn1-89928695
2026-05-18 16:40:03,853 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-fvn-88587687
2026-05-18 16:40:03,858 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-fvn-88587687:ctest-fvn-88587687
2026-05-18 16:40:03,865 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-76729545:ctest-fvn-88587687:ctest-fvn-88587687
2026-05-18 16:40:04,131 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:40:07,863 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:40:08,259 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:40:15,304 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:40:17,983 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:40:21,327 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:40:23,515 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:40:23,803 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:40:31,573 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:91933216-056d-4420-879a-4404d406901e
2026-05-18 16:40:31,583 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-82569486:ctest-vn1-55903215:ctest-vn1-55903215
2026-05-18 16:40:31,589 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:91933216-056d-4420-879a-4404d406901e
2026-05-18 16:40:39,540 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b12598c9-4024-4b07-9d70-a644bb3b6673
2026-05-18 16:40:39,547 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-82569486:ctest-vn1-55903215:ctest-vn1-55903215
2026-05-18 16:40:39,552 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b12598c9-4024-4b07-9d70-a644bb3b6673
2026-05-18 16:40:44,771 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:40:48,442 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:40:54,260 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:40:57,736 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:46:31,143 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:46:34,772 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:46:38,566 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-12261236:ctest-vn-12261236
2026-05-18 16:46:38,571 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-12261236:ctest-vn-12261236
2026-05-18 16:46:38,575 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-12261236:ctest-vn-12261236
2026-05-18 16:46:38,882 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-18093282:ctest-vn-18093282
2026-05-18 16:46:38,886 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-18093282:ctest-vn-18093282
2026-05-18 16:46:38,890 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-18093282:ctest-vn-18093282
2026-05-18 16:46:39,444 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-18093282
2026-05-18 16:46:39,449 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-18093282:ctest-vn-18093282
2026-05-18 16:46:39,454 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-18093282:ctest-vn-18093282
2026-05-18 16:46:39,709 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-12261236
2026-05-18 16:46:39,713 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-12261236:ctest-vn-12261236
2026-05-18 16:46:39,718 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-93361583:ctest-vn-12261236:ctest-vn-12261236
2026-05-18 16:46:39,998 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:46:43,406 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:46:43,691 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:46:46,449 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-93792415:ctest-vn4-36667819:ctest-vn4-36667819
2026-05-18 16:46:46,454 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-93792415:ctest-vn4-36667819:ctest-vn4-36667819
2026-05-18 16:46:46,459 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-93792415:ctest-vn4-36667819:ctest-vn4-36667819
2026-05-18 16:46:46,872 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-93792415:ctest-vn4-36667819
2026-05-18 16:46:46,877 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-93792415:ctest-vn4-36667819:ctest-vn4-36667819
2026-05-18 16:46:46,882 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-93792415:ctest-vn4-36667819:ctest-vn4-36667819
2026-05-18 16:46:47,342 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:46:47,638 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:46:51,083 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:46:54,465 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-16653417:ctest-vn-16653417
2026-05-18 16:46:54,471 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-16653417:ctest-vn-16653417
2026-05-18 16:46:54,477 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-16653417:ctest-vn-16653417
2026-05-18 16:46:54,785 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-66571271:ctest-vn-66571271
2026-05-18 16:46:54,791 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-66571271:ctest-vn-66571271
2026-05-18 16:46:54,797 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-66571271:ctest-vn-66571271
2026-05-18 16:52:22,932 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-66571271
2026-05-18 16:52:22,938 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-66571271:ctest-vn-66571271
2026-05-18 16:52:22,943 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-66571271:ctest-vn-66571271
2026-05-18 16:52:28,213 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-16653417
2026-05-18 16:52:28,218 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-16653417:ctest-vn-16653417
2026-05-18 16:52:28,223 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-68259516:ctest-vn-16653417:ctest-vn-16653417
2026-05-18 16:52:28,488 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:52:32,104 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:52:37,284 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:52:40,560 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:52:42,549 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-mgmt_vn-32989983:ctest-mgmt_vn-32989983
2026-05-18 16:52:42,554 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-mgmt_vn-32989983:ctest-mgmt_vn-32989983
2026-05-18 16:52:42,558 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-mgmt_vn-32989983:ctest-mgmt_vn-32989983
2026-05-18 16:52:43,391 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-left_vn-84062076:ctest-left_vn-84062076
2026-05-18 16:52:43,395 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-left_vn-84062076:ctest-left_vn-84062076
2026-05-18 16:52:43,400 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-left_vn-84062076:ctest-left_vn-84062076
2026-05-18 16:52:44,273 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-right_vn-55249586:ctest-right_vn-55249586
2026-05-18 16:52:44,278 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-right_vn-55249586:ctest-right_vn-55249586
2026-05-18 16:52:44,283 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-right_vn-55249586:ctest-right_vn-55249586
2026-05-18 16:52:49,848 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-right_vn-55249586
2026-05-18 16:52:49,853 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-right_vn-55249586:ctest-right_vn-55249586
2026-05-18 16:52:49,858 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-right_vn-55249586:ctest-right_vn-55249586
2026-05-18 16:52:50,104 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-left_vn-84062076
2026-05-18 16:52:50,109 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-left_vn-84062076:ctest-left_vn-84062076
2026-05-18 16:52:50,113 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-left_vn-84062076:ctest-left_vn-84062076
2026-05-18 16:52:50,403 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-mgmt_vn-32989983
2026-05-18 16:52:50,408 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-mgmt_vn-32989983:ctest-mgmt_vn-32989983
2026-05-18 16:52:50,413 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-79130829:ctest-mgmt_vn-32989983:ctest-mgmt_vn-32989983
2026-05-18 16:52:50,694 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:52:54,151 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:52:58,380 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:53:01,852 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:53:05,872 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:53:09,251 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:53:12,263 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:53:12,556 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:53:15,208 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:53:15,495 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:53:20,110 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-08820772:ctest-vn-05275350:ctest-vn-05275350
2026-05-18 16:53:20,115 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-08820772:ctest-vn-05275350:ctest-vn-05275350
2026-05-18 16:53:20,120 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-08820772:ctest-vn-05275350:ctest-vn-05275350
2026-05-18 16:53:21,205 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-08820772:ctest-vn-05275350
2026-05-18 16:53:21,210 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-08820772:ctest-vn-05275350:ctest-vn-05275350
2026-05-18 16:53:21,216 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-08820772:ctest-vn-05275350:ctest-vn-05275350
2026-05-18 16:53:21,579 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq?
2026-05-18 16:54:53,424 - INFO - Using existing project ['default-domain', 'admin'](2ed3c3d4-19e5-4a4c-853e-5527eed63ad5)
2026-05-18 16:54:53,436 - INFO - ================================================================================
2026-05-18 16:54:53,436 - INFO - STARTING TEST : test_contrail_status
2026-05-18 16:54:53,436 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-05-18 16:54:53,561 - DEBUG - Skipping xmpp flap check
2026-05-18 16:54:53,561 - INFO - Initial checks done. Running the testcase now
2026-05-18 16:54:53,561 - INFO -
2026-05-18 16:54:53,671 - INFO - 10.0.0.249
2026-05-18 16:54:53,671 - INFO - config
2026-05-18 16:54:53,678 - INFO - config-nodemgr:active
2026-05-18 16:54:53,683 - INFO - api-server:active
2026-05-18 16:54:53,688 - INFO - schema:active
2026-05-18 16:54:53,692 - INFO - svc-monitor:active
2026-05-18 16:54:53,697 - INFO - device-manager:active
2026-05-18 16:54:53,697 - INFO - config-database
2026-05-18 16:54:53,697 - INFO - config-cassandra:active
2026-05-18 16:54:53,697 - INFO - config-zookeeper:active
2026-05-18 16:54:53,697 - INFO - config-rabbitmq:active
2026-05-18 16:54:53,697 - INFO - vrouter
2026-05-18 16:54:53,701 - INFO - vrouter-nodemgr:active
2026-05-18 16:54:53,706 - INFO - agent:active
2026-05-18 16:54:53,707 - INFO - control
2026-05-18 16:54:53,711 - INFO - control-nodemgr:active
2026-05-18 16:54:53,717 - INFO - control:active
2026-05-18 16:54:53,717 - INFO - named:active
2026-05-18 16:54:53,723 - INFO - dns:active
2026-05-18 16:54:53,723 - INFO - analytics
2026-05-18 16:54:53,729 - INFO - analytics-nodemgr:active
2026-05-18 16:54:53,733 - INFO - analytics-api:active
2026-05-18 16:54:53,739 - INFO - collector:active
2026-05-18 16:54:53,739 - INFO - analytics-database
2026-05-18 16:54:53,739 - INFO - analytics-cassandra:active
2026-05-18 16:54:53,744 - INFO - analyticsdb-nodemgr:active
2026-05-18 16:54:53,750 - INFO - query-engine:active
2026-05-18 16:54:53,750 - INFO - webui
2026-05-18 16:54:53,750 - INFO - webui:active
2026-05-18 16:54:53,751 - INFO - webui-middleware:active
2026-05-18 16:54:53,751 - INFO - redis:active
2026-05-18 16:54:53,751 - INFO - analytics_snmp
2026-05-18 16:54:53,755 - INFO - snmp-collector:active
2026-05-18 16:54:53,755 - INFO - snmp-topology:active
2026-05-18 16:54:53,755 - INFO - analytics_alarm
2026-05-18 16:54:53,755 - INFO - alarmgen:active
2026-05-18 16:54:53,756 - INFO - All the contrail services are up on all nodes
2026-05-18 16:54:53,756 - INFO - contrail-status passed
2026-05-18 16:54:53,876 - DEBUG - Skipping xmpp flap check
2026-05-18 16:54:53,877 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2026-05-18 16:54:53,877 - INFO - --------------------------------------------------------------------------------