2025-12-25 02:17:04,612 - DEBUG - [10.0.0.41]: Running cmd : hostname
2025-12-25 02:17:04,816 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4924-1
2025-12-25 02:17:04,816 - DEBUG - [10.0.0.41]: Running cmd : hostname -f
2025-12-25 02:17:04,880 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4924-1.
2025-12-25 02:17:04,880 - DEBUG - [10.0.0.41]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-12-25 02:17:04,992 - DEBUG - Output : NAMES
contrail_test_kR0JoQzTh
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_snmp-collector_1
analytics_snmp_topology_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_api_1
analytics_nodemgr_1
analytics_collector_1
analytics_database_nodemgr_1
analytics_database_query-engine_1
analytics_database_cassandra_1
control_named_1
control_dns_1
control_control_1
control_nodemgr_1
webui_job_1
webui_web_1
config_devicemgr_1
config_dnsmasq_1
config_schema_1
config_api_1
config_svcmonitor_1
config_nodemgr_1
config_database_nodemgr_1
config_database_rabbitmq_1
config_database_zookeeper_1
config_database_cassandra_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-12-25 02:17:04,992 - DEBUG - [10.0.0.41]: Running cmd : getent hosts 10.0.0.41 | head -n 1 | awk '{print $2}'
2025-12-25 02:17:05,055 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4924-1.
2025-12-25 02:17:05,055 - DEBUG - [10.0.0.41]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2025-12-25 02:17:05,120 - DEBUG - Output : 127.0.0.1/8
10.0.0.41/24
172.17.0.1/16
10.20.0.210/24
2025-12-25 02:17:05,120 - DEBUG - [10.0.0.41]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2025-12-25 02:17:05,183 - DEBUG - Output : 10.20.0.210/24
2025-12-25 02:17:05,184 - DEBUG - [10.0.0.41]: Running cmd : getent hosts 10.20.0.210 | head -n 1 | awk '{print $2}'
2025-12-25 02:17:05,247 - DEBUG - Output :
2025-12-25 02:17:06,955 - INFO - Using existing project ['default-domain', 'admin'](d1e2df73-4255-4b28-9d5d-7633801ddb63)
2025-12-25 02:17:07,097 - INFO - ================================================================================
2025-12-25 02:17:07,097 - INFO - STARTING TEST : test_contrail_status
2025-12-25 02:17:07,097 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-12-25 02:17:07,231 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:17:07,237 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.210': '0'}} with
2025-12-25 02:17:07,237 - INFO - Initial checks done. Running the testcase now
2025-12-25 02:17:07,238 - INFO -
2025-12-25 02:17:07,238 - DEBUG - [10.0.0.41]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2025-12-25 02:17:07,330 - DEBUG - Output : contrail_test_kR0JoQzTh
vrouter_vrouter-agent_1
vrouter_nodemgr_1
vrouter_provisioner_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_snmp-collector_1
analytics_snmp_topology_1
analytics_snmp_provisioner_1
analytics_alarm_nodemgr_1
analytics_alarm_provisioner_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_provisioner_1
analytics_api_1
analytics_nodemgr_1
analytics_collector_1
analytics_database_nodemgr_1
analytics_database_provisioner_1
analytics_database_query-engine_1
analytics_database_cassandra_1
control_named_1
control_dns_1
control_provisioner_1
control_control_1
control_nodemgr_1
webui_job_1
webui_web_1
config_devicemgr_1
config_dnsmasq_1
config_schema_1
config_api_1
config_provisioner_1
config_svcmonitor_1
config_nodemgr_1
config_database_nodemgr_1
config_database_provisioner_1
config_database_rabbitmq_1
config_database_zookeeper_1
config_database_cassandra_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-12-25 02:17:07,330 - INFO - 10.0.0.41
2025-12-25 02:17:07,330 - INFO - config
2025-12-25 02:17:07,335 - INFO - config-nodemgr:active
2025-12-25 02:17:07,341 - INFO - api-server:active
2025-12-25 02:17:07,345 - INFO - schema:active
2025-12-25 02:17:07,349 - INFO - svc-monitor:active
2025-12-25 02:17:07,352 - INFO - device-manager:active
2025-12-25 02:17:07,352 - INFO - config-database
2025-12-25 02:17:07,352 - INFO - config-cassandra:active
2025-12-25 02:17:07,352 - INFO - config-zookeeper:active
2025-12-25 02:17:07,352 - INFO - config-rabbitmq:active
2025-12-25 02:17:07,352 - INFO - vrouter
2025-12-25 02:17:07,357 - INFO - vrouter-nodemgr:active
2025-12-25 02:17:07,360 - INFO - agent:active
2025-12-25 02:17:07,360 - INFO - control
2025-12-25 02:17:07,365 - INFO - control-nodemgr:active
2025-12-25 02:17:07,369 - INFO - control:active
2025-12-25 02:17:07,369 - INFO - named:active
2025-12-25 02:17:07,374 - INFO - dns:active
2025-12-25 02:17:07,374 - INFO - analytics
2025-12-25 02:17:07,378 - INFO - analytics-nodemgr:active
2025-12-25 02:17:07,381 - INFO - analytics-api:active
2025-12-25 02:17:07,385 - INFO - collector:active
2025-12-25 02:17:07,386 - INFO - analytics-database
2025-12-25 02:17:07,386 - INFO - analytics-cassandra:active
2025-12-25 02:17:07,390 - INFO - analyticsdb-nodemgr:active
2025-12-25 02:17:07,395 - INFO - query-engine:active
2025-12-25 02:17:07,395 - INFO - webui
2025-12-25 02:17:07,395 - INFO - webui:active
2025-12-25 02:17:07,395 - INFO - webui-middleware:active
2025-12-25 02:17:07,395 - INFO - redis:active
2025-12-25 02:17:07,395 - INFO - analytics_snmp
2025-12-25 02:17:07,398 - INFO - snmp-collector:active
2025-12-25 02:17:07,398 - INFO - snmp-topology:active
2025-12-25 02:17:07,399 - INFO - analytics_alarm
2025-12-25 02:17:07,399 - INFO - alarmgen:active
2025-12-25 02:17:07,399 - INFO - All the contrail services are up on all nodes
2025-12-25 02:17:07,399 - INFO - contrail-status passed
2025-12-25 02:17:07,524 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:17:07,529 - DEBUG - No XMPP flaps were noticed during the test
2025-12-25 02:17:07,529 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2025-12-25 02:17:07,529 - INFO - --------------------------------------------------------------------------------
2025-12-25 02:17:09,905 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:17:12,176 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-10128298:ctest-vn22-07405071:ctest-vn22-07405071
2025-12-25 02:17:12,183 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-10128298:ctest-vn22-07405071:ctest-vn22-07405071
2025-12-25 02:17:12,187 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-10128298:ctest-vn22-07405071:ctest-vn22-07405071
2025-12-25 02:17:33,239 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-10128298:ctest-vn22-07405071
2025-12-25 02:17:33,246 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-10128298:ctest-vn22-07405071:ctest-vn22-07405071
2025-12-25 02:17:33,251 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-10128298:ctest-vn22-07405071:ctest-vn22-07405071
2025-12-25 02:17:33,388 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:17:34,477 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:17:34,484 - DEBUG - [10.0.0.41]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check'
2025-12-25 02:17:37,844 - DEBUG - Output : 2025-12-25 02:17:36,998 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success
2025-12-25 02:17:37,025 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success
2025-12-25 02:17:37,133 INFO: (v1.41) Checker check_obj_mandatory_fields: Success
2025-12-25 02:17:37,330 INFO: (v1.41) Checker check_orphan_resources: Success
2025-12-25 02:17:37,524 INFO: (v1.41) Checker check_fq_name_uuid_match: Success
2025-12-25 02:17:37,524 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before.
2025-12-25 02:17:37,647 INFO: (v1.41) Checker check_duplicate_fq_name: Success
2025-12-25 02:17:37,660 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success
2025-12-25 02:17:37,667 INFO: (v1.41) Checker check_subnet_uuid: Success
2025-12-25 02:17:37,680 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed:
ZK subnet path '/api-server/subnets' does ends with a valid IP network
2025-12-25 02:17:37,707 INFO: (v1.41) Checker check_route_targets_id: Success
2025-12-25 02:17:37,716 INFO: (v1.41) Checker check_virtual_networks_id: Success
2025-12-25 02:17:37,724 INFO: (v1.41) Checker check_security_groups_id: Success
2025-12-25 02:17:37,728 INFO: (v1.41) Checker check_ipam_subnet_method: Success
2025-12-25 02:17:37,730 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success
2025-12-25 02:17:38,005 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:17:38,201 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:17:38,373 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:17:38,541 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:17:38,705 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:17:41,414 - INFO - admin user already present
2025-12-25 02:17:42,264 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:17:44,291 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-fvn-71776926:ctest-fvn-71776926
2025-12-25 02:17:44,296 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-fvn-71776926:ctest-fvn-71776926
2025-12-25 02:17:44,301 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-fvn-71776926:ctest-fvn-71776926
2025-12-25 02:17:45,220 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-vn1-56131885:ctest-vn1-56131885
2025-12-25 02:17:45,225 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-vn1-56131885:ctest-vn1-56131885
2025-12-25 02:17:45,229 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-vn1-56131885:ctest-vn1-56131885
2025-12-25 02:17:48,576 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c89958e0-6c31-4069-b42a-8c9e0a1b27cb
2025-12-25 02:17:48,581 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-vn1-56131885:ctest-vn1-56131885
2025-12-25 02:17:48,586 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c89958e0-6c31-4069-b42a-8c9e0a1b27cb
2025-12-25 02:17:58,623 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d16162b6-c83b-42ca-b1af-5150c1b6bd85
2025-12-25 02:17:58,629 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-fvn-71776926:ctest-fvn-71776926
2025-12-25 02:17:58,636 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d16162b6-c83b-42ca-b1af-5150c1b6bd85
2025-12-25 02:18:00,182 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c89958e0-6c31-4069-b42a-8c9e0a1b27cb
2025-12-25 02:18:00,188 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-fvn-71776926
2025-12-25 02:18:00,193 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-fvn-71776926:ctest-fvn-71776926
2025-12-25 02:18:00,198 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_Inet4UcRouteReq?x=3
2025-12-25 02:18:05,973 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-vn1-56131885
2025-12-25 02:18:05,979 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-vn1-56131885:ctest-vn1-56131885
2025-12-25 02:18:05,984 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-vn1-56131885:ctest-vn1-56131885
2025-12-25 02:18:06,283 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-fvn-71776926
2025-12-25 02:18:06,288 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-fvn-71776926:ctest-fvn-71776926
2025-12-25 02:18:06,294 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-54000345:ctest-fvn-71776926:ctest-fvn-71776926
2025-12-25 02:18:06,570 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:18:10,060 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:18:10,443 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:18:17,492 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:18:19,875 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:18:23,179 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:18:25,199 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:18:25,491 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:18:32,809 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:db84fd29-32f8-4f8f-9c8d-45f7a2f42f0c
2025-12-25 02:18:32,816 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-08261659:ctest-vn1-64494893:ctest-vn1-64494893
2025-12-25 02:18:32,821 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:db84fd29-32f8-4f8f-9c8d-45f7a2f42f0c
2025-12-25 02:18:43,882 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f58631e7-5187-4fc6-823d-8693d4590281
2025-12-25 02:18:43,887 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-08261659:ctest-vn1-64494893:ctest-vn1-64494893
2025-12-25 02:18:43,892 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f58631e7-5187-4fc6-823d-8693d4590281
2025-12-25 02:18:49,060 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:18:52,568 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:19:02,713 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:86ee7968-b98e-4a1c-a822-71ef80715248
2025-12-25 02:19:02,720 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-66169601:ctest-vn1-10213748:ctest-vn1-10213748
2025-12-25 02:19:02,725 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:86ee7968-b98e-4a1c-a822-71ef80715248
2025-12-25 02:19:08,651 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7b949cbe-3548-4430-9ece-2ba5722515e0
2025-12-25 02:19:08,657 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-66169601:ctest-vn2-70734335:ctest-vn2-70734335
2025-12-25 02:19:08,662 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7b949cbe-3548-4430-9ece-2ba5722515e0
2025-12-25 02:19:30,592 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:19:33,920 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:19:44,882 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9a351a30-0ec0-4631-b4db-d461c6579bc2
2025-12-25 02:19:44,889 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-39370059:ctest-vn-69618884:ctest-vn-69618884
2025-12-25 02:19:44,893 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9a351a30-0ec0-4631-b4db-d461c6579bc2
2025-12-25 02:19:50,828 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ab7cd3a7-43dc-4ec3-a4ad-efa9eaff8f1e
2025-12-25 02:19:50,835 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-39370059:ctest-ext_vn-51090687:ctest-ext_vn-51090687
2025-12-25 02:19:50,842 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ab7cd3a7-43dc-4ec3-a4ad-efa9eaff8f1e
2025-12-25 02:20:04,147 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:20:07,552 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:20:11,175 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-68397364:ctest-vn-68397364
2025-12-25 02:20:11,181 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-68397364:ctest-vn-68397364
2025-12-25 02:20:11,186 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-68397364:ctest-vn-68397364
2025-12-25 02:20:11,528 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-56892413:ctest-vn-56892413
2025-12-25 02:20:11,533 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-56892413:ctest-vn-56892413
2025-12-25 02:20:11,538 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-56892413:ctest-vn-56892413
2025-12-25 02:20:12,165 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-56892413
2025-12-25 02:20:12,169 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-56892413:ctest-vn-56892413
2025-12-25 02:20:12,173 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-56892413:ctest-vn-56892413
2025-12-25 02:20:12,417 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-68397364
2025-12-25 02:20:12,421 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-68397364:ctest-vn-68397364
2025-12-25 02:20:12,426 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63322177:ctest-vn-68397364:ctest-vn-68397364
2025-12-25 02:20:12,691 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:20:16,059 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:20:16,352 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:20:19,345 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72889726:ctest-vn4-04964034:ctest-vn4-04964034
2025-12-25 02:20:19,350 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72889726:ctest-vn4-04964034:ctest-vn4-04964034
2025-12-25 02:20:19,355 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72889726:ctest-vn4-04964034:ctest-vn4-04964034
2025-12-25 02:20:19,745 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72889726:ctest-vn4-04964034
2025-12-25 02:20:19,749 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72889726:ctest-vn4-04964034:ctest-vn4-04964034
2025-12-25 02:20:19,754 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72889726:ctest-vn4-04964034:ctest-vn4-04964034
2025-12-25 02:20:20,208 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:20:20,495 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:20:23,931 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:20:27,126 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-62711500:ctest-vn-62711500
2025-12-25 02:20:27,131 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-62711500:ctest-vn-62711500
2025-12-25 02:20:27,135 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-62711500:ctest-vn-62711500
2025-12-25 02:20:27,447 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-91094547:ctest-vn-91094547
2025-12-25 02:20:27,451 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-91094547:ctest-vn-91094547
2025-12-25 02:20:27,456 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-91094547:ctest-vn-91094547
2025-12-25 02:20:35,204 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:172b8aa5-9db8-4256-9546-0c6cd12f83f9
2025-12-25 02:20:35,210 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-62711500:ctest-vn-62711500
2025-12-25 02:20:35,215 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:172b8aa5-9db8-4256-9546-0c6cd12f83f9
2025-12-25 02:20:46,245 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d632cff2-e7ab-47bb-a240-e4571fce5ecb
2025-12-25 02:20:46,250 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-91094547:ctest-vn-91094547
2025-12-25 02:20:46,256 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d632cff2-e7ab-47bb-a240-e4571fce5ecb
2025-12-25 02:20:57,958 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-91094547
2025-12-25 02:20:57,964 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-91094547:ctest-vn-91094547
2025-12-25 02:20:57,968 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-91094547:ctest-vn-91094547
2025-12-25 02:20:58,224 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-62711500
2025-12-25 02:20:58,230 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-62711500:ctest-vn-62711500
2025-12-25 02:20:58,235 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-88388210:ctest-vn-62711500:ctest-vn-62711500
2025-12-25 02:20:58,504 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:21:01,916 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:21:11,749 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3b633cc4-4731-403d-b4af-cde75d9e7cde
2025-12-25 02:21:11,754 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-68152046:ctest-bgpaas_vn-98280906:ctest-bgpaas_vn-98280906
2025-12-25 02:21:11,758 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3b633cc4-4731-403d-b4af-cde75d9e7cde
2025-12-25 02:21:17,802 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c6df2c22-be45-4f3e-9d60-39ac62096d42
2025-12-25 02:21:17,808 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-68152046:ctest-bgpaas_vn-13237005:ctest-bgpaas_vn-13237005
2025-12-25 02:21:17,813 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c6df2c22-be45-4f3e-9d60-39ac62096d42
2025-12-25 02:21:19,484 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:21:20,499 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:21:26,856 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:21:30,180 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:21:32,075 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-mgmt_vn-99392890:ctest-mgmt_vn-99392890
2025-12-25 02:21:32,079 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-mgmt_vn-99392890:ctest-mgmt_vn-99392890
2025-12-25 02:21:32,084 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-mgmt_vn-99392890:ctest-mgmt_vn-99392890
2025-12-25 02:21:32,874 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-left_vn-38737392:ctest-left_vn-38737392
2025-12-25 02:21:32,879 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-left_vn-38737392:ctest-left_vn-38737392
2025-12-25 02:21:32,883 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-left_vn-38737392:ctest-left_vn-38737392
2025-12-25 02:21:33,722 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-right_vn-47642134:ctest-right_vn-47642134
2025-12-25 02:21:33,726 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-right_vn-47642134:ctest-right_vn-47642134
2025-12-25 02:21:33,731 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-right_vn-47642134:ctest-right_vn-47642134
2025-12-25 02:21:39,011 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-right_vn-47642134
2025-12-25 02:21:39,016 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-right_vn-47642134:ctest-right_vn-47642134
2025-12-25 02:21:39,020 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-right_vn-47642134:ctest-right_vn-47642134
2025-12-25 02:21:39,247 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-left_vn-38737392
2025-12-25 02:21:39,252 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-left_vn-38737392:ctest-left_vn-38737392
2025-12-25 02:21:39,256 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-left_vn-38737392:ctest-left_vn-38737392
2025-12-25 02:21:39,503 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-mgmt_vn-99392890
2025-12-25 02:21:39,507 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-mgmt_vn-99392890:ctest-mgmt_vn-99392890
2025-12-25 02:21:39,511 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-55988161:ctest-mgmt_vn-99392890:ctest-mgmt_vn-99392890
2025-12-25 02:21:39,773 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:21:43,072 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:21:52,220 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:21:55,608 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:21:59,512 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:22:02,968 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:22:05,828 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:22:06,120 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:22:13,788 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:22:14,076 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:22:18,796 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-54380217:ctest-vn-39048262:ctest-vn-39048262
2025-12-25 02:22:18,801 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-54380217:ctest-vn-39048262:ctest-vn-39048262
2025-12-25 02:22:18,805 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-54380217:ctest-vn-39048262:ctest-vn-39048262
2025-12-25 02:22:19,754 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-54380217:ctest-vn-39048262
2025-12-25 02:22:19,759 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-54380217:ctest-vn-39048262:ctest-vn-39048262
2025-12-25 02:22:19,763 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-54380217:ctest-vn-39048262:ctest-vn-39048262
2025-12-25 02:22:20,112 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq?
2025-12-25 02:24:06,622 - INFO - Using existing project ['default-domain', 'admin'](d1e2df73-4255-4b28-9d5d-7633801ddb63)
2025-12-25 02:24:06,633 - INFO - ================================================================================
2025-12-25 02:24:06,633 - INFO - STARTING TEST : test_contrail_status
2025-12-25 02:24:06,633 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-12-25 02:24:06,758 - DEBUG - Skipping xmpp flap check
2025-12-25 02:24:06,758 - INFO - Initial checks done. Running the testcase now
2025-12-25 02:24:06,758 - INFO -
2025-12-25 02:24:06,865 - INFO - 10.0.0.41
2025-12-25 02:24:06,865 - INFO - config
2025-12-25 02:24:06,872 - INFO - config-nodemgr:active
2025-12-25 02:24:06,877 - INFO - api-server:active
2025-12-25 02:24:06,882 - INFO - schema:active
2025-12-25 02:24:06,885 - INFO - svc-monitor:active
2025-12-25 02:24:06,889 - INFO - device-manager:active
2025-12-25 02:24:06,889 - INFO - config-database
2025-12-25 02:24:06,889 - INFO - config-cassandra:active
2025-12-25 02:24:06,889 - INFO - config-zookeeper:active
2025-12-25 02:24:06,889 - INFO - config-rabbitmq:active
2025-12-25 02:24:06,889 - INFO - vrouter
2025-12-25 02:24:06,895 - INFO - vrouter-nodemgr:active
2025-12-25 02:24:06,899 - INFO - agent:active
2025-12-25 02:24:06,899 - INFO - control
2025-12-25 02:24:06,904 - INFO - control-nodemgr:active
2025-12-25 02:24:06,908 - INFO - control:active
2025-12-25 02:24:06,908 - INFO - named:active
2025-12-25 02:24:06,912 - INFO - dns:active
2025-12-25 02:24:06,913 - INFO - analytics
2025-12-25 02:24:06,918 - INFO - analytics-nodemgr:active
2025-12-25 02:24:06,922 - INFO - analytics-api:active
2025-12-25 02:24:06,926 - INFO - collector:active
2025-12-25 02:24:06,927 - INFO - analytics-database
2025-12-25 02:24:06,927 - INFO - analytics-cassandra:active
2025-12-25 02:24:06,932 - INFO - analyticsdb-nodemgr:active
2025-12-25 02:24:06,936 - INFO - query-engine:active
2025-12-25 02:24:06,936 - INFO - webui
2025-12-25 02:24:06,936 - INFO - webui:active
2025-12-25 02:24:06,936 - INFO - webui-middleware:active
2025-12-25 02:24:06,936 - INFO - redis:active
2025-12-25 02:24:06,936 - INFO - analytics_snmp
2025-12-25 02:24:06,939 - INFO - snmp-collector:active
2025-12-25 02:24:06,940 - INFO - snmp-topology:active
2025-12-25 02:24:06,940 - INFO - analytics_alarm
2025-12-25 02:24:06,940 - INFO - alarmgen:active
2025-12-25 02:24:06,940 - INFO - All the contrail services are up on all nodes
2025-12-25 02:24:06,940 - INFO - contrail-status passed
2025-12-25 02:24:07,061 - DEBUG - Skipping xmpp flap check
2025-12-25 02:24:07,061 - INFO - END TEST : test_contrail_status : PASSED[0:00:01]
2025-12-25 02:24:07,061 - INFO - --------------------------------------------------------------------------------