2025-11-13 13:13:42,100 - DEBUG - [10.0.0.50]: Running cmd : hostname 2025-11-13 13:13:42,615 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4722-1 2025-11-13 13:13:42,615 - DEBUG - [10.0.0.50]: Running cmd : hostname -f 2025-11-13 13:13:42,680 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4722-1. 2025-11-13 13:13:42,680 - DEBUG - [10.0.0.50]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-11-13 13:13:42,795 - DEBUG - Output : NAMES contrail_test_muTPA9VaL vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_control_1 control_nodemgr_1 webui_job_1 webui_web_1 config_devicemgr_1 config_svcmonitor_1 config_dnsmasq_1 config_schema_1 config_api_1 config_nodemgr_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-11-13 13:13:42,796 - DEBUG - [10.0.0.50]: Running cmd : getent hosts 10.0.0.50 | head -n 1 | awk '{print $2}' 2025-11-13 13:13:42,850 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4722-1. 2025-11-13 13:13:42,851 - DEBUG - [10.0.0.50]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-11-13 13:13:42,911 - DEBUG - Output : 127.0.0.1/8 10.0.0.50/24 172.17.0.1/16 10.20.0.14/24 2025-11-13 13:13:42,912 - DEBUG - [10.0.0.50]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-11-13 13:13:42,974 - DEBUG - Output : 10.20.0.14/24 2025-11-13 13:13:42,975 - DEBUG - [10.0.0.50]: Running cmd : getent hosts 10.20.0.14 | head -n 1 | awk '{print $2}' 2025-11-13 13:13:43,045 - DEBUG - Output : 2025-11-13 13:13:44,666 - INFO - Using existing project ['default-domain', 'admin'](d19b8e22-5490-4f6b-a41f-d4f8b19a3058) 2025-11-13 13:13:44,796 - INFO - ================================================================================ 2025-11-13 13:13:44,796 - INFO - STARTING TEST : test_contrail_status 2025-11-13 13:13:44,796 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-11-13 13:13:44,923 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:13:44,929 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.14': '0'}} with 2025-11-13 13:13:44,929 - INFO - Initial checks done. Running the testcase now 2025-11-13 13:13:44,929 - INFO - 2025-11-13 13:13:44,929 - DEBUG - [10.0.0.50]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-11-13 13:13:45,017 - DEBUG - Output : contrail_test_muTPA9VaL vrouter_vrouter-agent_1 vrouter_provisioner_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_kafka_1 analytics_provisioner_1 analytics_collector_1 analytics_api_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_control_1 control_nodemgr_1 control_provisioner_1 webui_job_1 webui_web_1 config_devicemgr_1 config_svcmonitor_1 config_dnsmasq_1 config_schema_1 config_api_1 config_nodemgr_1 config_provisioner_1 config_database_provisioner_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-11-13 13:13:45,018 - INFO - 10.0.0.50 2025-11-13 13:13:45,018 - INFO - config 2025-11-13 13:13:45,024 - INFO - config-nodemgr:active 2025-11-13 13:13:45,029 - INFO - api-server:active 2025-11-13 13:13:45,033 - INFO - schema:active 2025-11-13 13:13:45,037 - INFO - svc-monitor:active 2025-11-13 13:13:45,041 - INFO - device-manager:active 2025-11-13 13:13:45,041 - INFO - config-database 2025-11-13 13:13:45,041 - INFO - config-cassandra:active 2025-11-13 13:13:45,041 - INFO - config-zookeeper:active 2025-11-13 13:13:45,041 - INFO - config-rabbitmq:active 2025-11-13 13:13:45,041 - INFO - vrouter 2025-11-13 13:13:45,045 - INFO - vrouter-nodemgr:active 2025-11-13 13:13:45,049 - INFO - agent:active 2025-11-13 13:13:45,049 - INFO - control 2025-11-13 13:13:45,054 - INFO - control-nodemgr:active 2025-11-13 13:13:45,058 - INFO - control:active 2025-11-13 13:13:45,058 - INFO - named:active 2025-11-13 13:13:45,062 - INFO - dns:active 2025-11-13 13:13:45,062 - INFO - analytics 2025-11-13 13:13:45,066 - INFO - analytics-nodemgr:active 2025-11-13 13:13:45,069 - INFO - analytics-api:active 2025-11-13 13:13:45,073 - INFO - collector:active 2025-11-13 13:13:45,073 - INFO - analytics-database 2025-11-13 13:13:45,073 - INFO - analytics-cassandra:active 2025-11-13 13:13:45,077 - INFO - analyticsdb-nodemgr:active 2025-11-13 13:13:45,081 - INFO - query-engine:active 2025-11-13 13:13:45,081 - INFO - webui 2025-11-13 13:13:45,081 - INFO - webui:active 2025-11-13 13:13:45,081 - INFO - webui-middleware:active 2025-11-13 13:13:45,081 - INFO - redis:active 2025-11-13 13:13:45,081 - INFO - analytics_snmp 2025-11-13 13:13:45,085 - INFO - snmp-collector:active 2025-11-13 13:13:45,085 - INFO - snmp-topology:active 2025-11-13 13:13:45,085 - INFO - analytics_alarm 2025-11-13 13:13:45,085 - INFO - alarmgen:active 2025-11-13 13:13:45,085 - INFO - All the contrail services are up on all nodes 2025-11-13 13:13:45,085 - INFO - contrail-status passed 2025-11-13 13:13:45,205 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:13:45,210 - DEBUG - No XMPP flaps were noticed during the test
2025-11-13 13:13:45,210 - INFO - END TEST : test_contrail_status : PASSED[0:00:01]
2025-11-13 13:13:45,210 - INFO - -------------------------------------------------------------------------------- 2025-11-13 13:13:47,329 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:13:49,415 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-20389506:ctest-vn22-69682883:ctest-vn22-69682883 2025-11-13 13:13:49,422 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-20389506:ctest-vn22-69682883:ctest-vn22-69682883 2025-11-13 13:13:49,426 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-20389506:ctest-vn22-69682883:ctest-vn22-69682883 2025-11-13 13:14:05,145 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-20389506:ctest-vn22-69682883 2025-11-13 13:14:05,153 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-20389506:ctest-vn22-69682883:ctest-vn22-69682883 2025-11-13 13:14:05,158 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-20389506:ctest-vn22-69682883:ctest-vn22-69682883 2025-11-13 13:14:05,293 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:06,253 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:06,259 - DEBUG - [10.0.0.50]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check' 2025-11-13 13:14:09,387 - DEBUG - Output : 2025-11-13 13:14:08,571 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success 2025-11-13 13:14:08,600 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success 2025-11-13 13:14:08,697 INFO: (v1.41) Checker check_obj_mandatory_fields: Success 2025-11-13 13:14:08,896 INFO: (v1.41) Checker check_orphan_resources: Success 2025-11-13 13:14:09,103 INFO: (v1.41) Checker check_fq_name_uuid_match: Success 2025-11-13 13:14:09,104 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before. 2025-11-13 13:14:09,205 INFO: (v1.41) Checker check_duplicate_fq_name: Success 2025-11-13 13:14:09,214 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success 2025-11-13 13:14:09,220 INFO: (v1.41) Checker check_subnet_uuid: Success 2025-11-13 13:14:09,229 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed: ZK subnet path '/api-server/subnets' does ends with a valid IP network 2025-11-13 13:14:09,258 INFO: (v1.41) Checker check_route_targets_id: Success 2025-11-13 13:14:09,271 INFO: (v1.41) Checker check_virtual_networks_id: Success 2025-11-13 13:14:09,278 INFO: (v1.41) Checker check_security_groups_id: Success 2025-11-13 13:14:09,281 INFO: (v1.41) Checker check_ipam_subnet_method: Success 2025-11-13 13:14:09,283 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success 2025-11-13 13:14:09,544 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:09,728 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:09,897 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:10,057 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:10,213 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:12,659 - INFO - admin user already present 2025-11-13 13:14:13,477 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:15,388 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-fvn-66593447:ctest-fvn-66593447 2025-11-13 13:14:15,393 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-fvn-66593447:ctest-fvn-66593447 2025-11-13 13:14:15,397 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-fvn-66593447:ctest-fvn-66593447 2025-11-13 13:14:16,234 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-vn1-03630694:ctest-vn1-03630694 2025-11-13 13:14:16,238 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-vn1-03630694:ctest-vn1-03630694 2025-11-13 13:14:16,242 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-vn1-03630694:ctest-vn1-03630694 2025-11-13 13:14:19,391 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b7882aec-e99a-4911-b370-7695e7a5022b 2025-11-13 13:14:19,399 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-vn1-03630694:ctest-vn1-03630694 2025-11-13 13:14:19,405 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b7882aec-e99a-4911-b370-7695e7a5022b 2025-11-13 13:14:34,483 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1afafe90-daf9-4b84-a9ac-c45706193af3 2025-11-13 13:14:34,489 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-fvn-66593447:ctest-fvn-66593447 2025-11-13 13:14:34,493 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1afafe90-daf9-4b84-a9ac-c45706193af3 2025-11-13 13:14:36,009 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b7882aec-e99a-4911-b370-7695e7a5022b 2025-11-13 13:14:36,014 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-fvn-66593447 2025-11-13 13:14:36,018 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-fvn-66593447:ctest-fvn-66593447 2025-11-13 13:14:36,022 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_Inet4UcRouteReq?x=3 2025-11-13 13:14:41,268 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-vn1-03630694 2025-11-13 13:14:41,272 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-vn1-03630694:ctest-vn1-03630694 2025-11-13 13:14:41,276 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-vn1-03630694:ctest-vn1-03630694 2025-11-13 13:14:41,519 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-fvn-66593447 2025-11-13 13:14:41,524 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-fvn-66593447:ctest-fvn-66593447 2025-11-13 13:14:41,528 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-41123125:ctest-fvn-66593447:ctest-fvn-66593447 2025-11-13 13:14:41,791 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:44,927 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:45,304 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:51,524 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:53,980 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:57,348 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:59,388 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:14:59,675 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:15:06,870 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ffdbd5c4-7479-4cf8-9fc1-5997ed3700fc 2025-11-13 13:15:06,875 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-35757980:ctest-vn1-35976656:ctest-vn1-35976656 2025-11-13 13:15:06,880 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ffdbd5c4-7479-4cf8-9fc1-5997ed3700fc 2025-11-13 13:15:17,883 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8befa23d-db3b-45bf-a2f6-ab8e00062a7c 2025-11-13 13:15:17,888 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-35757980:ctest-vn1-35976656:ctest-vn1-35976656 2025-11-13 13:15:17,892 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8befa23d-db3b-45bf-a2f6-ab8e00062a7c 2025-11-13 13:15:23,336 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:15:26,448 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:15:36,317 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d435663b-b2fa-40e0-8760-85ddc841d76b 2025-11-13 13:15:36,323 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-68879810:ctest-vn1-41516732:ctest-vn1-41516732 2025-11-13 13:15:36,327 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d435663b-b2fa-40e0-8760-85ddc841d76b 2025-11-13 13:15:42,238 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7d3c9b4e-8247-4350-be73-09917cd46df9 2025-11-13 13:15:42,243 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-68879810:ctest-vn2-06008156:ctest-vn2-06008156 2025-11-13 13:15:42,247 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7d3c9b4e-8247-4350-be73-09917cd46df9 2025-11-13 13:16:03,696 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:16:06,768 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:16:17,457 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d966cbeb-09a9-4a59-acf3-ede892aecb35 2025-11-13 13:16:17,462 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-54658983:ctest-vn-53807639:ctest-vn-53807639 2025-11-13 13:16:17,466 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d966cbeb-09a9-4a59-acf3-ede892aecb35 2025-11-13 13:16:28,478 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:638747b5-c57f-448f-8151-05d02900b4da 2025-11-13 13:16:28,482 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-54658983:ctest-ext_vn-85394931:ctest-ext_vn-85394931 2025-11-13 13:16:28,486 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:638747b5-c57f-448f-8151-05d02900b4da 2025-11-13 13:16:36,851 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:16:39,967 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:16:43,445 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-91151466:ctest-vn-91151466 2025-11-13 13:16:43,449 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-91151466:ctest-vn-91151466 2025-11-13 13:16:43,454 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-91151466:ctest-vn-91151466 2025-11-13 13:16:43,741 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-37773582:ctest-vn-37773582 2025-11-13 13:16:43,745 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-37773582:ctest-vn-37773582 2025-11-13 13:16:43,749 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-37773582:ctest-vn-37773582 2025-11-13 13:16:44,228 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-37773582 2025-11-13 13:16:44,233 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-37773582:ctest-vn-37773582 2025-11-13 13:16:44,238 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-37773582:ctest-vn-37773582 2025-11-13 13:16:44,547 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-91151466 2025-11-13 13:16:44,551 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-91151466:ctest-vn-91151466 2025-11-13 13:16:44,556 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-17594746:ctest-vn-91151466:ctest-vn-91151466 2025-11-13 13:16:44,815 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:16:47,827 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:16:48,116 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:16:50,718 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-65559829:ctest-vn4-29014970:ctest-vn4-29014970 2025-11-13 13:16:50,722 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-65559829:ctest-vn4-29014970:ctest-vn4-29014970 2025-11-13 13:16:50,727 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-65559829:ctest-vn4-29014970:ctest-vn4-29014970 2025-11-13 13:16:51,082 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-65559829:ctest-vn4-29014970 2025-11-13 13:16:51,088 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-65559829:ctest-vn4-29014970:ctest-vn4-29014970 2025-11-13 13:16:51,093 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-65559829:ctest-vn4-29014970:ctest-vn4-29014970 2025-11-13 13:16:51,540 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:16:51,831 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:16:55,140 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:16:58,190 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-07187161:ctest-vn-07187161 2025-11-13 13:16:58,194 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-07187161:ctest-vn-07187161 2025-11-13 13:16:58,198 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-07187161:ctest-vn-07187161 2025-11-13 13:16:58,476 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-69411915:ctest-vn-69411915 2025-11-13 13:16:58,480 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-69411915:ctest-vn-69411915 2025-11-13 13:16:58,484 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-69411915:ctest-vn-69411915 2025-11-13 13:17:05,923 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f7823b15-8e06-4ba5-8fb3-6df46bea2d3d 2025-11-13 13:17:05,928 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-07187161:ctest-vn-07187161 2025-11-13 13:17:05,933 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f7823b15-8e06-4ba5-8fb3-6df46bea2d3d 2025-11-13 13:17:11,826 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d5cce830-862f-49e4-8277-e8f0963dd959 2025-11-13 13:17:11,832 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-69411915:ctest-vn-69411915 2025-11-13 13:17:11,837 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d5cce830-862f-49e4-8277-e8f0963dd959 2025-11-13 13:17:23,125 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-69411915 2025-11-13 13:17:23,129 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-69411915:ctest-vn-69411915 2025-11-13 13:17:23,134 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-69411915:ctest-vn-69411915 2025-11-13 13:17:23,371 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-07187161 2025-11-13 13:17:23,377 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-07187161:ctest-vn-07187161 2025-11-13 13:17:23,382 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-15341523:ctest-vn-07187161:ctest-vn-07187161 2025-11-13 13:17:23,644 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:17:26,704 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:17:31,616 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:17:34,628 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:17:36,375 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-mgmt_vn-30544928:ctest-mgmt_vn-30544928 2025-11-13 13:17:36,380 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-mgmt_vn-30544928:ctest-mgmt_vn-30544928 2025-11-13 13:17:36,384 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-mgmt_vn-30544928:ctest-mgmt_vn-30544928 2025-11-13 13:17:37,127 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-left_vn-92265965:ctest-left_vn-92265965 2025-11-13 13:17:37,131 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-left_vn-92265965:ctest-left_vn-92265965 2025-11-13 13:17:37,136 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-left_vn-92265965:ctest-left_vn-92265965 2025-11-13 13:17:37,882 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-right_vn-64532115:ctest-right_vn-64532115 2025-11-13 13:17:37,886 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-right_vn-64532115:ctest-right_vn-64532115 2025-11-13 13:17:37,891 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-right_vn-64532115:ctest-right_vn-64532115 2025-11-13 13:17:43,007 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-right_vn-64532115 2025-11-13 13:17:43,012 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-right_vn-64532115:ctest-right_vn-64532115 2025-11-13 13:17:43,017 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-right_vn-64532115:ctest-right_vn-64532115 2025-11-13 13:17:43,258 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-left_vn-92265965 2025-11-13 13:17:43,263 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-left_vn-92265965:ctest-left_vn-92265965 2025-11-13 13:17:43,268 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-left_vn-92265965:ctest-left_vn-92265965 2025-11-13 13:17:43,515 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-mgmt_vn-30544928 2025-11-13 13:17:43,520 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-mgmt_vn-30544928:ctest-mgmt_vn-30544928 2025-11-13 13:17:43,524 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-26026710:ctest-mgmt_vn-30544928:ctest-mgmt_vn-30544928 2025-11-13 13:17:43,788 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:17:46,851 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:17:55,884 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:17:58,947 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:18:03,431 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:18:06,539 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:18:09,244 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:18:09,536 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:18:11,928 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:18:12,212 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:18:16,330 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-67528212:ctest-vn-26764559:ctest-vn-26764559 2025-11-13 13:18:16,334 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-67528212:ctest-vn-26764559:ctest-vn-26764559 2025-11-13 13:18:16,342 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-67528212:ctest-vn-26764559:ctest-vn-26764559 2025-11-13 13:18:17,263 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-67528212:ctest-vn-26764559 2025-11-13 13:18:17,267 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-67528212:ctest-vn-26764559:ctest-vn-26764559 2025-11-13 13:18:17,271 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-67528212:ctest-vn-26764559:ctest-vn-26764559 2025-11-13 13:18:17,628 - DEBUG - Requesting: http://10.0.0.50:8085/Snh_AgentXmppConnectionStatusReq? 2025-11-13 13:20:09,276 - INFO - Using existing project ['default-domain', 'admin'](d19b8e22-5490-4f6b-a41f-d4f8b19a3058) 2025-11-13 13:20:09,283 - INFO - ================================================================================ 2025-11-13 13:20:09,283 - INFO - STARTING TEST : test_contrail_status 2025-11-13 13:20:09,283 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-11-13 13:20:09,401 - DEBUG - Skipping xmpp flap check 2025-11-13 13:20:09,401 - INFO - Initial checks done. Running the testcase now 2025-11-13 13:20:09,401 - INFO - 2025-11-13 13:20:09,493 - INFO - 10.0.0.50 2025-11-13 13:20:09,493 - INFO - config 2025-11-13 13:20:09,498 - INFO - config-nodemgr:active 2025-11-13 13:20:09,503 - INFO - api-server:active 2025-11-13 13:20:09,507 - INFO - schema:active 2025-11-13 13:20:09,512 - INFO - svc-monitor:active 2025-11-13 13:20:09,518 - INFO - device-manager:active 2025-11-13 13:20:09,518 - INFO - config-database 2025-11-13 13:20:09,518 - INFO - config-cassandra:active 2025-11-13 13:20:09,518 - INFO - config-zookeeper:active 2025-11-13 13:20:09,518 - INFO - config-rabbitmq:active 2025-11-13 13:20:09,518 - INFO - vrouter 2025-11-13 13:20:09,523 - INFO - vrouter-nodemgr:active 2025-11-13 13:20:09,529 - INFO - agent:active 2025-11-13 13:20:09,529 - INFO - control 2025-11-13 13:20:09,534 - INFO - control-nodemgr:active 2025-11-13 13:20:09,538 - INFO - control:active 2025-11-13 13:20:09,538 - INFO - named:active 2025-11-13 13:20:09,542 - INFO - dns:active 2025-11-13 13:20:09,542 - INFO - analytics 2025-11-13 13:20:09,546 - INFO - analytics-nodemgr:active 2025-11-13 13:20:09,550 - INFO - analytics-api:active 2025-11-13 13:20:09,558 - INFO - collector:active 2025-11-13 13:20:09,558 - INFO - analytics-database 2025-11-13 13:20:09,559 - INFO - analytics-cassandra:active 2025-11-13 13:20:09,563 - INFO - analyticsdb-nodemgr:active 2025-11-13 13:20:09,569 - INFO - query-engine:active 2025-11-13 13:20:09,569 - INFO - webui 2025-11-13 13:20:09,570 - INFO - webui:active 2025-11-13 13:20:09,570 - INFO - webui-middleware:active 2025-11-13 13:20:09,570 - INFO - redis:active 2025-11-13 13:20:09,570 - INFO - analytics_snmp 2025-11-13 13:20:09,573 - INFO - snmp-collector:active 2025-11-13 13:20:09,573 - INFO - snmp-topology:active 2025-11-13 13:20:09,574 - INFO - analytics_alarm 2025-11-13 13:20:09,574 - INFO - alarmgen:active 2025-11-13 13:20:09,574 - INFO - All the contrail services are up on all nodes 2025-11-13 13:20:09,574 - INFO - contrail-status passed 2025-11-13 13:20:09,696 - DEBUG - Skipping xmpp flap check
2025-11-13 13:20:09,696 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2025-11-13 13:20:09,697 - INFO - --------------------------------------------------------------------------------