2025-08-20 15:53:56,726 - DEBUG - [10.0.0.65]: Running cmd : hostname 2025-08-20 15:53:57,209 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3898-1 2025-08-20 15:53:57,209 - DEBUG - [10.0.0.65]: Running cmd : hostname -f 2025-08-20 15:53:57,269 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3898-1. 2025-08-20 15:53:57,270 - DEBUG - [10.0.0.65]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-08-20 15:53:57,360 - DEBUG - Output : NAMES contrail_test_2dTPlkzJ2 vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_collector_1 analytics_api_1 analytics_database_query-engine_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_dns_1 control_nodemgr_1 webui_web_1 webui_job_1 config_devicemgr_1 config_svcmonitor_1 config_nodemgr_1 config_dnsmasq_1 config_schema_1 config_api_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-08-20 15:53:57,360 - DEBUG - [10.0.0.65]: Running cmd : getent hosts 10.0.0.65 | head -n 1 | awk '{print $2}' 2025-08-20 15:53:57,424 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3898-1. 2025-08-20 15:53:57,425 - DEBUG - [10.0.0.65]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-08-20 15:53:57,485 - DEBUG - Output : 127.0.0.1/8 10.0.0.65/24 172.17.0.1/16 10.20.0.17/24 2025-08-20 15:53:57,485 - DEBUG - [10.0.0.65]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-08-20 15:53:57,548 - DEBUG - Output : 10.20.0.17/24 2025-08-20 15:53:57,549 - DEBUG - [10.0.0.65]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}' 2025-08-20 15:53:57,608 - DEBUG - Output : 2025-08-20 15:53:59,261 - INFO - Using existing project ['default-domain', 'admin'](d85a0e9f-7224-4540-9fdc-eebedfdc8dab) 2025-08-20 15:53:59,420 - INFO - ================================================================================ 2025-08-20 15:53:59,420 - INFO - STARTING TEST : test_contrail_status 2025-08-20 15:53:59,421 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-08-20 15:53:59,539 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:53:59,545 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.17': '0'}} with 2025-08-20 15:53:59,545 - INFO - Initial checks done. Running the testcase now 2025-08-20 15:53:59,545 - INFO - 2025-08-20 15:53:59,546 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-08-20 15:53:59,637 - DEBUG - Output : contrail_test_2dTPlkzJ2 vrouter_vrouter-agent_1 vrouter_provisioner_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_collector_1 analytics_api_1 analytics_database_query-engine_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_dns_1 control_nodemgr_1 control_provisioner_1 webui_web_1 webui_job_1 config_devicemgr_1 config_svcmonitor_1 config_nodemgr_1 config_provisioner_1 config_dnsmasq_1 config_schema_1 config_api_1 config_database_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-08-20 15:53:59,637 - INFO - 10.0.0.65 2025-08-20 15:53:59,637 - INFO - config 2025-08-20 15:53:59,642 - INFO - config-nodemgr:active 2025-08-20 15:53:59,646 - INFO - api-server:active 2025-08-20 15:53:59,650 - INFO - schema:active 2025-08-20 15:53:59,654 - INFO - svc-monitor:active 2025-08-20 15:53:59,657 - INFO - device-manager:active 2025-08-20 15:53:59,657 - INFO - config-database 2025-08-20 15:53:59,657 - INFO - config-cassandra:active 2025-08-20 15:53:59,657 - INFO - config-zookeeper:active 2025-08-20 15:53:59,657 - INFO - config-rabbitmq:active 2025-08-20 15:53:59,658 - INFO - vrouter 2025-08-20 15:53:59,662 - INFO - vrouter-nodemgr:active 2025-08-20 15:53:59,666 - INFO - agent:active 2025-08-20 15:53:59,666 - INFO - control 2025-08-20 15:53:59,671 - INFO - control-nodemgr:active 2025-08-20 15:53:59,675 - INFO - control:active 2025-08-20 15:53:59,675 - INFO - named:active 2025-08-20 15:53:59,680 - INFO - dns:active 2025-08-20 15:53:59,680 - INFO - analytics 2025-08-20 15:53:59,685 - INFO - analytics-nodemgr:active 2025-08-20 15:53:59,688 - INFO - analytics-api:active 2025-08-20 15:53:59,693 - INFO - collector:active 2025-08-20 15:53:59,693 - INFO - analytics-database 2025-08-20 15:53:59,693 - INFO - analytics-cassandra:active 2025-08-20 15:53:59,698 - INFO - analyticsdb-nodemgr:active 2025-08-20 15:53:59,702 - INFO - query-engine:active 2025-08-20 15:53:59,702 - INFO - webui 2025-08-20 15:53:59,702 - INFO - webui:active 2025-08-20 15:53:59,702 - INFO - webui-middleware:active 2025-08-20 15:53:59,702 - INFO - redis:active 2025-08-20 15:53:59,703 - INFO - analytics_snmp 2025-08-20 15:53:59,706 - INFO - snmp-collector:active 2025-08-20 15:53:59,706 - INFO - snmp-topology:active 2025-08-20 15:53:59,706 - INFO - analytics_alarm 2025-08-20 15:53:59,706 - INFO - alarmgen:active 2025-08-20 15:53:59,706 - INFO - All the contrail services are up on all nodes 2025-08-20 15:53:59,706 - INFO - contrail-status passed 2025-08-20 15:53:59,826 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:53:59,832 - DEBUG - No XMPP flaps were noticed during the test 2025-08-20 15:53:59,832 - INFO - END TEST : test_contrail_status : PASSED[0:00:00] 2025-08-20 15:53:59,832 - INFO - -------------------------------------------------------------------------------- 2025-08-20 15:54:01,878 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:54:03,900 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675:ctest-vn22-10515675 2025-08-20 15:54:03,906 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675:ctest-vn22-10515675 2025-08-20 15:54:03,912 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675:ctest-vn22-10515675 2025-08-20 15:54:19,526 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675 2025-08-20 15:54:19,532 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675:ctest-vn22-10515675 2025-08-20 15:54:19,537 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675:ctest-vn22-10515675 2025-08-20 15:54:19,667 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:54:20,619 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:54:20,628 - DEBUG - [10.0.0.65]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check' 2025-08-20 15:54:24,589 - DEBUG - Output : 2025-08-20 15:54:22,939 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success 2025-08-20 15:54:22,960 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success 2025-08-20 15:54:23,197 INFO: (v1.41) Checker check_obj_mandatory_fields: Success 2025-08-20 15:54:23,726 INFO: (v1.41) Checker check_orphan_resources: Success 2025-08-20 15:54:24,174 INFO: (v1.41) Checker check_fq_name_uuid_match: Success 2025-08-20 15:54:24,174 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before. 2025-08-20 15:54:24,420 INFO: (v1.41) Checker check_duplicate_fq_name: Success 2025-08-20 15:54:24,433 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success 2025-08-20 15:54:24,442 INFO: (v1.41) Checker check_subnet_uuid: Success 2025-08-20 15:54:24,452 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed: ZK subnet path '/api-server/subnets' does ends with a valid IP network 2025-08-20 15:54:24,481 INFO: (v1.41) Checker check_route_targets_id: Success 2025-08-20 15:54:24,490 INFO: (v1.41) Checker check_virtual_networks_id: Success 2025-08-20 15:54:24,496 INFO: (v1.41) Checker check_security_groups_id: Success 2025-08-20 15:54:24,498 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success 2025-08-20 15:54:24,756 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:54:27,116 - INFO - admin user already present 2025-08-20 15:54:27,855 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:54:29,730 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490 2025-08-20 15:54:29,735 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490 2025-08-20 15:54:29,740 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490 2025-08-20 15:54:30,647 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150 2025-08-20 15:54:30,652 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150 2025-08-20 15:54:30,658 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150 2025-08-20 15:54:33,916 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3f8ec956-a3df-4fee-b8ad-c305298c56f8 2025-08-20 15:54:33,923 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150 2025-08-20 15:54:33,928 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3f8ec956-a3df-4fee-b8ad-c305298c56f8 2025-08-20 15:54:48,976 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4089735b-0490-4d0d-a63f-1f7adc73f873 2025-08-20 15:54:48,982 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490 2025-08-20 15:54:48,988 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4089735b-0490-4d0d-a63f-1f7adc73f873 2025-08-20 15:54:50,512 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3f8ec956-a3df-4fee-b8ad-c305298c56f8 2025-08-20 15:54:50,518 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490 2025-08-20 15:54:50,523 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490 2025-08-20 15:54:50,528 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Inet4UcRouteReq?x=3 2025-08-20 15:54:55,767 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150 2025-08-20 15:54:55,773 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150 2025-08-20 15:54:55,779 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150 2025-08-20 15:54:56,040 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490 2025-08-20 15:54:56,045 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490 2025-08-20 15:54:56,050 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490 2025-08-20 15:54:56,310 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:54:59,377 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:54:59,737 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:55:06,006 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:55:08,041 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:55:10,982 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:55:13,058 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:55:13,346 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:55:20,396 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ef4ed244-bbc7-4bbd-ad9c-6777eaa068f1 2025-08-20 15:55:20,403 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-97258317:ctest-vn1-05733379:ctest-vn1-05733379 2025-08-20 15:55:20,409 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ef4ed244-bbc7-4bbd-ad9c-6777eaa068f1 2025-08-20 15:55:26,294 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:25e370fc-cc64-44bf-a1a9-33c16f097502 2025-08-20 15:55:26,299 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-97258317:ctest-vn1-05733379:ctest-vn1-05733379 2025-08-20 15:55:26,304 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:25e370fc-cc64-44bf-a1a9-33c16f097502 2025-08-20 15:55:31,658 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:55:34,645 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:55:44,314 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a7d4a609-9300-45dc-be06-937ccc0d2476 2025-08-20 15:55:44,320 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-72654590:ctest-vn1-08457656:ctest-vn1-08457656 2025-08-20 15:55:44,325 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a7d4a609-9300-45dc-be06-937ccc0d2476 2025-08-20 15:55:50,194 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8b3afe90-b124-4156-88fe-a1006faa99c0 2025-08-20 15:55:50,200 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-72654590:ctest-vn2-02877882:ctest-vn2-02877882 2025-08-20 15:55:50,205 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8b3afe90-b124-4156-88fe-a1006faa99c0 2025-08-20 15:56:11,638 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:56:14,674 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:56:25,330 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:728cb966-69e9-4158-bc89-b265025c005b 2025-08-20 15:56:25,336 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-06764159:ctest-vn-33298033:ctest-vn-33298033 2025-08-20 15:56:25,341 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:728cb966-69e9-4158-bc89-b265025c005b 2025-08-20 15:56:36,344 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6b7f5dd8-4ce3-4d27-97d1-9f3a95f6b047 2025-08-20 15:56:36,350 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-06764159:ctest-ext_vn-36926989:ctest-ext_vn-36926989 2025-08-20 15:56:36,354 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6b7f5dd8-4ce3-4d27-97d1-9f3a95f6b047 2025-08-20 15:56:44,646 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:56:47,654 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:56:51,196 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733:ctest-vn-16317733 2025-08-20 15:56:51,201 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733:ctest-vn-16317733 2025-08-20 15:56:51,206 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733:ctest-vn-16317733 2025-08-20 15:56:51,515 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938:ctest-vn-09173938 2025-08-20 15:56:51,520 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938:ctest-vn-09173938 2025-08-20 15:56:51,525 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938:ctest-vn-09173938 2025-08-20 15:56:52,062 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938 2025-08-20 15:56:52,067 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938:ctest-vn-09173938 2025-08-20 15:56:52,072 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938:ctest-vn-09173938 2025-08-20 15:56:52,333 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733 2025-08-20 15:56:52,339 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733:ctest-vn-16317733 2025-08-20 15:56:52,345 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733:ctest-vn-16317733 2025-08-20 15:56:52,614 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:56:55,626 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:56:55,914 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:56:58,516 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103:ctest-vn4-14848103 2025-08-20 15:56:58,521 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103:ctest-vn4-14848103 2025-08-20 15:56:58,526 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103:ctest-vn4-14848103 2025-08-20 15:56:58,868 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103 2025-08-20 15:56:58,874 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103:ctest-vn4-14848103 2025-08-20 15:56:58,878 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103:ctest-vn4-14848103 2025-08-20 15:56:59,354 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:56:59,642 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:57:02,682 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:57:05,830 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792 2025-08-20 15:57:05,836 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792 2025-08-20 15:57:05,840 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792 2025-08-20 15:57:06,153 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177 2025-08-20 15:57:06,158 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177 2025-08-20 15:57:06,163 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177 2025-08-20 15:57:13,561 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:88c0b1c4-d600-4b12-b7e9-12065929506a 2025-08-20 15:57:13,567 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792 2025-08-20 15:57:13,571 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:88c0b1c4-d600-4b12-b7e9-12065929506a 2025-08-20 15:57:19,422 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cc386247-b03f-40fc-ad7a-d30a1a3bbcf6 2025-08-20 15:57:19,427 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177 2025-08-20 15:57:19,432 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cc386247-b03f-40fc-ad7a-d30a1a3bbcf6 2025-08-20 15:57:30,684 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177 2025-08-20 15:57:30,690 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177 2025-08-20 15:57:30,695 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177 2025-08-20 15:57:30,964 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792 2025-08-20 15:57:30,969 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792 2025-08-20 15:57:30,974 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792 2025-08-20 15:57:31,238 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:57:34,289 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:57:43,926 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a81e947f-ff54-4e62-aad6-4a95b78336a8 2025-08-20 15:57:43,932 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-41702587:ctest-bgpaas_vn-07577711:ctest-bgpaas_vn-07577711 2025-08-20 15:57:43,937 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a81e947f-ff54-4e62-aad6-4a95b78336a8 2025-08-20 15:57:49,790 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9adc9c4a-c9b7-4472-951a-e378c9fae868 2025-08-20 15:57:49,796 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-41702587:ctest-bgpaas_vn-40377205:ctest-bgpaas_vn-40377205 2025-08-20 15:57:49,801 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9adc9c4a-c9b7-4472-951a-e378c9fae868 2025-08-20 15:57:51,494 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:57:58,113 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:01,089 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:02,965 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050:ctest-mgmt_vn-59985050 2025-08-20 15:58:02,971 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050:ctest-mgmt_vn-59985050 2025-08-20 15:58:02,976 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050:ctest-mgmt_vn-59985050 2025-08-20 15:58:03,732 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599:ctest-left_vn-62729599 2025-08-20 15:58:03,737 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599:ctest-left_vn-62729599 2025-08-20 15:58:03,742 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599:ctest-left_vn-62729599 2025-08-20 15:58:09,698 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826:ctest-right_vn-11104826 2025-08-20 15:58:09,704 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826:ctest-right_vn-11104826 2025-08-20 15:58:09,709 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826:ctest-right_vn-11104826 2025-08-20 15:58:14,729 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826 2025-08-20 15:58:14,734 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826:ctest-right_vn-11104826 2025-08-20 15:58:14,740 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826:ctest-right_vn-11104826 2025-08-20 15:58:14,988 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599 2025-08-20 15:58:14,993 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599:ctest-left_vn-62729599 2025-08-20 15:58:14,999 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599:ctest-left_vn-62729599 2025-08-20 15:58:15,250 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050 2025-08-20 15:58:15,255 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050:ctest-mgmt_vn-59985050 2025-08-20 15:58:15,260 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050:ctest-mgmt_vn-59985050 2025-08-20 15:58:15,526 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:18,590 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:27,514 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:30,503 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:34,154 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:37,129 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:39,802 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:40,089 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:47,582 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:47,872 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 15:58:51,882 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901:ctest-vn-36579901 2025-08-20 15:58:51,888 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901:ctest-vn-36579901 2025-08-20 15:58:51,893 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901:ctest-vn-36579901 2025-08-20 15:58:52,725 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901 2025-08-20 15:58:52,731 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901:ctest-vn-36579901 2025-08-20 15:58:52,736 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901:ctest-vn-36579901 2025-08-20 15:58:53,090 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-20 16:00:14,081 - INFO - Using existing project ['default-domain', 'admin'](d85a0e9f-7224-4540-9fdc-eebedfdc8dab) 2025-08-20 16:00:14,091 - INFO - ================================================================================ 2025-08-20 16:00:14,091 - INFO - STARTING TEST : test_contrail_status 2025-08-20 16:00:14,091 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-08-20 16:00:14,207 - DEBUG - Skipping xmpp flap check 2025-08-20 16:00:14,207 - INFO - Initial checks done. Running the testcase now 2025-08-20 16:00:14,207 - INFO - 2025-08-20 16:00:14,307 - INFO - 10.0.0.65 2025-08-20 16:00:14,307 - INFO - config 2025-08-20 16:00:14,313 - INFO - config-nodemgr:active 2025-08-20 16:00:14,317 - INFO - api-server:active 2025-08-20 16:00:14,321 - INFO - schema:active 2025-08-20 16:00:14,325 - INFO - svc-monitor:active 2025-08-20 16:00:14,329 - INFO - device-manager:active 2025-08-20 16:00:14,329 - INFO - config-database 2025-08-20 16:00:14,329 - INFO - config-cassandra:active 2025-08-20 16:00:14,329 - INFO - config-zookeeper:active 2025-08-20 16:00:14,329 - INFO - config-rabbitmq:active 2025-08-20 16:00:14,329 - INFO - vrouter 2025-08-20 16:00:14,334 - INFO - vrouter-nodemgr:active 2025-08-20 16:00:14,340 - INFO - agent:active 2025-08-20 16:00:14,340 - INFO - control 2025-08-20 16:00:14,345 - INFO - control-nodemgr:active 2025-08-20 16:00:14,350 - INFO - control:active 2025-08-20 16:00:14,350 - INFO - named:active 2025-08-20 16:00:14,355 - INFO - dns:active 2025-08-20 16:00:14,355 - INFO - analytics 2025-08-20 16:00:14,359 - INFO - analytics-nodemgr:active 2025-08-20 16:00:14,363 - INFO - analytics-api:active 2025-08-20 16:00:14,369 - INFO - collector:active 2025-08-20 16:00:14,369 - INFO - analytics-database 2025-08-20 16:00:14,369 - INFO - analytics-cassandra:active 2025-08-20 16:00:14,374 - INFO - analyticsdb-nodemgr:active 2025-08-20 16:00:14,379 - INFO - query-engine:active 2025-08-20 16:00:14,379 - INFO - webui 2025-08-20 16:00:14,379 - INFO - webui:active 2025-08-20 16:00:14,379 - INFO - webui-middleware:active 2025-08-20 16:00:14,380 - INFO - redis:active 2025-08-20 16:00:14,380 - INFO - analytics_snmp 2025-08-20 16:00:14,383 - INFO - snmp-collector:active 2025-08-20 16:00:14,383 - INFO - snmp-topology:active 2025-08-20 16:00:14,384 - INFO - analytics_alarm 2025-08-20 16:00:14,384 - INFO - alarmgen:active 2025-08-20 16:00:14,384 - INFO - All the contrail services are up on all nodes 2025-08-20 16:00:14,384 - INFO - contrail-status passed 2025-08-20 16:00:14,498 - DEBUG - Skipping xmpp flap check 2025-08-20 16:00:14,499 - INFO - END TEST : test_contrail_status : PASSED[0:00:00] 2025-08-20 16:00:14,499 - INFO - --------------------------------------------------------------------------------