2025-08-20 15:53:56,726 - DEBUG - [10.0.0.65]: Running cmd : hostname
2025-08-20 15:53:57,209 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3898-1
2025-08-20 15:53:57,209 - DEBUG - [10.0.0.65]: Running cmd : hostname -f
2025-08-20 15:53:57,269 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3898-1.
2025-08-20 15:53:57,270 - DEBUG - [10.0.0.65]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-08-20 15:53:57,360 - DEBUG - Output : NAMES
contrail_test_2dTPlkzJ2
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_snmp-collector_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_nodemgr_1
analytics_collector_1
analytics_api_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_dns_1
control_nodemgr_1
webui_web_1
webui_job_1
config_devicemgr_1
config_svcmonitor_1
config_nodemgr_1
config_dnsmasq_1
config_schema_1
config_api_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-08-20 15:53:57,360 - DEBUG - [10.0.0.65]: Running cmd : getent hosts 10.0.0.65 | head -n 1 | awk '{print $2}'
2025-08-20 15:53:57,424 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3898-1.
2025-08-20 15:53:57,425 - DEBUG - [10.0.0.65]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2025-08-20 15:53:57,485 - DEBUG - Output : 127.0.0.1/8
10.0.0.65/24
172.17.0.1/16
10.20.0.17/24
2025-08-20 15:53:57,485 - DEBUG - [10.0.0.65]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2025-08-20 15:53:57,548 - DEBUG - Output : 10.20.0.17/24
2025-08-20 15:53:57,549 - DEBUG - [10.0.0.65]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}'
2025-08-20 15:53:57,608 - DEBUG - Output :
2025-08-20 15:53:59,261 - INFO - Using existing project ['default-domain', 'admin'](d85a0e9f-7224-4540-9fdc-eebedfdc8dab)
2025-08-20 15:53:59,420 - INFO - ================================================================================
2025-08-20 15:53:59,420 - INFO - STARTING TEST : test_contrail_status
2025-08-20 15:53:59,421 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-08-20 15:53:59,539 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:53:59,545 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.17': '0'}} with
2025-08-20 15:53:59,545 - INFO - Initial checks done. Running the testcase now
2025-08-20 15:53:59,545 - INFO -
2025-08-20 15:53:59,546 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2025-08-20 15:53:59,637 - DEBUG - Output : contrail_test_2dTPlkzJ2
vrouter_vrouter-agent_1
vrouter_provisioner_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_snmp-collector_1
analytics_snmp_nodemgr_1
analytics_snmp_provisioner_1
analytics_snmp_topology_1
analytics_alarm_nodemgr_1
analytics_alarm_provisioner_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_nodemgr_1
analytics_provisioner_1
analytics_collector_1
analytics_api_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_provisioner_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_dns_1
control_nodemgr_1
control_provisioner_1
webui_web_1
webui_job_1
config_devicemgr_1
config_svcmonitor_1
config_nodemgr_1
config_provisioner_1
config_dnsmasq_1
config_schema_1
config_api_1
config_database_provisioner_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-08-20 15:53:59,637 - INFO - 10.0.0.65
2025-08-20 15:53:59,637 - INFO - config
2025-08-20 15:53:59,642 - INFO - config-nodemgr:active
2025-08-20 15:53:59,646 - INFO - api-server:active
2025-08-20 15:53:59,650 - INFO - schema:active
2025-08-20 15:53:59,654 - INFO - svc-monitor:active
2025-08-20 15:53:59,657 - INFO - device-manager:active
2025-08-20 15:53:59,657 - INFO - config-database
2025-08-20 15:53:59,657 - INFO - config-cassandra:active
2025-08-20 15:53:59,657 - INFO - config-zookeeper:active
2025-08-20 15:53:59,657 - INFO - config-rabbitmq:active
2025-08-20 15:53:59,658 - INFO - vrouter
2025-08-20 15:53:59,662 - INFO - vrouter-nodemgr:active
2025-08-20 15:53:59,666 - INFO - agent:active
2025-08-20 15:53:59,666 - INFO - control
2025-08-20 15:53:59,671 - INFO - control-nodemgr:active
2025-08-20 15:53:59,675 - INFO - control:active
2025-08-20 15:53:59,675 - INFO - named:active
2025-08-20 15:53:59,680 - INFO - dns:active
2025-08-20 15:53:59,680 - INFO - analytics
2025-08-20 15:53:59,685 - INFO - analytics-nodemgr:active
2025-08-20 15:53:59,688 - INFO - analytics-api:active
2025-08-20 15:53:59,693 - INFO - collector:active
2025-08-20 15:53:59,693 - INFO - analytics-database
2025-08-20 15:53:59,693 - INFO - analytics-cassandra:active
2025-08-20 15:53:59,698 - INFO - analyticsdb-nodemgr:active
2025-08-20 15:53:59,702 - INFO - query-engine:active
2025-08-20 15:53:59,702 - INFO - webui
2025-08-20 15:53:59,702 - INFO - webui:active
2025-08-20 15:53:59,702 - INFO - webui-middleware:active
2025-08-20 15:53:59,702 - INFO - redis:active
2025-08-20 15:53:59,703 - INFO - analytics_snmp
2025-08-20 15:53:59,706 - INFO - snmp-collector:active
2025-08-20 15:53:59,706 - INFO - snmp-topology:active
2025-08-20 15:53:59,706 - INFO - analytics_alarm
2025-08-20 15:53:59,706 - INFO - alarmgen:active
2025-08-20 15:53:59,706 - INFO - All the contrail services are up on all nodes
2025-08-20 15:53:59,706 - INFO - contrail-status passed
2025-08-20 15:53:59,826 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:53:59,832 - DEBUG - No XMPP flaps were noticed during the test
2025-08-20 15:53:59,832 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2025-08-20 15:53:59,832 - INFO - --------------------------------------------------------------------------------
2025-08-20 15:54:01,878 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:54:03,900 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675:ctest-vn22-10515675
2025-08-20 15:54:03,906 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675:ctest-vn22-10515675
2025-08-20 15:54:03,912 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675:ctest-vn22-10515675
2025-08-20 15:54:19,526 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675
2025-08-20 15:54:19,532 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675:ctest-vn22-10515675
2025-08-20 15:54:19,537 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-88440413:ctest-vn22-10515675:ctest-vn22-10515675
2025-08-20 15:54:19,667 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:54:20,619 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:54:20,628 - DEBUG - [10.0.0.65]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check'
2025-08-20 15:54:24,589 - DEBUG - Output : 2025-08-20 15:54:22,939 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success
2025-08-20 15:54:22,960 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success
2025-08-20 15:54:23,197 INFO: (v1.41) Checker check_obj_mandatory_fields: Success
2025-08-20 15:54:23,726 INFO: (v1.41) Checker check_orphan_resources: Success
2025-08-20 15:54:24,174 INFO: (v1.41) Checker check_fq_name_uuid_match: Success
2025-08-20 15:54:24,174 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before.
2025-08-20 15:54:24,420 INFO: (v1.41) Checker check_duplicate_fq_name: Success
2025-08-20 15:54:24,433 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success
2025-08-20 15:54:24,442 INFO: (v1.41) Checker check_subnet_uuid: Success
2025-08-20 15:54:24,452 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed:
ZK subnet path '/api-server/subnets' does ends with a valid IP network
2025-08-20 15:54:24,481 INFO: (v1.41) Checker check_route_targets_id: Success
2025-08-20 15:54:24,490 INFO: (v1.41) Checker check_virtual_networks_id: Success
2025-08-20 15:54:24,496 INFO: (v1.41) Checker check_security_groups_id: Success
2025-08-20 15:54:24,498 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success
2025-08-20 15:54:24,756 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:54:27,116 - INFO - admin user already present
2025-08-20 15:54:27,855 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:54:29,730 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490
2025-08-20 15:54:29,735 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490
2025-08-20 15:54:29,740 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490
2025-08-20 15:54:30,647 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150
2025-08-20 15:54:30,652 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150
2025-08-20 15:54:30,658 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150
2025-08-20 15:54:33,916 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3f8ec956-a3df-4fee-b8ad-c305298c56f8
2025-08-20 15:54:33,923 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150
2025-08-20 15:54:33,928 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3f8ec956-a3df-4fee-b8ad-c305298c56f8
2025-08-20 15:54:48,976 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4089735b-0490-4d0d-a63f-1f7adc73f873
2025-08-20 15:54:48,982 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490
2025-08-20 15:54:48,988 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4089735b-0490-4d0d-a63f-1f7adc73f873
2025-08-20 15:54:50,512 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3f8ec956-a3df-4fee-b8ad-c305298c56f8
2025-08-20 15:54:50,518 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490
2025-08-20 15:54:50,523 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490
2025-08-20 15:54:50,528 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Inet4UcRouteReq?x=3
2025-08-20 15:54:55,767 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150
2025-08-20 15:54:55,773 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150
2025-08-20 15:54:55,779 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-vn1-63662150:ctest-vn1-63662150
2025-08-20 15:54:56,040 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490
2025-08-20 15:54:56,045 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490
2025-08-20 15:54:56,050 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-06563627:ctest-fvn-86847490:ctest-fvn-86847490
2025-08-20 15:54:56,310 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:54:59,377 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:54:59,737 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:55:06,006 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:55:08,041 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:55:10,982 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:55:13,058 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:55:13,346 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:55:20,396 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ef4ed244-bbc7-4bbd-ad9c-6777eaa068f1
2025-08-20 15:55:20,403 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-97258317:ctest-vn1-05733379:ctest-vn1-05733379
2025-08-20 15:55:20,409 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ef4ed244-bbc7-4bbd-ad9c-6777eaa068f1
2025-08-20 15:55:26,294 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:25e370fc-cc64-44bf-a1a9-33c16f097502
2025-08-20 15:55:26,299 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-97258317:ctest-vn1-05733379:ctest-vn1-05733379
2025-08-20 15:55:26,304 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:25e370fc-cc64-44bf-a1a9-33c16f097502
2025-08-20 15:55:31,658 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:55:34,645 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:55:44,314 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a7d4a609-9300-45dc-be06-937ccc0d2476
2025-08-20 15:55:44,320 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-72654590:ctest-vn1-08457656:ctest-vn1-08457656
2025-08-20 15:55:44,325 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a7d4a609-9300-45dc-be06-937ccc0d2476
2025-08-20 15:55:50,194 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8b3afe90-b124-4156-88fe-a1006faa99c0
2025-08-20 15:55:50,200 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-72654590:ctest-vn2-02877882:ctest-vn2-02877882
2025-08-20 15:55:50,205 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8b3afe90-b124-4156-88fe-a1006faa99c0
2025-08-20 15:56:11,638 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:56:14,674 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:56:25,330 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:728cb966-69e9-4158-bc89-b265025c005b
2025-08-20 15:56:25,336 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-06764159:ctest-vn-33298033:ctest-vn-33298033
2025-08-20 15:56:25,341 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:728cb966-69e9-4158-bc89-b265025c005b
2025-08-20 15:56:36,344 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6b7f5dd8-4ce3-4d27-97d1-9f3a95f6b047
2025-08-20 15:56:36,350 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-06764159:ctest-ext_vn-36926989:ctest-ext_vn-36926989
2025-08-20 15:56:36,354 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6b7f5dd8-4ce3-4d27-97d1-9f3a95f6b047
2025-08-20 15:56:44,646 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:56:47,654 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:56:51,196 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733:ctest-vn-16317733
2025-08-20 15:56:51,201 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733:ctest-vn-16317733
2025-08-20 15:56:51,206 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733:ctest-vn-16317733
2025-08-20 15:56:51,515 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938:ctest-vn-09173938
2025-08-20 15:56:51,520 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938:ctest-vn-09173938
2025-08-20 15:56:51,525 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938:ctest-vn-09173938
2025-08-20 15:56:52,062 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938
2025-08-20 15:56:52,067 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938:ctest-vn-09173938
2025-08-20 15:56:52,072 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-09173938:ctest-vn-09173938
2025-08-20 15:56:52,333 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733
2025-08-20 15:56:52,339 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733:ctest-vn-16317733
2025-08-20 15:56:52,345 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-45767124:ctest-vn-16317733:ctest-vn-16317733
2025-08-20 15:56:52,614 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:56:55,626 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:56:55,914 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:56:58,516 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103:ctest-vn4-14848103
2025-08-20 15:56:58,521 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103:ctest-vn4-14848103
2025-08-20 15:56:58,526 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103:ctest-vn4-14848103
2025-08-20 15:56:58,868 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103
2025-08-20 15:56:58,874 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103:ctest-vn4-14848103
2025-08-20 15:56:58,878 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-33508300:ctest-vn4-14848103:ctest-vn4-14848103
2025-08-20 15:56:59,354 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:56:59,642 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:57:02,682 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:57:05,830 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792
2025-08-20 15:57:05,836 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792
2025-08-20 15:57:05,840 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792
2025-08-20 15:57:06,153 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177
2025-08-20 15:57:06,158 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177
2025-08-20 15:57:06,163 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177
2025-08-20 15:57:13,561 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:88c0b1c4-d600-4b12-b7e9-12065929506a
2025-08-20 15:57:13,567 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792
2025-08-20 15:57:13,571 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:88c0b1c4-d600-4b12-b7e9-12065929506a
2025-08-20 15:57:19,422 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cc386247-b03f-40fc-ad7a-d30a1a3bbcf6
2025-08-20 15:57:19,427 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177
2025-08-20 15:57:19,432 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cc386247-b03f-40fc-ad7a-d30a1a3bbcf6
2025-08-20 15:57:30,684 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177
2025-08-20 15:57:30,690 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177
2025-08-20 15:57:30,695 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-86818177:ctest-vn-86818177
2025-08-20 15:57:30,964 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792
2025-08-20 15:57:30,969 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792
2025-08-20 15:57:30,974 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-47792262:ctest-vn-76369792:ctest-vn-76369792
2025-08-20 15:57:31,238 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:57:34,289 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:57:43,926 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a81e947f-ff54-4e62-aad6-4a95b78336a8
2025-08-20 15:57:43,932 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-41702587:ctest-bgpaas_vn-07577711:ctest-bgpaas_vn-07577711
2025-08-20 15:57:43,937 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a81e947f-ff54-4e62-aad6-4a95b78336a8
2025-08-20 15:57:49,790 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9adc9c4a-c9b7-4472-951a-e378c9fae868
2025-08-20 15:57:49,796 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-41702587:ctest-bgpaas_vn-40377205:ctest-bgpaas_vn-40377205
2025-08-20 15:57:49,801 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9adc9c4a-c9b7-4472-951a-e378c9fae868
2025-08-20 15:57:51,494 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:57:58,113 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:01,089 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:02,965 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050:ctest-mgmt_vn-59985050
2025-08-20 15:58:02,971 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050:ctest-mgmt_vn-59985050
2025-08-20 15:58:02,976 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050:ctest-mgmt_vn-59985050
2025-08-20 15:58:03,732 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599:ctest-left_vn-62729599
2025-08-20 15:58:03,737 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599:ctest-left_vn-62729599
2025-08-20 15:58:03,742 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599:ctest-left_vn-62729599
2025-08-20 15:58:09,698 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826:ctest-right_vn-11104826
2025-08-20 15:58:09,704 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826:ctest-right_vn-11104826
2025-08-20 15:58:09,709 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826:ctest-right_vn-11104826
2025-08-20 15:58:14,729 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826
2025-08-20 15:58:14,734 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826:ctest-right_vn-11104826
2025-08-20 15:58:14,740 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-right_vn-11104826:ctest-right_vn-11104826
2025-08-20 15:58:14,988 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599
2025-08-20 15:58:14,993 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599:ctest-left_vn-62729599
2025-08-20 15:58:14,999 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-left_vn-62729599:ctest-left_vn-62729599
2025-08-20 15:58:15,250 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050
2025-08-20 15:58:15,255 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050:ctest-mgmt_vn-59985050
2025-08-20 15:58:15,260 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-15369398:ctest-mgmt_vn-59985050:ctest-mgmt_vn-59985050
2025-08-20 15:58:15,526 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:18,590 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:27,514 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:30,503 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:34,154 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:37,129 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:39,802 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:40,089 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:47,582 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:47,872 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 15:58:51,882 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901:ctest-vn-36579901
2025-08-20 15:58:51,888 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901:ctest-vn-36579901
2025-08-20 15:58:51,893 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901:ctest-vn-36579901
2025-08-20 15:58:52,725 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901
2025-08-20 15:58:52,731 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901:ctest-vn-36579901
2025-08-20 15:58:52,736 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-45117358:ctest-vn-36579901:ctest-vn-36579901
2025-08-20 15:58:53,090 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-20 16:00:14,081 - INFO - Using existing project ['default-domain', 'admin'](d85a0e9f-7224-4540-9fdc-eebedfdc8dab)
2025-08-20 16:00:14,091 - INFO - ================================================================================
2025-08-20 16:00:14,091 - INFO - STARTING TEST : test_contrail_status
2025-08-20 16:00:14,091 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-08-20 16:00:14,207 - DEBUG - Skipping xmpp flap check
2025-08-20 16:00:14,207 - INFO - Initial checks done. Running the testcase now
2025-08-20 16:00:14,207 - INFO -
2025-08-20 16:00:14,307 - INFO - 10.0.0.65
2025-08-20 16:00:14,307 - INFO - config
2025-08-20 16:00:14,313 - INFO - config-nodemgr:active
2025-08-20 16:00:14,317 - INFO - api-server:active
2025-08-20 16:00:14,321 - INFO - schema:active
2025-08-20 16:00:14,325 - INFO - svc-monitor:active
2025-08-20 16:00:14,329 - INFO - device-manager:active
2025-08-20 16:00:14,329 - INFO - config-database
2025-08-20 16:00:14,329 - INFO - config-cassandra:active
2025-08-20 16:00:14,329 - INFO - config-zookeeper:active
2025-08-20 16:00:14,329 - INFO - config-rabbitmq:active
2025-08-20 16:00:14,329 - INFO - vrouter
2025-08-20 16:00:14,334 - INFO - vrouter-nodemgr:active
2025-08-20 16:00:14,340 - INFO - agent:active
2025-08-20 16:00:14,340 - INFO - control
2025-08-20 16:00:14,345 - INFO - control-nodemgr:active
2025-08-20 16:00:14,350 - INFO - control:active
2025-08-20 16:00:14,350 - INFO - named:active
2025-08-20 16:00:14,355 - INFO - dns:active
2025-08-20 16:00:14,355 - INFO - analytics
2025-08-20 16:00:14,359 - INFO - analytics-nodemgr:active
2025-08-20 16:00:14,363 - INFO - analytics-api:active
2025-08-20 16:00:14,369 - INFO - collector:active
2025-08-20 16:00:14,369 - INFO - analytics-database
2025-08-20 16:00:14,369 - INFO - analytics-cassandra:active
2025-08-20 16:00:14,374 - INFO - analyticsdb-nodemgr:active
2025-08-20 16:00:14,379 - INFO - query-engine:active
2025-08-20 16:00:14,379 - INFO - webui
2025-08-20 16:00:14,379 - INFO - webui:active
2025-08-20 16:00:14,379 - INFO - webui-middleware:active
2025-08-20 16:00:14,380 - INFO - redis:active
2025-08-20 16:00:14,380 - INFO - analytics_snmp
2025-08-20 16:00:14,383 - INFO - snmp-collector:active
2025-08-20 16:00:14,383 - INFO - snmp-topology:active
2025-08-20 16:00:14,384 - INFO - analytics_alarm
2025-08-20 16:00:14,384 - INFO - alarmgen:active
2025-08-20 16:00:14,384 - INFO - All the contrail services are up on all nodes
2025-08-20 16:00:14,384 - INFO - contrail-status passed
2025-08-20 16:00:14,498 - DEBUG - Skipping xmpp flap check
2025-08-20 16:00:14,499 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2025-08-20 16:00:14,499 - INFO - --------------------------------------------------------------------------------