2025-07-24 02:21:22,268 - DEBUG - [10.0.0.249]: Running cmd : hostname 2025-07-24 02:21:22,481 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3709-1 2025-07-24 02:21:22,481 - DEBUG - [10.0.0.249]: Running cmd : hostname -f 2025-07-24 02:21:22,548 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3709-1. 2025-07-24 02:21:22,548 - DEBUG - [10.0.0.249]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-07-24 02:21:22,659 - DEBUG - Output : NAMES contrail_test_Ivjk0kmDd vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_collector_1 analytics_api_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_nodemgr_1 control_dns_1 control_control_1 webui_job_1 webui_web_1 config_devicemgr_1 config_svcmonitor_1 config_schema_1 config_nodemgr_1 config_dnsmasq_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-07-24 02:21:22,660 - DEBUG - [10.0.0.249]: Running cmd : getent hosts 10.0.0.249 | head -n 1 | awk '{print $2}' 2025-07-24 02:21:22,725 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3709-1. 2025-07-24 02:21:22,725 - DEBUG - [10.0.0.249]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}' 2025-07-24 02:21:22,788 - DEBUG - Output : 10.0.0.249/24 172.17.0.1/16 10.20.0.254/24 2025-07-24 02:21:22,788 - DEBUG - [10.0.0.249]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}' 2025-07-24 02:21:22,852 - DEBUG - Output : 10.20.0.254/24 2025-07-24 02:21:22,852 - DEBUG - [10.0.0.249]: Running cmd : getent hosts 10.20.0.254 | head -n 1 | awk '{print $2}' 2025-07-24 02:21:22,919 - DEBUG - Output : 2025-07-24 02:21:24,714 - INFO - Using existing project ['default-domain', 'admin'](0b34a109-c47d-4fa6-a80a-2074edc04d76) 2025-07-24 02:21:24,888 - INFO - ================================================================================ 2025-07-24 02:21:24,889 - INFO - STARTING TEST : test_contrail_status 2025-07-24 02:21:24,889 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-07-24 02:21:25,024 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:21:25,032 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.254': '0'}} with 2025-07-24 02:21:25,032 - INFO - Initial checks done. Running the testcase now 2025-07-24 02:21:25,033 - INFO - 2025-07-24 02:21:25,033 - DEBUG - [10.0.0.249]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-07-24 02:21:25,131 - DEBUG - Output : contrail_test_Ivjk0kmDd vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_snmp-collector_1 analytics_snmp_provisioner_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_collector_1 analytics_api_1 analytics_provisioner_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_cassandra_1 control_named_1 control_nodemgr_1 control_provisioner_1 control_dns_1 control_control_1 webui_job_1 webui_web_1 config_devicemgr_1 config_svcmonitor_1 config_schema_1 config_nodemgr_1 config_provisioner_1 config_dnsmasq_1 config_api_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_rabbitmq_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-07-24 02:21:25,131 - INFO - 10.0.0.249 2025-07-24 02:21:25,131 - INFO - config 2025-07-24 02:21:25,137 - INFO - config-nodemgr:active 2025-07-24 02:21:25,143 - INFO - api-server:active 2025-07-24 02:21:25,147 - INFO - schema:active 2025-07-24 02:21:25,151 - INFO - svc-monitor:active 2025-07-24 02:21:25,156 - INFO - device-manager:active 2025-07-24 02:21:25,157 - INFO - config-database 2025-07-24 02:21:25,157 - INFO - config-cassandra:active 2025-07-24 02:21:25,157 - INFO - config-zookeeper:active 2025-07-24 02:21:25,157 - INFO - config-rabbitmq:active 2025-07-24 02:21:25,157 - INFO - vrouter 2025-07-24 02:21:25,162 - INFO - vrouter-nodemgr:active 2025-07-24 02:21:25,168 - INFO - agent:active 2025-07-24 02:21:25,168 - INFO - control 2025-07-24 02:21:25,174 - INFO - control-nodemgr:active 2025-07-24 02:21:25,180 - INFO - control:active 2025-07-24 02:21:25,180 - INFO - named:active 2025-07-24 02:21:25,186 - INFO - dns:active 2025-07-24 02:21:25,186 - INFO - analytics 2025-07-24 02:21:25,191 - INFO - analytics-nodemgr:active 2025-07-24 02:21:25,196 - INFO - analytics-api:active 2025-07-24 02:21:25,204 - INFO - collector:active 2025-07-24 02:21:25,204 - INFO - analytics-database 2025-07-24 02:21:25,204 - INFO - analytics-cassandra:active 2025-07-24 02:21:25,210 - INFO - analyticsdb-nodemgr:active 2025-07-24 02:21:25,217 - INFO - query-engine:active 2025-07-24 02:21:25,217 - INFO - webui 2025-07-24 02:21:25,218 - INFO - webui:active 2025-07-24 02:21:25,218 - INFO - webui-middleware:active 2025-07-24 02:21:25,218 - INFO - redis:active 2025-07-24 02:21:25,218 - INFO - analytics_snmp 2025-07-24 02:21:25,224 - INFO - snmp-collector:active 2025-07-24 02:21:25,224 - INFO - snmp-topology:active 2025-07-24 02:21:25,224 - INFO - analytics_alarm 2025-07-24 02:21:25,224 - INFO - alarmgen:active 2025-07-24 02:21:25,224 - INFO - All the contrail services are up on all nodes 2025-07-24 02:21:25,224 - INFO - contrail-status passed 2025-07-24 02:21:25,345 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:21:25,352 - DEBUG - No XMPP flaps were noticed during the test 2025-07-24 02:21:25,353 - INFO - END TEST : test_contrail_status : PASSED[0:00:01] 2025-07-24 02:21:25,353 - INFO - -------------------------------------------------------------------------------- 2025-07-24 02:21:27,664 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:21:30,035 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-74879894:ctest-vn22-64588131:ctest-vn22-64588131 2025-07-24 02:21:30,045 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-74879894:ctest-vn22-64588131:ctest-vn22-64588131 2025-07-24 02:21:30,051 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-74879894:ctest-vn22-64588131:ctest-vn22-64588131 2025-07-24 02:21:51,207 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-74879894:ctest-vn22-64588131 2025-07-24 02:21:51,213 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-74879894:ctest-vn22-64588131:ctest-vn22-64588131 2025-07-24 02:21:51,220 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-74879894:ctest-vn22-64588131:ctest-vn22-64588131 2025-07-24 02:21:51,359 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:21:52,410 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:21:52,418 - DEBUG - [10.0.0.249]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check' 2025-07-24 02:21:56,954 - DEBUG - Output : 2025-07-24 02:21:54,762 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success 2025-07-24 02:21:54,786 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success 2025-07-24 02:21:55,104 INFO: (v1.41) Checker check_obj_mandatory_fields: Success 2025-07-24 02:21:55,781 INFO: (v1.41) Checker check_orphan_resources: Success 2025-07-24 02:21:56,418 INFO: (v1.41) Checker check_fq_name_uuid_match: Success 2025-07-24 02:21:56,418 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before. 2025-07-24 02:21:56,732 INFO: (v1.41) Checker check_duplicate_fq_name: Success 2025-07-24 02:21:56,745 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success 2025-07-24 02:21:56,753 INFO: (v1.41) Checker check_subnet_uuid: Success 2025-07-24 02:21:56,764 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed: ZK subnet path '/api-server/subnets' does ends with a valid IP network 2025-07-24 02:21:56,802 INFO: (v1.41) Checker check_route_targets_id: Success 2025-07-24 02:21:56,817 INFO: (v1.41) Checker check_virtual_networks_id: Success 2025-07-24 02:21:56,827 INFO: (v1.41) Checker check_security_groups_id: Success 2025-07-24 02:21:56,829 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success 2025-07-24 02:21:57,118 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:21:59,805 - INFO - admin user already present 2025-07-24 02:22:00,658 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:22:02,763 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-fvn-55976159:ctest-fvn-55976159 2025-07-24 02:22:02,770 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-fvn-55976159:ctest-fvn-55976159 2025-07-24 02:22:02,776 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-fvn-55976159:ctest-fvn-55976159 2025-07-24 02:22:03,774 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-vn1-62511063:ctest-vn1-62511063 2025-07-24 02:22:03,779 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-vn1-62511063:ctest-vn1-62511063 2025-07-24 02:22:03,786 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-vn1-62511063:ctest-vn1-62511063 2025-07-24 02:22:07,391 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6d4189b9-4b9f-4efc-b727-76abea5eed19 2025-07-24 02:22:07,402 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-vn1-62511063:ctest-vn1-62511063 2025-07-24 02:22:07,416 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6d4189b9-4b9f-4efc-b727-76abea5eed19 2025-07-24 02:22:17,482 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:829b0ef3-1cc0-44e2-b70e-5e7443228e80 2025-07-24 02:22:17,489 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-fvn-55976159:ctest-fvn-55976159 2025-07-24 02:22:17,496 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:829b0ef3-1cc0-44e2-b70e-5e7443228e80 2025-07-24 02:22:19,032 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6d4189b9-4b9f-4efc-b727-76abea5eed19 2025-07-24 02:22:19,039 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-fvn-55976159 2025-07-24 02:22:19,046 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-fvn-55976159:ctest-fvn-55976159 2025-07-24 02:22:19,052 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Inet4UcRouteReq?x=3 2025-07-24 02:22:24,780 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-vn1-62511063 2025-07-24 02:22:24,787 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-vn1-62511063:ctest-vn1-62511063 2025-07-24 02:22:24,792 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-vn1-62511063:ctest-vn1-62511063 2025-07-24 02:22:25,104 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-fvn-55976159 2025-07-24 02:22:25,110 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-fvn-55976159:ctest-fvn-55976159 2025-07-24 02:22:25,116 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-57432958:ctest-fvn-55976159:ctest-fvn-55976159 2025-07-24 02:22:25,384 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:22:28,785 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:22:29,191 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:22:36,113 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:22:38,657 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:22:41,949 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:22:44,049 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:22:44,336 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:22:51,672 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8c98d1bd-8dc0-42fb-ad6a-45c7480a5565 2025-07-24 02:22:51,681 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-03694677:ctest-vn1-59494194:ctest-vn1-59494194 2025-07-24 02:22:51,687 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8c98d1bd-8dc0-42fb-ad6a-45c7480a5565 2025-07-24 02:23:02,752 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cc0884ba-bc33-4b8b-99b5-c27830924bda 2025-07-24 02:23:02,760 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-03694677:ctest-vn1-59494194:ctest-vn1-59494194 2025-07-24 02:23:02,766 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cc0884ba-bc33-4b8b-99b5-c27830924bda 2025-07-24 02:23:08,032 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:23:11,473 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:23:21,733 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ab1807ad-e8fd-4b64-a4ee-367c09348045 2025-07-24 02:23:21,741 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-87836803:ctest-vn1-66305405:ctest-vn1-66305405 2025-07-24 02:23:21,746 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ab1807ad-e8fd-4b64-a4ee-367c09348045 2025-07-24 02:23:27,714 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fcbd236e-c89f-40f7-b93b-ecf69498e0dd 2025-07-24 02:23:27,722 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-87836803:ctest-vn2-96047979:ctest-vn2-96047979 2025-07-24 02:23:27,731 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fcbd236e-c89f-40f7-b93b-ecf69498e0dd 2025-07-24 02:23:49,977 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:23:53,321 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:24:04,385 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f4f1dcbf-bc34-49a8-b1e9-f16fe10d85d2 2025-07-24 02:24:04,393 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-59703396:ctest-vn-27404447:ctest-vn-27404447 2025-07-24 02:24:04,401 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f4f1dcbf-bc34-49a8-b1e9-f16fe10d85d2 2025-07-24 02:24:10,346 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:274b0f66-bfa1-4410-8c2c-d3e92c39ed55 2025-07-24 02:24:10,352 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-59703396:ctest-ext_vn-31938963:ctest-ext_vn-31938963 2025-07-24 02:24:10,358 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:274b0f66-bfa1-4410-8c2c-d3e92c39ed55 2025-07-24 02:24:18,532 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:24:21,977 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:24:25,822 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-28686159:ctest-vn-28686159 2025-07-24 02:24:25,828 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-28686159:ctest-vn-28686159 2025-07-24 02:24:25,834 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-28686159:ctest-vn-28686159 2025-07-24 02:24:26,177 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-36230080:ctest-vn-36230080 2025-07-24 02:24:26,183 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-36230080:ctest-vn-36230080 2025-07-24 02:24:26,190 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-36230080:ctest-vn-36230080 2025-07-24 02:24:26,797 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-36230080 2025-07-24 02:24:26,802 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-36230080:ctest-vn-36230080 2025-07-24 02:24:26,807 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-36230080:ctest-vn-36230080 2025-07-24 02:24:27,110 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-28686159 2025-07-24 02:24:27,117 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-28686159:ctest-vn-28686159 2025-07-24 02:24:27,124 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-25063475:ctest-vn-28686159:ctest-vn-28686159 2025-07-24 02:24:27,392 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:24:30,689 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:24:30,980 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:24:34,095 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-58905425:ctest-vn4-38979129:ctest-vn4-38979129 2025-07-24 02:24:34,102 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-58905425:ctest-vn4-38979129:ctest-vn4-38979129 2025-07-24 02:24:34,109 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-58905425:ctest-vn4-38979129:ctest-vn4-38979129 2025-07-24 02:24:34,534 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-58905425:ctest-vn4-38979129 2025-07-24 02:24:34,540 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-58905425:ctest-vn4-38979129:ctest-vn4-38979129 2025-07-24 02:24:34,548 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-58905425:ctest-vn4-38979129:ctest-vn4-38979129 2025-07-24 02:24:35,009 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:24:35,304 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:24:39,150 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:24:42,377 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-66458377:ctest-vn-66458377 2025-07-24 02:24:42,383 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-66458377:ctest-vn-66458377 2025-07-24 02:24:42,389 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-66458377:ctest-vn-66458377 2025-07-24 02:24:42,726 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-48917220:ctest-vn-48917220 2025-07-24 02:24:42,731 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-48917220:ctest-vn-48917220 2025-07-24 02:24:42,737 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-48917220:ctest-vn-48917220 2025-07-24 02:24:50,413 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9d26cf81-c710-4c77-b41a-1d4f55b8325c 2025-07-24 02:24:50,421 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-66458377:ctest-vn-66458377 2025-07-24 02:24:50,426 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9d26cf81-c710-4c77-b41a-1d4f55b8325c 2025-07-24 02:24:56,423 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:76f5920f-b640-4ebb-9055-97352b3a2c8b 2025-07-24 02:24:56,430 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-48917220:ctest-vn-48917220 2025-07-24 02:24:56,436 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:76f5920f-b640-4ebb-9055-97352b3a2c8b 2025-07-24 02:25:08,211 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-48917220 2025-07-24 02:25:08,216 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-48917220:ctest-vn-48917220 2025-07-24 02:25:08,221 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-48917220:ctest-vn-48917220 2025-07-24 02:25:08,489 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-66458377 2025-07-24 02:25:08,495 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-66458377:ctest-vn-66458377 2025-07-24 02:25:08,501 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-61741536:ctest-vn-66458377:ctest-vn-66458377 2025-07-24 02:25:08,779 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:25:12,186 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:25:22,087 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d637cec4-6ad7-4ef8-abd3-11241e7105cb 2025-07-24 02:25:22,094 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-01391949:ctest-bgpaas_vn-54966086:ctest-bgpaas_vn-54966086 2025-07-24 02:25:22,100 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d637cec4-6ad7-4ef8-abd3-11241e7105cb 2025-07-24 02:25:28,071 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:873394f2-b42c-4c04-b66c-a70e1af2ba48 2025-07-24 02:25:28,079 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-01391949:ctest-bgpaas_vn-15080123:ctest-bgpaas_vn-15080123 2025-07-24 02:25:28,086 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:873394f2-b42c-4c04-b66c-a70e1af2ba48 2025-07-24 02:25:29,785 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:25:36,321 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:25:40,268 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:25:42,222 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-mgmt_vn-64320718:ctest-mgmt_vn-64320718 2025-07-24 02:25:42,228 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-mgmt_vn-64320718:ctest-mgmt_vn-64320718 2025-07-24 02:25:42,234 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-mgmt_vn-64320718:ctest-mgmt_vn-64320718 2025-07-24 02:25:43,199 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847:ctest-left_vn-56964847 2025-07-24 02:25:43,204 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847:ctest-left_vn-56964847 2025-07-24 02:25:43,209 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847:ctest-left_vn-56964847 2025-07-24 02:25:44,135 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338:ctest-right_vn-26836338 2025-07-24 02:25:44,141 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338:ctest-right_vn-26836338 2025-07-24 02:25:44,147 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338:ctest-right_vn-26836338 2025-07-24 02:25:54,591 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3b338a91-2e3b-45f6-970f-7727afdc5558 2025-07-24 02:25:54,601 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-mgmt_vn-64320718:ctest-mgmt_vn-64320718 2025-07-24 02:25:54,608 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:82af5bf4-6fa4-4b9b-8e5a-6739c49e048b 2025-07-24 02:25:54,616 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847:ctest-left_vn-56964847 2025-07-24 02:25:54,624 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bcf7ec0c-8ac4-4c95-b021-0efb3d7b8971 2025-07-24 02:25:54,633 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338:ctest-right_vn-26836338 2025-07-24 02:25:54,639 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3b338a91-2e3b-45f6-970f-7727afdc5558 2025-07-24 02:25:54,646 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:82af5bf4-6fa4-4b9b-8e5a-6739c49e048b 2025-07-24 02:25:54,652 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bcf7ec0c-8ac4-4c95-b021-0efb3d7b8971 2025-07-24 02:26:30,125 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8c68d866-c8ac-4558-a776-17e6c0f14365 2025-07-24 02:26:30,133 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847:ctest-left_vn-56964847 2025-07-24 02:26:30,139 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8c68d866-c8ac-4558-a776-17e6c0f14365 2025-07-24 02:26:31,994 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8afa4c07-a7fe-4b50-b2e2-00847e0ca69b 2025-07-24 02:26:32,000 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338:ctest-right_vn-26836338 2025-07-24 02:26:32,006 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8afa4c07-a7fe-4b50-b2e2-00847e0ca69b 2025-07-24 02:26:36,770 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3b338a91-2e3b-45f6-970f-7727afdc5558 2025-07-24 02:26:36,777 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:82af5bf4-6fa4-4b9b-8e5a-6739c49e048b 2025-07-24 02:26:36,783 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bcf7ec0c-8ac4-4c95-b021-0efb3d7b8971 2025-07-24 02:26:38,022 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847 2025-07-24 02:26:38,028 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:82af5bf4-6fa4-4b9b-8e5a-6739c49e048b 2025-07-24 02:26:38,035 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-07-24 02:26:38,045 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847:ctest-left_vn-56964847 2025-07-24 02:26:38,205 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Inet4UcRouteReq?x=2 2025-07-24 02:26:38,417 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Layer2RouteReq?x=2 2025-07-24 02:26:38,432 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847 2025-07-24 02:26:38,439 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847:ctest-left_vn-56964847 2025-07-24 02:26:38,645 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Inet4UcRouteReq?x=2 2025-07-24 02:26:38,853 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Layer2RouteReq?x=2 2025-07-24 02:26:38,866 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-mgmt_vn-64320718 2025-07-24 02:26:38,873 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3b338a91-2e3b-45f6-970f-7727afdc5558 2025-07-24 02:26:38,880 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-07-24 02:26:38,891 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-mgmt_vn-64320718:ctest-mgmt_vn-64320718 2025-07-24 02:26:39,061 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Inet4UcRouteReq?x=4 2025-07-24 02:26:39,273 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Layer2RouteReq?x=4 2025-07-24 02:26:39,287 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-mgmt_vn-64320718 2025-07-24 02:26:39,293 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-mgmt_vn-64320718:ctest-mgmt_vn-64320718 2025-07-24 02:26:39,501 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Inet4UcRouteReq?x=4 2025-07-24 02:26:39,713 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Layer2RouteReq?x=4 2025-07-24 02:26:39,727 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338 2025-07-24 02:26:39,736 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bcf7ec0c-8ac4-4c95-b021-0efb3d7b8971 2025-07-24 02:26:39,746 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-07-24 02:26:39,756 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338:ctest-right_vn-26836338 2025-07-24 02:26:39,925 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Inet4UcRouteReq?x=3 2025-07-24 02:26:40,137 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Layer2RouteReq?x=3 2025-07-24 02:26:40,151 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338 2025-07-24 02:26:40,158 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338:ctest-right_vn-26836338 2025-07-24 02:26:40,361 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Inet4UcRouteReq?x=3 2025-07-24 02:26:40,569 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Layer2RouteReq?x=3 2025-07-24 02:26:41,117 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name= 2025-07-24 02:26:41,131 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Inet4UcRouteReq?x=5 2025-07-24 02:26:41,143 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:82af5bf4-6fa4-4b9b-8e5a-6739c49e048b 2025-07-24 02:26:41,301 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name= 2025-07-24 02:26:41,308 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_Inet4UcRouteReq?x=6 2025-07-24 02:26:41,318 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bcf7ec0c-8ac4-4c95-b021-0efb3d7b8971 2025-07-24 02:26:48,811 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338 2025-07-24 02:26:48,819 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338:ctest-right_vn-26836338 2025-07-24 02:26:48,826 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-right_vn-26836338:ctest-right_vn-26836338 2025-07-24 02:26:49,103 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847 2025-07-24 02:26:49,109 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847:ctest-left_vn-56964847 2025-07-24 02:26:49,116 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-left_vn-56964847:ctest-left_vn-56964847 2025-07-24 02:26:49,393 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-mgmt_vn-64320718 2025-07-24 02:26:49,399 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-mgmt_vn-64320718:ctest-mgmt_vn-64320718 2025-07-24 02:26:49,404 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-27350748:ctest-mgmt_vn-64320718:ctest-mgmt_vn-64320718 2025-07-24 02:26:49,668 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:26:53,017 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:27:01,880 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bb78bdc9-9587-4375-bb48-6f5dea1a46ab 2025-07-24 02:27:01,888 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestvDNSBasic0-42185875:ctest-vn1-vdns-77669693:ctest-vn1-vdns-77669693 2025-07-24 02:27:01,895 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bb78bdc9-9587-4375-bb48-6f5dea1a46ab 2025-07-24 02:27:13,777 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_DnsInfo? 2025-07-24 02:27:20,366 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:36fad069-7f3e-49b5-90b0-98d610ed1059 2025-07-24 02:27:20,374 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestvDNSBasic0-42185875:ctest-vn1-vdns-77669693:ctest-vn1-vdns-77669693 2025-07-24 02:27:20,380 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:36fad069-7f3e-49b5-90b0-98d610ed1059 2025-07-24 02:27:30,230 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_DnsInfo? 2025-07-24 02:27:41,404 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:27:44,708 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:27:53,681 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:dee5a1c9-f626-4cfa-9ed9-53faae3fddb3 2025-07-24 02:27:53,690 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVNx-00369610:ctest-vn-82160524:ctest-vn-82160524 2025-07-24 02:27:53,696 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:dee5a1c9-f626-4cfa-9ed9-53faae3fddb3 2025-07-24 02:27:59,622 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0259af6e-e69a-4b48-b6bb-299a07dd13ef 2025-07-24 02:27:59,632 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVNx-00369610:ctest-vn-82160524:ctest-vn-82160524 2025-07-24 02:27:59,638 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0259af6e-e69a-4b48-b6bb-299a07dd13ef 2025-07-24 02:28:08,378 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:28:11,684 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:28:19,131 - DEBUG - [10.0.0.249]: Running cmd : docker exec --privileged -it vrouter_vrouter-agent_1 /bin/bash -c 'echo "10.20.0.254 cn-jenkins-deploy-platform-ansible-os-3709-1-test" >> /etc/hosts' 2025-07-24 02:28:19,240 - DEBUG - Output : 2025-07-24 02:28:19,754 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:799306fe-89a9-4873-8e22-d1c03f90914a 2025-07-24 02:28:19,761 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-26163701:ctest-vn2_metadata-46586137:ctest-vn2_metadata-46586137 2025-07-24 02:28:19,767 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:799306fe-89a9-4873-8e22-d1c03f90914a 2025-07-24 02:28:32,247 - DEBUG - [10.0.0.249]: Running cmd : docker exec --privileged -it vrouter_vrouter-agent_1 /bin/bash -c 'sed -i '$ d' /etc/hosts' 2025-07-24 02:28:32,392 - DEBUG - Output : sed: -e expression #1, char 1: missing command 2025-07-24 02:28:34,992 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:28:35,285 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:28:42,233 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ced7d92e-4d2a-4a55-92f7-434435d7fb66 2025-07-24 02:28:42,239 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-26163701:ctest-vn-33862974:ctest-vn-33862974 2025-07-24 02:28:42,245 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ced7d92e-4d2a-4a55-92f7-434435d7fb66 2025-07-24 02:28:57,176 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:28:57,469 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:29:02,190 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-26163701:ctest-vn-32687373:ctest-vn-32687373 2025-07-24 02:29:02,537 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:dd6db51b-0fc8-40d8-b937-5166f39e4cb8 2025-07-24 02:29:02,549 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-26163701:ctest-vn-32687373:ctest-vn-32687373 2025-07-24 02:29:02,559 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:dd6db51b-0fc8-40d8-b937-5166f39e4cb8 2025-07-24 02:29:12,614 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:889fee38-6f0c-45c3-a2ed-212ba1bc2d2c 2025-07-24 02:29:12,621 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-26163701:ctest-vn-32687373:ctest-vn-32687373 2025-07-24 02:29:12,627 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:889fee38-6f0c-45c3-a2ed-212ba1bc2d2c 2025-07-24 02:29:14,423 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3dbb225d-cf96-4297-ae34-0044ef03fe91 2025-07-24 02:29:14,430 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-26163701:ctest-vn-32687373:ctest-vn-32687373 2025-07-24 02:29:14,436 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3dbb225d-cf96-4297-ae34-0044ef03fe91 2025-07-24 02:29:34,514 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-26163701:ctest-vn-32687373 2025-07-24 02:29:34,521 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-26163701:ctest-vn-32687373:ctest-vn-32687373 2025-07-24 02:29:34,526 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_VrfListReq?name= 2025-07-24 02:29:34,532 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_KRouteReq?x=2 2025-07-24 02:29:34,539 - DEBUG - Unable to fetch route details in vrouter for vrf index 2, Got :[] 2025-07-24 02:29:34,908 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-07-24 02:31:34,164 - INFO - Using existing project ['default-domain', 'admin'](0b34a109-c47d-4fa6-a80a-2074edc04d76) 2025-07-24 02:31:34,176 - INFO - ================================================================================ 2025-07-24 02:31:34,176 - INFO - STARTING TEST : test_contrail_status 2025-07-24 02:31:34,176 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-07-24 02:31:34,312 - DEBUG - Skipping xmpp flap check 2025-07-24 02:31:34,312 - INFO - Initial checks done. Running the testcase now 2025-07-24 02:31:34,312 - INFO - 2025-07-24 02:31:34,423 - INFO - 10.0.0.249 2025-07-24 02:31:34,423 - INFO - config 2025-07-24 02:31:34,433 - INFO - config-nodemgr:active 2025-07-24 02:31:34,447 - INFO - api-server:active 2025-07-24 02:31:34,452 - INFO - schema:active 2025-07-24 02:31:34,457 - INFO - svc-monitor:active 2025-07-24 02:31:34,463 - INFO - device-manager:active 2025-07-24 02:31:34,463 - INFO - config-database 2025-07-24 02:31:34,463 - INFO - config-cassandra:active 2025-07-24 02:31:34,463 - INFO - config-zookeeper:active 2025-07-24 02:31:34,463 - INFO - config-rabbitmq:active 2025-07-24 02:31:34,464 - INFO - vrouter 2025-07-24 02:31:34,469 - INFO - vrouter-nodemgr:active 2025-07-24 02:31:34,476 - INFO - agent:active 2025-07-24 02:31:34,476 - INFO - control 2025-07-24 02:31:34,484 - INFO - control-nodemgr:active 2025-07-24 02:31:34,490 - INFO - control:active 2025-07-24 02:31:34,490 - INFO - named:active 2025-07-24 02:31:34,497 - INFO - dns:active 2025-07-24 02:31:34,497 - INFO - analytics 2025-07-24 02:31:34,503 - INFO - analytics-nodemgr:active 2025-07-24 02:31:34,507 - INFO - analytics-api:active 2025-07-24 02:31:34,513 - INFO - collector:active 2025-07-24 02:31:34,513 - INFO - analytics-database 2025-07-24 02:31:34,513 - INFO - analytics-cassandra:active 2025-07-24 02:31:34,519 - INFO - analyticsdb-nodemgr:active 2025-07-24 02:31:34,524 - INFO - query-engine:active 2025-07-24 02:31:34,525 - INFO - webui 2025-07-24 02:31:34,525 - INFO - webui:active 2025-07-24 02:31:34,525 - INFO - webui-middleware:active 2025-07-24 02:31:34,525 - INFO - redis:active 2025-07-24 02:31:34,525 - INFO - analytics_snmp 2025-07-24 02:31:34,536 - INFO - snmp-collector:initializing (Database:RabbitMQ[] connection down) 2025-07-24 02:31:34,536 - INFO - snmp-topology:active 2025-07-24 02:31:34,537 - INFO - analytics_alarm 2025-07-24 02:31:34,537 - INFO - alarmgen:active 2025-07-24 02:31:34,537 - DEBUG - defaultdict(, {'10.0.0.249': {'snmp-collector': {'status': 'initializing', 'description': 'Database:RabbitMQ[] connection down'}}}) 2025-07-24 02:31:34,537 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 0 2025-07-24 02:31:44,594 - INFO - 10.0.0.249 2025-07-24 02:31:44,594 - INFO - config 2025-07-24 02:31:44,600 - INFO - config-nodemgr:active 2025-07-24 02:31:44,606 - INFO - api-server:active 2025-07-24 02:31:44,611 - INFO - schema:active 2025-07-24 02:31:44,614 - INFO - svc-monitor:active 2025-07-24 02:31:44,618 - INFO - device-manager:active 2025-07-24 02:31:44,618 - INFO - config-database 2025-07-24 02:31:44,618 - INFO - config-cassandra:active 2025-07-24 02:31:44,619 - INFO - config-zookeeper:active 2025-07-24 02:31:44,619 - INFO - config-rabbitmq:active 2025-07-24 02:31:44,619 - INFO - vrouter 2025-07-24 02:31:44,623 - INFO - vrouter-nodemgr:active 2025-07-24 02:31:44,628 - INFO - agent:active 2025-07-24 02:31:44,628 - INFO - control 2025-07-24 02:31:44,633 - INFO - control-nodemgr:active 2025-07-24 02:31:44,638 - INFO - control:active 2025-07-24 02:31:44,638 - INFO - named:active 2025-07-24 02:31:44,643 - INFO - dns:active 2025-07-24 02:31:44,643 - INFO - analytics 2025-07-24 02:31:44,647 - INFO - analytics-nodemgr:active 2025-07-24 02:31:44,652 - INFO - analytics-api:active 2025-07-24 02:31:44,658 - INFO - collector:active 2025-07-24 02:31:44,658 - INFO - analytics-database 2025-07-24 02:31:44,658 - INFO - analytics-cassandra:active 2025-07-24 02:31:44,663 - INFO - analyticsdb-nodemgr:active 2025-07-24 02:31:44,668 - INFO - query-engine:active 2025-07-24 02:31:44,669 - INFO - webui 2025-07-24 02:31:44,669 - INFO - webui:active 2025-07-24 02:31:44,669 - INFO - webui-middleware:active 2025-07-24 02:31:44,669 - INFO - redis:active 2025-07-24 02:31:44,669 - INFO - analytics_snmp 2025-07-24 02:31:44,673 - INFO - snmp-collector:active 2025-07-24 02:31:44,673 - INFO - snmp-topology:active 2025-07-24 02:31:44,673 - INFO - analytics_alarm 2025-07-24 02:31:44,673 - INFO - alarmgen:active 2025-07-24 02:31:44,673 - INFO - All the contrail services are up on all nodes 2025-07-24 02:31:44,673 - INFO - contrail-status passed 2025-07-24 02:31:44,808 - DEBUG - Skipping xmpp flap check 2025-07-24 02:31:44,808 - INFO - END TEST : test_contrail_status : PASSED[0:00:10] 2025-07-24 02:31:44,808 - INFO - --------------------------------------------------------------------------------