2025-10-22 16:12:25,045 - DEBUG - [10.0.0.242]: Running cmd : hostname 2025-10-22 16:12:25,283 - DEBUG - Output : cn-jenkins-deploy-platform-juju-os-602-1 2025-10-22 16:12:25,283 - DEBUG - [10.0.0.242]: Running cmd : hostname -f 2025-10-22 16:12:25,370 - DEBUG - Output : cn-jenkins-deploy-platform-juju-os-602-1 2025-10-22 16:12:25,370 - DEBUG - [10.0.0.242]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-10-22 16:12:25,479 - DEBUG - Output : NAMES contrail_test_zHWzmDGNh vrouter-vrouter-agent-1 vrouter-nodemgr-1 analytics_database-query-engine-1 analytics_database-cassandra-1 analytics_database-nodemgr-1 analytics_snmp-topology-1 analytics_snmp-nodemgr-1 analytics_snmp-snmp-collector-1 analytics_alarm-nodemgr-1 analytics_alarm-kafka-1 analytics_alarm-alarm-gen-1 analytics-collector-1 analytics-nodemgr-1 analytics-api-1 redis-stunnel-1 redis-redis-1 webui-job-1 webui-web-1 control-named-1 control-nodemgr-1 control-control-1 control-dns-1 config_database-cassandra-1 config_database-zookeeper-1 config_database-rabbitmq-1 config_database-nodemgr-1 config_api-devicemgr-1 config_api-dnsmasq-1 config_api-api-1 config_api-nodemgr-1 config_api-svcmonitor-1 config_api-schema-1 2025-10-22 16:12:25,480 - DEBUG - [10.0.0.242]: Running cmd : getent hosts 10.0.0.242 | head -n 1 | awk '{print $2}' 2025-10-22 16:12:25,570 - DEBUG - Output : cn-jenkins-deploy-platform-juju-os-602-1 2025-10-22 16:12:25,571 - DEBUG - [10.0.0.242]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-10-22 16:12:25,662 - DEBUG - Output : 127.0.0.1/8 252.242.0.1/8 10.243.192.1/24 172.17.0.1/16 10.0.0.242/24 2025-10-22 16:12:25,662 - DEBUG - [10.0.0.242]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-10-22 16:12:25,750 - DEBUG - Output : 10.0.0.242/24 2025-10-22 16:12:36,090 - INFO - Using existing project ['admin_domain', 'admin'](99551b05-b945-4841-9d5e-da26849b4cab) 2025-10-22 16:12:36,239 - INFO - ================================================================================ 2025-10-22 16:12:36,240 - INFO - STARTING TEST : test_contrail_status 2025-10-22 16:12:36,240 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-10-22 16:12:36,449 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:12:36,503 - DEBUG - Nothing to compare xmpp stats {'10.0.0.242': {'10.0.0.242': '0'}} with 2025-10-22 16:12:36,504 - INFO - Initial checks done. Running the testcase now 2025-10-22 16:12:36,504 - INFO - 2025-10-22 16:12:36,504 - DEBUG - [10.0.0.242]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-10-22 16:12:36,579 - DEBUG - Output : contrail_test_zHWzmDGNh vrouter-vrouter-agent-1 vrouter-nodemgr-1 vrouter-provisioner-1 control-provisioner-1 config_api-provisioner-1 analytics_database-provisioner-1 analytics_database-query-engine-1 analytics_database-cassandra-1 analytics_database-nodemgr-1 analytics_snmp-topology-1 analytics_snmp-nodemgr-1 analytics_snmp-provisioner-1 analytics_snmp-snmp-collector-1 analytics_alarm-nodemgr-1 analytics_alarm-kafka-1 analytics_alarm-alarm-gen-1 analytics_alarm-provisioner-1 analytics-provisioner-1 analytics-collector-1 analytics-nodemgr-1 analytics-api-1 redis-stunnel-1 redis-redis-1 webui-job-1 webui-web-1 control-named-1 control-nodemgr-1 control-control-1 control-dns-1 config_database-cassandra-1 config_database-zookeeper-1 config_database-provisioner-1 config_database-rabbitmq-1 config_database-nodemgr-1 config_api-devicemgr-1 config_api-dnsmasq-1 config_api-api-1 config_api-nodemgr-1 config_api-svcmonitor-1 config_api-schema-1 2025-10-22 16:12:36,579 - INFO - 10.0.0.242 2025-10-22 16:12:36,579 - INFO - config 2025-10-22 16:12:36,634 - INFO - config-nodemgr:active 2025-10-22 16:12:36,689 - INFO - api-server:active 2025-10-22 16:12:36,741 - INFO - schema:active 2025-10-22 16:12:36,793 - INFO - svc-monitor:active 2025-10-22 16:12:36,850 - INFO - device-manager:active 2025-10-22 16:12:36,850 - INFO - config-database 2025-10-22 16:12:36,850 - INFO - config-cassandra:active 2025-10-22 16:12:36,850 - INFO - config-zookeeper:active 2025-10-22 16:12:36,850 - INFO - config-rabbitmq:active 2025-10-22 16:12:36,850 - INFO - vrouter 2025-10-22 16:12:36,906 - INFO - vrouter-nodemgr:active 2025-10-22 16:12:36,961 - INFO - agent:active 2025-10-22 16:12:36,961 - INFO - control 2025-10-22 16:12:37,021 - INFO - control-nodemgr:active 2025-10-22 16:12:37,073 - INFO - control:active 2025-10-22 16:12:37,073 - INFO - named:active 2025-10-22 16:12:37,125 - INFO - dns:active 2025-10-22 16:12:37,125 - INFO - analytics 2025-10-22 16:12:37,181 - INFO - analytics-nodemgr:active 2025-10-22 16:12:37,233 - INFO - analytics-api:active 2025-10-22 16:12:37,285 - INFO - collector:active 2025-10-22 16:12:37,285 - INFO - analytics-database 2025-10-22 16:12:37,286 - INFO - analytics-cassandra:active 2025-10-22 16:12:37,341 - INFO - analyticsdb-nodemgr:active 2025-10-22 16:12:37,393 - INFO - query-engine:active 2025-10-22 16:12:37,393 - INFO - webui 2025-10-22 16:12:37,393 - INFO - webui:active 2025-10-22 16:12:37,394 - INFO - webui-middleware:active 2025-10-22 16:12:37,394 - INFO - redis:active 2025-10-22 16:12:37,394 - INFO - analytics_snmp 2025-10-22 16:12:37,445 - INFO - snmp-collector:active 2025-10-22 16:12:37,445 - INFO - snmp-topology:active 2025-10-22 16:12:37,445 - INFO - analytics_alarm 2025-10-22 16:12:37,445 - INFO - alarmgen:active 2025-10-22 16:12:37,445 - INFO - All the contrail services are up on all nodes 2025-10-22 16:12:37,446 - INFO - contrail-status passed 2025-10-22 16:12:37,652 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:12:37,706 - DEBUG - No XMPP flaps were noticed during the test
2025-10-22 16:12:37,706 - INFO - END TEST : test_contrail_status : PASSED[0:00:01]
2025-10-22 16:12:37,706 - INFO - -------------------------------------------------------------------------------- 2025-10-22 16:12:47,269 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:12:51,281 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-45265844:ctest-vn22-51371459:ctest-vn22-51371459 2025-10-22 16:12:51,329 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-45265844:ctest-vn22-51371459:ctest-vn22-51371459 2025-10-22 16:12:51,381 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-45265844:ctest-vn22-51371459:ctest-vn22-51371459 2025-10-22 16:13:12,586 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-45265844:ctest-vn22-51371459 2025-10-22 16:13:12,637 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-45265844:ctest-vn22-51371459:ctest-vn22-51371459 2025-10-22 16:13:12,686 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-45265844:ctest-vn22-51371459:ctest-vn22-51371459 2025-10-22 16:13:13,037 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:13:14,449 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:13:14,499 - DEBUG - [10.0.0.242]: Running cmd : docker exec --privileged -it config_api-api-1 /bin/bash -c 'db-manage check' 2025-10-22 16:13:17,187 - DEBUG - Output : 2025-10-22 16:13:17,008 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success 2025-10-22 16:13:17,063 ERROR: (v1.41) Checker check_cassandra_keyspace_replication: Exception, NoHostAvailable Python 3.9.21: /usr/bin/python3 Wed Oct 22 16:13:17 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in wrapper(*args=(,), **kwargs={}) 1535 self = args[0] 1536 try: 1537 errors = func(*args, **kwargs) 1538 if not errors: 1539 self._logger.info('(v%s) Checker %s: Success', __version__, errors undefined func = args = (,) kwargs = {} /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in check_cassandra_keyspace_replication(self=) 1635 raise CassandraConnectionError("error, {}: {}".format( 1636 error, utils.detailed_traceback())) 1637 temp_cluster.connect() 1638 for ks_name, _ in self._db_info: 1639 if self._api_args.cluster_id: temp_cluster = temp_cluster.connect = > /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection._reconnect_internal() NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.242:9041': ConnectionResetError(104, 'Connection reset by peer')}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {'10.0.0.242:9041': ConnectionResetError(104, 'Connection reset by peer')}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to connect to any servers', {'10.0.0.242:9041': ConnectionResetError(104, 'Connection reset by peer')}) errors = {'10.0.0.242:9041': ConnectionResetError(104, 'Connection reset by peer')} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1537, in wrapper errors = func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1637, in check_cassandra_keyspace_replication temp_cluster.connect() File "cassandra/cluster.py", line 1717, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1753, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1740, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 3543, in cassandra.cluster.ControlConnection.connect File "cassandra/cluster.py", line 3588, in cassandra.cluster.ControlConnection._reconnect_internal cassandra.cluster.NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.242:9041': ConnectionResetError(104, 'Connection reset by peer')}) Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1537, in wrapper errors = func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1637, in check_cassandra_keyspace_replication temp_cluster.connect() File "cassandra/cluster.py", line 1717, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1753, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1740, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 3543, in cassandra.cluster.ControlConnection.connect File "cassandra/cluster.py", line 3588, in cassandra.cluster.ControlConnection._reconnect_internal cassandra.cluster.NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.242:9041': ConnectionResetError(104, 'Connection reset by peer')}) NoHostAvailable Python 3.9.21: /usr/bin/python3 Wed Oct 22 16:13:17 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/local/bin/db-manage in 4 import sys 5 from vnc_cfg_api_server.db_manage import main 6 if __name__ == '__main__': 7 sys.argv[0] = re.sub(r'(-script\.pyw|\.exe)?$', '', sys.argv[0]) 8 sys.exit(main()) sys = sys.exit = main = /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in main() 3451 verb = args.operation 3452 if 'db_%s' % (verb) in globals(): 3453 return globals()['db_%s' % (verb)](args, api_args) 3454 3455 if getattr(DatabaseChecker, verb, None): builtinglobals = verb = 'check' args = Namespace(operation='check', api_conf='/etc/cont...1024, log_file='/var/log/contrail/db_manage.log') api_args = Namespace(conf_file=['/etc/contrail/contrail-api...esh_base.SandeshConfig object at 0x7f4953c72af0>) /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in db_check(args=Namespace(operation='check', api_conf='/etc/cont...1024, log_file='/var/log/contrail/db_manage.log'), api_args=Namespace(conf_file=['/etc/contrail/contrail-api...esh_base.SandeshConfig object at 0x7f4953c72af0>)) 3358 # Mode and node count check across all nodes 3359 db_checker.check_zk_mode_and_node_count() 3360 db_checker.check_cassandra_keyspace_replication() 3361 # Obj UUID cassandra inconsistencies 3362 db_checker.check_obj_mandatory_fields() db_checker = db_checker.check_cassandra_keyspace_replication = > /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in wrapper(*args=(,), **kwargs={}) 1535 self = args[0] 1536 try: 1537 errors = func(*args, **kwargs) 1538 if not errors: 1539 self._logger.info('(v%s) Checker %s: Success', __version__, errors undefined func = args = (,) kwargs = {} /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in check_cassandra_keyspace_replication(self=) 1635 raise CassandraConnectionError("error, {}: {}".format( 1636 error, utils.detailed_traceback())) 1637 temp_cluster.connect() 1638 for ks_name, _ in self._db_info: 1639 if self._api_args.cluster_id: temp_cluster = temp_cluster.connect = > /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection._reconnect_internal() NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.242:9041': ConnectionResetError(104, 'Connection reset by peer')}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {'10.0.0.242:9041': ConnectionResetError(104, 'Connection reset by peer')}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to connect to any servers', {'10.0.0.242:9041': ConnectionResetError(104, 'Connection reset by peer')}) errors = {'10.0.0.242:9041': ConnectionResetError(104, 'Connection reset by peer')} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/local/bin/db-manage", line 8, in sys.exit(main()) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 3453, in main return globals()['db_%s' % (verb)](args, api_args) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 3360, in db_check db_checker.check_cassandra_keyspace_replication() File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1537, in wrapper errors = func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1637, in check_cassandra_keyspace_replication temp_cluster.connect() File "cassandra/cluster.py", line 1717, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1753, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1740, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 3543, in cassandra.cluster.ControlConnection.connect File "cassandra/cluster.py", line 3588, in cassandra.cluster.ControlConnection._reconnect_internal cassandra.cluster.NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.242:9041': ConnectionResetError(104, 'Connection reset by peer')}) 2025-10-22 16:13:17,424 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:13:17,768 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:13:18,076 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:13:18,332 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:13:18,593 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:13:21,863 - INFO - admin user already present 2025-10-22 16:13:22,824 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:13:26,817 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-fvn-89927709:ctest-fvn-89927709 2025-10-22 16:13:26,869 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-fvn-89927709:ctest-fvn-89927709 2025-10-22 16:13:26,926 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-fvn-89927709:ctest-fvn-89927709 2025-10-22 16:13:29,174 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-vn1-76512480:ctest-vn1-76512480 2025-10-22 16:13:29,226 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-vn1-76512480:ctest-vn1-76512480 2025-10-22 16:13:29,278 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-vn1-76512480:ctest-vn1-76512480 2025-10-22 16:13:35,278 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f4bc2a38-694b-4707-8d8d-a75eaaf68a04 2025-10-22 16:13:35,330 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-vn1-76512480:ctest-vn1-76512480 2025-10-22 16:13:35,382 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f4bc2a38-694b-4707-8d8d-a75eaaf68a04 2025-10-22 16:13:51,291 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4e442b21-2bcb-454d-a51b-020675fa8706 2025-10-22 16:13:51,342 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-fvn-89927709:ctest-fvn-89927709 2025-10-22 16:13:51,389 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4e442b21-2bcb-454d-a51b-020675fa8706 2025-10-22 16:13:53,134 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f4bc2a38-694b-4707-8d8d-a75eaaf68a04 2025-10-22 16:13:53,187 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-fvn-89927709 2025-10-22 16:13:53,238 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-fvn-89927709:ctest-fvn-89927709 2025-10-22 16:13:53,290 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Inet4UcRouteReq?x=3 2025-10-22 16:13:59,542 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-vn1-76512480 2025-10-22 16:13:59,589 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-vn1-76512480:ctest-vn1-76512480 2025-10-22 16:13:59,641 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-vn1-76512480:ctest-vn1-76512480 2025-10-22 16:14:00,214 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-fvn-89927709 2025-10-22 16:14:00,261 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-fvn-89927709:ctest-fvn-89927709 2025-10-22 16:14:00,314 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-70798166:ctest-fvn-89927709:ctest-fvn-89927709 2025-10-22 16:14:00,796 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:14:04,522 - INFO - ctest-TestHeat-58453973 user already added to project 2025-10-22 16:14:04,856 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:14:05,799 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:14:14,075 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:14:22,234 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:14:26,012 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:14:28,955 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:14:29,344 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:14:39,058 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:22110501-f27c-419e-b5e2-6a3f78dddd65 2025-10-22 16:14:39,110 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestPorts-54765725:ctest-vn1-41388362:ctest-vn1-41388362 2025-10-22 16:14:39,161 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:22110501-f27c-419e-b5e2-6a3f78dddd65 2025-10-22 16:14:53,146 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c1a8a5ae-5617-47e8-9cc6-e0c6dfccb76e 2025-10-22 16:14:53,198 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestPorts-54765725:ctest-vn1-41388362:ctest-vn1-41388362 2025-10-22 16:14:53,254 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c1a8a5ae-5617-47e8-9cc6-e0c6dfccb76e 2025-10-22 16:15:00,637 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:15:05,988 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:15:18,561 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f3441453-0cf5-4649-90e2-b93a999a823f 2025-10-22 16:15:18,620 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRouters-70909902:ctest-vn1-77133574:ctest-vn1-77133574 2025-10-22 16:15:18,674 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f3441453-0cf5-4649-90e2-b93a999a823f 2025-10-22 16:15:25,142 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2562c031-9395-47a9-9e95-c4f699f84d25 2025-10-22 16:15:25,194 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRouters-70909902:ctest-vn2-08567363:ctest-vn2-08567363 2025-10-22 16:15:25,245 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2562c031-9395-47a9-9e95-c4f699f84d25 2025-10-22 16:15:43,807 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:15:48,219 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:16:01,755 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e753a355-28e0-4e1c-8a02-a68b849165bc 2025-10-22 16:16:01,810 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRoutersBasic-62117368:ctest-vn-40781126:ctest-vn-40781126 2025-10-22 16:16:01,862 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e753a355-28e0-4e1c-8a02-a68b849165bc 2025-10-22 16:16:13,502 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cb2d870b-00e6-47d7-bef8-14c7bcefe84e 2025-10-22 16:16:13,558 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRoutersBasic-62117368:ctest-ext_vn-33340498:ctest-ext_vn-33340498 2025-10-22 16:16:13,605 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cb2d870b-00e6-47d7-bef8-14c7bcefe84e 2025-10-22 16:16:22,429 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:16:26,216 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:16:32,354 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-09651778:ctest-vn-09651778 2025-10-22 16:16:32,401 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-09651778:ctest-vn-09651778 2025-10-22 16:16:32,449 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-09651778:ctest-vn-09651778 2025-10-22 16:16:33,721 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-90496741:ctest-vn-90496741 2025-10-22 16:16:33,773 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-90496741:ctest-vn-90496741 2025-10-22 16:16:33,822 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-90496741:ctest-vn-90496741 2025-10-22 16:16:34,886 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-90496741 2025-10-22 16:16:34,937 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-90496741:ctest-vn-90496741 2025-10-22 16:16:34,994 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-90496741:ctest-vn-90496741 2025-10-22 16:16:35,730 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-09651778 2025-10-22 16:16:35,781 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-09651778:ctest-vn-09651778 2025-10-22 16:16:35,830 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-86121510:ctest-vn-09651778:ctest-vn-09651778 2025-10-22 16:16:36,323 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:16:40,167 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:16:40,563 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:16:45,045 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-51223550:ctest-vn4-12925437:ctest-vn4-12925437 2025-10-22 16:16:45,093 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-51223550:ctest-vn4-12925437:ctest-vn4-12925437 2025-10-22 16:16:45,142 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-51223550:ctest-vn4-12925437:ctest-vn4-12925437 2025-10-22 16:16:45,898 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-51223550:ctest-vn4-12925437 2025-10-22 16:16:45,949 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-51223550:ctest-vn4-12925437:ctest-vn4-12925437 2025-10-22 16:16:46,001 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-51223550:ctest-vn4-12925437:ctest-vn4-12925437 2025-10-22 16:16:46,675 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:16:47,055 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:16:50,851 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:16:56,102 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-79085875:ctest-vn-79085875 2025-10-22 16:16:56,154 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-79085875:ctest-vn-79085875 2025-10-22 16:16:56,202 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-79085875:ctest-vn-79085875 2025-10-22 16:16:57,466 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-47630703:ctest-vn-47630703 2025-10-22 16:16:57,517 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-47630703:ctest-vn-47630703 2025-10-22 16:16:57,569 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-47630703:ctest-vn-47630703 2025-10-22 16:17:05,851 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d07434ce-e7ff-412b-bca3-83476dd4d836 2025-10-22 16:17:05,902 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-79085875:ctest-vn-79085875 2025-10-22 16:17:05,957 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d07434ce-e7ff-412b-bca3-83476dd4d836 2025-10-22 16:17:12,282 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:91ebad59-502a-4f6f-8e58-94cd1e00154f 2025-10-22 16:17:12,334 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-47630703:ctest-vn-47630703 2025-10-22 16:17:12,385 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:91ebad59-502a-4f6f-8e58-94cd1e00154f 2025-10-22 16:17:30,311 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-47630703 2025-10-22 16:17:30,361 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-47630703:ctest-vn-47630703 2025-10-22 16:17:30,409 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-47630703:ctest-vn-47630703 2025-10-22 16:17:30,958 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-79085875 2025-10-22 16:17:31,005 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-79085875:ctest-vn-79085875 2025-10-22 16:17:31,053 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-66728683:ctest-vn-79085875:ctest-vn-79085875 2025-10-22 16:17:31,554 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:17:35,475 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:17:46,698 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9f832e5a-13bc-4ecd-bb59-17d0983f0f4e 2025-10-22 16:17:46,754 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRP-05368288:ctest-bgpaas_vn-98433596:ctest-bgpaas_vn-98433596 2025-10-22 16:17:46,802 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9f832e5a-13bc-4ecd-bb59-17d0983f0f4e 2025-10-22 16:17:53,162 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fc73396e-984d-4a0d-bda3-1399772ad0be 2025-10-22 16:17:53,214 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRP-05368288:ctest-bgpaas_vn-92533647:ctest-bgpaas_vn-92533647 2025-10-22 16:17:53,265 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fc73396e-984d-4a0d-bda3-1399772ad0be 2025-10-22 16:17:55,093 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:18:02,083 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:18:06,018 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:18:09,321 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-mgmt_vn-69764765:ctest-mgmt_vn-69764765 2025-10-22 16:18:09,369 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-mgmt_vn-69764765:ctest-mgmt_vn-69764765 2025-10-22 16:18:09,417 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-mgmt_vn-69764765:ctest-mgmt_vn-69764765 2025-10-22 16:18:11,522 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203:ctest-left_vn-56797203 2025-10-22 16:18:11,573 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203:ctest-left_vn-56797203 2025-10-22 16:18:11,621 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203:ctest-left_vn-56797203 2025-10-22 16:18:13,858 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674:ctest-right_vn-68563674 2025-10-22 16:18:13,909 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674:ctest-right_vn-68563674 2025-10-22 16:18:13,957 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674:ctest-right_vn-68563674 2025-10-22 16:18:31,039 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e3a9fb11-8a29-4baa-9111-51935c6a3af4 2025-10-22 16:18:31,090 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-mgmt_vn-69764765:ctest-mgmt_vn-69764765 2025-10-22 16:18:31,141 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f7c5d5d3-0ac4-4c5a-8788-af0b02b63f76 2025-10-22 16:18:31,194 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203:ctest-left_vn-56797203 2025-10-22 16:18:31,245 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0feb7c0b-4e14-4375-b556-5715050ea81e 2025-10-22 16:18:31,298 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674:ctest-right_vn-68563674 2025-10-22 16:18:31,350 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0feb7c0b-4e14-4375-b556-5715050ea81e 2025-10-22 16:18:31,398 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e3a9fb11-8a29-4baa-9111-51935c6a3af4 2025-10-22 16:18:31,446 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f7c5d5d3-0ac4-4c5a-8788-af0b02b63f76 2025-10-22 16:19:14,352 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cb398c3b-3bdd-489f-866e-0409ab9c8756 2025-10-22 16:19:14,406 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203:ctest-left_vn-56797203 2025-10-22 16:19:14,458 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cb398c3b-3bdd-489f-866e-0409ab9c8756 2025-10-22 16:19:16,783 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7fa3dabc-329c-4644-a136-7e2509ca5c07 2025-10-22 16:19:16,835 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674:ctest-right_vn-68563674 2025-10-22 16:19:16,885 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7fa3dabc-329c-4644-a136-7e2509ca5c07 2025-10-22 16:19:23,863 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0feb7c0b-4e14-4375-b556-5715050ea81e 2025-10-22 16:19:23,918 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e3a9fb11-8a29-4baa-9111-51935c6a3af4 2025-10-22 16:19:23,970 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f7c5d5d3-0ac4-4c5a-8788-af0b02b63f76 2025-10-22 16:19:25,271 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203 2025-10-22 16:19:25,322 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f7c5d5d3-0ac4-4c5a-8788-af0b02b63f76 2025-10-22 16:19:25,374 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-10-22 16:19:25,385 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203:ctest-left_vn-56797203 2025-10-22 16:19:25,589 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Inet4UcRouteReq?x=2 2025-10-22 16:19:25,805 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Layer2RouteReq?x=2 2025-10-22 16:19:25,865 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203 2025-10-22 16:19:25,918 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203:ctest-left_vn-56797203 2025-10-22 16:19:26,125 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Inet4UcRouteReq?x=2 2025-10-22 16:19:26,337 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Layer2RouteReq?x=2 2025-10-22 16:19:26,354 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-mgmt_vn-69764765 2025-10-22 16:19:26,401 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e3a9fb11-8a29-4baa-9111-51935c6a3af4 2025-10-22 16:19:26,450 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-10-22 16:19:26,462 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-mgmt_vn-69764765:ctest-mgmt_vn-69764765 2025-10-22 16:19:26,661 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Inet4UcRouteReq?x=4 2025-10-22 16:19:26,869 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Layer2RouteReq?x=4 2025-10-22 16:19:26,881 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-mgmt_vn-69764765 2025-10-22 16:19:26,930 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-mgmt_vn-69764765:ctest-mgmt_vn-69764765 2025-10-22 16:19:27,141 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Inet4UcRouteReq?x=4 2025-10-22 16:19:27,361 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Layer2RouteReq?x=4 2025-10-22 16:19:27,422 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674 2025-10-22 16:19:27,469 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0feb7c0b-4e14-4375-b556-5715050ea81e 2025-10-22 16:19:27,518 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-10-22 16:19:27,532 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674:ctest-right_vn-68563674 2025-10-22 16:19:27,737 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Inet4UcRouteReq?x=3 2025-10-22 16:19:27,949 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Layer2RouteReq?x=3 2025-10-22 16:19:27,964 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674 2025-10-22 16:19:28,017 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674:ctest-right_vn-68563674 2025-10-22 16:19:28,217 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Inet4UcRouteReq?x=3 2025-10-22 16:19:28,429 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Layer2RouteReq?x=3 2025-10-22 16:19:29,173 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name= 2025-10-22 16:19:29,222 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Inet4UcRouteReq?x=5 2025-10-22 16:19:29,273 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f7c5d5d3-0ac4-4c5a-8788-af0b02b63f76 2025-10-22 16:19:29,429 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name= 2025-10-22 16:19:29,478 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_Inet4UcRouteReq?x=6 2025-10-22 16:19:29,532 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0feb7c0b-4e14-4375-b556-5715050ea81e 2025-10-22 16:19:37,178 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674 2025-10-22 16:19:37,225 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674:ctest-right_vn-68563674 2025-10-22 16:19:37,273 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-right_vn-68563674:ctest-right_vn-68563674 2025-10-22 16:19:37,862 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203 2025-10-22 16:19:37,909 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203:ctest-left_vn-56797203 2025-10-22 16:19:37,958 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-left_vn-56797203:ctest-left_vn-56797203 2025-10-22 16:19:38,554 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-mgmt_vn-69764765 2025-10-22 16:19:38,602 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-mgmt_vn-69764765:ctest-mgmt_vn-69764765 2025-10-22 16:19:38,657 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-77587787:ctest-mgmt_vn-69764765:ctest-mgmt_vn-69764765 2025-10-22 16:19:39,151 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:19:42,963 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:19:53,242 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:623f779a-6a5a-42f0-a6b4-e405d3da2892 2025-10-22 16:19:53,294 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestvDNSBasic0-94294498:ctest-vn1-vdns-56314446:ctest-vn1-vdns-56314446 2025-10-22 16:19:53,346 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:623f779a-6a5a-42f0-a6b4-e405d3da2892 2025-10-22 16:20:10,969 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_DnsInfo? 2025-10-22 16:20:18,308 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:da7fe780-1b54-420b-85d5-48b225796f80 2025-10-22 16:20:18,358 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestvDNSBasic0-94294498:ctest-vn1-vdns-56314446:ctest-vn1-vdns-56314446 2025-10-22 16:20:18,414 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:da7fe780-1b54-420b-85d5-48b225796f80 2025-10-22 16:20:30,451 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_DnsInfo? 2025-10-22 16:20:42,548 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:20:46,336 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:20:56,511 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5d4a99a7-c398-4a55-844c-838df84868de 2025-10-22 16:20:56,562 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVNx-80836914:ctest-vn-99776745:ctest-vn-99776745 2025-10-22 16:20:56,610 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5d4a99a7-c398-4a55-844c-838df84868de 2025-10-22 16:21:03,011 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2ae7c953-9fd9-4fec-aa50-c9282be964fb 2025-10-22 16:21:03,062 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVNx-80836914:ctest-vn-99776745:ctest-vn-99776745 2025-10-22 16:21:03,114 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2ae7c953-9fd9-4fec-aa50-c9282be964fb 2025-10-22 16:21:12,287 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:21:16,115 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:21:24,039 - DEBUG - [10.0.0.242]: Running cmd : docker exec --privileged -it vrouter-vrouter-agent-1 /bin/bash -c 'echo "10.0.0.242 cn-jenkins-deploy-platform-juju-os-602-1-test" >> /etc/hosts' 2025-10-22 16:21:24,175 - DEBUG - Output : 2025-10-22 16:21:24,926 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:67312ea1-d362-4ea6-8854-e211bc5ae721 2025-10-22 16:21:24,979 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-88253537:ctest-vn2_metadata-26831098:ctest-vn2_metadata-26831098 2025-10-22 16:21:25,033 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:67312ea1-d362-4ea6-8854-e211bc5ae721 2025-10-22 16:21:32,496 - DEBUG - [10.0.0.242]: Running cmd : docker exec --privileged -it vrouter-vrouter-agent-1 /bin/bash -c 'sed -i '$ d' /etc/hosts' 2025-10-22 16:21:32,664 - DEBUG - Output : sed: -e expression #1, char 1: missing command 2025-10-22 16:21:35,540 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:21:35,932 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:21:43,706 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:972312cb-7da2-4ca4-9661-932874bbd05f 2025-10-22 16:21:43,758 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-88253537:ctest-vn-36731536:ctest-vn-36731536 2025-10-22 16:21:43,813 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:972312cb-7da2-4ca4-9661-932874bbd05f 2025-10-22 16:21:56,016 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:21:56,399 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:22:03,746 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-88253537:ctest-vn-07420625:ctest-vn-07420625 2025-10-22 16:22:04,414 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e2addbe6-eaa9-47f4-bd32-b65c38f9f571 2025-10-22 16:22:04,462 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-88253537:ctest-vn-07420625:ctest-vn-07420625 2025-10-22 16:22:04,509 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e2addbe6-eaa9-47f4-bd32-b65c38f9f571 2025-10-22 16:22:15,079 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:41e804f1-595e-4d32-a8ee-84cb4d918823 2025-10-22 16:22:15,134 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-88253537:ctest-vn-07420625:ctest-vn-07420625 2025-10-22 16:22:15,187 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:41e804f1-595e-4d32-a8ee-84cb4d918823 2025-10-22 16:22:17,350 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4aaf28c1-5aed-427e-ae60-93559025ea96 2025-10-22 16:22:17,402 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-88253537:ctest-vn-07420625:ctest-vn-07420625 2025-10-22 16:22:17,450 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4aaf28c1-5aed-427e-ae60-93559025ea96 2025-10-22 16:22:38,206 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicVMVN-88253537:ctest-vn-07420625 2025-10-22 16:22:38,257 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-88253537:ctest-vn-07420625:ctest-vn-07420625 2025-10-22 16:22:38,305 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_VrfListReq?name= 2025-10-22 16:22:38,353 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_KRouteReq?x=2 2025-10-22 16:22:38,405 - DEBUG - Unable to fetch route details in vrouter for vrf index 2, Got :[] 2025-10-22 16:22:39,019 - DEBUG - Requesting: https://10.0.0.242:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 16:24:44,906 - INFO - Using existing project ['admin_domain', 'admin'](99551b05-b945-4841-9d5e-da26849b4cab) 2025-10-22 16:24:44,915 - INFO - ================================================================================ 2025-10-22 16:24:44,915 - INFO - STARTING TEST : test_contrail_status 2025-10-22 16:24:44,915 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-10-22 16:24:45,125 - DEBUG - Skipping xmpp flap check 2025-10-22 16:24:45,125 - INFO - Initial checks done. Running the testcase now 2025-10-22 16:24:45,125 - INFO - 2025-10-22 16:24:45,237 - INFO - 10.0.0.242 2025-10-22 16:24:45,238 - INFO - config 2025-10-22 16:24:45,294 - INFO - config-nodemgr:active 2025-10-22 16:24:45,353 - INFO - api-server:active 2025-10-22 16:24:45,413 - INFO - schema:active 2025-10-22 16:24:45,465 - INFO - svc-monitor:active 2025-10-22 16:24:45,518 - INFO - device-manager:active 2025-10-22 16:24:45,519 - INFO - config-database 2025-10-22 16:24:45,519 - INFO - config-cassandra:active 2025-10-22 16:24:45,519 - INFO - config-zookeeper:active 2025-10-22 16:24:45,519 - INFO - config-rabbitmq:active 2025-10-22 16:24:45,519 - INFO - vrouter 2025-10-22 16:24:45,577 - INFO - vrouter-nodemgr:active 2025-10-22 16:24:45,629 - INFO - agent:active 2025-10-22 16:24:45,629 - INFO - control 2025-10-22 16:24:45,686 - INFO - control-nodemgr:active 2025-10-22 16:24:45,737 - INFO - control:active 2025-10-22 16:24:45,738 - INFO - named:active 2025-10-22 16:24:45,793 - INFO - dns:active 2025-10-22 16:24:45,793 - INFO - analytics 2025-10-22 16:24:45,845 - INFO - analytics-nodemgr:active 2025-10-22 16:24:45,897 - INFO - analytics-api:active 2025-10-22 16:24:45,950 - INFO - collector:active 2025-10-22 16:24:45,950 - INFO - analytics-database 2025-10-22 16:24:45,950 - INFO - analytics-cassandra:active 2025-10-22 16:24:46,005 - INFO - analyticsdb-nodemgr:active 2025-10-22 16:24:46,061 - INFO - query-engine:active 2025-10-22 16:24:46,062 - INFO - webui 2025-10-22 16:24:46,062 - INFO - webui:active 2025-10-22 16:24:46,062 - INFO - webui-middleware:active 2025-10-22 16:24:46,062 - INFO - redis:active 2025-10-22 16:24:46,062 - INFO - analytics_snmp 2025-10-22 16:24:46,113 - INFO - snmp-collector:active 2025-10-22 16:24:46,114 - INFO - snmp-topology:active 2025-10-22 16:24:46,114 - INFO - analytics_alarm 2025-10-22 16:24:46,114 - INFO - alarmgen:active 2025-10-22 16:24:46,114 - INFO - All the contrail services are up on all nodes 2025-10-22 16:24:46,114 - INFO - contrail-status passed 2025-10-22 16:24:46,321 - DEBUG - Skipping xmpp flap check
2025-10-22 16:24:46,322 - INFO - END TEST : test_contrail_status : PASSED[0:00:02]
2025-10-22 16:24:46,322 - INFO - --------------------------------------------------------------------------------