2025-10-13 01:48:26,293 - DEBUG - [10.0.0.129]: Running cmd : hostname 2025-10-13 01:48:26,525 - DEBUG - Output : cn-jenkins-deploy-platform-juju-os-589-1 2025-10-13 01:48:26,525 - DEBUG - [10.0.0.129]: Running cmd : hostname -f 2025-10-13 01:48:26,613 - DEBUG - Output : cn-jenkins-deploy-platform-juju-os-589-1 2025-10-13 01:48:26,613 - DEBUG - [10.0.0.129]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-10-13 01:48:26,725 - DEBUG - Output : NAMES contrail_test_tafscb5tM vrouter-vrouter-agent-1 vrouter-nodemgr-1 webui-job-1 webui-web-1 control-named-1 control-control-1 control-dns-1 control-nodemgr-1 config_database-rabbitmq-1 config_database-nodemgr-1 config_database-cassandra-1 config_database-zookeeper-1 config_api-devicemgr-1 config_api-schema-1 config_api-nodemgr-1 config_api-api-1 config_api-dnsmasq-1 config_api-svcmonitor-1 redis-redis-1 redis-stunnel-1 analytics_snmp-nodemgr-1 analytics_snmp-topology-1 analytics_snmp-snmp-collector-1 analytics_alarm-nodemgr-1 analytics_alarm-alarm-gen-1 analytics_alarm-kafka-1 analytics-collector-1 analytics-api-1 analytics-nodemgr-1 analytics_database-query-engine-1 analytics_database-cassandra-1 analytics_database-nodemgr-1 2025-10-13 01:48:26,726 - DEBUG - [10.0.0.129]: Running cmd : getent hosts 10.0.0.129 | head -n 1 | awk '{print $2}' 2025-10-13 01:48:26,817 - DEBUG - Output : cn-jenkins-deploy-platform-juju-os-589-1 2025-10-13 01:48:26,818 - DEBUG - [10.0.0.129]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-10-13 01:48:26,913 - DEBUG - Output : 127.0.0.1/8 252.129.0.1/8 10.0.215.1/24 172.17.0.1/16 10.0.0.129/24 2025-10-13 01:48:26,914 - DEBUG - [10.0.0.129]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-10-13 01:48:27,009 - DEBUG - Output : 10.0.0.129/24 2025-10-13 01:48:36,989 - INFO - Using existing project ['admin_domain', 'admin'](5fc4bc8d-4b10-4e41-99a1-5d01acfe2c8e) 2025-10-13 01:48:37,137 - INFO - ================================================================================ 2025-10-13 01:48:37,137 - INFO - STARTING TEST : test_contrail_status 2025-10-13 01:48:37,138 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-10-13 01:48:37,346 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:48:37,401 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.0.0.129': '0'}} with 2025-10-13 01:48:37,401 - INFO - Initial checks done. Running the testcase now 2025-10-13 01:48:37,401 - INFO - 2025-10-13 01:48:37,401 - DEBUG - [10.0.0.129]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-10-13 01:48:37,476 - DEBUG - Output : contrail_test_tafscb5tM vrouter-vrouter-agent-1 vrouter-nodemgr-1 vrouter-provisioner-1 control-provisioner-1 config_api-provisioner-1 webui-job-1 webui-web-1 control-named-1 control-control-1 control-dns-1 control-nodemgr-1 config_database-rabbitmq-1 config_database-nodemgr-1 config_database-provisioner-1 config_database-cassandra-1 config_database-zookeeper-1 config_api-devicemgr-1 config_api-schema-1 config_api-nodemgr-1 config_api-api-1 config_api-dnsmasq-1 config_api-svcmonitor-1 redis-redis-1 redis-stunnel-1 analytics_snmp-nodemgr-1 analytics_snmp-provisioner-1 analytics_snmp-topology-1 analytics_snmp-snmp-collector-1 analytics_alarm-nodemgr-1 analytics_alarm-alarm-gen-1 analytics_alarm-provisioner-1 analytics_alarm-kafka-1 analytics-collector-1 analytics-provisioner-1 analytics-api-1 analytics-nodemgr-1 analytics_database-query-engine-1 analytics_database-cassandra-1 analytics_database-nodemgr-1 analytics_database-provisioner-1 2025-10-13 01:48:37,476 - INFO - 10.0.0.129 2025-10-13 01:48:37,476 - INFO - config 2025-10-13 01:48:37,528 - INFO - config-nodemgr:active 2025-10-13 01:48:37,579 - INFO - api-server:active 2025-10-13 01:48:37,632 - INFO - schema:active 2025-10-13 01:48:37,684 - INFO - svc-monitor:active 2025-10-13 01:48:37,735 - INFO - device-manager:active 2025-10-13 01:48:37,736 - INFO - config-database 2025-10-13 01:48:37,736 - INFO - config-cassandra:active 2025-10-13 01:48:37,736 - INFO - config-zookeeper:active 2025-10-13 01:48:37,736 - INFO - config-rabbitmq:active 2025-10-13 01:48:37,736 - INFO - vrouter 2025-10-13 01:48:37,788 - INFO - vrouter-nodemgr:active 2025-10-13 01:48:37,840 - INFO - agent:active 2025-10-13 01:48:37,840 - INFO - control 2025-10-13 01:48:37,892 - INFO - control-nodemgr:active 2025-10-13 01:48:37,944 - INFO - control:active 2025-10-13 01:48:37,944 - INFO - named:active 2025-10-13 01:48:37,996 - INFO - dns:active 2025-10-13 01:48:37,996 - INFO - analytics 2025-10-13 01:48:38,048 - INFO - analytics-nodemgr:active 2025-10-13 01:48:38,100 - INFO - analytics-api:active 2025-10-13 01:48:38,152 - INFO - collector:active 2025-10-13 01:48:38,152 - INFO - analytics-database 2025-10-13 01:48:38,152 - INFO - analytics-cassandra:active 2025-10-13 01:48:38,204 - INFO - analyticsdb-nodemgr:active 2025-10-13 01:48:38,260 - INFO - query-engine:active 2025-10-13 01:48:38,260 - INFO - webui 2025-10-13 01:48:38,260 - INFO - webui:active 2025-10-13 01:48:38,260 - INFO - webui-middleware:active 2025-10-13 01:48:38,260 - INFO - redis:active 2025-10-13 01:48:38,260 - INFO - analytics_snmp 2025-10-13 01:48:38,316 - INFO - snmp-collector:active 2025-10-13 01:48:38,316 - INFO - snmp-topology:active 2025-10-13 01:48:38,316 - INFO - analytics_alarm 2025-10-13 01:48:38,316 - INFO - alarmgen:active 2025-10-13 01:48:38,316 - INFO - All the contrail services are up on all nodes 2025-10-13 01:48:38,316 - INFO - contrail-status passed 2025-10-13 01:48:38,518 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:48:38,568 - DEBUG - No XMPP flaps were noticed during the test
2025-10-13 01:48:38,568 - INFO - END TEST : test_contrail_status : PASSED[0:00:01]
2025-10-13 01:48:38,568 - INFO - -------------------------------------------------------------------------------- 2025-10-13 01:48:48,382 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:48:52,452 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-36678216:ctest-vn22-76193502:ctest-vn22-76193502 2025-10-13 01:48:52,500 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-36678216:ctest-vn22-76193502:ctest-vn22-76193502 2025-10-13 01:48:52,548 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-36678216:ctest-vn22-76193502:ctest-vn22-76193502 2025-10-13 01:49:15,197 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-36678216:ctest-vn22-76193502 2025-10-13 01:49:15,248 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-36678216:ctest-vn22-76193502:ctest-vn22-76193502 2025-10-13 01:49:15,300 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-36678216:ctest-vn22-76193502:ctest-vn22-76193502 2025-10-13 01:49:15,663 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:49:16,957 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:49:17,009 - DEBUG - [10.0.0.129]: Running cmd : docker exec --privileged -it config_api-api-1 /bin/bash -c 'db-manage check' 2025-10-13 01:49:19,547 - DEBUG - Output : 2025-10-13 01:49:19,370 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success 2025-10-13 01:49:19,419 ERROR: (v1.41) Checker check_cassandra_keyspace_replication: Exception, NoHostAvailable Python 3.9.21: /usr/bin/python3 Mon Oct 13 01:49:19 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in wrapper(*args=(,), **kwargs={}) 1535 self = args[0] 1536 try: 1537 errors = func(*args, **kwargs) 1538 if not errors: 1539 self._logger.info('(v%s) Checker %s: Success', __version__, errors undefined func = args = (,) kwargs = {} /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in check_cassandra_keyspace_replication(self=) 1635 raise CassandraConnectionError("error, {}: {}".format( 1636 error, utils.detailed_traceback())) 1637 temp_cluster.connect() 1638 for ks_name, _ in self._db_info: 1639 if self._api_args.cluster_id: temp_cluster = temp_cluster.connect = > /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection._reconnect_internal() NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.129:9041': ConnectionResetError(104, 'Connection reset by peer')}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {'10.0.0.129:9041': ConnectionResetError(104, 'Connection reset by peer')}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to connect to any servers', {'10.0.0.129:9041': ConnectionResetError(104, 'Connection reset by peer')}) errors = {'10.0.0.129:9041': ConnectionResetError(104, 'Connection reset by peer')} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1537, in wrapper errors = func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1637, in check_cassandra_keyspace_replication temp_cluster.connect() File "cassandra/cluster.py", line 1717, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1753, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1740, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 3543, in cassandra.cluster.ControlConnection.connect File "cassandra/cluster.py", line 3588, in cassandra.cluster.ControlConnection._reconnect_internal cassandra.cluster.NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.129:9041': ConnectionResetError(104, 'Connection reset by peer')}) Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1537, in wrapper errors = func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1637, in check_cassandra_keyspace_replication temp_cluster.connect() File "cassandra/cluster.py", line 1717, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1753, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1740, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 3543, in cassandra.cluster.ControlConnection.connect File "cassandra/cluster.py", line 3588, in cassandra.cluster.ControlConnection._reconnect_internal cassandra.cluster.NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.129:9041': ConnectionResetError(104, 'Connection reset by peer')}) NoHostAvailable Python 3.9.21: /usr/bin/python3 Mon Oct 13 01:49:19 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/local/bin/db-manage in 3 from vnc_cfg_api_server.db_manage import main 4 if __name__ == '__main__': 5 if sys.argv[0].endswith('.exe'): 6 sys.argv[0] = sys.argv[0][:-4] 7 sys.exit(main()) sys = sys.exit = main = /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in main() 3451 verb = args.operation 3452 if 'db_%s' % (verb) in globals(): 3453 return globals()['db_%s' % (verb)](args, api_args) 3454 3455 if getattr(DatabaseChecker, verb, None): builtinglobals = verb = 'check' args = Namespace(operation='check', api_conf='/etc/cont...1024, log_file='/var/log/contrail/db_manage.log') api_args = Namespace(conf_file=['/etc/contrail/contrail-api...esh_base.SandeshConfig object at 0x7f5e6e3650a0>) /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in db_check(args=Namespace(operation='check', api_conf='/etc/cont...1024, log_file='/var/log/contrail/db_manage.log'), api_args=Namespace(conf_file=['/etc/contrail/contrail-api...esh_base.SandeshConfig object at 0x7f5e6e3650a0>)) 3358 # Mode and node count check across all nodes 3359 db_checker.check_zk_mode_and_node_count() 3360 db_checker.check_cassandra_keyspace_replication() 3361 # Obj UUID cassandra inconsistencies 3362 db_checker.check_obj_mandatory_fields() db_checker = db_checker.check_cassandra_keyspace_replication = > /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in wrapper(*args=(,), **kwargs={}) 1535 self = args[0] 1536 try: 1537 errors = func(*args, **kwargs) 1538 if not errors: 1539 self._logger.info('(v%s) Checker %s: Success', __version__, errors undefined func = args = (,) kwargs = {} /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in check_cassandra_keyspace_replication(self=) 1635 raise CassandraConnectionError("error, {}: {}".format( 1636 error, utils.detailed_traceback())) 1637 temp_cluster.connect() 1638 for ks_name, _ in self._db_info: 1639 if self._api_args.cluster_id: temp_cluster = temp_cluster.connect = > /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection._reconnect_internal() NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.129:9041': ConnectionResetError(104, 'Connection reset by peer')}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {'10.0.0.129:9041': ConnectionResetError(104, 'Connection reset by peer')}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to connect to any servers', {'10.0.0.129:9041': ConnectionResetError(104, 'Connection reset by peer')}) errors = {'10.0.0.129:9041': ConnectionResetError(104, 'Connection reset by peer')} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/local/bin/db-manage", line 7, in sys.exit(main()) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 3453, in main return globals()['db_%s' % (verb)](args, api_args) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 3360, in db_check db_checker.check_cassandra_keyspace_replication() File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1537, in wrapper errors = func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1637, in check_cassandra_keyspace_replication temp_cluster.connect() File "cassandra/cluster.py", line 1717, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1753, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1740, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 3543, in cassandra.cluster.ControlConnection.connect File "cassandra/cluster.py", line 3588, in cassandra.cluster.ControlConnection._reconnect_internal cassandra.cluster.NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.129:9041': ConnectionResetError(104, 'Connection reset by peer')}) 2025-10-13 01:49:19,795 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:49:20,149 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:49:20,431 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:49:20,710 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:49:20,981 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:49:24,378 - INFO - admin user already present 2025-10-13 01:49:25,347 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:49:28,900 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-fvn-32553111:ctest-fvn-32553111 2025-10-13 01:49:28,948 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-fvn-32553111:ctest-fvn-32553111 2025-10-13 01:49:29,000 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-fvn-32553111:ctest-fvn-32553111 2025-10-13 01:49:31,144 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-vn1-84782413:ctest-vn1-84782413 2025-10-13 01:49:31,192 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-vn1-84782413:ctest-vn1-84782413 2025-10-13 01:49:31,240 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-vn1-84782413:ctest-vn1-84782413 2025-10-13 01:49:45,997 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f3cd9b83-00b4-409d-81ca-9e61c10b67e1 2025-10-13 01:49:46,069 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-vn1-84782413:ctest-vn1-84782413 2025-10-13 01:49:46,132 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f3cd9b83-00b4-409d-81ca-9e61c10b67e1 2025-10-13 01:50:02,205 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:02e2ed65-92d8-42bf-95fd-f360e3e76e6e 2025-10-13 01:50:02,256 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-fvn-32553111:ctest-fvn-32553111 2025-10-13 01:50:02,308 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:02e2ed65-92d8-42bf-95fd-f360e3e76e6e 2025-10-13 01:50:04,109 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f3cd9b83-00b4-409d-81ca-9e61c10b67e1 2025-10-13 01:50:04,160 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-fvn-32553111 2025-10-13 01:50:04,208 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-fvn-32553111:ctest-fvn-32553111 2025-10-13 01:50:04,264 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Inet4UcRouteReq?x=3 2025-10-13 01:50:10,421 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-vn1-84782413 2025-10-13 01:50:10,472 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-vn1-84782413:ctest-vn1-84782413 2025-10-13 01:50:10,520 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-vn1-84782413:ctest-vn1-84782413 2025-10-13 01:50:11,092 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-fvn-32553111 2025-10-13 01:50:11,141 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-fvn-32553111:ctest-fvn-32553111 2025-10-13 01:50:11,188 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-45569992:ctest-fvn-32553111:ctest-fvn-32553111 2025-10-13 01:50:11,677 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:50:15,559 - INFO - ctest-TestHeat-98127140 user already added to project 2025-10-13 01:50:15,898 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:50:16,853 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:50:24,833 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:50:32,922 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:50:36,606 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:50:39,861 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:50:40,274 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:50:49,589 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3ac90f2a-dd16-42bf-a15a-4fb0668f6c19 2025-10-13 01:50:49,637 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestPorts-52314665:ctest-vn1-01008738:ctest-vn1-01008738 2025-10-13 01:50:49,692 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3ac90f2a-dd16-42bf-a15a-4fb0668f6c19 2025-10-13 01:51:00,209 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8782fe0c-2de5-45ac-9158-3de23108d7af 2025-10-13 01:51:00,260 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestPorts-52314665:ctest-vn1-01008738:ctest-vn1-01008738 2025-10-13 01:51:00,308 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8782fe0c-2de5-45ac-9158-3de23108d7af 2025-10-13 01:51:06,598 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:51:10,488 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:51:22,773 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c224456a-c510-4e05-af6c-16e9ab9c1ca0 2025-10-13 01:51:22,829 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRouters-11701436:ctest-vn1-79224623:ctest-vn1-79224623 2025-10-13 01:51:22,880 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c224456a-c510-4e05-af6c-16e9ab9c1ca0 2025-10-13 01:51:29,249 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fade9064-2662-480b-9ac2-73dc83924de6 2025-10-13 01:51:29,296 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRouters-11701436:ctest-vn2-26425477:ctest-vn2-26425477 2025-10-13 01:51:29,352 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fade9064-2662-480b-9ac2-73dc83924de6 2025-10-13 01:51:52,410 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:51:56,537 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:52:09,886 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2bfb2b69-a15a-4b6a-a5cf-80e9d6b77bcb 2025-10-13 01:52:09,937 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRoutersBasic-45688964:ctest-vn-22177125:ctest-vn-22177125 2025-10-13 01:52:09,996 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2bfb2b69-a15a-4b6a-a5cf-80e9d6b77bcb 2025-10-13 01:52:16,369 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2771aad7-ab31-49f5-9ebf-2ec18f3f9cad 2025-10-13 01:52:16,416 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRoutersBasic-45688964:ctest-ext_vn-09637672:ctest-ext_vn-09637672 2025-10-13 01:52:16,472 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2771aad7-ab31-49f5-9ebf-2ec18f3f9cad 2025-10-13 01:52:25,334 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:52:29,600 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:52:35,644 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-99492197:ctest-vn-99492197 2025-10-13 01:52:35,692 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-99492197:ctest-vn-99492197 2025-10-13 01:52:35,741 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-99492197:ctest-vn-99492197 2025-10-13 01:52:37,012 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-85550113:ctest-vn-85550113 2025-10-13 01:52:37,064 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-85550113:ctest-vn-85550113 2025-10-13 01:52:37,116 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-85550113:ctest-vn-85550113 2025-10-13 01:52:38,200 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-85550113 2025-10-13 01:52:38,248 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-85550113:ctest-vn-85550113 2025-10-13 01:52:38,296 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-85550113:ctest-vn-85550113 2025-10-13 01:52:38,868 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-99492197 2025-10-13 01:52:38,916 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-99492197:ctest-vn-99492197 2025-10-13 01:52:38,968 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-87598214:ctest-vn-99492197:ctest-vn-99492197 2025-10-13 01:52:39,482 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:52:43,526 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:52:43,918 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:52:48,340 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-19718268:ctest-vn4-26080794:ctest-vn4-26080794 2025-10-13 01:52:48,388 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-19718268:ctest-vn4-26080794:ctest-vn4-26080794 2025-10-13 01:52:48,436 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-19718268:ctest-vn4-26080794:ctest-vn4-26080794 2025-10-13 01:52:49,213 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-19718268:ctest-vn4-26080794 2025-10-13 01:52:49,264 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-19718268:ctest-vn4-26080794:ctest-vn4-26080794 2025-10-13 01:52:49,312 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-19718268:ctest-vn4-26080794:ctest-vn4-26080794 2025-10-13 01:52:50,025 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:52:50,414 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:52:54,411 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:52:59,700 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-15109593:ctest-vn-15109593 2025-10-13 01:52:59,748 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-15109593:ctest-vn-15109593 2025-10-13 01:52:59,796 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-15109593:ctest-vn-15109593 2025-10-13 01:53:01,092 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-09240494:ctest-vn-09240494 2025-10-13 01:53:01,148 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-09240494:ctest-vn-09240494 2025-10-13 01:53:01,197 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-09240494:ctest-vn-09240494 2025-10-13 01:53:09,573 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7678ebef-8148-48bc-9600-a6d7f25e3f2c 2025-10-13 01:53:09,620 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-15109593:ctest-vn-15109593 2025-10-13 01:53:09,676 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7678ebef-8148-48bc-9600-a6d7f25e3f2c 2025-10-13 01:53:21,373 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5a50a8bb-f516-43ba-8920-375961419819 2025-10-13 01:53:21,424 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-09240494:ctest-vn-09240494 2025-10-13 01:53:21,472 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5a50a8bb-f516-43ba-8920-375961419819 2025-10-13 01:53:34,249 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-09240494 2025-10-13 01:53:34,300 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-09240494:ctest-vn-09240494 2025-10-13 01:53:34,348 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-09240494:ctest-vn-09240494 2025-10-13 01:53:34,945 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-15109593 2025-10-13 01:53:34,996 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-15109593:ctest-vn-15109593 2025-10-13 01:53:35,044 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-64046718:ctest-vn-15109593:ctest-vn-15109593 2025-10-13 01:53:35,529 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:53:39,689 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:53:51,127 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e0b5bd6d-5831-4884-8953-20f968acf530 2025-10-13 01:53:51,188 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRP-00436358:ctest-bgpaas_vn-21881767:ctest-bgpaas_vn-21881767 2025-10-13 01:53:51,241 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e0b5bd6d-5831-4884-8953-20f968acf530 2025-10-13 01:53:57,693 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f1943c32-5d3e-4891-b06e-7b730893476b 2025-10-13 01:53:57,745 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRP-00436358:ctest-bgpaas_vn-11774072:ctest-bgpaas_vn-11774072 2025-10-13 01:53:57,796 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f1943c32-5d3e-4891-b06e-7b730893476b 2025-10-13 01:53:59,640 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:54:06,818 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:54:10,878 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:54:14,444 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-mgmt_vn-15082788:ctest-mgmt_vn-15082788 2025-10-13 01:54:14,496 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-mgmt_vn-15082788:ctest-mgmt_vn-15082788 2025-10-13 01:54:14,544 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-mgmt_vn-15082788:ctest-mgmt_vn-15082788 2025-10-13 01:54:16,820 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240:ctest-left_vn-54437240 2025-10-13 01:54:16,868 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240:ctest-left_vn-54437240 2025-10-13 01:54:16,916 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240:ctest-left_vn-54437240 2025-10-13 01:54:19,128 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590:ctest-right_vn-61315590 2025-10-13 01:54:19,176 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590:ctest-right_vn-61315590 2025-10-13 01:54:19,224 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590:ctest-right_vn-61315590 2025-10-13 01:54:36,404 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f1cf4e9c-74e0-4d34-8fcb-ee69c30f30bc 2025-10-13 01:54:36,461 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-mgmt_vn-15082788:ctest-mgmt_vn-15082788 2025-10-13 01:54:36,512 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9964c9a8-c31c-4aff-aeea-892f2c91aea1 2025-10-13 01:54:36,564 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240:ctest-left_vn-54437240 2025-10-13 01:54:36,616 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e63dc3ba-58bf-4b99-9973-8a5ccdeddfe8 2025-10-13 01:54:36,668 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590:ctest-right_vn-61315590 2025-10-13 01:54:36,716 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9964c9a8-c31c-4aff-aeea-892f2c91aea1 2025-10-13 01:54:36,768 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e63dc3ba-58bf-4b99-9973-8a5ccdeddfe8 2025-10-13 01:54:36,817 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f1cf4e9c-74e0-4d34-8fcb-ee69c30f30bc 2025-10-13 01:55:14,941 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1361c869-c11e-4323-a7c9-1f9059ca65b7 2025-10-13 01:55:14,993 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240:ctest-left_vn-54437240 2025-10-13 01:55:15,050 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1361c869-c11e-4323-a7c9-1f9059ca65b7 2025-10-13 01:55:17,353 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:76d837a2-9bb8-49c9-bbf0-7c3698200e31 2025-10-13 01:55:17,404 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590:ctest-right_vn-61315590 2025-10-13 01:55:17,452 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:76d837a2-9bb8-49c9-bbf0-7c3698200e31 2025-10-13 01:55:24,169 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9964c9a8-c31c-4aff-aeea-892f2c91aea1 2025-10-13 01:55:24,220 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e63dc3ba-58bf-4b99-9973-8a5ccdeddfe8 2025-10-13 01:55:24,268 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f1cf4e9c-74e0-4d34-8fcb-ee69c30f30bc 2025-10-13 01:55:25,584 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240 2025-10-13 01:55:25,684 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9964c9a8-c31c-4aff-aeea-892f2c91aea1 2025-10-13 01:55:25,737 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-10-13 01:55:25,750 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240:ctest-left_vn-54437240 2025-10-13 01:55:25,955 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Inet4UcRouteReq?x=2 2025-10-13 01:55:26,167 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Layer2RouteReq?x=2 2025-10-13 01:55:26,184 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240 2025-10-13 01:55:26,237 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240:ctest-left_vn-54437240 2025-10-13 01:55:26,459 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Inet4UcRouteReq?x=2 2025-10-13 01:55:26,679 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Layer2RouteReq?x=2 2025-10-13 01:55:26,694 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-mgmt_vn-15082788 2025-10-13 01:55:26,744 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f1cf4e9c-74e0-4d34-8fcb-ee69c30f30bc 2025-10-13 01:55:26,793 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-10-13 01:55:26,804 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-mgmt_vn-15082788:ctest-mgmt_vn-15082788 2025-10-13 01:55:27,015 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Inet4UcRouteReq?x=4 2025-10-13 01:55:27,223 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Layer2RouteReq?x=4 2025-10-13 01:55:27,239 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-mgmt_vn-15082788 2025-10-13 01:55:27,293 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-mgmt_vn-15082788:ctest-mgmt_vn-15082788 2025-10-13 01:55:27,503 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Inet4UcRouteReq?x=4 2025-10-13 01:55:27,707 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Layer2RouteReq?x=4 2025-10-13 01:55:27,722 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590 2025-10-13 01:55:27,776 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e63dc3ba-58bf-4b99-9973-8a5ccdeddfe8 2025-10-13 01:55:27,824 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-10-13 01:55:27,837 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590:ctest-right_vn-61315590 2025-10-13 01:55:28,043 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Inet4UcRouteReq?x=3 2025-10-13 01:55:28,251 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Layer2RouteReq?x=3 2025-10-13 01:55:28,264 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590 2025-10-13 01:55:28,318 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590:ctest-right_vn-61315590 2025-10-13 01:55:28,515 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Inet4UcRouteReq?x=3 2025-10-13 01:55:28,727 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Layer2RouteReq?x=3 2025-10-13 01:55:29,483 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name= 2025-10-13 01:55:29,537 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Inet4UcRouteReq?x=5 2025-10-13 01:55:29,590 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9964c9a8-c31c-4aff-aeea-892f2c91aea1 2025-10-13 01:55:29,747 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name= 2025-10-13 01:55:29,797 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_Inet4UcRouteReq?x=6 2025-10-13 01:55:29,850 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e63dc3ba-58bf-4b99-9973-8a5ccdeddfe8 2025-10-13 01:55:37,657 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590 2025-10-13 01:55:37,708 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590:ctest-right_vn-61315590 2025-10-13 01:55:37,764 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-right_vn-61315590:ctest-right_vn-61315590 2025-10-13 01:55:38,357 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240 2025-10-13 01:55:38,404 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240:ctest-left_vn-54437240 2025-10-13 01:55:38,456 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-left_vn-54437240:ctest-left_vn-54437240 2025-10-13 01:55:39,061 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-mgmt_vn-15082788 2025-10-13 01:55:39,116 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-mgmt_vn-15082788:ctest-mgmt_vn-15082788 2025-10-13 01:55:39,164 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-59976298:ctest-mgmt_vn-15082788:ctest-mgmt_vn-15082788 2025-10-13 01:55:39,679 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:55:44,066 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:55:54,569 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:957da5fc-7629-4bbf-96e0-521c7d5a5303 2025-10-13 01:55:54,621 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestvDNSBasic0-04187609:ctest-vn1-vdns-47320747:ctest-vn1-vdns-47320747 2025-10-13 01:55:54,672 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:957da5fc-7629-4bbf-96e0-521c7d5a5303 2025-10-13 01:56:07,128 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_DnsInfo? 2025-10-13 01:56:14,558 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2c0b607b-f674-492b-a360-12c881dd0b41 2025-10-13 01:56:14,617 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestvDNSBasic0-04187609:ctest-vn1-vdns-47320747:ctest-vn1-vdns-47320747 2025-10-13 01:56:14,668 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2c0b607b-f674-492b-a360-12c881dd0b41 2025-10-13 01:56:29,125 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_DnsInfo? 2025-10-13 01:56:41,918 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:56:46,369 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:56:56,825 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7d7cd795-5be7-4106-b1b9-ddffa97f7698 2025-10-13 01:56:56,881 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVNx-52604542:ctest-vn-99148086:ctest-vn-99148086 2025-10-13 01:56:56,932 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7d7cd795-5be7-4106-b1b9-ddffa97f7698 2025-10-13 01:57:03,321 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:23522767-535b-4eb4-9a45-fcb22ef4b649 2025-10-13 01:57:03,373 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVNx-52604542:ctest-vn-99148086:ctest-vn-99148086 2025-10-13 01:57:03,428 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:23522767-535b-4eb4-9a45-fcb22ef4b649 2025-10-13 01:57:12,722 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:57:16,738 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:57:24,586 - DEBUG - [10.0.0.129]: Running cmd : docker exec --privileged -it vrouter-vrouter-agent-1 /bin/bash -c 'echo "10.0.0.129 cn-jenkins-deploy-platform-juju-os-589-1-test" >> /etc/hosts' 2025-10-13 01:57:24,714 - DEBUG - Output : 2025-10-13 01:57:25,445 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a00116eb-2a22-4da6-918f-d0f00ec983c1 2025-10-13 01:57:25,497 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-75338255:ctest-vn2_metadata-31629955:ctest-vn2_metadata-31629955 2025-10-13 01:57:25,544 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a00116eb-2a22-4da6-918f-d0f00ec983c1 2025-10-13 01:57:38,218 - DEBUG - [10.0.0.129]: Running cmd : docker exec --privileged -it vrouter-vrouter-agent-1 /bin/bash -c 'sed -i '$ d' /etc/hosts' 2025-10-13 01:57:38,391 - DEBUG - Output : sed: -e expression #1, char 1: missing command 2025-10-13 01:57:41,254 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:57:41,650 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:57:49,469 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8ba021d4-a657-4501-9d3b-f1f924f63b70 2025-10-13 01:57:49,520 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-75338255:ctest-vn-56732579:ctest-vn-56732579 2025-10-13 01:57:49,568 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8ba021d4-a657-4501-9d3b-f1f924f63b70 2025-10-13 01:58:04,998 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:58:05,382 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 01:58:12,729 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-75338255:ctest-vn-50733957:ctest-vn-50733957 2025-10-13 01:58:13,329 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4e012916-abfd-4f9e-965c-117c72b8391c 2025-10-13 01:58:13,381 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-75338255:ctest-vn-50733957:ctest-vn-50733957 2025-10-13 01:58:13,432 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4e012916-abfd-4f9e-965c-117c72b8391c 2025-10-13 01:58:23,985 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4bac89f4-7db3-45f0-922a-2052f3fed1f6 2025-10-13 01:58:24,032 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-75338255:ctest-vn-50733957:ctest-vn-50733957 2025-10-13 01:58:24,080 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4bac89f4-7db3-45f0-922a-2052f3fed1f6 2025-10-13 01:58:26,249 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:31d23427-41dc-42cb-aed8-8fa8c8ccac74 2025-10-13 01:58:26,300 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-75338255:ctest-vn-50733957:ctest-vn-50733957 2025-10-13 01:58:26,348 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:31d23427-41dc-42cb-aed8-8fa8c8ccac74 2025-10-13 01:58:44,980 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicVMVN-75338255:ctest-vn-50733957 2025-10-13 01:58:45,028 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-75338255:ctest-vn-50733957:ctest-vn-50733957 2025-10-13 01:58:45,076 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_VrfListReq?name= 2025-10-13 01:58:45,124 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_KRouteReq?x=2 2025-10-13 01:58:45,177 - DEBUG - Unable to fetch route details in vrouter for vrf index 2, Got :[] 2025-10-13 01:58:45,790 - DEBUG - Requesting: https://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-13 02:00:52,887 - INFO - Using existing project ['admin_domain', 'admin'](5fc4bc8d-4b10-4e41-99a1-5d01acfe2c8e) 2025-10-13 02:00:52,894 - INFO - ================================================================================ 2025-10-13 02:00:52,894 - INFO - STARTING TEST : test_contrail_status 2025-10-13 02:00:52,895 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-10-13 02:00:53,107 - DEBUG - Skipping xmpp flap check 2025-10-13 02:00:53,107 - INFO - Initial checks done. Running the testcase now 2025-10-13 02:00:53,107 - INFO - 2025-10-13 02:00:53,217 - INFO - 10.0.0.129 2025-10-13 02:00:53,217 - INFO - config 2025-10-13 02:00:53,276 - INFO - config-nodemgr:active 2025-10-13 02:00:53,332 - INFO - api-server:active 2025-10-13 02:00:53,383 - INFO - schema:active 2025-10-13 02:00:53,436 - INFO - svc-monitor:active 2025-10-13 02:00:53,487 - INFO - device-manager:active 2025-10-13 02:00:53,488 - INFO - config-database 2025-10-13 02:00:53,488 - INFO - config-cassandra:active 2025-10-13 02:00:53,488 - INFO - config-zookeeper:active 2025-10-13 02:00:53,488 - INFO - config-rabbitmq:active 2025-10-13 02:00:53,488 - INFO - vrouter 2025-10-13 02:00:53,540 - INFO - vrouter-nodemgr:active 2025-10-13 02:00:53,596 - INFO - agent:active 2025-10-13 02:00:53,596 - INFO - control 2025-10-13 02:00:53,652 - INFO - control-nodemgr:active 2025-10-13 02:00:53,704 - INFO - control:active 2025-10-13 02:00:53,704 - INFO - named:active 2025-10-13 02:00:53,760 - INFO - dns:active 2025-10-13 02:00:53,760 - INFO - analytics 2025-10-13 02:00:53,812 - INFO - analytics-nodemgr:active 2025-10-13 02:00:53,868 - INFO - analytics-api:active 2025-10-13 02:00:53,924 - INFO - collector:active 2025-10-13 02:00:53,924 - INFO - analytics-database 2025-10-13 02:00:53,924 - INFO - analytics-cassandra:active 2025-10-13 02:00:53,980 - INFO - analyticsdb-nodemgr:active 2025-10-13 02:00:54,032 - INFO - query-engine:active 2025-10-13 02:00:54,032 - INFO - webui 2025-10-13 02:00:54,032 - INFO - webui:active 2025-10-13 02:00:54,032 - INFO - webui-middleware:active 2025-10-13 02:00:54,032 - INFO - redis:active 2025-10-13 02:00:54,032 - INFO - analytics_snmp 2025-10-13 02:00:54,083 - INFO - snmp-collector:active 2025-10-13 02:00:54,084 - INFO - snmp-topology:active 2025-10-13 02:00:54,084 - INFO - analytics_alarm 2025-10-13 02:00:54,084 - INFO - alarmgen:active 2025-10-13 02:00:54,084 - INFO - All the contrail services are up on all nodes 2025-10-13 02:00:54,084 - INFO - contrail-status passed 2025-10-13 02:00:54,290 - DEBUG - Skipping xmpp flap check
2025-10-13 02:00:54,290 - INFO - END TEST : test_contrail_status : PASSED[0:00:02]
2025-10-13 02:00:54,291 - INFO - --------------------------------------------------------------------------------