10/30/2025 01:48:13.439 7f447d9ada00 [contrail-database-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/30/2025 01:48:13.439 7f447d9ada00 [contrail-database-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/30/2025 01:48:13.439 7f447d9ada00 [contrail-database-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/30/2025 01:48:13.448 7f447a9e6400 [contrail-database-nodemgr] [ERROR]: Cannot write http_port 8103 to /tmp/contrail-database-nodemgr.0.http_port 10/30/2025 01:48:13.448 7f447a9e6400 [contrail-database-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8103 10/30/2025 01:48:13.449 7f447a9e67c0 [contrail-database-nodemgr] [INFO]: Processing event[EvStart] in state[none] 10/30/2025 01:48:13.450 7f447a9e67c0 [contrail-database-nodemgr] [DEBUG]: Add uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:48:13.451 7f447a9e67c0 [contrail-database-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/30/2025 01:48:13.451 7f447a9e67c0 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/30/2025 01:48:13.451 7f447a9e67c0 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:13.451 7f447a9e67c0 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/30/2025 01:48:13.451 7f447a9e67c0 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:13.451 7f447a9e67c0 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:13.451 7f447a9e67c0 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1:Database:contrail-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8103 start_time = 1761788893451071 collector_name = collector_ip = collector_list = [ 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 10/30/2025 01:48:13.452 7f447a9e67c0 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:13.529 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'cassandra', 'group': 'cassandra', 'pid': 65251484261089108839272390535530138216538123871740864470908040665207861192849, 'start': '1761788891000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-query-engine', 'group': 'contrail-query-engine', 'pid': 111854195018753062004607598912703163672620907617456479155408778315160551121428, 'start': '1761788891000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-database-nodemgr', 'group': 'contrail-database-nodemgr', 'pid': 101386320739543148807902968190418767823895411753283785089592489857674457147913, 'start': '1761788891000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 10/30/2025 01:48:13.560 7f447a9e6860 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:48:13.616 7f447a9e6860 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:13.616 7f447a9e6860 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-10-30 00:56:42.728728", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12281-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = package contrail-lib is not installed installed_package_version = package contrail-lib is not installed >> 10/30/2025 01:48:13.616 7f447a9e6860 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:13.617 7f447d9ada00 [contrail-database-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-database-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1642-1', _node_type='Database', _instance_id='0', _timestamp=1761788893617014, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-database-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo'), _seqnum=0) 10/30/2025 01:48:13.617 7f447d9ada00 [contrail-database-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-database-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1642-1', _node_type='Database', _instance_id='0', _timestamp=1761788893617425, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='cassandra', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761788891000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-query-engine', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761788891000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-database-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761788891000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-10-30 00:56:42.728728", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12281-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo'), _seqnum=0) 10/30/2025 01:48:13.619 7f447a9e6860 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:13.620 7f447a9e6860 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/30/2025 01:48:13.620 7f447a9e6860 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:13.620 7f447a9e6860 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:13.620 7f447a9e6860 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 deleted = False process_info = [ << process_name = cassandra process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761788891000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-query-engine process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761788891000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-database-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761788891000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-10-30 00:56:42.728728", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12281-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} >> 10/30/2025 01:48:13.620 7f447a9e6860 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:13.834 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:48:14.032 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: Add uve in the [ObjectDatabaseInfo:DatabaseUsage] map 10/30/2025 01:48:14.033 7f447a9519a0 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:14.033 7f447a9519a0 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] DatabaseUsage: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 database_usage = [ << disk_space_used_1k = 12251996 disk_space_available_1k = 68838488 analytics_db_size_1k = 4 >>, ] >> 10/30/2025 01:48:14.033 7f447a9519a0 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:14.374 7f447d9ada00 [contrail-database-nodemgr] [ERROR]: Failed to connect to database by CQL and socket: Result: 1 10/30/2025 01:48:14.375 7f447d9ada00 [contrail-database-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-database-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1642-1', _node_type='Database', _instance_id='0', _timestamp=1761788894375040, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-database-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Cassandra state detected DOWN. Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo'), _seqnum=0) 10/30/2025 01:48:14.376 7f447a9e6ea0 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:14.376 7f447a9e6ea0 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Cassandra state detected DOWN. Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/30/2025 01:48:14.376 7f447a9e6ea0 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:15.525 7f447d9ada00 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 2 10/30/2025 01:48:17.045 7f447d9ada00 [contrail-database-nodemgr] [ERROR]: Failed to run cmd: 'nodetool -p 7200 repair -pr ContrailAnalyticsCql'. Error is: Result: 1 10/30/2025 01:48:17.450 7f447a951f40 [contrail-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/30/2025 01:48:17.452 7f447a951f40 [contrail-database-nodemgr] [INFO]: Session Event: TCP Connected 10/30/2025 01:48:17.452 7f447a951f40 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/30/2025 01:48:17.452 7f447a951f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:48:17.452 7f447a951f40 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/30/2025 01:48:17.452 7f447a951f40 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:48:17.454 7f447a951f40 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/30/2025 01:48:17.454 7f447a951f40 [contrail-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/30/2025 01:48:17.454 7f447a951f40 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/30/2025 01:48:17.454 7f447a951f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:48:17.455 7f447a951f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:48:22.095 7f447d9ada00 [contrail-database-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-database-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1642-1', _node_type='Database', _instance_id='0', _timestamp=1761788902094968, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='cassandra', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761788891000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-query-engine', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761788891000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-database-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761788891000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-10-30 00:56:42.728728", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12281-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo'), _seqnum=0) 10/30/2025 01:48:22.095 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12253116, partition_space_available_1k=68837368, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1297020, cpu_share=0.0, mem_res=1284404, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=9532, cpu_share=0.0, mem_res=5504, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54868, cpu_share=0.0, mem_res=42808, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=3113604, free=393652, buffers=420712, cached=12605976, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.37, five_min_avg=1.95, fifteen_min_avg=0.89, cpu_share=0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 01:48:22.095 7f447ac59540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:48:22.096 7f447ac59540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:48:47.454 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 10/30/2025 01:48:47.454 7f447b689540 [contrail-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 10/30/2025 01:48:47.454 7f447b689540 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 10/30/2025 01:48:47.454 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 10/30/2025 01:48:47.454 7f447b689540 [contrail-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 10/30/2025 01:48:47.454 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:47.455 7f447b689540 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 10/30/2025 01:48:47.455 7f447b689540 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:47.455 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:47.455 7f447b689540 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1:Database:contrail-database-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8103 start_time = 1761788893451071 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 10/30/2025 01:48:47.455 7f447b689540 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:48:51.457 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/30/2025 01:48:51.458 7f447b689540 [contrail-database-nodemgr] [INFO]: Session Event: TCP Connected 10/30/2025 01:48:51.458 7f447b689540 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/30/2025 01:48:51.458 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:48:51.458 7f447b689540 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/30/2025 01:48:51.459 7f447b689540 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:48:51.459 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/30/2025 01:48:51.459 7f447b689540 [contrail-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/30/2025 01:48:51.459 7f447b689540 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/30/2025 01:48:51.460 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:48:51.460 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:49:13.783 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:49:13.973 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:49:14.335 7f447d9ada00 [contrail-database-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-database-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1642-1', _node_type='Database', _instance_id='0', _timestamp=1761788954335640, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-database-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=['10.0.0.41:8086'], status='Initializing', description='Connect to ClientInit on EvTcpConnected')]), flag_infos=None, description='Collector:Collector[Connect to ClientInit on EvTcpConnected] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo'), _seqnum=0) 10/30/2025 01:49:14.337 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:49:17.180 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: Sending UVE: CassandraStatusUVE(_context='', _scope='', _module='contrail-database-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1642-1', _node_type='Database', _instance_id='0', _timestamp=1761788957179986, _versionsig=46427434, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=CassandraStatusData(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, cassandra_compaction_task=CassandraCompactionTask(pending_compaction_tasks=0), thread_pool_stats=[CassandraThreadPoolStats(pool_name='ReadStage', active=0, pending=0, all_time_blocked=0), CassandraThreadPoolStats(pool_name='CompactionExecutor', active=0, pending=0, all_time_blocked=0), CassandraThreadPoolStats(pool_name='MutationStage', active=0, pending=0, all_time_blocked=0), CassandraThreadPoolStats(pool_name='Native-Transport-Requests', active=0, pending=0, all_time_blocked=0), CassandraThreadPoolStats(pool_name='MemtableFlushWriter', active=0, pending=0, all_time_blocked=0)], _table='ObjectDatabaseInfo'), _seqnum=0) 10/30/2025 01:49:17.180 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: Add uve in the [ObjectDatabaseInfo:CassandraStatusUVE] map 10/30/2025 01:49:17.182 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:49:21.460 7f447a951860 [contrail-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 10/30/2025 01:49:21.460 7f447a951860 [contrail-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 10/30/2025 01:49:21.460 7f447a951860 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 10/30/2025 01:49:21.461 7f447a951860 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 10/30/2025 01:49:21.461 7f447a951860 [contrail-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 10/30/2025 01:49:21.461 7f447a951860 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:49:21.461 7f447a951860 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 10/30/2025 01:49:21.461 7f447a951860 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:49:21.461 7f447a951860 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:49:21.461 7f447a951860 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1:Database:contrail-database-nodemgr:0 client_info = << status = Idle successful_connections = 2 pid = 1 http_port = 8103 start_time = 1761788893451071 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 10/30/2025 01:49:21.461 7f447a951860 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:49:22.218 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12269612, partition_space_available_1k=68820872, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1291224, cpu_share=0.13, mem_res=1277600, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11592, cpu_share=0.0, mem_res=7492, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54912, cpu_share=0.01, mem_res=42836, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=3518872, free=361664, buffers=426116, cached=12227304, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.18, five_min_avg=2.03, fifteen_min_avg=0.98, cpu_share=9.5, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 01:49:22.219 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:49:22.219 7f447b689540 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 12269612 partition_space_available_1k = 68820872 percentage_partition_space_used = 15 >> } process_mem_cpu_usage = { cassandra : << mem_virt = 1291224 cpu_share = 0.13 mem_res = 1277600 >>contrail-query-engine : << mem_virt = 11592 cpu_share = 0.0 mem_res = 7492 >>contrail-database-nodemgr : << mem_virt = 54912 cpu_share = 0.01 mem_res = 42836 >> } system_mem_usage = << total = 16184208 used = 3518872 free = 361664 buffers = 426116 cached = 12227304 node_type = database-node >> system_cpu_usage = << one_min_avg = 3.18 five_min_avg = 2.03 fifteen_min_avg = 0.98 cpu_share = 9.5 node_type = database-node >> >> 10/30/2025 01:49:22.219 7f447b689540 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:49:25.464 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/30/2025 01:49:25.466 7f447b689540 [contrail-database-nodemgr] [INFO]: Session Event: TCP Connected 10/30/2025 01:49:25.466 7f447b689540 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/30/2025 01:49:25.466 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:49:25.466 7f447b689540 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/30/2025 01:49:25.466 7f447b689540 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:49:25.466 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/30/2025 01:49:25.466 7f447b689540 [contrail-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/30/2025 01:49:25.467 7f447b689540 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/30/2025 01:49:25.467 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:49:25.467 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:49:55.471 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 10/30/2025 01:49:55.471 7f447b689540 [contrail-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 10/30/2025 01:49:55.472 7f447b689540 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 10/30/2025 01:49:55.472 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 10/30/2025 01:49:55.472 7f447b689540 [contrail-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 10/30/2025 01:49:55.472 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:49:55.472 7f447b689540 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 10/30/2025 01:49:55.472 7f447b689540 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:49:55.472 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:49:55.473 7f447b689540 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1:Database:contrail-database-nodemgr:0 client_info = << status = Idle successful_connections = 3 pid = 1 http_port = 8103 start_time = 1761788893451071 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 10/30/2025 01:49:55.473 7f447b689540 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:49:59.472 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/30/2025 01:49:59.473 7f447b689540 [contrail-database-nodemgr] [INFO]: Session Event: TCP Connected 10/30/2025 01:49:59.473 7f447b689540 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/30/2025 01:49:59.473 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:49:59.473 7f447b689540 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/30/2025 01:49:59.473 7f447b689540 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:49:59.474 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/30/2025 01:49:59.474 7f447b689540 [contrail-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/30/2025 01:49:59.474 7f447b689540 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/30/2025 01:49:59.474 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:49:59.474 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:50:13.809 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:50:14.004 7f447b739f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:50:21.441 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12273920, partition_space_available_1k=68816564, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1287164, cpu_share=0.09, mem_res=1273448, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11732, cpu_share=0.0, mem_res=7632, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54972, cpu_share=0.01, mem_res=42920, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=3474808, free=482688, buffers=427732, cached=12148736, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.35, five_min_avg=2.02, fifteen_min_avg=1.04, cpu_share=4.75, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 01:50:21.442 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:50:29.474 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 10/30/2025 01:50:29.474 7f447b689540 [contrail-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 10/30/2025 01:50:29.475 7f447b689540 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 10/30/2025 01:50:29.475 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 10/30/2025 01:50:29.475 7f447b689540 [contrail-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 10/30/2025 01:50:29.475 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:50:29.475 7f447b689540 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 10/30/2025 01:50:29.475 7f447b689540 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:50:29.476 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:50:29.476 7f447b689540 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1:Database:contrail-database-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8103 start_time = 1761788893451071 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 10/30/2025 01:50:29.476 7f447b689540 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:50:33.477 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/30/2025 01:50:33.478 7f447b689540 [contrail-database-nodemgr] [INFO]: Session Event: TCP Connected 10/30/2025 01:50:33.478 7f447b689540 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/30/2025 01:50:33.478 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:50:33.479 7f447b689540 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/30/2025 01:50:33.479 7f447b689540 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:50:33.479 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/30/2025 01:50:33.479 7f447b689540 [contrail-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/30/2025 01:50:33.479 7f447b689540 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/30/2025 01:50:33.479 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:50:33.480 7f447b689540 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:50:37.125 7f447b689540 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:50:44.377 7f447b739f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:51:03.482 7f447ac59f40 [contrail-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 10/30/2025 01:51:03.482 7f447ac59f40 [contrail-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 10/30/2025 01:51:03.482 7f447ac59f40 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 10/30/2025 01:51:03.482 7f447ac59f40 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 10/30/2025 01:51:03.482 7f447ac59f40 [contrail-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 10/30/2025 01:51:03.482 7f447ac59f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:03.482 7f447ac59f40 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 10/30/2025 01:51:03.483 7f447ac59f40 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:03.483 7f447ac59f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:03.483 7f447ac59f40 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1:Database:contrail-database-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8103 start_time = 1761788893451071 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 10/30/2025 01:51:03.483 7f447ac59f40 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:04.570 7f447ac59f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:51:07.485 7f447a9e6ae0 [contrail-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/30/2025 01:51:07.486 7f447a9e6ae0 [contrail-database-nodemgr] [INFO]: Session Event: TCP Connected 10/30/2025 01:51:07.486 7f447a9e6ae0 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/30/2025 01:51:07.486 7f447a9e6ae0 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:07.486 7f447a9e6ae0 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/30/2025 01:51:07.486 7f447a9e6ae0 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:07.486 7f447a9e6ae0 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/30/2025 01:51:07.486 7f447a9e6ae0 [contrail-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/30/2025 01:51:07.487 7f447a9e6ae0 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/30/2025 01:51:07.487 7f447a9e6ae0 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:07.487 7f447a9e6ae0 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:13.983 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:51:14.316 7f447a9e6b80 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:15.165 7f447a951860 [contrail-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 10/30/2025 01:51:15.166 7f447ac59360 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 10/30/2025 01:51:15.166 7f447ac59360 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 10/30/2025 01:51:15.166 7f447ac59360 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:15.166 7f447ac59360 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 10/30/2025 01:51:15.167 7f447ac59360 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:15.167 7f447ac59360 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:15.167 7f447ac59360 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1:Database:contrail-database-nodemgr:0 client_info = << status = Idle successful_connections = 6 pid = 1 http_port = 8103 start_time = 1761788893451071 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/30/2025 01:51:15.167 7f447ac59360 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:16.325 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:51:19.167 7f447a951180 [contrail-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/30/2025 01:51:19.169 7f447a951180 [contrail-database-nodemgr] [INFO]: Session Event: TCP Connected 10/30/2025 01:51:19.169 7f447a951180 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/30/2025 01:51:19.169 7f447a951180 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:19.170 7f447a951180 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/30/2025 01:51:19.170 7f447a951180 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:19.170 7f447a951180 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/30/2025 01:51:19.170 7f447a951180 [contrail-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/30/2025 01:51:19.170 7f447a951180 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/30/2025 01:51:19.172 7f447a951180 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:19.172 7f447a951180 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:19.173 7f447a9515e0 [contrail-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 10/30/2025 01:51:19.175 7f447a951180 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 10/30/2025 01:51:19.175 7f447a951180 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 10/30/2025 01:51:19.176 7f447a951180 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:19.176 7f447a951180 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 10/30/2025 01:51:19.176 7f447a951180 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:19.176 7f447a951180 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:19.177 7f447a951180 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1:Database:contrail-database-nodemgr:0 client_info = << status = Idle successful_connections = 7 pid = 1 http_port = 8103 start_time = 1761788893451071 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/30/2025 01:51:19.177 7f447a951180 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:23.081 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12894680, partition_space_available_1k=68195804, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1329000, cpu_share=0.2, mem_res=1311860, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12988, cpu_share=0.0, mem_res=8800, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54412, cpu_share=0.01, mem_res=43008, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=5972832, free=183368, buffers=363752, cached=9973200, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.16, five_min_avg=2.95, fifteen_min_avg=1.41, cpu_share=13.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 01:51:23.081 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:23.081 7f447a9e6f40 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 12894680 partition_space_available_1k = 68195804 percentage_partition_space_used = 16 >> } process_mem_cpu_usage = { cassandra : << mem_virt = 1329000 cpu_share = 0.2 mem_res = 1311860 >>contrail-query-engine : << mem_virt = 12988 cpu_share = 0.0 mem_res = 8800 >>contrail-database-nodemgr : << mem_virt = 54412 cpu_share = 0.01 mem_res = 43008 >> } system_mem_usage = << total = 16184208 used = 5972832 free = 183368 buffers = 363752 cached = 9973200 node_type = database-node >> system_cpu_usage = << one_min_avg = 6.16 five_min_avg = 2.95 fifteen_min_avg = 1.41 cpu_share = 13.0 node_type = database-node >> >> 10/30/2025 01:51:23.081 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:23.176 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/30/2025 01:51:23.177 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Session Event: TCP Connected 10/30/2025 01:51:23.178 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/30/2025 01:51:23.178 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:23.178 7f447a9e6f40 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/30/2025 01:51:23.179 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:23.179 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/30/2025 01:51:23.179 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/30/2025 01:51:23.179 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/30/2025 01:51:23.179 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:23.179 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:23.239 7f447b689540 [contrail-database-nodemgr] [DEBUG]: Extracted sandesh length: 0000001014 10/30/2025 01:51:23.239 7f447b689540 [contrail-database-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/30/2025 01:51:23.240 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/30/2025 01:51:23.240 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 10/30/2025 01:51:23.240 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:DatabaseUsage] map 10/30/2025 01:51:23.240 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:CassandraStatusUVE] map 10/30/2025 01:51:23.240 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:51:23.240 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/30/2025 01:51:23.241 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/30/2025 01:51:23.241 7f447ac59d60 [contrail-database-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/30/2025 01:51:23.242 7f447ac59d60 [contrail-database-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/30/2025 01:51:24.091 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:51:25.043 7f447b689540 [contrail-database-nodemgr] [DEBUG]: Extracted sandesh length: 0000001579 10/30/2025 01:51:25.044 7f447b689540 [contrail-database-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/30/2025 01:51:25.044 7f447a9e6f40 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 10/30/2025 01:51:25.044 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 4 10/30/2025 01:51:25.044 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:DatabaseUsage] map 10/30/2025 01:51:25.047 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:CassandraStatusUVE] map 10/30/2025 01:51:25.048 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:51:25.048 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/30/2025 01:51:25.048 7f447ac59040 [contrail-database-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/30/2025 01:51:25.049 7f447ac59040 [contrail-database-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/30/2025 01:51:38.987 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:51:46.861 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:51:52.402 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:51:55.173 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:51:59.635 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:52:13.851 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:52:21.822 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12942076, partition_space_available_1k=68148408, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1328800, cpu_share=0.16, mem_res=1308352, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13680, cpu_share=0.0, mem_res=9460, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54148, cpu_share=0.01, mem_res=42920, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7635912, free=326244, buffers=355320, cached=8192188, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.88, five_min_avg=3.9, fifteen_min_avg=1.82, cpu_share=17.5, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 01:52:43.551 7f447a9e6f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:52:46.245 7f447ac59ea0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:52:50.302 7f447ac59ea0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:53:13.898 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:53:21.890 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12964508, partition_space_available_1k=68125976, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1379164, cpu_share=0.21, mem_res=1353032, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14016, cpu_share=0.0, mem_res=9724, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54368, cpu_share=0.01, mem_res=42964, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7697340, free=269132, buffers=364696, cached=8178440, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.74, five_min_avg=4.48, fifteen_min_avg=2.17, cpu_share=14.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 01:53:30.228 7f447b739f40 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:54:13.878 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:54:21.835 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12973076, partition_space_available_1k=68117408, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1362484, cpu_share=0.09, mem_res=1334168, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14092, cpu_share=0.0, mem_res=9724, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54360, cpu_share=0.01, mem_res=43024, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7700424, free=252904, buffers=364864, cached=8191312, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.59, five_min_avg=3.97, fifteen_min_avg=2.14, cpu_share=8.75, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 01:55:13.878 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:55:21.847 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12980128, partition_space_available_1k=68110356, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1364188, cpu_share=0.09, mem_res=1334228, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14100, cpu_share=0.0, mem_res=9724, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54324, cpu_share=0.01, mem_res=42928, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7685820, free=258840, buffers=364932, cached=8200136, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.22, five_min_avg=3.78, fifteen_min_avg=2.19, cpu_share=8.75, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 01:56:13.895 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:56:21.882 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12986808, partition_space_available_1k=68103676, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1396936, cpu_share=0.09, mem_res=1365372, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14104, cpu_share=0.0, mem_res=9724, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54236, cpu_share=0.01, mem_res=42980, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7735452, free=246632, buffers=361400, cached=8165436, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.87, five_min_avg=3.29, fifteen_min_avg=2.12, cpu_share=8.5, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 01:57:12.507 7f447ac142c0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:57:14.013 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:57:15.453 7f447abe2cc0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:57:22.291 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12997476, partition_space_available_1k=68093008, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1378500, cpu_share=0.09, mem_res=1345052, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14188, cpu_share=0.0, mem_res=9724, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54336, cpu_share=0.01, mem_res=42936, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7746948, free=283232, buffers=360760, cached=8118448, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.98, five_min_avg=3.26, fifteen_min_avg=2.17, cpu_share=9.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 01:57:41.136 7f447abe2cc0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:57:44.120 7f447abe2cc0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 01:58:13.905 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:58:21.880 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13006924, partition_space_available_1k=68083560, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1385536, cpu_share=0.08, mem_res=1350932, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13960, cpu_share=0.0, mem_res=9556, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54480, cpu_share=0.01, mem_res=43048, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7714032, free=392204, buffers=362424, cached=8041376, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.45, five_min_avg=3.38, fifteen_min_avg=2.29, cpu_share=9.5, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 01:59:13.933 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 01:59:21.910 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13016784, partition_space_available_1k=68073700, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1380064, cpu_share=0.09, mem_res=1343536, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13964, cpu_share=0.0, mem_res=9556, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54512, cpu_share=0.01, mem_res=43160, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7704944, free=374632, buffers=364196, cached=8065280, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.74, five_min_avg=3.48, fifteen_min_avg=2.39, cpu_share=10.5, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:00:14.035 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 02:00:22.796 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14269432, partition_space_available_1k=66821052, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1381884, cpu_share=0.09, mem_res=1344836, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13968, cpu_share=0.0, mem_res=9556, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54236, cpu_share=0.01, mem_res=43096, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7937936, free=280764, buffers=374464, cached=7925072, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.81, five_min_avg=3.79, fifteen_min_avg=2.56, cpu_share=13.75, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:01:13.222 7f447a9515e0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:01:13.966 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 02:01:16.936 7f447abe2cc0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:01:21.688 7f447a951220 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:01:24.039 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14286020, partition_space_available_1k=66804464, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1396972, cpu_share=0.11, mem_res=1356440, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14060, cpu_share=0.0, mem_res=9688, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54356, cpu_share=0.01, mem_res=43212, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7959936, free=311884, buffers=373392, cached=7873220, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.21, five_min_avg=3.72, fifteen_min_avg=2.61, cpu_share=10.5, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:01:59.900 7f447ac14040 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:02:13.944 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 02:02:21.927 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14314612, partition_space_available_1k=66775872, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1402540, cpu_share=0.12, mem_res=1356484, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14060, cpu_share=0.0, mem_res=9688, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54344, cpu_share=0.01, mem_res=43024, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7943512, free=302144, buffers=373964, cached=7898580, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.92, five_min_avg=4.15, fifteen_min_avg=2.83, cpu_share=10.75, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:03:13.962 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 02:03:23.401 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14322072, partition_space_available_1k=66768412, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1416264, cpu_share=0.08, mem_res=1365724, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14060, cpu_share=0.0, mem_res=9688, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54272, cpu_share=0.01, mem_res=43112, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7966912, free=282260, buffers=378560, cached=7890820, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.85, five_min_avg=3.69, fifteen_min_avg=2.76, cpu_share=11.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:04:13.969 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 02:04:21.946 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14325440, partition_space_available_1k=66765044, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1425104, cpu_share=0.08, mem_res=1372080, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14088, cpu_share=0.0, mem_res=9820, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54268, cpu_share=0.01, mem_res=43080, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7968720, free=273268, buffers=378648, cached=7898108, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.01, five_min_avg=3.31, fifteen_min_avg=2.69, cpu_share=8.25, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:05:13.997 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 02:05:23.239 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14338140, partition_space_available_1k=66752344, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1436772, cpu_share=0.09, mem_res=1380360, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14140, cpu_share=0.0, mem_res=9820, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54480, cpu_share=0.01, mem_res=43216, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8000464, free=282432, buffers=377200, cached=7857744, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.35, five_min_avg=3.38, fifteen_min_avg=2.74, cpu_share=9.25, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:06:13.986 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 02:06:21.595 7f447a9e6e00 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:06:21.978 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14394576, partition_space_available_1k=66695908, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1443872, cpu_share=0.1, mem_res=1384188, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14236, cpu_share=0.0, mem_res=9952, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54488, cpu_share=0.01, mem_res=43024, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7840260, free=352728, buffers=380624, cached=7943416, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.3, five_min_avg=3.76, fifteen_min_avg=2.92, cpu_share=10.5, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:06:25.127 7f447a951220 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:06:27.652 7f447a951220 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:06:31.593 7f447a951220 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:07:14.150 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 02:07:17.369 7f447ac142c0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:07:25.730 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14713124, partition_space_available_1k=66377360, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1447532, cpu_share=0.09, mem_res=1387604, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14332, cpu_share=0.0, mem_res=9952, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54356, cpu_share=0.01, mem_res=42988, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8012956, free=392420, buffers=383696, cached=7731764, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.95, five_min_avg=3.73, fifteen_min_avg=2.96, cpu_share=12.75, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:07:44.226 7f447ac142c0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:08:13.983 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 02:08:22.018 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14717680, partition_space_available_1k=66372804, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1448624, cpu_share=0.08, mem_res=1387460, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14348, cpu_share=0.0, mem_res=9952, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54236, cpu_share=0.01, mem_res=42976, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8025996, free=340600, buffers=387700, cached=7766604, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.63, five_min_avg=3.67, fifteen_min_avg=2.99, cpu_share=11.5, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:08:31.691 7f447ac142c0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:08:58.628 7f447abe2cc0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 10/30/2025 02:09:13.990 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 02:09:23.275 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14727772, partition_space_available_1k=66362712, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1460056, cpu_share=0.09, mem_res=1395596, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14372, cpu_share=0.0, mem_res=9952, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54208, cpu_share=0.01, mem_res=42904, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7945044, free=420860, buffers=387304, cached=7767720, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.57, five_min_avg=3.35, fifteen_min_avg=2.92, cpu_share=11.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:10:14.040 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 10/30/2025 02:10:22.021 7f447d9ada00 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14722760, partition_space_available_1k=66367724, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1463784, cpu_share=0.08, mem_res=1397592, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14268, cpu_share=0.0, mem_res=9952, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54096, cpu_share=0.01, mem_res=42812, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7863024, free=498740, buffers=388176, cached=7770680, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.37, five_min_avg=3.14, fifteen_min_avg=2.87, cpu_share=9.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 10/30/2025 02:10:29.993 7f447ac597c0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map