09/25/2025 01:25:06.587 7f418621c540 [contrail-database-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/25/2025 01:25:06.587 7f418621c540 [contrail-database-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/25/2025 01:25:06.587 7f418621c540 [contrail-database-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/25/2025 01:25:06.619 7f4183f8d4a0 [contrail-database-nodemgr] [ERROR]: Cannot write http_port 8103 to /tmp/contrail-database-nodemgr.0.http_port 09/25/2025 01:25:06.621 7f4183f8d4a0 [contrail-database-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8103 09/25/2025 01:25:06.623 7f4183f8d860 [contrail-database-nodemgr] [INFO]: Processing event[EvStart] in state[none] 09/25/2025 01:25:06.636 7f4183f8d860 [contrail-database-nodemgr] [DEBUG]: Add uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:25:06.638 7f4183f8d860 [contrail-database-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/25/2025 01:25:06.638 7f4183f8d860 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/25/2025 01:25:06.638 7f4183f8d860 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:06.638 7f4183f8d860 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1521-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/25/2025 01:25:06.638 7f4183f8d860 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:06.638 7f4183f8d860 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:06.638 7f4183f8d860 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1521-1:Database:contrail-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8103 start_time = 1758763506637972 collector_name = collector_ip = collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/25/2025 01:25:06.638 7f4183f8d860 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:06.873 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'cassandra', 'group': 'cassandra', 'pid': 87928018529063316464784785789648574697764020552801297114454409189953418384353, 'start': '1758763503000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-query-engine', 'group': 'contrail-query-engine', 'pid': 24051730479419365421475476514475412827680064252719985484313255727232941770199, 'start': '1758763503000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-database-nodemgr', 'group': 'contrail-database-nodemgr', 'pid': 111489474265969949081734713589760209430805930157909161060027626391628227223317, 'start': '1758763503000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 09/25/2025 01:25:06.990 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:06.990 7f4183f8d900 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1521-1 build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-25 00:15:10.514512", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11279-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = package contrail-lib is not installed installed_package_version = package contrail-lib is not installed >> 09/25/2025 01:25:06.990 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:06.991 7f418621c540 [contrail-database-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-database-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1521-1', _node_type='Database', _instance_id='0', _timestamp=1758763506991318, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-database-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo'), _seqnum=0) 09/25/2025 01:25:06.991 7f418621c540 [contrail-database-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-database-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1521-1', _node_type='Database', _instance_id='0', _timestamp=1758763506991635, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='cassandra', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1758763503000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-query-engine', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1758763503000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-database-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1758763503000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-25 00:15:10.514512", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11279-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo'), _seqnum=0) 09/25/2025 01:25:07.008 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:07.008 7f4183f8d900 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1521-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/25/2025 01:25:07.008 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:07.008 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:07.008 7f4183f8d900 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1521-1 deleted = False process_info = [ << process_name = cassandra process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1758763503000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-query-engine process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1758763503000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-database-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1758763503000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-25 00:15:10.514512", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11279-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} >> 09/25/2025 01:25:07.008 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:07.576 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:25:07.578 7f4183f8d900 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:25:07.991 7f418621c540 [contrail-database-nodemgr] [DEBUG]: Add uve in the [ObjectDatabaseInfo:DatabaseUsage] map 09/25/2025 01:25:07.993 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:07.993 7f4183f8d900 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] DatabaseUsage: data = << name = cn-jenkins-deploy-platform-juju-k8s-1521-1 database_usage = [ << disk_space_used_1k = 12880520 disk_space_available_1k = 68209964 analytics_db_size_1k = 4 >>, ] >> 09/25/2025 01:25:07.993 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:08.195 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to connect to database by CQL and socket: Result: 1 09/25/2025 01:25:08.197 7f418621c540 [contrail-database-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-database-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1521-1', _node_type='Database', _instance_id='0', _timestamp=1758763508197586, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-database-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Cassandra state detected DOWN. Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo'), _seqnum=0) 09/25/2025 01:25:08.199 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:08.199 7f4183f8d900 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1521-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Cassandra state detected DOWN. Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/25/2025 01:25:08.199 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/25/2025 01:25:09.198 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:25:10.494 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to run cmd: 'nodetool -p 7200 repair -pr ContrailAnalyticsCql'. Error is: Result: 1 09/25/2025 01:25:10.625 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/25/2025 01:25:10.626 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Session Event: TCP Connected 09/25/2025 01:25:10.627 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/25/2025 01:25:10.627 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/25/2025 01:25:10.627 7f4183f8d900 [contrail-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1521-1 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/25/2025 01:25:10.627 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/25/2025 01:25:10.627 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/25/2025 01:25:10.628 7f4183f8d900 [contrail-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/25/2025 01:25:10.628 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/25/2025 01:25:10.628 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/25/2025 01:25:10.629 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/25/2025 01:25:10.631 7f4183378d60 [contrail-database-nodemgr] [DEBUG]: Extracted sandesh length: 0000001014 09/25/2025 01:25:10.632 7f4183378d60 [contrail-database-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/25/2025 01:25:10.632 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 09/25/2025 01:25:10.633 7f4183f8d900 [contrail-database-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 09/25/2025 01:25:10.633 7f4183f8d900 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:DatabaseUsage] map 09/25/2025 01:25:10.633 7f4183f8d900 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:25:10.633 7f4183f8d900 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/25/2025 01:25:10.634 7f4183f8d900 [contrail-database-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 09/25/2025 01:25:10.634 7f4183f8dc20 [contrail-database-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/25/2025 01:25:10.635 7f4183f8dc20 [contrail-database-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/25/2025 01:25:15.541 7f418621c540 [contrail-database-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-database-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1521-1', _node_type='Database', _instance_id='0', _timestamp=1758763515540921, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='cassandra', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1758763503000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-query-engine', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1758763503000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-database-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1758763503000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-25 00:15:10.514512", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11279-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo'), _seqnum=0) 09/25/2025 01:25:15.541 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12886204, partition_space_available_1k=68204280, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1292120, cpu_share=0.0, mem_res=1251428, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18436, cpu_share=0.0, mem_res=5260, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53616, cpu_share=0.0, mem_res=41384, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7387280, free=203200, buffers=379940, cached=8551236, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.07, five_min_avg=3.05, fifteen_min_avg=1.47, cpu_share=0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:25:45.619 7f41835ba400 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:25:48.366 7f41835ba400 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:25:54.947 7f4183f8dea0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:26:07.401 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:26:08.781 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:26:08.781 7f418621c540 [contrail-database-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-database-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1521-1', _node_type='Database', _instance_id='0', _timestamp=1758763568781906, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-database-nodemgr', instance_id='0', state='Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=['10.0.0.50:8086'], status='Up', description='ClientInit to Established on EvSandeshCtrlMessageRecv')]), flag_infos=None, description='')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo'), _seqnum=0) 09/25/2025 01:26:11.076 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:26:16.109 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12909400, partition_space_available_1k=68181084, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1372408, cpu_share=0.33, mem_res=1322292, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21876, cpu_share=0.0, mem_res=8252, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53404, cpu_share=0.01, mem_res=41540, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7774544, free=386320, buffers=381076, cached=7983044, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.35, five_min_avg=3.42, fifteen_min_avg=1.69, cpu_share=15.25, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:26:33.849 7f4183f8db80 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:26:37.671 7f4183f8db80 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:26:40.357 7f41835baae0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:26:44.060 7f41835baae0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:26:46.842 7f41835baae0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:27:07.200 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:27:07.582 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:27:08.356 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:27:13.382 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12925708, partition_space_available_1k=68164776, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1386064, cpu_share=0.13, mem_res=1331960, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22360, cpu_share=0.0, mem_res=8912, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53492, cpu_share=0.01, mem_res=41728, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7750480, free=329380, buffers=384356, cached=8026484, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.1, five_min_avg=3.41, fifteen_min_avg=1.79, cpu_share=11.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:28:07.229 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:28:07.610 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:28:08.351 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:28:13.381 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12932124, partition_space_available_1k=68158360, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1386032, cpu_share=0.05, mem_res=1331068, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22424, cpu_share=0.0, mem_res=9044, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53436, cpu_share=0.01, mem_res=41588, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7756964, free=312704, buffers=384416, cached=8036576, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.15, five_min_avg=2.97, fifteen_min_avg=1.73, cpu_share=7.25, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:29:07.227 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:29:07.586 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:29:08.335 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:29:11.991 7f41835ba400 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:29:13.374 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12940972, partition_space_available_1k=68149512, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1391004, cpu_share=0.06, mem_res=1333716, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22492, cpu_share=0.0, mem_res=9044, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53592, cpu_share=0.01, mem_res=41736, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7804776, free=226848, buffers=388116, cached=8070740, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.09, five_min_avg=2.81, fifteen_min_avg=1.75, cpu_share=10.75, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:29:14.816 7f418401f5e0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:29:18.972 7f418401f5e0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:30:07.232 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:30:07.595 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:30:08.348 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:30:13.387 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12952216, partition_space_available_1k=68138268, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1395176, cpu_share=0.05, mem_res=1336336, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22640, cpu_share=0.0, mem_res=9176, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53824, cpu_share=0.01, mem_res=41672, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7777188, free=241196, buffers=388256, cached=8083884, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.69, five_min_avg=2.58, fifteen_min_avg=1.74, cpu_share=8.5, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:30:41.617 7f418401f5e0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:31:07.258 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:31:07.614 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:31:08.326 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:31:13.352 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12960076, partition_space_available_1k=68130408, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1398032, cpu_share=0.04, mem_res=1337356, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22704, cpu_share=0.0, mem_res=9308, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53828, cpu_share=0.01, mem_res=41672, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7771344, free=277732, buffers=387156, cached=8054348, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.31, five_min_avg=2.3, fifteen_min_avg=1.7, cpu_share=7.75, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:32:07.266 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:32:07.639 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:32:08.343 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:32:13.372 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12968500, partition_space_available_1k=68121984, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1402728, cpu_share=0.05, mem_res=1339708, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22348, cpu_share=0.0, mem_res=9000, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53920, cpu_share=0.01, mem_res=41728, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7770192, free=266492, buffers=387528, cached=8065480, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.46, five_min_avg=2.16, fifteen_min_avg=1.69, cpu_share=8.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:33:07.300 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:33:07.641 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:33:08.324 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:33:13.350 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12976916, partition_space_available_1k=68113568, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1405396, cpu_share=0.04, mem_res=1340832, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22328, cpu_share=0.0, mem_res=9000, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53948, cpu_share=0.01, mem_res=41548, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7789760, free=394008, buffers=387148, cached=7919172, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.85, five_min_avg=2.17, fifteen_min_avg=1.72, cpu_share=10.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:34:07.306 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:34:07.718 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:34:08.419 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:34:13.447 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12984768, partition_space_available_1k=68105716, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1408840, cpu_share=0.04, mem_res=1342544, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22420, cpu_share=0.0, mem_res=9000, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53820, cpu_share=0.01, mem_res=41524, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7792332, free=381200, buffers=387484, cached=7929136, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.35, five_min_avg=1.97, fifteen_min_avg=1.68, cpu_share=7.75, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:35:06.208 7f418401f5e0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:35:07.325 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:35:07.803 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:35:08.915 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:35:09.346 7f41835a8360 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:35:13.966 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13005112, partition_space_available_1k=68085372, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1411288, cpu_share=0.04, mem_res=1343324, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22524, cpu_share=0.0, mem_res=9000, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53856, cpu_share=0.01, mem_res=41780, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7896108, free=177332, buffers=388492, cached=8027848, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.25, five_min_avg=2.04, fifteen_min_avg=1.72, cpu_share=9.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:35:14.447 7f4183577d60 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:35:28.024 7f4183577d60 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:36:07.340 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:36:07.768 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:36:08.635 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:36:13.666 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14264748, partition_space_available_1k=66825736, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1409696, cpu_share=0.08, mem_res=1345956, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22224, cpu_share=0.0, mem_res=9264, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53560, cpu_share=0.01, mem_res=41796, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8004408, free=281932, buffers=403988, cached=7811708, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.86, five_min_avg=2.77, fifteen_min_avg=1.99, cpu_share=14.25, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:37:07.392 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:37:07.855 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:37:08.981 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:37:14.012 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14273764, partition_space_available_1k=66816720, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1420276, cpu_share=0.07, mem_res=1352780, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22240, cpu_share=0.0, mem_res=9264, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53620, cpu_share=0.01, mem_res=41864, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8034196, free=271632, buffers=409292, cached=7787960, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.07, five_min_avg=3.36, fifteen_min_avg=2.23, cpu_share=11.5, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:38:07.325 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:38:07.776 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:38:08.560 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:38:13.592 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14284924, partition_space_available_1k=66805560, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1433960, cpu_share=0.09, mem_res=1361244, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22192, cpu_share=0.0, mem_res=9264, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53704, cpu_share=0.01, mem_res=41548, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8059088, free=226040, buffers=409576, cached=7807824, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.5, five_min_avg=3.82, fifteen_min_avg=2.47, cpu_share=9.25, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:39:07.372 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:39:07.790 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:39:08.496 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:39:13.537 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14287952, partition_space_available_1k=66802532, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1436312, cpu_share=0.04, mem_res=1361540, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22232, cpu_share=0.0, mem_res=9264, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53760, cpu_share=0.01, mem_res=41440, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8061924, free=267576, buffers=407704, cached=7766248, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.93, five_min_avg=3.39, fifteen_min_avg=2.41, cpu_share=8.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:40:03.860 7f418401f5e0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:40:06.670 7f418401f5e0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:40:07.338 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:40:07.768 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:40:08.984 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:40:11.260 7f4183378e00 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:40:14.036 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14298652, partition_space_available_1k=66791832, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1440140, cpu_share=0.04, mem_res=1363628, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22316, cpu_share=0.0, mem_res=9396, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53864, cpu_share=0.01, mem_res=41744, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8096220, free=283964, buffers=404808, cached=7718228, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.54, five_min_avg=3.16, fifteen_min_avg=2.39, cpu_share=9.25, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:41:07.351 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:41:07.744 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:41:08.514 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:41:13.546 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14305612, partition_space_available_1k=66784872, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1446648, cpu_share=0.06, mem_res=1366928, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22368, cpu_share=0.0, mem_res=9528, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53756, cpu_share=0.01, mem_res=41668, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8091948, free=267912, buffers=406024, cached=7736928, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.34, five_min_avg=3.3, fifteen_min_avg=2.48, cpu_share=8.75, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:41:41.979 7f4183577d60 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:42:07.342 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:42:07.750 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:42:08.493 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:42:13.521 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14363240, partition_space_available_1k=66727244, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1452824, cpu_share=0.06, mem_res=1370024, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22384, cpu_share=0.0, mem_res=9528, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53868, cpu_share=0.01, mem_res=41620, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7886040, free=395716, buffers=410064, cached=7810300, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.42, five_min_avg=3.05, fifteen_min_avg=2.45, cpu_share=12.0, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:42:55.653 7f4183f8de00 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:43:07.369 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:43:08.186 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:43:09.518 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:43:14.560 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14913516, partition_space_available_1k=66176968, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1452444, cpu_share=0.04, mem_res=1373632, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22268, cpu_share=0.0, mem_res=9528, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53788, cpu_share=0.01, mem_res=41848, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8082064, free=344424, buffers=400892, cached=7681492, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.18, five_min_avg=2.92, fifteen_min_avg=2.44, cpu_share=10.75, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:43:21.762 7f41835a80e0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:43:48.686 7f41835a80e0 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:44:07.365 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:44:07.738 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:44:08.760 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:44:13.795 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14920884, partition_space_available_1k=66169600, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1455916, cpu_share=0.05, mem_res=1374864, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22196, cpu_share=0.0, mem_res=9528, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53812, cpu_share=0.01, mem_res=41844, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8238512, free=212648, buffers=398656, cached=7659308, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.48, five_min_avg=2.85, fifteen_min_avg=2.45, cpu_share=10.5, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:44:14.531 7f4183f8dc20 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:45:07.370 7f418621c540 [contrail-database-nodemgr] [DEBUG]: dir for analytics is /var/lib/cassandra/data 09/25/2025 01:45:07.771 7f418621c540 [contrail-database-nodemgr] [WARNING]: CQLSH failed, but Cassandra native transport port is open 09/25/2025 01:45:08.545 7f418621c540 [contrail-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/25/2025 01:45:13.581 7f418621c540 [contrail-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1521-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14929860, partition_space_available_1k=66160624, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1461068, cpu_share=0.05, mem_res=1377892, _EventManager__key='cassandra'), 'contrail-query-engine': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22280, cpu_share=0.0, mem_res=9528, _EventManager__key='contrail-query-engine'), 'contrail-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53872, cpu_share=0.01, mem_res=41696, _EventManager__key='contrail-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8023456, free=412448, buffers=399196, cached=7674176, node_type='database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.9, five_min_avg=2.64, fifteen_min_avg=2.4, cpu_share=8.25, node_type='database-node'), running_package_version=None, installed_package_version=None, _table='ObjectDatabaseInfo') 09/25/2025 01:45:53.466 7f4183f8db80 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:45:56.863 7f4183f8db80 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map 09/25/2025 01:46:00.114 7f4183f8db80 [contrail-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:NodeStatusUVE] map