09/09/2024 02:45:43.450 7fe0631baaf8 [contrail-analytics-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/09/2024 02:45:43.450 7fe0631baaf8 [contrail-analytics-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/09/2024 02:45:43.450 7fe0631baaf8 [contrail-analytics-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/09/2024 02:45:43.457 7fe05dae7748 [contrail-analytics-nodemgr] [ERROR]: Cannot write http_port 8104 to /tmp/contrail-analytics-nodemgr.0.http_port 09/09/2024 02:45:43.458 7fe05dae7748 [contrail-analytics-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8104 09/09/2024 02:45:43.458 7fe05da47048 [contrail-analytics-nodemgr] [INFO]: Processing event[EvStart] in state[none] 09/09/2024 02:45:43.459 7fe05da47048 [contrail-analytics-nodemgr] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:45:43.459 7fe05da47048 [contrail-analytics-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/09/2024 02:45:43.459 7fe05da47048 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/09/2024 02:45:43.459 7fe05da47048 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:43.460 7fe05da47048 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1869-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/09/2024 02:45:43.460 7fe05da47048 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:43.460 7fe05da47048 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:43.460 7fe05da47048 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1869-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1725849943459516 collector_name = collector_ip = collector_list = [ 10.0.0.29:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/09/2024 02:45:43.460 7fe05da47048 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:43.642 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-collector', 'group': 'contrail-collector', 'pid': 74010906484025016931595050530995347750322670583260446055858720458964276928617, 'start': '1725849941000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-analytics-api', 'group': 'contrail-analytics-api', 'pid': 101302858714472570164735042925161640569387273106794632336599194401178860862467, 'start': '1725849941000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-analytics-nodemgr', 'group': 'contrail-analytics-nodemgr', 'pid': 10440506621135551075608022939346192352401560500882706588678789361526344603628, 'start': '1725849941000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 09/09/2024 02:45:43.759 7fe0631baaf8 [contrail-analytics-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1869-1.', _node_type='Analytics', _instance_id='0', _timestamp=1725849943759110, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-analytics-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/09/2024 02:45:43.759 7fe0631baaf8 [contrail-analytics-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1869-1.', _node_type='Analytics', _instance_id='0', _timestamp=1725849943759660, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-collector', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/09/2024 02:45:43.762 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:43.763 7fe05da47448 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1869-1. build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 09/09/2024 02:45:43.763 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:43.763 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:43.763 7fe05da47448 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1869-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/09/2024 02:45:43.764 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:43.764 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:43.764 7fe05da47448 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1869-1. deleted = False process_info = [ << process_name = contrail-collector process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1725849941000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1725849941000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1725849941000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 09/09/2024 02:45:43.764 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:47.460 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:45:47.462 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Session Event: TCP Connected 09/09/2024 02:45:47.462 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:45:47.462 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:47.462 7fe05da47448 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1869-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:45:47.463 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:47.463 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/09/2024 02:45:47.463 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/09/2024 02:45:47.463 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/09/2024 02:45:47.464 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/09/2024 02:45:47.464 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/09/2024 02:45:49.518 7fe0631baaf8 [contrail-analytics-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1869-1.', _node_type='Analytics', _instance_id='0', _timestamp=1725849949518387, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-collector', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/09/2024 02:45:49.518 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16287608, partition_space_available_1k=64802876, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17584, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18636, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50884, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=7726308, free=7812076, buffers=702108, cached=16424616, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.15, five_min_avg=1.72, fifteen_min_avg=1.22, cpu_share=0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:45:49.519 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/09/2024 02:45:49.519 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/09/2024 02:45:51.224 7fe05d98c448 [contrail-analytics-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 09/09/2024 02:45:51.225 7fe05d98c448 [contrail-analytics-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/09/2024 02:45:51.225 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 09/09/2024 02:45:51.225 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 09/09/2024 02:45:51.225 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:45:51.225 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/09/2024 02:45:51.226 7fe05da47448 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 09/09/2024 02:45:51.226 7fe05da47148 [contrail-analytics-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/09/2024 02:45:51.227 7fe05da47148 [contrail-analytics-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/09/2024 02:46:02.061 7fe05d98c448 [contrail-analytics-nodemgr] [DEBUG]: Extracted sandesh length: 0000001294 09/09/2024 02:46:02.061 7fe05d98c448 [contrail-analytics-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/09/2024 02:46:02.068 7fe05da47148 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 09/09/2024 02:46:02.068 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 09/09/2024 02:46:02.071 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:46:02.071 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/09/2024 02:46:48.878 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17609356, partition_space_available_1k=63481128, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25616, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1380, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43252, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=8865028, free=20407476, buffers=734080, cached=2658524, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.4, five_min_avg=2.17, fifteen_min_avg=1.41, cpu_share=5.12, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:47:00.345 7fe05d98c248 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-analytics-api,group:contrail-analytics-api,state:PROCESS_STATE_BACKOFF 09/09/2024 02:47:47.077 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17661096, partition_space_available_1k=63429388, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=29028, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43312, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9326236, free=19640272, buffers=740320, cached=2958280, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.8, five_min_avg=2.24, fifteen_min_avg=1.48, cpu_share=4.25, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:47:52.122 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:48:04.056 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:48:16.069 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:48:28.067 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:48:40.077 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:48:46.952 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18112332, partition_space_available_1k=62978152, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32192, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43464, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9309800, free=19351784, buffers=743264, cached=3260260, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.73, five_min_avg=2.34, fifteen_min_avg=1.56, cpu_share=3.38, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:48:52.415 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:49:04.456 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:49:16.424 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:49:28.312 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:49:40.286 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:49:47.804 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18118824, partition_space_available_1k=62971660, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=34332, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43420, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9331376, free=19322848, buffers=743324, cached=3267560, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.64, five_min_avg=2.43, fifteen_min_avg=1.65, cpu_share=3.12, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:49:52.594 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:50:04.658 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:50:16.777 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:50:28.849 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:50:41.000 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:50:46.869 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18125428, partition_space_available_1k=62965056, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=37156, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43412, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9347732, free=19300064, buffers=743416, cached=3273896, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.35, five_min_avg=2.42, fifteen_min_avg=1.7, cpu_share=3.25, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:50:48.882 7fe05d98c248 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-analytics-api,group:contrail-analytics-api,state:PROCESS_STATE_RUNNING 09/09/2024 02:50:48.883 7fe05d98c248 [contrail-analytics-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1869-1.', _node_type='Analytics', _instance_id='0', _timestamp=1725850248883095, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-collector', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-api', process_state='PROCESS_STATE_RUNNING', start_count=2, stop_count=0, exit_count=0, last_start_time='1725850248883041', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/09/2024 02:50:53.485 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:51:04.111 7fe05d98c248 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-analytics-api,group:contrail-analytics-api,state:PROCESS_STATE_BACKOFF 09/09/2024 02:51:05.551 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:51:17.519 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:51:29.554 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:51:41.533 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:51:46.834 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18131816, partition_space_available_1k=62958668, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39520, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43432, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9387184, free=19254004, buffers=743492, cached=3280428, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.16, five_min_avg=2.36, fifteen_min_avg=1.72, cpu_share=3.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:51:53.960 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:52:05.905 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:52:17.845 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:52:29.939 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:52:41.923 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:52:46.839 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18138640, partition_space_available_1k=62951844, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=41180, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43448, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9381104, free=19252224, buffers=743552, cached=3288228, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.05, five_min_avg=2.29, fifteen_min_avg=1.74, cpu_share=3.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:52:54.270 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:53:06.335 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:53:18.451 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:53:30.492 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:53:42.438 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:53:46.909 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18153516, partition_space_available_1k=62936968, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42372, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43460, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9385088, free=19241048, buffers=743752, cached=3295220, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.89, five_min_avg=2.5, fifteen_min_avg=1.85, cpu_share=3.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:53:54.783 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:54:06.609 7fe05d98c248 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-analytics-api,group:contrail-analytics-api,state:PROCESS_STATE_RUNNING 09/09/2024 02:54:06.609 7fe05d98c248 [contrail-analytics-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1869-1.', _node_type='Analytics', _instance_id='0', _timestamp=1725850446609880, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-collector', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-api', process_state='PROCESS_STATE_RUNNING', start_count=3, stop_count=0, exit_count=0, last_start_time='1725850446609824', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/09/2024 02:54:06.829 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:54:18.851 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:54:21.807 7fe05d98c248 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-analytics-api,group:contrail-analytics-api,state:PROCESS_STATE_BACKOFF 09/09/2024 02:54:30.828 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:54:42.761 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:54:46.851 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18159948, partition_space_available_1k=62930536, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43464, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43476, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9476564, free=19142768, buffers=743836, cached=3301940, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.73, five_min_avg=2.51, fifteen_min_avg=1.89, cpu_share=3.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:54:54.997 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:55:06.903 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:55:18.954 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:55:30.990 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:55:42.997 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:55:46.906 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18166424, partition_space_available_1k=62924060, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43908, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43484, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9404680, free=19207428, buffers=743872, cached=3309128, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.19, five_min_avg=2.41, fifteen_min_avg=1.9, cpu_share=3.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:55:55.125 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:56:07.432 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:56:19.456 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:56:23.455 7fe05d98c248 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-analytics-api,group:contrail-analytics-api,state:PROCESS_STATE_RUNNING 09/09/2024 02:56:23.455 7fe05d98c248 [contrail-analytics-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1869-1.', _node_type='Analytics', _instance_id='0', _timestamp=1725850583455481, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-collector', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-api', process_state='PROCESS_STATE_RUNNING', start_count=4, stop_count=0, exit_count=0, last_start_time='1725850583455422', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/09/2024 02:56:31.486 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:56:38.731 7fe05d98c248 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-analytics-api,group:contrail-analytics-api,state:PROCESS_STATE_BACKOFF 09/09/2024 02:56:43.523 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:56:47.724 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18172732, partition_space_available_1k=62917752, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44208, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43488, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9454580, free=19146576, buffers=743928, cached=3320024, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.0, five_min_avg=2.33, fifteen_min_avg=1.91, cpu_share=3.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:56:55.519 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:57:07.897 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:57:19.905 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:57:31.906 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:57:43.927 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:57:46.954 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18183364, partition_space_available_1k=62907120, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44896, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43492, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9435416, free=19162408, buffers=743976, cached=3323308, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.11, five_min_avg=2.3, fifteen_min_avg=1.92, cpu_share=3.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:57:55.948 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:58:08.237 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:58:20.197 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:58:32.190 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:58:44.227 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:58:46.942 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18188640, partition_space_available_1k=62901844, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45148, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43496, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9472808, free=19118560, buffers=744024, cached=3329716, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.2, five_min_avg=2.27, fifteen_min_avg=1.93, cpu_share=3.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:58:56.254 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:59:08.536 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:59:20.492 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:59:32.483 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:59:41.244 7fe05d98c248 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-analytics-api,group:contrail-analytics-api,state:PROCESS_STATE_RUNNING 09/09/2024 02:59:41.245 7fe05d98c248 [contrail-analytics-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1869-1.', _node_type='Analytics', _instance_id='0', _timestamp=1725850781245061, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-collector', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-api', process_state='PROCESS_STATE_RUNNING', start_count=5, stop_count=0, exit_count=0, last_start_time='1725850781245006', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849941000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/09/2024 02:59:44.659 7fe05da47448 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:59:46.956 7fe0631baaf8 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1869-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18193200, partition_space_available_1k=62897284, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45856, cpu_share=0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=0, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43496, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665108, used=9495040, free=19089292, buffers=744088, cached=3336688, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.31, five_min_avg=2.27, fifteen_min_avg=1.95, cpu_share=3.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/09/2024 02:59:56.572 7fe05d98c248 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-analytics-api,group:contrail-analytics-api,state:PROCESS_STATE_BACKOFF 09/09/2024 02:59:56.657 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 02:59:58.651 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 03:00:00.616 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/09/2024 03:00:31.955 7fe05da47148 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map