09/16/2024 02:09:48.360 7f0091e9faf8 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/16/2024 02:09:48.360 7f0091e9faf8 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/16/2024 02:09:48.360 7f0091e9faf8 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/16/2024 02:09:48.367 7f008c34a748 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 09/16/2024 02:09:48.367 7f008c34a748 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 09/16/2024 02:09:48.368 7f008b7d7048 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 09/16/2024 02:09:48.368 7f008b7d7048 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 09/16/2024 02:09:48.369 7f008b7d7048 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/16/2024 02:09:48.369 7f008b7d7048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/16/2024 02:09:48.369 7f008b7d7048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:48.369 7f008b7d7048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/16/2024 02:09:48.369 7f008b7d7048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:48.369 7f008b7d7048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:48.370 7f008b7d7048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/16/2024 02:09:48.370 7f008b7d7048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:48.521 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 113465540226941320319554798851568208150773717406577756208039184363403720417113, 'start': '1726452587000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 12011373973917563737441246002407470190331150597026122242712227051951329112128, 'start': '1726452586000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 182952288767085689047490512794527829378375975880520741802205513898335040081, 'start': '1726452586000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 95406767146997752902171505378878690806668927618241700413951225859124310739834, 'start': '1726452587000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 103200463611037563052207882754885364070656119218139210343012015325068411341937, 'start': '1726452586000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 09/16/2024 02:09:48.658 7f0091e9faf8 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1944-1.', _node_type='Config', _instance_id='0', _timestamp=1726452588658702, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 09/16/2024 02:09:48.659 7f0091e9faf8 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1944-1.', _node_type='Config', _instance_id='0', _timestamp=1726452588659388, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1726452587000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1726452586000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1726452586000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1726452587000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1726452586000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-16 01:06:59.020380", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5463-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 09/16/2024 02:09:48.664 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:48.665 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-16 01:06:59.020380", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5463-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 09/16/2024 02:09:48.665 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:48.665 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:48.665 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/16/2024 02:09:48.665 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:48.665 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:48.665 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1726452587000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1726452586000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1726452586000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1726452587000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1726452586000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-16 01:06:59.020380", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5463-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 09/16/2024 02:09:48.666 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:52.370 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:09:52.371 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:09:52.372 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:09:52.372 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:09:52.372 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:09:52.372 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:09:52.372 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:09:52.373 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:09:52.373 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:52.373 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:09:52.373 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:52.373 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:52.373 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:09:52.373 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:56.372 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:09:57.252 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:09:57.258 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:09:57.259 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:09:57.259 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:09:57.259 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:09:57.259 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:09:57.259 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:09:57.260 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:57.260 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:09:57.260 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:57.260 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:57.260 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:09:57.260 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:57.912 7f0091e9faf8 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1944-1.', _node_type='Config', _instance_id='0', _timestamp=1726452597912156, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1726452587000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1726452586000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1726452586000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1726452587000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1726452586000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-16 01:06:59.020380", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5463-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 09/16/2024 02:09:57.912 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14806344, partition_space_available_1k=66284140, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1572, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1584, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=70636, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=163872, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50816, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=5850968, free=11221716, buffers=666740, cached=14925688, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.01, five_min_avg=2.11, fifteen_min_avg=1.3, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:09:57.912 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:57.913 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1726452587000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1726452586000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1726452586000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1726452587000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1726452586000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-16 01:06:59.020380", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5463-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 09/16/2024 02:09:57.914 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:57.914 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:09:57.914 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 14806344 partition_space_available_1k = 66284140 percentage_partition_space_used = 18 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 1572 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 1584 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 70636 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 163872 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50816 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665112 used = 5850968 free = 11221716 buffers = 666740 cached = 14925688 node_type = config-node >> system_cpu_usage = << one_min_avg = 4.01 five_min_avg = 2.11 fifteen_min_avg = 1.3 cpu_share = 0 node_type = config-node >> >> 09/16/2024 02:09:57.914 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:01.254 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:01.255 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:01.255 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:01.255 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:01.255 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:01.255 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:01.255 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:01.256 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:01.256 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:01.256 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:01.256 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:01.256 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:01.256 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:01.256 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:05.256 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:05.257 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:05.257 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:05.257 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:05.257 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:05.257 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:05.257 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:05.258 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:05.258 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:05.258 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:05.258 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:05.258 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:05.258 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:05.258 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:09.258 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:09.259 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:09.259 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:09.259 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:09.259 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:09.259 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:09.260 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:09.260 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:09.260 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:09.260 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:09.260 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:09.260 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:09.261 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:09.261 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:13.262 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:13.263 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:13.263 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:13.263 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:13.263 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:13.263 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:13.263 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:13.263 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:13.263 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:13.263 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:13.264 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:13.264 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:13.264 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:13.264 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:17.263 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:17.264 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:17.264 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:17.264 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:17.264 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:17.265 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:17.265 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:17.265 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:17.265 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:17.265 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:17.265 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:17.265 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:17.265 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:17.265 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:21.266 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:21.267 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:21.267 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:21.267 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:21.267 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:21.267 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:21.267 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:21.268 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:21.268 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:21.268 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:21.268 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:21.268 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:21.268 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:21.268 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:25.270 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:25.271 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:25.271 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:25.271 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:25.271 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:25.271 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:25.271 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:25.271 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:25.271 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:25.272 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:25.272 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:25.272 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:25.272 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:25.272 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:29.272 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:29.273 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:29.273 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:29.273 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:29.274 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:29.274 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:29.274 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:29.274 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:29.274 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:29.274 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:29.274 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:29.274 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:29.274 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:29.274 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:33.276 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:33.277 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:33.277 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:33.277 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:33.277 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:33.277 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:33.278 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:33.278 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:33.278 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:33.278 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:33.278 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:33.278 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:33.278 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:33.278 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:37.278 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:37.279 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:37.279 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:37.279 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:37.279 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:37.279 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:37.279 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:37.279 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:37.279 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:37.280 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:37.280 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:37.280 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:37.280 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:37.280 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:41.282 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:41.283 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:41.283 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:41.283 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:41.283 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:41.283 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:41.283 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:41.283 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:41.284 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:41.284 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:41.284 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:41.284 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:41.284 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:41.284 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:45.286 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:45.287 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:45.287 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:45.287 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:45.287 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:45.287 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:45.287 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:45.288 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:45.288 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:45.288 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:45.288 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:45.288 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:45.288 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:45.288 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:49.288 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:49.289 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:49.290 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:49.290 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:49.290 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:49.290 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:49.290 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:49.290 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:49.290 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:49.291 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:49.291 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:49.291 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:49.291 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:49.291 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:53.290 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:53.291 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:53.291 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:53.291 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:53.291 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:53.291 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:53.291 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:53.292 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:53.292 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:53.292 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:53.292 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:53.292 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:53.292 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:53.292 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:57.291 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:10:57.292 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:10:57.292 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:10:57.292 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:57.293 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:10:57.293 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:10:57.293 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:10:57.293 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:10:57.293 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:57.293 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:10:57.293 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:57.293 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:57.293 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:10:57.294 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:57.946 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15525448, partition_space_available_1k=65565036, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104096, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=70908, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82192, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=172852, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51136, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=6153440, free=10433288, buffers=678180, cached=15400204, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.58, five_min_avg=2.06, fifteen_min_avg=1.33, cpu_share=3.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:10:57.946 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:10:57.946 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15525448 partition_space_available_1k = 65565036 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 104096 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 70908 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 82192 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 172852 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 51136 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665112 used = 6153440 free = 10433288 buffers = 678180 cached = 15400204 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.58 five_min_avg = 2.06 fifteen_min_avg = 1.33 cpu_share = 3.25 node_type = config-node >> >> 09/16/2024 02:10:57.946 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:01.295 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:01.296 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:01.296 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:01.296 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:01.296 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:01.296 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:01.296 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:01.297 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:01.297 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:01.297 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:01.297 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:01.297 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:01.297 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:01.297 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:05.296 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:05.297 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:05.298 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:05.298 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:05.298 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:05.298 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:05.298 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:05.298 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:05.298 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:05.298 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:05.298 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:05.299 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:05.299 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:05.299 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:09.299 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:09.301 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:09.301 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:09.301 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:09.301 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:09.301 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:09.301 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:09.302 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:09.302 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:09.302 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:09.302 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:09.302 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:09.302 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:09.302 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:13.302 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:13.303 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:13.303 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:13.303 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:13.303 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:13.304 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:13.304 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:13.304 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:13.304 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:13.304 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:13.304 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:13.304 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:13.305 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:13.305 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:17.306 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:17.307 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:17.307 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:17.307 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:17.307 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:17.307 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:17.307 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:17.307 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:17.308 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:17.308 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:17.308 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:17.308 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:17.308 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:17.308 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:21.308 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:21.309 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:21.309 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:21.309 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:21.309 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:21.309 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:21.309 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:21.310 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:21.310 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:21.310 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:21.310 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:21.310 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:21.310 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:21.310 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:25.312 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:25.314 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:25.314 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:25.314 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:25.314 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:25.314 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:25.314 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:25.314 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:25.314 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:25.315 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:25.315 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:25.315 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:25.315 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:25.315 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:29.315 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:29.316 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:29.316 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:29.316 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:29.316 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:29.316 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:29.316 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:29.317 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:29.317 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:29.317 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:29.317 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:29.317 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:29.317 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:29.317 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:33.319 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:33.320 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:33.320 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:33.320 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:33.320 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:33.320 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:33.320 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:33.321 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:33.321 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:33.321 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:33.321 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:33.321 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:33.321 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:33.321 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:37.321 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:37.322 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:37.322 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:37.322 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:37.322 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:37.322 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:37.322 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:37.323 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:37.323 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:37.323 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:37.323 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:37.323 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:37.323 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:37.323 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:41.323 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:41.324 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:41.325 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:41.325 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:41.325 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:41.325 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:41.325 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:41.325 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:41.325 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:41.325 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:41.325 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:41.325 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:41.326 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:41.326 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:45.326 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:45.327 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:45.327 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:45.327 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:45.327 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:45.327 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:45.327 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:45.327 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:45.327 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:45.328 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:45.328 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:45.328 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:45.328 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:45.328 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:49.327 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:49.329 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:49.329 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:49.329 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:49.329 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:49.329 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:49.329 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:49.330 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:49.330 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:49.330 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:49.330 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:49.330 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:49.330 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:49.330 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:53.329 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:53.331 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:53.331 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:53.331 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:53.331 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:53.331 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:53.331 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:53.331 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:53.331 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:53.332 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:53.332 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:53.332 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:53.332 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:53.332 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:57.332 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:11:57.333 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:11:57.333 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:11:57.333 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:57.333 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:11:57.333 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:11:57.333 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:11:57.334 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:11:57.334 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:57.334 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:11:57.334 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:57.334 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:57.334 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:11:57.334 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:57.916 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16227816, partition_space_available_1k=64862668, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104852, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71148, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82280, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=173796, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51272, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=6419080, free=9352084, buffers=713708, cached=16180240, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.0, five_min_avg=1.98, fifteen_min_avg=1.35, cpu_share=2.62, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:11:57.916 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:11:57.917 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 16227816 partition_space_available_1k = 64862668 percentage_partition_space_used = 20 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 104852 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 71148 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 82280 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 173796 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 51272 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665112 used = 6419080 free = 9352084 buffers = 713708 cached = 16180240 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.0 five_min_avg = 1.98 fifteen_min_avg = 1.35 cpu_share = 2.62 node_type = config-node >> >> 09/16/2024 02:11:57.917 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:01.334 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:01.335 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:01.335 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:01.335 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:01.335 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:01.335 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:01.335 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:01.335 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:01.336 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:01.336 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:01.336 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:01.336 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:01.336 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:01.336 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:05.335 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:05.336 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:05.336 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:05.336 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:05.337 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:05.337 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:05.337 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:05.337 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:05.337 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:05.337 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:05.337 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:05.337 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:05.337 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:05.337 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:09.338 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:09.339 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:09.339 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:09.339 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:09.340 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:09.340 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:09.340 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:09.340 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:09.340 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:09.340 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:09.340 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:09.340 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:09.340 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:09.341 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:13.340 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:13.341 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:13.341 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:13.341 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:13.342 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:13.342 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:13.342 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:13.342 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:13.342 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:13.342 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:13.343 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:13.343 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:13.343 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:13.343 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:17.344 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:17.345 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:17.346 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:17.346 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:17.346 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:17.346 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:17.346 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:17.346 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:17.346 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:17.346 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:17.346 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:17.347 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:17.347 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:17.347 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:21.346 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:21.347 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:21.347 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:21.347 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:21.347 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:21.347 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:21.347 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:21.348 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:21.348 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:21.350 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:21.350 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:21.350 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:21.351 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:21.351 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:25.350 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:25.351 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:25.351 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:25.351 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:25.352 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:25.352 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:25.352 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:25.352 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:25.353 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:25.353 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:25.353 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:25.353 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:25.353 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:25.353 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:29.351 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:29.352 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:29.352 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:29.352 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:29.353 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:29.353 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:29.353 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:29.353 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:29.353 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:29.353 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:29.353 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:29.353 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:29.354 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:29.354 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:33.354 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:33.355 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:33.355 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:33.355 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:33.355 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:33.355 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:33.355 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:33.356 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:33.356 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:33.356 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:33.356 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:33.356 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:33.356 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:33.356 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:37.356 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:37.357 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:37.357 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:37.357 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:37.358 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:37.358 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:37.358 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:37.358 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:37.358 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:37.358 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:37.358 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:37.358 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:37.358 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:37.358 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:41.358 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:41.360 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:41.360 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:41.360 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:41.360 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:41.360 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:41.360 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:41.360 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:41.360 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:41.361 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:41.361 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:41.361 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:41.361 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:41.361 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:45.361 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:45.363 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:45.363 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:45.363 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:45.363 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:45.363 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:45.363 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:45.363 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:45.363 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:45.364 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:45.364 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:45.364 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:45.364 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:45.364 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:49.363 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:49.364 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:49.365 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:49.365 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:49.365 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:49.365 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:49.365 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:49.365 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:49.365 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:49.366 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:49.366 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:49.366 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:49.366 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:49.366 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:53.365 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:53.367 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:53.367 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:53.367 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:53.367 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:53.367 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:53.367 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:53.367 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:53.367 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:53.367 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:53.368 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:53.368 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:53.368 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:53.368 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:57.367 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:12:57.368 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:12:57.369 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:12:57.369 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:57.369 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:12:57.369 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:12:57.369 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:12:57.369 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:12:57.369 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:57.369 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:12:57.369 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:57.370 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:57.370 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:12:57.370 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:57.939 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16241780, partition_space_available_1k=64848704, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104948, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71240, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82340, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=173868, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51416, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=7746276, free=8002136, buffers=716004, cached=16200696, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.85, five_min_avg=1.94, fifteen_min_avg=1.37, cpu_share=2.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:12:57.939 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:12:57.939 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 16241780 partition_space_available_1k = 64848704 percentage_partition_space_used = 20 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 104948 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 71240 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 82340 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 173868 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 51416 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665112 used = 7746276 free = 8002136 buffers = 716004 cached = 16200696 node_type = config-node >> system_cpu_usage = << one_min_avg = 1.85 five_min_avg = 1.94 fifteen_min_avg = 1.37 cpu_share = 2.75 node_type = config-node >> >> 09/16/2024 02:12:57.939 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:13:01.371 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:13:01.372 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/16/2024 02:13:01.372 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:13:01.372 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:13:01.372 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:13:01.372 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:13:01.373 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/16/2024 02:13:01.373 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/16/2024 02:13:01.373 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:13:01.373 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/16/2024 02:13:01.373 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:13:01.373 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:13:01.374 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:13:01.374 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:13:05.376 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:13:05.377 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 09/16/2024 02:13:05.377 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:13:05.377 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:13:05.377 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:13:05.378 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:13:05.378 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/16/2024 02:13:05.378 7f008b7d7448 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/16/2024 02:13:05.378 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/16/2024 02:13:05.378 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/16/2024 02:13:05.378 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/16/2024 02:13:13.308 7f008c4bb448 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/16/2024 02:13:13.308 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 09/16/2024 02:13:13.308 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 09/16/2024 02:13:13.309 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:13:13.309 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 09/16/2024 02:13:13.309 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:13:13.309 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:13:13.309 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8100 start_time = 1726452588369218 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/16/2024 02:13:13.309 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/16/2024 02:13:17.310 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/16/2024 02:13:17.311 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 09/16/2024 02:13:17.311 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/16/2024 02:13:17.311 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:13:17.311 7f008b7d7448 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1944-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/16/2024 02:13:17.311 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/16/2024 02:13:17.311 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/16/2024 02:13:17.311 7f008b7d7448 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/16/2024 02:13:17.312 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/16/2024 02:13:17.312 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/16/2024 02:13:17.312 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/16/2024 02:13:17.318 7f008c4bb448 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 09/16/2024 02:13:17.319 7f008c4bb448 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/16/2024 02:13:17.319 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 09/16/2024 02:13:17.319 7f008b7d7448 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 09/16/2024 02:13:17.319 7f008b7d7448 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/16/2024 02:13:17.320 7f008b7d7448 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/16/2024 02:13:17.320 7f008b7d7448 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 09/16/2024 02:13:17.320 7f008b7d7148 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/16/2024 02:13:17.321 7f008b7d7148 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/16/2024 02:13:24.517 7f008c4bb448 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001297 09/16/2024 02:13:24.518 7f008c4bb448 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/16/2024 02:13:24.518 7f008b7d7148 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 09/16/2024 02:13:24.518 7f008b7d7148 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 09/16/2024 02:13:24.519 7f008b7d7148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/16/2024 02:13:24.519 7f008b7d7148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/16/2024 02:13:58.357 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17271756, partition_space_available_1k=63818728, percentage_partition_space_used=21, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=105092, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71276, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82296, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=173872, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51840, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=8940704, free=5026340, buffers=755892, cached=17942176, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.48, five_min_avg=2.42, fifteen_min_avg=1.58, cpu_share=4.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:14:58.410 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17896776, partition_space_available_1k=63193708, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=99968, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69484, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80156, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164976, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44252, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=8835648, free=20193024, buffers=762916, cached=2873524, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.4, five_min_avg=2.68, fifteen_min_avg=1.73, cpu_share=3.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:15:19.168 7f008b7d7148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/16/2024 02:15:21.106 7f008b7d7148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/16/2024 02:15:58.255 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18373328, partition_space_available_1k=62717156, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=100140, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69576, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80176, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165040, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43964, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=9575556, free=18173440, buffers=779132, cached=4136984, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.4, five_min_avg=2.54, fifteen_min_avg=1.74, cpu_share=3.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:16:28.194 7f008b7d7448 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/16/2024 02:16:58.313 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19503584, partition_space_available_1k=61586900, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103636, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69776, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80316, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165224, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44028, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10000076, free=17267184, buffers=799180, cached=4598672, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.89, five_min_avg=2.65, fifteen_min_avg=1.83, cpu_share=4.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:17:58.361 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19538668, partition_space_available_1k=61551816, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108996, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=70540, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80312, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165640, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44088, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10211296, free=16978180, buffers=799892, cached=4675744, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.86, five_min_avg=2.91, fifteen_min_avg=1.97, cpu_share=5.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:18:58.383 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19616604, partition_space_available_1k=61473880, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=116400, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71368, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80852, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=166220, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44092, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=11008036, free=16122712, buffers=800000, cached=4734364, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.27, five_min_avg=3.17, fifteen_min_avg=2.11, cpu_share=5.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:19:58.192 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19629064, partition_space_available_1k=61461420, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=120104, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71980, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81172, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=166592, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44120, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10557448, free=16540140, buffers=800048, cached=4767476, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.32, five_min_avg=3.95, fifteen_min_avg=2.47, cpu_share=3.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:20:57.977 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19654228, partition_space_available_1k=61436256, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=122740, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72180, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81348, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=166764, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44108, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=11065908, free=16008640, buffers=800260, cached=4790304, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.62, five_min_avg=3.7, fifteen_min_avg=2.47, cpu_share=4.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:21:58.287 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19681236, partition_space_available_1k=61409248, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125756, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72432, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81520, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=166996, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44124, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10590396, free=16447744, buffers=800340, cached=4826632, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.95, five_min_avg=3.79, fifteen_min_avg=2.58, cpu_share=4.62, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:22:10.403 7f008b7d7448 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/16/2024 02:22:58.259 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19786784, partition_space_available_1k=61303700, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126304, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72556, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81624, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=167112, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44120, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10444000, free=16484468, buffers=800452, cached=4936192, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.36, five_min_avg=3.68, fifteen_min_avg=2.62, cpu_share=4.12, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:23:58.272 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19803324, partition_space_available_1k=61287160, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126416, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72584, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81660, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=167160, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44124, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10483124, free=16427828, buffers=800472, cached=4953688, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.8, five_min_avg=3.46, fifteen_min_avg=2.62, cpu_share=4.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/16/2024 02:24:56.480 7f008b7d7448 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/16/2024 02:24:58.265 7f0091e9faf8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1944-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19863080, partition_space_available_1k=61227404, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126440, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72584, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81660, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=167168, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44124, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10465704, free=16275056, buffers=803532, cached=5120820, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.44, five_min_avg=3.25, fifteen_min_avg=2.6, cpu_share=3.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode')