04/03/2025 02:14:35.142 7fdc1c1e1a48 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 04/03/2025 02:14:35.142 7fdc1c1e1a48 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 04/03/2025 02:14:35.142 7fdc1c1e1a48 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 04/03/2025 02:14:35.153 7fdc1bba90f0 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 04/03/2025 02:14:35.154 7fdc1bba90f0 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 04/03/2025 02:14:35.154 7fdc1bba8a20 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 04/03/2025 02:14:35.155 7fdc1bba8a20 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 04/03/2025 02:14:35.155 7fdc1bba8a20 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 04/03/2025 02:14:35.156 7fdc1bba8a20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 04/03/2025 02:14:35.156 7fdc1bba8a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:35.156 7fdc1bba8a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 04/03/2025 02:14:35.156 7fdc1bba8a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:35.156 7fdc1bba8a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:35.157 7fdc1bba8a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 04/03/2025 02:14:35.157 7fdc1bba8a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:35.316 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 44359223206862270611110257474520813874336342790103821185049174732045711421475, 'start': '1743646473000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 64222433175837796058739676402010017273289313814003125071320122240493293871356, 'start': '1743646473000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 96808615588881334056361587663807801301237672113504875071785757251766043120758, 'start': '1743646473000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 26653892922194158241163249767238966823167564821563237099158499865428496776570, 'start': '1743646473000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 18397505333444219284007728077987251600285918354143070590800498850072861234642, 'start': '1743646473000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 04/03/2025 02:14:35.461 7fdc1c1e1a48 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3025-1.', _node_type='Config', _instance_id='0', _timestamp=1743646475461671, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 04/03/2025 02:14:35.462 7fdc1c1e1a48 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3025-1.', _node_type='Config', _instance_id='0', _timestamp=1743646475462305, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743646473000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743646473000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743646473000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743646473000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743646473000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-03 00:45:53.631874", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8445-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 04/03/2025 02:14:35.465 7fdc22d25a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:35.466 7fdc22d25a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-03 00:45:53.631874", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8445-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 04/03/2025 02:14:35.466 7fdc22d25a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:35.466 7fdc22d25a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:35.467 7fdc22d25a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 04/03/2025 02:14:35.467 7fdc22d25a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:35.467 7fdc22d25a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:35.467 7fdc22d25a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743646473000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743646473000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743646473000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743646473000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743646473000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-03 00:45:53.631874", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8445-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 04/03/2025 02:14:35.467 7fdc22d25a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:39.155 7fdc1998f2e8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:14:39.157 7fdc1998f2e8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:14:39.157 7fdc1998f2e8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:14:39.157 7fdc1998f2e8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:39.157 7fdc1998f2e8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:14:39.157 7fdc1998f2e8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:39.157 7fdc1998f2e8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:14:39.158 7fdc1998f2e8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:14:39.158 7fdc1998f2e8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:39.158 7fdc1998f2e8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:14:39.158 7fdc1998f2e8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:39.158 7fdc1998f2e8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:39.158 7fdc1998f2e8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:14:39.158 7fdc1998f2e8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:43.158 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:14:43.160 7fdc1823ed68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:14:43.160 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:14:43.160 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:43.160 7fdc1823ed68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:14:43.160 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:43.160 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:14:43.161 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:14:43.161 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:43.162 7fdc1823ed68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:14:43.162 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:43.163 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:43.163 7fdc1823ed68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:14:43.163 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:44.516 7fdc1c1e1a48 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3025-1.', _node_type='Config', _instance_id='0', _timestamp=1743646484516150, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743646473000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743646473000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743646473000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743646473000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743646473000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-03 00:45:53.631874", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8445-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 04/03/2025 02:14:44.516 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13769492, partition_space_available_1k=67320992, percentage_partition_space_used=17, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1588, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=5024, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71832, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=128716, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50892, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=6290140, free=11931556, buffers=653668, cached=13789752, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.21, five_min_avg=2.09, fifteen_min_avg=1.31, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:14:44.516 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:44.516 7fdc19aa8438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743646473000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743646473000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743646473000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743646473000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743646473000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-03 00:45:53.631874", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8445-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 04/03/2025 02:14:44.517 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:44.517 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:44.517 7fdc19aa8438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 13769492 partition_space_available_1k = 67320992 percentage_partition_space_used = 17 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 1588 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 5024 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 71832 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 128716 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50892 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665116 used = 6290140 free = 11931556 buffers = 653668 cached = 13789752 node_type = config-node >> system_cpu_usage = << one_min_avg = 3.21 five_min_avg = 2.09 fifteen_min_avg = 1.31 cpu_share = 0 node_type = config-node >> >> 04/03/2025 02:14:44.517 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:47.163 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:14:47.164 7fdc19aa8438 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:14:47.164 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:14:47.164 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:47.164 7fdc19aa8438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:14:47.164 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:47.164 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:14:47.165 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:14:47.165 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:47.165 7fdc19aa8438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:14:47.165 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:47.165 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:47.165 7fdc19aa8438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:14:47.165 7fdc19aa8438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:51.164 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:14:51.165 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:14:51.165 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:14:51.166 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:51.166 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:14:51.166 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:51.166 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:14:51.166 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:14:51.166 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:51.167 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:14:51.167 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:51.167 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:51.167 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:14:51.167 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:55.170 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:14:55.171 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:14:55.171 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:14:55.171 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:55.171 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:14:55.171 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:55.171 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:14:55.172 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:14:55.172 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:55.172 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:14:55.172 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:55.172 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:55.172 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:14:55.172 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:59.174 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:14:59.175 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:14:59.175 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:14:59.175 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:59.175 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:14:59.175 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:14:59.175 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:14:59.176 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:14:59.176 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:59.176 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:14:59.176 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:59.176 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:14:59.176 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:14:59.176 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:03.180 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:03.181 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:03.181 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:03.181 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:03.181 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:03.181 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:03.181 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:03.182 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:03.182 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:03.182 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:03.182 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:03.182 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:03.182 7fdc1999f390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:03.182 7fdc1999f390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:07.183 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:07.185 7fdc18249240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:07.185 7fdc18249240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:07.185 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:07.185 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:07.185 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:07.185 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:07.186 7fdc18249240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:07.186 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:07.186 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:07.186 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:07.186 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:07.186 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:07.186 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:11.186 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:11.188 7fdc18249240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:11.188 7fdc18249240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:11.188 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:11.188 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:11.188 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:11.188 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:11.189 7fdc18249240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:11.189 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:11.189 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:11.189 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:11.189 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:11.189 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:11.189 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:15.192 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:15.193 7fdc18249240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:15.193 7fdc18249240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:15.193 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:15.193 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:15.193 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:15.193 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:15.194 7fdc18249240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:15.194 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:15.194 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:15.194 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:15.194 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:15.194 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:15.194 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:19.194 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:19.195 7fdc18249240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:19.195 7fdc18249240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:19.195 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:19.195 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:19.195 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:19.195 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:19.196 7fdc18249240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:19.196 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:19.196 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:19.196 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:19.196 7fdc18249240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:19.196 7fdc18249240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:19.196 7fdc18249240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:23.198 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:23.199 7fdc18253588 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:23.199 7fdc18253588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:23.199 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:23.199 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:23.199 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:23.199 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:23.200 7fdc18253588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:23.200 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:23.200 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:23.200 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:23.200 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:23.200 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:23.200 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:27.202 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:27.203 7fdc18253588 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:27.203 7fdc18253588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:27.203 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:27.203 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:27.203 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:27.204 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:27.204 7fdc18253588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:27.204 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:27.204 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:27.204 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:27.204 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:27.205 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:27.205 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:31.208 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:31.209 7fdc18253588 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:31.210 7fdc18253588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:31.210 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:31.210 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:31.210 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:31.210 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:31.211 7fdc18253588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:31.211 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:31.211 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:31.211 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:31.211 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:31.211 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:31.211 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:35.214 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:35.215 7fdc18253588 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:35.215 7fdc18253588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:35.215 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:35.215 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:35.215 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:35.215 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:35.216 7fdc18253588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:35.216 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:35.216 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:35.216 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:35.216 7fdc18253588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:35.216 7fdc18253588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:35.216 7fdc18253588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:39.216 7fdc1824df60 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:39.218 7fdc1824df60 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:39.218 7fdc1824df60 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:39.218 7fdc1824df60 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:39.218 7fdc1824df60 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:39.218 7fdc1824df60 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:39.218 7fdc1824df60 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:39.219 7fdc1824df60 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:39.219 7fdc1824df60 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:39.219 7fdc1824df60 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:39.220 7fdc1824df60 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:39.220 7fdc1824df60 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:39.220 7fdc1824df60 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:39.221 7fdc1824df60 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:43.219 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:43.220 7fdc1823ed68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:43.221 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:43.221 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:43.221 7fdc1823ed68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:43.221 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:43.221 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:43.221 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:43.221 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:43.222 7fdc1823ed68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:43.222 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:43.222 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:43.222 7fdc1823ed68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:43.222 7fdc1823ed68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:44.499 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14507188, partition_space_available_1k=66583296, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97068, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81060, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82428, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198088, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50944, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=6566272, free=11173348, buffers=665228, cached=14260268, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.95, five_min_avg=2.21, fifteen_min_avg=1.4, cpu_share=3.12, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:15:44.499 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:44.500 7fdc1bfc1b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 14507188 partition_space_available_1k = 66583296 percentage_partition_space_used = 18 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 97068 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 81060 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 82428 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 198088 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50944 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665116 used = 6566272 free = 11173348 buffers = 665228 cached = 14260268 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.95 five_min_avg = 2.21 fifteen_min_avg = 1.4 cpu_share = 3.12 node_type = config-node >> >> 04/03/2025 02:15:44.500 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:47.224 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:47.225 7fdc1bfc1b70 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:47.225 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:47.225 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:47.225 7fdc1bfc1b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:47.226 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:47.226 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:47.226 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:47.226 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:47.226 7fdc1bfc1b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:47.226 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:47.226 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:47.226 7fdc1bfc1b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:47.226 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:51.226 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:51.227 7fdc1bfc1b70 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:51.227 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:51.227 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:51.227 7fdc1bfc1b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:51.227 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:51.227 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:51.228 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:51.228 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:51.228 7fdc1bfc1b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:51.228 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:51.228 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:51.228 7fdc1bfc1b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:51.228 7fdc1bfc1b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:55.231 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:55.233 7fdc220be048 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:55.233 7fdc220be048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:55.233 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:55.233 7fdc220be048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:55.233 7fdc220be048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:55.233 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:55.233 7fdc220be048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:55.233 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:55.234 7fdc220be048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:55.234 7fdc220be048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:55.234 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:55.234 7fdc220be048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:55.234 7fdc220be048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:59.234 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:15:59.235 7fdc220be048 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:15:59.235 7fdc220be048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:15:59.235 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:59.235 7fdc220be048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:15:59.235 7fdc220be048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:15:59.235 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:15:59.235 7fdc220be048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:15:59.235 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:59.236 7fdc220be048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:15:59.236 7fdc220be048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:59.236 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:15:59.236 7fdc220be048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:15:59.236 7fdc220be048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:03.239 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:03.240 7fdc220be048 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:03.240 7fdc220be048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:03.240 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:03.241 7fdc220be048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:03.241 7fdc220be048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:03.241 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:03.241 7fdc220be048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:03.241 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:03.241 7fdc220be048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:03.241 7fdc220be048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:03.241 7fdc220be048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:03.241 7fdc220be048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:03.242 7fdc220be048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:07.242 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:07.243 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:07.243 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:07.243 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:07.244 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:07.244 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:07.244 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:07.244 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:07.244 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:07.244 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:07.244 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:07.244 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:07.245 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:07.245 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:11.246 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:11.247 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:11.247 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:11.247 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:11.247 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:11.247 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:11.247 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:11.248 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:11.248 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:11.248 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:11.248 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:11.248 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:11.248 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:11.248 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:15.250 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:15.251 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:15.251 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:15.251 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:15.251 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:15.251 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:15.251 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:15.251 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:15.251 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:15.252 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:15.252 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:15.252 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:15.252 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:15.252 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:19.254 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:19.255 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:19.255 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:19.255 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:19.255 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:19.255 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:19.255 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:19.255 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:19.256 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:19.256 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:19.256 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:19.256 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:19.256 7fdc1825acc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:19.256 7fdc1825acc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:23.255 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:23.257 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:23.257 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:23.257 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:23.257 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:23.257 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:23.258 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:23.258 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:23.258 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:23.258 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:23.258 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:23.259 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:23.259 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:23.259 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:27.258 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:27.259 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:27.259 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:27.259 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:27.259 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:27.259 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:27.259 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:27.259 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:27.260 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:27.260 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:27.260 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:27.260 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:27.260 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:27.260 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:31.262 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:31.263 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:31.263 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:31.263 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:31.263 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:31.263 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:31.263 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:31.264 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:31.264 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:31.264 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:31.264 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:31.264 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:31.264 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:31.264 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:35.266 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:35.267 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:35.267 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:35.267 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:35.267 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:35.267 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:35.268 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:35.268 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:35.268 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:35.268 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:35.268 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:35.268 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:35.268 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:35.268 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:39.269 7fdc19985438 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:39.270 7fdc19985438 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:39.271 7fdc19985438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:39.271 7fdc19985438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:39.271 7fdc19985438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:39.271 7fdc19985438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:39.271 7fdc19985438 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:39.271 7fdc19985438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:39.272 7fdc19985438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:39.272 7fdc19985438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:39.272 7fdc19985438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:39.272 7fdc19985438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:39.272 7fdc19985438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:39.272 7fdc19985438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:43.272 7fdc1825ccc0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:43.273 7fdc1825ccc0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:43.273 7fdc1825ccc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:43.273 7fdc1825ccc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:43.273 7fdc1825ccc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:43.273 7fdc1825ccc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:43.273 7fdc1825ccc0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:43.274 7fdc1825ccc0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:43.274 7fdc1825ccc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:43.274 7fdc1825ccc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:43.274 7fdc1825ccc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:43.274 7fdc1825ccc0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:43.274 7fdc1825ccc0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:43.274 7fdc1825ccc0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:44.501 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14912812, partition_space_available_1k=66177672, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97140, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81168, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82488, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198160, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50992, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=6823716, free=10452928, buffers=677832, cached=14710640, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.23, five_min_avg=2.14, fifteen_min_avg=1.43, cpu_share=2.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:16:44.502 7fdc13c00e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:44.502 7fdc13c00e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 14912812 partition_space_available_1k = 66177672 percentage_partition_space_used = 18 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 97140 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 81168 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 82488 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 198160 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50992 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665116 used = 6823716 free = 10452928 buffers = 677832 cached = 14710640 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.23 five_min_avg = 2.14 fifteen_min_avg = 1.43 cpu_share = 2.38 node_type = config-node >> >> 04/03/2025 02:16:44.502 7fdc13c00e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:47.274 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:47.275 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:47.275 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:47.276 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:47.276 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:47.276 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:47.276 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:47.276 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:47.276 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:47.277 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:47.277 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:47.277 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:47.277 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:47.277 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:51.278 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:51.279 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:51.279 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:51.279 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:51.279 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:51.279 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:51.279 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:51.280 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:51.280 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:51.280 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:51.280 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:51.280 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:51.280 7fdc1bba9780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:51.280 7fdc1bba9780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:55.282 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:55.283 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:55.283 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:55.283 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:55.283 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:55.283 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:55.284 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:55.284 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:55.284 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:55.284 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:55.284 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:55.284 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:55.284 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:55.284 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:59.287 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:16:59.288 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:16:59.288 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:16:59.288 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:59.288 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:16:59.288 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:16:59.288 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:16:59.289 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:16:59.289 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:59.289 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:16:59.289 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:59.289 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:16:59.289 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:16:59.289 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:03.293 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:03.294 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:03.294 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:03.294 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:03.294 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:03.294 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:03.294 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:03.295 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:03.295 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:03.295 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:03.295 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:03.295 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:03.295 7fdc1824d828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:03.295 7fdc1824d828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:07.295 7fdc19985240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:07.298 7fdc19985240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:07.298 7fdc19985240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:07.298 7fdc19985240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:07.298 7fdc19985240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:07.298 7fdc19985240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:07.298 7fdc19985240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:07.298 7fdc19985240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:07.299 7fdc19985240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:07.299 7fdc19985240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:07.299 7fdc19985240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:07.299 7fdc19985240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:07.299 7fdc19985240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:07.299 7fdc19985240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:11.299 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:11.300 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:11.300 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:11.300 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:11.300 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:11.300 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:11.301 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:11.301 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:11.301 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:11.301 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:11.301 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:11.301 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:11.301 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:11.301 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:15.302 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:15.303 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:15.303 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:15.303 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:15.303 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:15.303 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:15.303 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:15.303 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:15.304 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:15.304 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:15.304 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:15.304 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:15.304 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:15.304 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:19.306 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:19.307 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:19.307 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:19.307 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:19.307 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:19.307 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:19.307 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:19.308 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:19.308 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:19.308 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:19.308 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:19.308 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:19.308 7fdc13c00ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:19.308 7fdc13c00ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:23.308 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:23.309 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:23.309 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:23.309 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:23.310 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:23.310 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:23.310 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:23.310 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:23.310 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:23.310 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:23.310 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:23.310 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:23.310 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:23.310 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:27.314 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:27.315 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:27.316 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:27.316 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:27.316 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:27.316 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:27.316 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:27.317 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:27.317 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:27.317 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:27.317 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:27.317 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:27.317 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:27.317 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:31.318 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:31.319 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:31.319 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:31.319 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:31.319 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:31.319 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:31.319 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:31.320 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:31.320 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:31.320 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:31.320 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:31.320 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:31.320 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:31.320 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:35.322 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:35.323 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:35.323 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:35.323 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:35.323 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:35.323 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:35.323 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:35.324 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:35.324 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:35.324 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:35.324 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:35.324 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:35.324 7fdc13c00d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:35.324 7fdc13c00d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:39.324 7fdc18266e10 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:39.325 7fdc18266e10 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:39.326 7fdc18266e10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:39.326 7fdc18266e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:39.326 7fdc18266e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:39.326 7fdc18266e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:39.326 7fdc18266e10 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:39.326 7fdc18266e10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:39.326 7fdc18266e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:39.326 7fdc18266e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:39.326 7fdc18266e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:39.326 7fdc18266e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:39.327 7fdc18266e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:39.327 7fdc18266e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:43.327 7fdc18266828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:43.328 7fdc18266828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:43.329 7fdc18266828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:43.329 7fdc18266828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:43.329 7fdc18266828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:43.329 7fdc18266828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:43.329 7fdc18266828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:43.329 7fdc18266828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:43.329 7fdc18266828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:43.329 7fdc18266828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:43.330 7fdc18266828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:43.330 7fdc18266828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:43.330 7fdc18266828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:43.330 7fdc18266828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:44.502 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15343188, partition_space_available_1k=65747296, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97220, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81240, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82548, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198232, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51040, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=8166016, free=8623316, buffers=691508, cached=15184276, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.9, five_min_avg=2.05, fifteen_min_avg=1.45, cpu_share=3.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:17:44.503 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:44.503 7fdc1825c630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15343188 partition_space_available_1k = 65747296 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 97220 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 81240 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 82548 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 198232 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 51040 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665116 used = 8166016 free = 8623316 buffers = 691508 cached = 15184276 node_type = config-node >> system_cpu_usage = << one_min_avg = 1.9 five_min_avg = 2.05 fifteen_min_avg = 1.45 cpu_share = 3.0 node_type = config-node >> >> 04/03/2025 02:17:44.503 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:47.332 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:47.333 7fdc1825c630 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:47.333 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:47.333 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:47.333 7fdc1825c630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:47.333 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:47.333 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:47.333 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:47.333 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:47.333 7fdc1825c630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:47.333 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:47.334 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:47.334 7fdc1825c630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:47.334 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:51.336 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:51.338 7fdc1825c630 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:51.338 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:51.338 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:51.338 7fdc1825c630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:51.338 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:51.338 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:51.339 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:51.339 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:51.339 7fdc1825c630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:51.339 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:51.339 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:51.339 7fdc1825c630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:51.339 7fdc1825c630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:55.341 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:55.342 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:55.342 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:55.342 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:55.342 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:55.343 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:55.343 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:55.343 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:55.343 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:55.343 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:55.343 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:55.343 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:55.343 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:55.344 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:59.346 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:17:59.347 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:17:59.347 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:17:59.348 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:59.348 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:17:59.348 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:17:59.348 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:17:59.348 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:17:59.349 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:59.349 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:17:59.349 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:59.349 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:17:59.349 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:17:59.349 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:03.348 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:18:03.349 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:18:03.349 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:18:03.349 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:18:03.350 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:18:03.350 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:18:03.350 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:18:03.350 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:18:03.350 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:03.351 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:18:03.351 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:03.351 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:03.351 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:18:03.351 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:07.352 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:18:07.353 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:18:07.353 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:18:07.353 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:18:07.353 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:18:07.353 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:18:07.354 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:18:07.354 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:18:07.354 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:07.354 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:18:07.354 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:07.354 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:07.354 7fdc18237eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:18:07.354 7fdc18237eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:11.354 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:18:11.355 7fdc1bbc4390 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/03/2025 02:18:11.356 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:18:11.356 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:18:11.356 7fdc1bbc4390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:18:11.356 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:18:11.356 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/03/2025 02:18:11.356 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/03/2025 02:18:11.356 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:11.356 7fdc1bbc4390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/03/2025 02:18:11.356 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:11.356 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:11.356 7fdc1bbc4390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1743646475155781 collector_name = collector_ip = 10.0.0.54:8086 collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/03/2025 02:18:11.357 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/03/2025 02:18:15.358 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/03/2025 02:18:15.359 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 04/03/2025 02:18:15.359 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/03/2025 02:18:15.359 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:18:15.359 7fdc1bbc4390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3025-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/03/2025 02:18:15.359 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/03/2025 02:18:15.359 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 04/03/2025 02:18:15.360 7fdc1bbc4390 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 04/03/2025 02:18:15.360 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 04/03/2025 02:18:15.361 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 04/03/2025 02:18:15.361 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 04/03/2025 02:18:21.705 7fdc1998f588 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 04/03/2025 02:18:21.705 7fdc1998f588 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 04/03/2025 02:18:21.706 7fdc19c52eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 04/03/2025 02:18:21.706 7fdc19c52eb8 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 04/03/2025 02:18:21.706 7fdc19c52eb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/03/2025 02:18:21.707 7fdc19c52eb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 04/03/2025 02:18:21.707 7fdc19c52eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 04/03/2025 02:18:21.707 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 04/03/2025 02:18:21.709 7fdc1bbc4390 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 04/03/2025 02:18:34.252 7fdc1998f588 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001297 04/03/2025 02:18:34.253 7fdc1998f588 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 04/03/2025 02:18:34.253 7fdc13c00438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 04/03/2025 02:18:34.253 7fdc13c00438 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 04/03/2025 02:18:34.253 7fdc13c00438 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/03/2025 02:18:34.253 7fdc13c00438 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 04/03/2025 02:18:45.131 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15814152, partition_space_available_1k=65276332, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97284, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81296, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82568, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198252, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51188, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=9249072, free=6969284, buffers=709684, cached=15737076, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.94, five_min_avg=2.27, fifteen_min_avg=1.56, cpu_share=3.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:19:45.150 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17029548, partition_space_available_1k=64060936, percentage_partition_space_used=21, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=95292, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=79872, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80820, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179756, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42076, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=9412200, free=20017092, buffers=735480, cached=2500344, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.24, five_min_avg=2.73, fifteen_min_avg=1.76, cpu_share=5.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:20:45.351 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17168884, partition_space_available_1k=63921600, percentage_partition_space_used=21, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=95416, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=79892, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80824, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179784, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42116, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=9562976, free=19432572, buffers=743268, cached=2926300, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.85, five_min_avg=3.24, fifteen_min_avg=2.0, cpu_share=5.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:20:48.717 7fdc19c52780 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/03/2025 02:20:50.965 7fdc19c52780 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/03/2025 02:21:45.258 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18632352, partition_space_available_1k=62458132, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=95432, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=79932, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80828, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179784, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42164, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=9759108, free=18009772, buffers=774056, cached=4122180, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.45, five_min_avg=3.44, fifteen_min_avg=2.15, cpu_share=3.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:21:48.935 7fdc19c52eb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/03/2025 02:22:45.363 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18681380, partition_space_available_1k=62409104, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=99484, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80168, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81004, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179980, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42184, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=10162424, free=17535600, buffers=774248, cached=4192844, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.26, five_min_avg=3.82, fifteen_min_avg=2.36, cpu_share=5.12, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:23:45.250 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18709220, partition_space_available_1k=62381264, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=105632, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81140, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81656, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180604, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42192, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=10582924, free=17068224, buffers=774648, cached=4239320, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.7, five_min_avg=3.99, fifteen_min_avg=2.51, cpu_share=5.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:24:45.364 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18802456, partition_space_available_1k=62288028, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108084, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81584, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81928, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180904, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42464, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=11247596, free=16345976, buffers=774744, cached=4296800, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.16, five_min_avg=4.3, fifteen_min_avg=2.72, cpu_share=5.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:25:45.367 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18796692, partition_space_available_1k=62293792, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=109344, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82084, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82228, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181200, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42200, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=10688288, free=16883640, buffers=774932, cached=4318256, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.02, five_min_avg=4.65, fifteen_min_avg=2.93, cpu_share=4.12, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:26:45.398 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18818668, partition_space_available_1k=62271816, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=109992, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82240, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82364, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181368, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42196, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=10438908, free=17109136, buffers=774956, cached=4342116, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.41, five_min_avg=4.94, fifteen_min_avg=3.14, cpu_share=4.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:27:45.028 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18843876, partition_space_available_1k=62246608, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=111488, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82576, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82596, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181580, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42196, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=11276632, free=16240392, buffers=775012, cached=4373080, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.09, five_min_avg=4.78, fifteen_min_avg=3.19, cpu_share=5.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:28:19.532 7fdc186e5780 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/03/2025 02:28:44.943 7fdc1c1e1a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3025-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18978000, partition_space_available_1k=62112484, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=112180, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82668, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82668, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181676, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42204, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=10208808, free=17115256, buffers=777400, cached=4563652, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.69, five_min_avg=4.39, fifteen_min_avg=3.16, cpu_share=4.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/03/2025 02:29:04.977 7fdc186d1b70 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map