12/18/2025 02:09:11.327 7fb4f68619c0 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 12/18/2025 02:09:11.327 7fb4f68619c0 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 12/18/2025 02:09:11.327 7fb4f68619c0 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 12/18/2025 02:09:11.337 7fb4f3900360 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 12/18/2025 02:09:11.337 7fb4f3900360 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 12/18/2025 02:09:11.338 7fb4f3900720 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 12/18/2025 02:09:11.339 7fb4f3900720 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 12/18/2025 02:09:11.339 7fb4f3900720 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/18/2025 02:09:11.339 7fb4f3900720 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 12/18/2025 02:09:11.339 7fb4f3900720 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:11.340 7fb4f3900720 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/18/2025 02:09:11.340 7fb4f3900720 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:11.340 7fb4f3900720 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:11.340 7fb4f3900720 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 12/18/2025 02:09:11.340 7fb4f3900720 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:11.476 7fb4f68619c0 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 90516194585160589142414087563957091056176524406782005095821518875362473503086, 'start': '1766023749000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 76983701298840916831078322405234560757848879603877603199880224432707994660939, 'start': '1766023749000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 58674968670549199825470669974479425562597295482333079525501101974463326084231, 'start': '1766023749000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 53746462065218992307909053813224758581498588720214698491841925529896394594204, 'start': '1766023750000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 92726176098167811124817151990850337998824853459331236959327687719437800705266, 'start': '1766023749000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 12/18/2025 02:09:11.513 7fb4f68619c0 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4901-1.', _node_type='Config', _instance_id='0', _timestamp=1766023751513351, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 12/18/2025 02:09:11.514 7fb4f68619c0 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4901-1.', _node_type='Config', _instance_id='0', _timestamp=1766023751513954, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1766023749000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1766023749000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1766023749000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1766023750000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1766023749000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-18 00:49:09.200950", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-13034-1.novalocal", "build-id": "v0+nightly", "build-number": "202512180007"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 12/18/2025 02:09:11.516 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:11.517 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-18 00:49:09.200950", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-13034-1.novalocal", "build-id": "v0+nightly", "build-number": "202512180007"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> >> 12/18/2025 02:09:11.517 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:11.517 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:11.517 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/18/2025 02:09:11.517 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:11.517 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:11.518 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1766023749000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1766023749000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1766023749000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1766023750000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1766023749000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-18 00:49:09.200950", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-13034-1.novalocal", "build-id": "v0+nightly", "build-number": "202512180007"}]} >> 12/18/2025 02:09:11.518 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:15.339 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:15.340 7fb4f398d2c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:15.340 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:15.340 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:15.340 7fb4f398d2c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:15.341 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:15.341 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:15.341 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:15.341 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:15.341 7fb4f398d2c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:15.341 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:15.342 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:15.342 7fb4f398d2c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:15.342 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:19.342 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:19.343 7fb4f398d2c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:19.343 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:19.343 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:19.343 7fb4f398d2c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:19.343 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:19.343 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:19.344 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:19.345 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:19.345 7fb4f398d2c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:19.345 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:19.345 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:19.346 7fb4f398d2c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:19.346 7fb4f398d2c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:20.565 7fb4f68619c0 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4901-1.', _node_type='Config', _instance_id='0', _timestamp=1766023760565069, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1766023749000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1766023749000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1766023749000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1766023750000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1766023749000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-18 00:49:09.200950", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-13034-1.novalocal", "build-id": "v0+nightly", "build-number": "202512180007"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 12/18/2025 02:09:20.565 7fb4f68619c0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14153776, partition_space_available_1k=66936708, percentage_partition_space_used=17, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2068, cpu_share=0.0, mem_res=1244, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2064, cpu_share=0.0, mem_res=1248, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=163068, cpu_share=0.0, mem_res=160620, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196608, cpu_share=0.0, mem_res=177832, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50740, cpu_share=0.0, mem_res=41428, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=6191676, free=11741844, buffers=672644, cached=14602096, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.68, five_min_avg=1.79, fifteen_min_avg=1.19, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/18/2025 02:09:20.565 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:20.566 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1766023749000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1766023749000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1766023749000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1766023750000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1766023749000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-18 00:49:09.200950", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-13034-1.novalocal", "build-id": "v0+nightly", "build-number": "202512180007"}]} >> 12/18/2025 02:09:20.566 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:20.566 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:20.566 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 14153776 partition_space_available_1k = 66936708 percentage_partition_space_used = 17 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 2068 cpu_share = 0.0 mem_res = 1244 >>contrail-schema : << mem_virt = 2064 cpu_share = 0.0 mem_res = 1248 >>contrail-svc-monitor : << mem_virt = 163068 cpu_share = 0.0 mem_res = 160620 >>contrail-device-manager : << mem_virt = 196608 cpu_share = 0.0 mem_res = 177832 >>contrail-config-nodemgr : << mem_virt = 50740 cpu_share = 0.0 mem_res = 41428 >> } system_mem_usage = << total = 32665116 used = 6191676 free = 11741844 buffers = 672644 cached = 14602096 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.68 five_min_avg = 1.79 fifteen_min_avg = 1.19 cpu_share = 0 node_type = config-node >> >> 12/18/2025 02:09:20.566 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:23.346 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:23.347 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:23.347 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:23.347 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:23.347 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:23.347 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:23.347 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:23.348 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:23.348 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:23.348 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:23.348 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:23.348 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:23.348 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:23.348 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:27.349 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:27.349 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:27.350 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:27.350 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:27.350 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:27.350 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:27.350 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:27.350 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:27.350 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:27.350 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:27.350 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:27.350 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:27.351 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:27.351 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:31.350 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:31.352 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:31.352 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:31.352 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:31.352 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:31.352 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:31.352 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:31.353 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:31.353 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:31.353 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:31.353 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:31.353 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:31.353 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:31.353 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:35.355 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:35.356 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:35.356 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:35.356 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:35.356 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:35.357 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:35.357 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:35.357 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:35.357 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:35.357 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:35.357 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:35.357 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:35.357 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:35.357 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:39.361 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:39.362 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:39.362 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:39.362 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:39.362 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:39.362 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:39.362 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:39.362 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:39.362 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:39.362 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:39.362 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:39.363 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:39.363 7fb4f39b17c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:39.363 7fb4f39b17c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:43.364 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:43.365 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:43.365 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:43.365 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:43.366 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:43.366 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:43.366 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:43.366 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:43.366 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:43.366 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:43.366 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:43.366 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:43.366 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:43.366 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:47.367 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:47.368 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:47.368 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:47.368 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:47.368 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:47.368 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:47.368 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:47.369 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:47.369 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:47.369 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:47.369 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:47.369 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:47.369 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:47.369 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:51.373 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:51.374 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:51.374 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:51.374 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:51.374 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:51.374 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:51.374 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:51.374 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:51.374 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:51.374 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:51.375 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:51.375 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:51.375 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:51.375 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:55.377 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:55.378 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:55.379 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:55.379 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:55.379 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:55.379 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:55.379 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:55.381 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:55.381 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:55.381 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:55.382 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:55.382 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:55.382 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:55.382 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:59.381 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:09:59.382 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:09:59.382 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:09:59.382 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:59.383 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:09:59.383 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:09:59.383 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:09:59.383 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:09:59.383 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:59.383 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:09:59.383 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:59.383 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:09:59.383 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:09:59.383 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:03.383 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:03.384 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:03.384 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:03.384 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:03.385 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:03.385 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:03.385 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:03.385 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:03.385 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:03.385 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:03.385 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:03.385 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:03.385 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:03.385 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:07.389 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:07.390 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:07.390 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:07.390 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:07.390 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:07.391 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:07.391 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:07.391 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:07.391 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:07.391 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:07.391 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:07.391 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:07.392 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:07.392 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:11.391 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:11.392 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:11.392 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:11.392 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:11.392 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:11.393 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:11.393 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:11.393 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:11.393 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:11.393 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:11.393 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:11.393 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:11.393 7fb4f3900e00 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:11.393 7fb4f3900e00 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:15.393 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:15.395 7fb4f39b1040 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:15.395 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:15.395 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:15.395 7fb4f39b1040 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:15.395 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:15.395 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:15.395 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:15.396 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:15.396 7fb4f39b1040 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:15.396 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:15.396 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:15.396 7fb4f39b1040 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:15.396 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:19.396 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:19.397 7fb4f39b1040 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:19.397 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:19.397 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:19.397 7fb4f39b1040 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:19.397 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:19.397 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:19.398 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:19.398 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:19.398 7fb4f39b1040 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:19.398 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:19.398 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:19.398 7fb4f39b1040 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:19.398 7fb4f39b1040 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:20.562 7fb4f68619c0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15671760, partition_space_available_1k=65418724, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183352, cpu_share=0.09, mem_res=179328, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175452, cpu_share=0.05, mem_res=172388, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164480, cpu_share=0.03, mem_res=161000, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=312700, cpu_share=0.04, mem_res=288492, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50796, cpu_share=0.01, mem_res=41428, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=6389712, free=10470684, buffers=680432, cached=15591852, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.67, five_min_avg=1.98, fifteen_min_avg=1.3, cpu_share=2.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/18/2025 02:10:20.563 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:20.563 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15671760 partition_space_available_1k = 65418724 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 183352 cpu_share = 0.09 mem_res = 179328 >>contrail-schema : << mem_virt = 175452 cpu_share = 0.05 mem_res = 172388 >>contrail-svc-monitor : << mem_virt = 164480 cpu_share = 0.03 mem_res = 161000 >>contrail-device-manager : << mem_virt = 312700 cpu_share = 0.04 mem_res = 288492 >>contrail-config-nodemgr : << mem_virt = 50796 cpu_share = 0.01 mem_res = 41428 >> } system_mem_usage = << total = 32665116 used = 6389712 free = 10470684 buffers = 680432 cached = 15591852 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.67 five_min_avg = 1.98 fifteen_min_avg = 1.3 cpu_share = 2.88 node_type = config-node >> >> 12/18/2025 02:10:20.563 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:23.399 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:23.400 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:23.400 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:23.400 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:23.400 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:23.400 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:23.401 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:23.401 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:23.401 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:23.401 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:23.401 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:23.401 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:23.401 7fb4f39b12c0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:23.401 7fb4f39b12c0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:27.401 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:27.402 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:27.402 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:27.402 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:27.402 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:27.402 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:27.402 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:27.403 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:27.403 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:27.403 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:27.403 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:27.403 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:27.403 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:27.403 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:31.403 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:31.404 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:31.404 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:31.404 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:31.404 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:31.404 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:31.405 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:31.405 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:31.405 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:31.405 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:31.405 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:31.405 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:31.405 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:31.405 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:35.407 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:35.408 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:35.408 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:35.408 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:35.408 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:35.409 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:35.409 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:35.409 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:35.409 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:35.409 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:35.409 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:35.409 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:35.409 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:35.409 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:39.411 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:39.412 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:39.412 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:39.412 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:39.413 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:39.413 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:39.413 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:39.413 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:39.413 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:39.413 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:39.413 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:39.413 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:39.414 7fb4f3900c20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:39.414 7fb4f3900c20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:43.413 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:43.414 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:43.414 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:43.414 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:43.415 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:43.415 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:43.415 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:43.415 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:43.415 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:43.415 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:43.415 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:43.415 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:43.415 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:43.415 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:47.415 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:47.416 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:47.416 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:47.416 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:47.416 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:47.416 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:47.416 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:47.417 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:47.417 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:47.417 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:47.417 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:47.417 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:47.417 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:47.417 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:51.419 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:51.420 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:51.420 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:51.420 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:51.421 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:51.421 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:51.421 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:51.421 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:51.421 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:51.421 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:51.421 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:51.421 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:51.421 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:51.421 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:55.423 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:55.424 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:55.424 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:55.424 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:55.424 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:55.424 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:55.424 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:55.425 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:55.425 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:55.425 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:55.425 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:55.425 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:55.425 7fb4f39b1360 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:55.425 7fb4f39b1360 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:59.427 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:10:59.428 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:10:59.428 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:10:59.428 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:59.428 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:10:59.428 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:10:59.428 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:10:59.429 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:10:59.429 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:59.429 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:10:59.429 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:59.429 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:10:59.429 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:10:59.429 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:03.431 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:11:03.432 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:11:03.433 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:11:03.433 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:03.433 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:11:03.433 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:03.433 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:11:03.433 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:11:03.433 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:03.433 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:11:03.433 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:03.433 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:03.433 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:11:03.434 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:07.437 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:11:07.438 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:11:07.438 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:11:07.438 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:07.438 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:11:07.439 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:07.439 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:11:07.439 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:11:07.439 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:07.439 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:11:07.439 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:07.439 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:07.440 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:11:07.440 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:11.439 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:11:11.440 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:11:11.440 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:11:11.440 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:11.440 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:11:11.441 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:11.441 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:11:11.441 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:11:11.441 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:11.441 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:11:11.442 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:11.442 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:11.442 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:11:11.442 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:15.441 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:11:15.443 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:11:15.443 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:11:15.443 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:15.443 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:11:15.443 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:15.443 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:11:15.444 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:11:15.444 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:15.444 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:11:15.444 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:15.444 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:15.444 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:11:15.444 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:19.444 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:11:19.445 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 12/18/2025 02:11:19.445 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:11:19.445 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:19.445 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:11:19.445 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:19.445 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/18/2025 02:11:19.446 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/18/2025 02:11:19.446 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:19.446 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/18/2025 02:11:19.446 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:19.446 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:19.446 7fb4f3900f40 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:11:19.446 7fb4f3900f40 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:20.562 7fb4f68619c0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16862588, partition_space_available_1k=64227896, percentage_partition_space_used=21, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183436, cpu_share=0.0, mem_res=179328, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175564, cpu_share=0.0, mem_res=172432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164544, cpu_share=0.0, mem_res=161000, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=312772, cpu_share=0.0, mem_res=288492, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50844, cpu_share=0.01, mem_res=41428, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=7870500, free=7738288, buffers=689180, cached=16835400, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.43, five_min_avg=2.06, fifteen_min_avg=1.36, cpu_share=3.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/18/2025 02:11:20.562 7fb4f39b1220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:20.562 7fb4f39b1220 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 16862588 partition_space_available_1k = 64227896 percentage_partition_space_used = 21 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 183436 cpu_share = 0.0 mem_res = 179328 >>contrail-schema : << mem_virt = 175564 cpu_share = 0.0 mem_res = 172432 >>contrail-svc-monitor : << mem_virt = 164544 cpu_share = 0.0 mem_res = 161000 >>contrail-device-manager : << mem_virt = 312772 cpu_share = 0.0 mem_res = 288492 >>contrail-config-nodemgr : << mem_virt = 50844 cpu_share = 0.01 mem_res = 41428 >> } system_mem_usage = << total = 32665116 used = 7870500 free = 7738288 buffers = 689180 cached = 16835400 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.43 five_min_avg = 2.06 fifteen_min_avg = 1.36 cpu_share = 3.0 node_type = config-node >> >> 12/18/2025 02:11:20.562 7fb4f39b1220 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:23.448 7fb4f39b1220 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:11:23.448 7fb4f39b1220 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 12/18/2025 02:11:23.449 7fb4f39b1220 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:11:23.449 7fb4f39b1220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:23.449 7fb4f39b1220 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:11:23.449 7fb4f39b1220 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:23.449 7fb4f39b1220 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 12/18/2025 02:11:23.449 7fb4f39b1220 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 12/18/2025 02:11:23.449 7fb4f39b1220 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 12/18/2025 02:11:23.450 7fb4f39b1220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/18/2025 02:11:23.450 7fb4f39b1220 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/18/2025 02:11:34.062 7fb4f39b1860 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connection Closed 12/18/2025 02:11:34.063 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 12/18/2025 02:11:34.063 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 12/18/2025 02:11:34.063 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:34.064 7fb4f46884a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 12/18/2025 02:11:34.064 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:34.065 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:34.065 7fb4f46884a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8100 start_time = 1766023751339647 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 12/18/2025 02:11:34.065 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/18/2025 02:11:38.067 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/18/2025 02:11:38.068 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 12/18/2025 02:11:38.069 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/18/2025 02:11:38.069 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:38.069 7fb4f46884a0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4901-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/18/2025 02:11:38.069 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/18/2025 02:11:38.069 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 12/18/2025 02:11:38.069 7fb4f46884a0 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 12/18/2025 02:11:38.069 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 12/18/2025 02:11:38.069 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/18/2025 02:11:38.070 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/18/2025 02:11:38.080 7fb4f39b1040 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 12/18/2025 02:11:38.089 7fb4f39b1040 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 12/18/2025 02:11:38.089 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 12/18/2025 02:11:38.090 7fb4f46884a0 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 12/18/2025 02:11:38.090 7fb4f46884a0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/18/2025 02:11:38.090 7fb4f46884a0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/18/2025 02:11:38.090 7fb4f46884a0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 12/18/2025 02:11:38.090 7fb4f3900d60 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 12/18/2025 02:11:38.091 7fb4f3900d60 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 12/18/2025 02:11:44.062 7fb4f39b1040 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 12/18/2025 02:11:44.063 7fb4f39b1040 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 12/18/2025 02:11:44.064 7fb4f39b1c20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 12/18/2025 02:11:44.064 7fb4f39b1c20 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 12/18/2025 02:11:44.064 7fb4f39b1c20 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/18/2025 02:11:44.064 7fb4f39b1c20 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/18/2025 02:12:20.571 7fb4f68619c0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18999912, partition_space_available_1k=62090572, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183528, cpu_share=0.0, mem_res=179368, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175600, cpu_share=0.0, mem_res=172480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164536, cpu_share=0.0, mem_res=160996, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=312772, cpu_share=0.0, mem_res=288488, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50828, cpu_share=0.01, mem_res=41424, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=9349048, free=3448792, buffers=723956, cached=19612516, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.52, five_min_avg=2.79, fifteen_min_avg=1.67, cpu_share=4.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/18/2025 02:13:20.604 7fb4f68619c0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19536736, partition_space_available_1k=61553748, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181424, cpu_share=0.0, mem_res=179396, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174068, cpu_share=0.0, mem_res=172480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=162640, cpu_share=0.0, mem_res=160996, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=292200, cpu_share=0.0, mem_res=288488, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43548, cpu_share=0.01, mem_res=41424, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=9391112, free=18274372, buffers=728072, cached=4740868, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.66, five_min_avg=2.86, fifteen_min_avg=1.76, cpu_share=3.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/18/2025 02:14:20.615 7fb4f68619c0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19539496, partition_space_available_1k=61550988, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181468, cpu_share=0.0, mem_res=179424, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174064, cpu_share=0.0, mem_res=172480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=162652, cpu_share=0.0, mem_res=160996, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=292216, cpu_share=0.0, mem_res=288488, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43484, cpu_share=0.01, mem_res=41424, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=9931152, free=17752172, buffers=730968, cached=4720132, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.54, five_min_avg=2.73, fifteen_min_avg=1.79, cpu_share=2.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/18/2025 02:14:25.813 7fb4f46884a0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/18/2025 02:14:38.194 7fb4f3900f40 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/18/2025 02:14:40.389 7fb4f3900f40 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/18/2025 02:15:20.603 7fb4f68619c0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19834032, partition_space_available_1k=61256452, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181644, cpu_share=0.0, mem_res=179552, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174140, cpu_share=0.0, mem_res=172544, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=162648, cpu_share=0.0, mem_res=160996, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=292224, cpu_share=0.0, mem_res=288488, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43532, cpu_share=0.01, mem_res=41424, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=10089808, free=16773588, buffers=744536, cached=5525224, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.64, five_min_avg=2.76, fifteen_min_avg=1.86, cpu_share=3.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/18/2025 02:16:20.619 7fb4f68619c0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20107900, partition_space_available_1k=60982584, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=185540, cpu_share=0.06, mem_res=182168, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175300, cpu_share=0.01, mem_res=172972, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=163408, cpu_share=0.01, mem_res=160996, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=293052, cpu_share=0.01, mem_res=288488, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43532, cpu_share=0.01, mem_res=41424, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=10223932, free=16377156, buffers=759084, cached=5772836, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.67, five_min_avg=3.22, fifteen_min_avg=2.08, cpu_share=4.62, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/18/2025 02:17:20.624 7fb4f68619c0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4901-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20156076, partition_space_available_1k=60934408, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=199756, cpu_share=0.26, mem_res=189132, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179600, cpu_share=0.05, mem_res=174356, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=167360, cpu_share=0.04, mem_res=161040, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=294940, cpu_share=0.03, mem_res=288488, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43536, cpu_share=0.01, mem_res=41424, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=10383344, free=16167580, buffers=759108, cached=5827980, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=8.04, five_min_avg=4.59, fifteen_min_avg=2.63, cpu_share=5.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 12/18/2025 02:18:10.182 7fb4f45c4ea0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map