10/23/2025 05:27:58.810 7fb3aa66edf0 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/23/2025 05:27:58.810 7fb3aa66edf0 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/23/2025 05:27:58.810 7fb3aa66edf0 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/23/2025 05:27:58.817 7fb3a4f0b548 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 10/23/2025 05:27:58.818 7fb3a4f0b548 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 10/23/2025 05:27:58.818 7fb3a4f0bd48 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 10/23/2025 05:27:58.820 7fb3a4f0bd48 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 10/23/2025 05:27:58.820 7fb3a4f0bd48 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/23/2025 05:27:58.820 7fb3a4f0bd48 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/23/2025 05:27:58.820 7fb3a4f0bd48 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:27:58.821 7fb3a4f0bd48 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/23/2025 05:27:58.821 7fb3a4f0bd48 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:27:58.821 7fb3a4f0bd48 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:27:58.821 7fb3a4f0bd48 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 10/23/2025 05:27:58.821 7fb3a4f0bd48 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:27:58.981 7fb3aa66edf0 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 94096979648137807433693814853274002280812309469019175142332410123394215125211, 'start': '1761197277000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 59814039196959821045948736606291024320641324859766237643453527851647871219961, 'start': '1761197276000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 76996131959904465296521687773371299293263073417406168406467890377927332667561, 'start': '1761197276000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 4768396625404369645542043455026537444285632498836803857442079279554701021109, 'start': '1761197277000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 113770203409173643582180661730915343789311865623385951625190473426574397634830, 'start': '1761197277000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 10/23/2025 05:27:59.115 7fb3aa66edf0 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4452-1.', _node_type='Config', _instance_id='0', _timestamp=1761197279115266, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4452-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 10/23/2025 05:27:59.116 7fb3aa66edf0 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4452-1.', _node_type='Config', _instance_id='0', _timestamp=1761197279116031, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4452-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761197277000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761197276000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761197276000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761197277000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761197277000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly.r24.1.centos", "build-time" : "2025-10-06 01:00:31.164147", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11344-1.novalocal", "build-id" : "v0+nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 10/23/2025 05:27:59.118 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:27:59.119 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. build_info = {"build-info" : [{"build-version" : "v0+nightly.r24.1.centos", "build-time" : "2025-10-06 01:00:31.164147", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11344-1.novalocal", "build-id" : "v0+nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = v0+nightly.r24.1.centos-nightly_r24.1_centos.el7 installed_package_version = v0+nightly.r24.1.centos-nightly_r24.1_centos.el7 >> 10/23/2025 05:27:59.119 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:27:59.119 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:27:59.119 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/23/2025 05:27:59.119 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:27:59.119 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:27:59.120 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761197277000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761197276000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761197276000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761197277000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761197277000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly.r24.1.centos", "build-time" : "2025-10-06 01:00:31.164147", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11344-1.novalocal", "build-id" : "v0+nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 10/23/2025 05:27:59.120 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:02.820 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:02.821 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:02.822 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:02.822 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:02.822 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:02.822 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:02.822 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:02.823 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:02.823 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:02.823 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:02.823 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:02.823 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:02.823 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:02.823 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:06.822 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:06.824 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:06.824 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:06.824 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:06.824 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:06.824 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:06.824 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:06.824 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:06.825 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:06.826 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:06.826 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:06.826 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:06.826 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:06.826 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:08.178 7fb3aa66edf0 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4452-1.', _node_type='Config', _instance_id='0', _timestamp=1761197288178721, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4452-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761197277000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761197276000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761197276000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761197277000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761197277000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly.r24.1.centos", "build-time" : "2025-10-06 01:00:31.164147", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11344-1.novalocal", "build-id" : "v0+nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 10/23/2025 05:28:08.180 7fb3aa66edf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4452-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13293300, partition_space_available_1k=67797184, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1584, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1604, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=63444, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83072, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50584, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5942868, free=323492, buffers=644812, cached=9650724, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.5, five_min_avg=2.59, fifteen_min_avg=1.45, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 10/23/2025 05:28:08.180 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:08.180 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761197277000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761197276000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761197276000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761197277000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761197277000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly.r24.1.centos", "build-time" : "2025-10-06 01:00:31.164147", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11344-1.novalocal", "build-id" : "v0+nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 10/23/2025 05:28:08.180 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:08.181 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:08.181 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 13293300 partition_space_available_1k = 67797184 percentage_partition_space_used = 16 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 1584 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 1604 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 63444 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 83072 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50584 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175640 used = 5942868 free = 323492 buffers = 644812 cached = 9650724 node_type = config-node >> system_cpu_usage = << one_min_avg = 5.5 five_min_avg = 2.59 fifteen_min_avg = 1.45 cpu_share = 0 node_type = config-node >> >> 10/23/2025 05:28:08.181 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:10.826 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:10.827 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:10.827 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:10.827 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:10.827 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:10.827 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:10.827 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:10.828 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:10.828 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:10.828 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:10.828 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:10.828 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:10.828 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:10.828 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:14.827 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:14.828 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:14.829 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:14.829 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:14.829 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:14.829 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:14.829 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:14.829 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:14.829 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:14.829 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:14.830 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:14.830 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:14.830 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:14.830 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:18.830 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:18.831 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:18.831 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:18.831 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:18.832 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:18.832 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:18.832 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:18.832 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:18.832 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:18.832 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:18.832 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:18.832 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:18.832 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:18.832 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:22.834 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:22.835 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:22.835 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:22.835 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:22.835 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:22.836 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:22.836 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:22.836 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:22.836 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:22.836 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:22.836 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:22.836 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:22.837 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:22.837 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:26.838 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:26.839 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:26.839 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:26.839 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:26.839 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:26.840 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:26.840 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:26.840 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:26.840 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:26.840 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:26.840 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:26.840 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:26.840 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:26.840 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:30.839 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:30.841 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:30.841 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:30.842 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:30.842 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:30.845 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:30.845 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:30.846 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:30.846 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:30.846 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:30.846 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:30.846 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:30.846 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:30.846 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:34.842 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:34.843 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:34.844 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:34.844 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:34.844 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:34.844 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:34.844 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:34.844 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:34.844 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:34.844 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:34.844 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:34.844 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:34.845 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:34.845 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:38.847 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:38.849 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:38.849 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:38.849 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:38.850 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:38.850 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:38.850 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:38.851 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:38.851 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:38.851 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:38.851 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:38.851 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:38.851 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:38.851 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:42.854 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:42.856 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:42.858 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:42.860 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:42.860 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:42.860 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:42.860 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:42.861 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:42.861 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:42.861 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:42.861 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:42.861 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:42.861 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:42.861 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:46.856 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:46.859 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:46.859 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:46.859 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:46.859 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:46.859 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:46.859 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:46.859 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:46.859 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:46.860 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:46.860 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:46.860 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:46.860 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:46.860 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:50.863 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:50.864 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:50.865 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:50.865 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:50.865 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:50.865 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:50.865 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:50.865 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:50.865 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:50.865 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:50.865 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:50.865 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:50.866 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:50.866 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:54.867 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:54.868 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:54.868 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:54.868 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:54.868 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:54.868 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:54.869 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:54.869 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:54.869 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:54.869 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:54.869 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:54.869 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:54.869 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:54.869 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:58.870 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:28:58.871 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:28:58.871 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:28:58.871 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:58.871 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:28:58.871 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:28:58.871 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:28:58.872 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:28:58.872 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:58.872 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:28:58.872 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:58.872 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:28:58.872 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:28:58.872 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:02.872 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:02.874 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:02.874 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:02.874 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:02.874 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:02.874 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:02.874 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:02.874 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:02.874 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:02.874 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:02.875 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:02.875 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:02.875 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:02.875 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:06.877 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:06.878 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:06.878 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:06.878 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:06.878 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:06.879 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:06.879 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:06.879 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:06.879 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:06.879 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:06.879 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:06.879 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:06.879 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:06.879 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:08.163 7fb3aa66edf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4452-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13700232, partition_space_available_1k=67390252, percentage_partition_space_used=17, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=99884, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=66048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81328, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84632, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50512, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6498324, free=304100, buffers=650636, cached=9109176, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.8, five_min_avg=3.2, fifteen_min_avg=1.73, cpu_share=19.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 10/23/2025 05:29:08.163 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:08.163 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 13700232 partition_space_available_1k = 67390252 percentage_partition_space_used = 17 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 99884 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 66048 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 81328 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 84632 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50512 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175640 used = 6498324 free = 304100 buffers = 650636 cached = 9109176 node_type = config-node >> system_cpu_usage = << one_min_avg = 5.8 five_min_avg = 3.2 fifteen_min_avg = 1.73 cpu_share = 19.75 node_type = config-node >> >> 10/23/2025 05:29:08.163 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:10.880 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:10.881 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:10.881 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:10.881 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:10.881 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:10.882 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:10.882 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:10.882 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:10.882 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:10.882 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:10.882 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:10.882 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:10.883 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:10.883 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:14.884 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:14.885 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:14.886 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:14.886 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:14.886 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:14.886 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:14.886 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:14.886 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:14.886 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:14.887 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:14.887 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:14.887 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:14.887 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:14.887 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:18.887 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:18.888 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:18.888 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:18.888 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:18.889 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:18.889 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:18.889 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:18.889 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:18.889 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:18.889 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:18.890 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:18.890 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:18.890 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:18.890 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:22.890 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:22.891 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:22.891 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:22.892 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:22.894 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:22.894 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:22.894 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:22.895 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:22.895 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:22.895 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:22.895 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:22.895 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:22.895 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:22.895 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:26.894 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:26.896 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:26.896 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:26.896 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:26.896 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:26.896 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:26.897 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:26.897 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:26.897 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:26.897 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:26.897 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:26.897 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:26.897 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:26.897 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:30.897 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:30.898 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:30.898 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:30.898 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:30.898 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:30.898 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:30.898 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:30.899 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:30.899 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:30.899 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:30.899 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:30.899 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:30.899 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:30.899 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:34.899 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:34.900 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:34.900 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:34.900 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:34.900 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:34.900 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:34.900 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:34.901 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:34.901 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:34.901 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:34.901 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:34.901 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:34.901 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:34.901 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:38.906 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:38.908 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:38.908 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:38.909 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:38.909 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:38.909 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:38.909 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:38.909 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:38.909 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:38.910 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:38.910 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:38.910 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:38.910 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:38.910 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:42.911 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:42.912 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:42.912 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:42.912 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:42.912 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:42.912 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:42.913 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:42.913 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:42.913 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:42.913 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:42.913 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:42.913 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:42.913 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:42.913 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:46.917 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:46.918 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:46.918 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:46.918 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:46.918 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:46.918 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:46.918 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:46.918 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:46.919 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:46.919 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:46.919 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:46.919 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:46.919 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:46.919 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:50.918 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:50.920 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:50.920 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:50.920 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:50.920 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:50.920 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:50.920 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:50.920 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:50.920 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:50.920 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:50.921 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:50.921 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:50.921 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:50.921 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:54.922 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:54.923 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:54.923 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:54.923 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:54.924 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:54.924 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:54.924 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:54.924 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:54.924 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:54.924 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:54.924 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:54.924 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:54.924 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:54.924 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:58.926 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:29:58.927 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:29:58.927 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:29:58.927 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:58.927 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:29:58.927 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:29:58.927 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:29:58.928 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:29:58.928 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:58.928 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:29:58.928 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:58.928 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:29:58.928 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:29:58.928 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:02.928 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:30:02.930 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:30:02.930 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:30:02.930 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:30:02.930 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:30:02.930 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:30:02.930 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:30:02.930 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:30:02.931 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:02.931 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:30:02.931 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:02.931 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:02.931 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:30:02.931 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:06.931 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:30:06.932 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:30:06.932 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:30:06.932 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:30:06.932 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:30:06.932 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:30:06.932 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:30:06.933 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:30:06.933 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:06.933 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:30:06.933 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:06.933 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:06.933 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:30:06.933 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:08.191 7fb3aa66edf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4452-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14115556, partition_space_available_1k=66974928, percentage_partition_space_used=17, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104324, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=66096, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81900, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84080, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50396, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=7931216, free=363316, buffers=676896, cached=7591336, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.64, five_min_avg=3.94, fifteen_min_avg=2.08, cpu_share=19.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 10/23/2025 05:30:08.191 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:08.191 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 14115556 partition_space_available_1k = 66974928 percentage_partition_space_used = 17 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 104324 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 66096 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 81900 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 84080 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50396 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175640 used = 7931216 free = 363316 buffers = 676896 cached = 7591336 node_type = config-node >> system_cpu_usage = << one_min_avg = 6.64 five_min_avg = 3.94 fifteen_min_avg = 2.08 cpu_share = 19.5 node_type = config-node >> >> 10/23/2025 05:30:08.191 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:10.934 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:30:10.935 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:30:10.936 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:30:10.936 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:30:10.936 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:30:10.936 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:30:10.936 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:30:10.937 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:30:10.937 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:10.937 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:30:10.937 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:10.937 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:10.937 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:30:10.937 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:14.938 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:30:14.940 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/23/2025 05:30:14.940 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:30:14.940 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:30:14.940 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:30:14.940 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:30:14.940 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/23/2025 05:30:14.940 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/23/2025 05:30:14.940 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:14.940 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/23/2025 05:30:14.941 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:14.941 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:14.941 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1761197278820552 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/23/2025 05:30:14.941 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/23/2025 05:30:18.941 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/23/2025 05:30:18.942 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 10/23/2025 05:30:18.942 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/23/2025 05:30:18.942 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:30:18.942 7fb3a4b03248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4452-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/23/2025 05:30:18.942 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/23/2025 05:30:18.942 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/23/2025 05:30:18.942 7fb3a4b03248 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/23/2025 05:30:18.943 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/23/2025 05:30:18.943 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/23/2025 05:30:18.943 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/23/2025 05:30:28.836 7fb3a4da9248 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 10/23/2025 05:30:28.837 7fb3a4da9248 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/23/2025 05:30:28.837 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/23/2025 05:30:28.837 7fb3a4b03248 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 10/23/2025 05:30:28.837 7fb3a4b03248 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/23/2025 05:30:28.837 7fb3a4b03248 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/23/2025 05:30:28.839 7fb3a4b03248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/23/2025 05:30:28.839 7fb3a4f0be48 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/23/2025 05:30:28.840 7fb3a4f0be48 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/23/2025 05:30:39.117 7fb3a4da9248 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 10/23/2025 05:30:39.117 7fb3a4da9248 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/23/2025 05:30:39.118 7fb3a4f0be48 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 10/23/2025 05:30:39.118 7fb3a4f0be48 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 10/23/2025 05:30:39.118 7fb3a4f0be48 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/23/2025 05:30:39.118 7fb3a4f0be48 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/23/2025 05:31:08.627 7fb3aa66edf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4452-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14535316, partition_space_available_1k=66555168, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104804, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=66084, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81908, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83968, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50676, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=9088984, free=333660, buffers=690884, cached=6449940, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=8.61, five_min_avg=5.02, fifteen_min_avg=2.58, cpu_share=19.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 10/23/2025 05:32:08.174 7fb3aa66edf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4452-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14599492, partition_space_available_1k=66490992, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104804, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=66084, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81908, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83968, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50708, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8918464, free=451252, buffers=691048, cached=6502536, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.02, five_min_avg=4.88, fifteen_min_avg=2.67, cpu_share=13.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 10/23/2025 05:33:08.190 7fb3aa66edf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4452-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14629200, partition_space_available_1k=66461284, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104876, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=66084, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81920, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83968, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50764, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8962272, free=392048, buffers=691276, cached=6520028, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.76, five_min_avg=4.44, fifteen_min_avg=2.66, cpu_share=12.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 10/23/2025 05:33:23.006 7fb3a4b03248 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/23/2025 05:33:34.535 7fb3a4b03248 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/23/2025 05:34:08.188 7fb3aa66edf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4452-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15090828, partition_space_available_1k=65999656, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=105208, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=66084, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81924, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83968, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50776, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8964276, free=312640, buffers=702300, cached=6584096, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.79, five_min_avg=4.35, fifteen_min_avg=2.74, cpu_share=14.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 10/23/2025 05:35:08.872 7fb3aa66edf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4452-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15475016, partition_space_available_1k=65615468, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=105260, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=66084, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81920, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83952, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50836, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8997112, free=379028, buffers=705924, cached=6481200, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.25, five_min_avg=4.12, fifteen_min_avg=2.78, cpu_share=13.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 10/23/2025 05:35:45.113 7fb3a4b03248 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map